Artificial Intelligence thread

Engineer

Major
A
Please, Log in or Register to view URLs content!
note that LLMs that follow a “Kepler-esque” approach: they can successfully predict the next position in a planet’s orbit, but fail to find the underlying explanation of Newton’s Law of Gravity (see
Please, Log in or Register to view URLs content!
). Instead, they resort to incorrect fitting rules that allow them to successfully predict the planet’s next orbital position but
Please, Log in or Register to view URLs content!
to find the force vector and generalize to other physics. Explained in
Please, Log in or Register to view URLs content!
.

A neat idea, but the authors oversimplified the concept of planetary motion. An excerpt from the paper:
For centuries, astronomers and physicists have worked on predicting the orbits of planets around the sun. A groundbreaking model was offered by the astronomer Johannes Kepler in the 17th century. His model was based on geometric patterns: for example, that the orbit of each planet followed an ellipse with the sun at one of its foci. While the model could predict orbits with a near-perfect level of precision, it couldn’t explain why the planets obeyed these geometric orbits or be applied to new problems beyond predicting trajectories.

Later, Isaac Newton expanded on this model using new laws of motion, now known as Newtonian mechanics. These laws involved computing properties of the set of planets in motion, such as their relative velocities and masses. Using these properties, he could derive Kepler’s earlier laws for orbital trajectories, but also go beyond, understanding and formalizing other concepts like force and gravity. From Kepler to Newton, scientists were able to move beyond good predictive models of sequences to a deeper understanding of them. In this section, we test whether a transformer that can predict sequences of orbital trajectories is merely a good sequence model, or whether it has also made the transition to providing a world model.

May be the authors didn't have enough space to devote to history, but that very first sentence should have given everyone a clue: If the concept were so simple, humanity wouldn't have spent centuries working on it! Those centuries should be more like millennia, because observation started way back in ancient time. Here is a video about that history:

The authors trained and used a 109M parameters model that did nothing except for predicting next planetary positions based on a sequence of observation. The authors' argument would have been a little more convincing had the model output velocity of the planets as well. With only positions and no mass data given, the valid course of prediction would be through the use of N-th order polynomials, and that's exactly what the model did.

Even with knowledge on Newton's Law of Gravity, N-th order polynomials are still used to describe motion of planets in real world application, such as NASA's DE Series. Newton's Law only works for two-body systems, which the solar system is not. So may be it wasn't the model that is stupid here.
 
Last edited:

Wrought

Senior Member
Registered Member
Paper on reduced stress in doctors using AI assistants for medical paperwork.

This multicenter quality improvement study found that use of an ambient AI scribe platform was associated with a significant reduction in burnout, cognitive task load, and time spent documenting, as well as the perception that it could improve patient access to care and increase attention on patient concerns in an ambulatory environment. These findings suggest that AI may help reduce administrative burdens for clinicians and allow more time for meaningful work and professional well-being.

Physicians, who are in short supply and high demand,
Please, Log in or Register to view URLs content!
spend more than half their workday documenting in the EHR,
Please, Log in or Register to view URLs content!
-
Please, Log in or Register to view URLs content!
and only a quarter of their time is spent face to face with patients.
Please, Log in or Register to view URLs content!
The proportion of time spent documenting continues to escalate,
Please, Log in or Register to view URLs content!
,
Please, Log in or Register to view URLs content!
especially for primary care professionals,
Please, Log in or Register to view URLs content!
-
Please, Log in or Register to view URLs content!
and is associated with burnout, reduction in work effort, and turnover.
Please, Log in or Register to view URLs content!
,
Please, Log in or Register to view URLs content!
-
Please, Log in or Register to view URLs content!


The National Academy of Medicine convened a meeting in December 2024 on the potential for AI to improve health worker well-being (eg, reduce burnout).
Please, Log in or Register to view URLs content!
To date, there are scant, mostly single-center data assessing whether this technology could reduce administrative burden, liberate time for patients, and reduce professional burnout.
Please, Log in or Register to view URLs content!

Please, Log in or Register to view URLs content!
 
Top