Unlike traditional neural networks which require fixed-resolution inputs (e.g., pixels), neural operators model data as continuous functions. This allows them to "zoom in" and make predictions at resolutions higher than the training data, a crucial capability for multi-scale physical phenomena like weather patterns.

DE Shaw Research (DESRES) invested heavily in custom silicon for molecular dynamics (MD) to solve protein folding. In contrast, DeepMind's AlphaFold, using ML on experimental data, solved it on commodity hardware. This demonstrates data-driven approaches can be vastly more effective than brute-force simulation for complex scientific problems.

Most AI weather models project the Earth onto a flat rectangle, causing simulations to become unstable and "blow up" over long periods. By incorporating the planet's spherical geometry using Fourier Neural Operators, models like ForecastNet remain stable for long-term climate rollouts, effectively becoming climate models.

The public database of protein structures (PDB) is small and grows slowly. To train more powerful models, Genesis leverages physics simulations to model small molecule behavior, creating a large, high-quality synthetic dataset that isn't possible for more complex protein-protein interactions.

While traditional hybrid models still require solving differential equations during use, Physics-Informed Neural Networks (PINNs) learn the final outcome directly. They are trained to obey physical laws but don't need the equations for inference. This provides a significant speed advantage for computationally expensive systems like chromatography, making them more suitable for real-time applications.

For physical design, simulation shouldn't just be a final verification step. Instead, it should be a tool used during model training to build the AI's intuition or "taste." This allows the model to generate high-quality designs quickly at inference time, mirroring how expert human engineers develop their skills.

Rather than just replacing physics-based models, AI can be used to select the *correct* physics model. Heather Kulik's team uses the quantum wave function itself as an input to a neural network to predict which quantum mechanical approximation will be most accurate for a specific material, a complex task that defies simple heuristics.

EBMs are based on a fundamental principle in physics where systems naturally seek their lowest energy state (e.g., sitting on a couch when tired). The model maps all possible outcomes onto an 'energy landscape,' where the lowest points represent the most probable solutions. This avoids the expensive, token-by-token guessing game played by LLMs.

Static data scraped from the web is becoming less central to AI training. The new frontier is "dynamic data," where models learn through trial-and-error in synthetic environments (like solving math problems), effectively creating their own training material via reinforcement learning.