CRUNCH is home to PINNs and DeepOnet!
We are at the cross-roads in Computational Mathematics! The machine learning revolution is real this time around and is changing our field in a fundamental way! We may experience the sudden death of FEM and other classical numerical methods, and the rise of new and simpler methods using Deep Learning. No longer do we have to spend days in building elaborate grids or agonizing over solution smoothness and precise boundary conditions. Instead, we will be able to produce realistic solutions for non-sterilized computational problems in diverse physical and biological sciences. Most importantly, we will be able to discover new equations from all this data!
At CRUNCH we developed PINNs and DeepOnet and we lead the way in this new revolution on scientific machine learning for diverse applications. The postdocs, students, and visitors of CRUNCH lead this revolution with a bold spirit and no fear of new directions and new challenging applications!
It's all about PINNs! that is Physics-Informed Neural Networks. The thrust of the research of the CRUNCH group is the development of data-driven stochastic multiscale methods for physical and biological applications, specifically numerical algorithms. We also employ visualization methods and parallel software for continuum and atomistic simulations in biophysics, soft matter and functional materials, fluid and solid mechanics, biomedicine and related applications. Scientific Machine Learning is a new (disruptive) area that we emphasize, i.e., encoding conservation laws into kernels to build Physics-informed Learning Machines or neural networks to build Physics-informed Neural Networks.
It's all about DeepOnet! We were the first to develop neural operators based on rigorous mathematical theory in 2019, see the original paper here. DeepONet is blazingly fast next to numerical solvers, according to Quantamagazine. Irina Higgins of DeepMind wrote in Nature-MI: "…Once DeepONet is trained, it can be applied to new input functions, thus producing new results substantially faster than numerical solvers. Another benefit of DeepONet is that it can be applied to simulation data, experimental data or both, and the experimental data may span multiple orders of magnitude in spatio-temporal scales, thus allowing scientists to estimate dynamics better by pooling the existing data. While DeepONet is still only a first step towards building truly powerful and scalable universal operator approximators, it opens up exciting opportunities, like modelling the dynamics of complex systems where no analytical descriptions exist, for example social dynamics…"
Long history of pioneering research: Previously, numerical methods developed at CRUNCH are spectral/hp element methods, multi-element polynomial chaos, stochastic molecular dynamics (DPD), and spectral and high-order methods for fractional partial differential equations. The CRUNCH group has pioneered such methods, e.g. the spectral element method on unstructured meshes (1995), generalized polynomial chaos (gPC) for uncertainty quantification, rigorous coarse grained molecular methods (2010), and poly-fractonomials for fractional operators (2015). More recently we have focused on PINNs, hiddens fluid mechanics, and numerical Gaussian Processes that allow us to solve PDEs from noisy measurements, only without the tyranny of building elaborate grids! Currently we employ deep neural networks to solve complex PDEs in continuous space-time domains! We are also interested to employ fractional operators and Gaussian processes to discover Hidden Physics Models. Our group has pionerred this!
Funding is currently provided by DOE, AFOSR, DARPA, ARO, ARL, NIH and NSF, Cummins, Ansys, FEA, etc.