RESEARCH PAPER: Synthesis Modeling: The Intersection Of HPC And Machine Learning

By Karl Freund, Patrick Moorhead - November 14, 2017
Historically, numerical analysis has formed the backbone of supercomputing for decades by applying mathematical models of first-principle physics to simulate the behavior of systems from subatomic to galactic scale. Recently, scientists have begun experimenting with a relatively new approach to understand complex systems using machine learning (ML) predictive models, primarily Deep Neural Networks (DNN), trained by the virtually unlimited data sets produced from traditional analysis and direct observation. Early results indicate that these “synthesis models” combining ML and traditional simulation, can improve accuracy, accelerate time to solution and significantly reduce costs. You can download the paper on the NVIDIA website.  Click here.

Table Of Contents

  • Introduction
  • Applying Machine Learning In HPC
  • Three Approaches To Applying Machine Learning In HPC
  • Machine Learning Use Cases In HPC
  • Application Of Model Modulation At ITER
  • Conclusions
  • Figure 1: The Synthesis Of Numerical Analysis And Machine Learning Can Create New Predictive Simulation Models
  • Figure 2: Machine Learning Can Improve Neutrino Detection By Combining Simulation Results From Different Models To Produce A Superior Model
  • Figure 3: Bose-Einstein Condensate Achieved Convergence After Only 10-12 Experiments Using Machine Learning, Compared To 140 Experiments Using the Traditional Approach
  • Figure 4: Example Use Cases For Synthesis Modeling
  • Figure 5: Spinning Black Holes Create Gravitational Waves, Ripples In The Fabric Of Space And Time.  Machine Learning Is Now Enhancing Our Understanding Of These Phenomena

Companies Cited

  • Caltech
  • Deep Neural Networks (DNN)
  • Fermilab
  • Laser Interferometer Gravitational Wave Observatory (LIGO)
  • NVIDIA
  • National Center For Supercomputing Applications (NCSA)
  • University Of Florida
  • University Of North Carolina
  • University Of South Wales
   
 
+ posts
+ posts

Patrick founded the firm based on his real-world world technology experiences with the understanding of what he wasn’t getting from analysts and consultants. Ten years later, Patrick is ranked #1 among technology industry analysts in terms of “power” (ARInsights)  in “press citations” (Apollo Research). Moorhead is a contributor at Forbes and frequently appears on CNBC. He is a broad-based analyst covering a wide variety of topics including the cloud, enterprise SaaS, collaboration, client computing, and semiconductors. He has 30 years of experience including 15 years of executive experience at high tech companies (NCR, AT&T, Compaq, now HP, and AMD) leading strategy, product management, product marketing, and corporate marketing, including three industry board appointments.