Optimized Learning for Yielding Meteorological Predictions Using Surrogates

Status: Completed

Start Date: 2024-08-07

End Date: 2025-02-06

Description: NASA's current physics-based models are the gold standard for simulating atmospheric and heliophysics variables. These models, however, require very large amounts of compute power and several hours to produce a forecast. We propose to build the Optimized Learning for Yielding Meteorological Predictions Using Surrogates (OLYMPUS), comprising machine learning-based surrogate models to dramatically reduce the computational time and resources needed to make a prediction. We do not anticipate that these models will replace the physics-based ones, as they do not offer the same level of transparency and explainability. Rather, these models will be used to produce forecasts quickly and cheaply at a fraction of the cost. At the heart of our approach is a novel approach to dramatically reducing the size of gridded atmospheric data, making it feasible to use a modern deep learning architecture to predict sequences of this data. This methodology entails computing the Spherical Harmonic Transform (SHT) of atmospheric variables. The SHT will give us a global representation of atmospheric data on a sphere, efficiently compressing spatial information to a more compact, multi-scale level representation that captures both small-scale, high-frequency and large-scale, low-frequency variations. It will also reduce aliasing artifacts as the spherical nature of the transform allows for an accurate representation of features across different latitudes, mitigating distortions that arise with traditional grids. Performing principal component analysis across the resulting SHT coefficients from several different time periods will allow us to identify the principal components that are able to explain the bulk of the variance within the system and reduce the number of variables form millions to thousands or even hundreds. This reduction will allow us to use state-of-the-art deep learning model architectures that would otherwise not scale to the size of this problem.
Benefits: • GMAO's GEOS-FP: Produce a forecast like the GEOS-FP by using as inputs and outputs sequences of assimilated data. We will request GEOS-FP shareable historical forecast data, though not required in Phase I. We will target GEOS-FP's assimilated state variables, to produce a forecast at the same spatial-temporal resolution & time horizon as the physics-based forecaster. • Empower NASA's plan to pre-position Wildland Firefighting drones. • Develop surrogate heliophysics models, like those of NASA's Community Coordinated Modeling Center. Surrogate models will be turned into weather predictors applicable to: • Government and municipal agencies for emergency management services, urban planning, and infrastructure • Agricultural cooperatives • Insurers • Construction • Real estate developers • Media companies • Weather channels • Environmental Protection Agency, Department of Defense, and Department of Homeland Security Aerial Vantage's overall business objective is to build and sell a high-accuracy crop yield forecast model. Accurate weather forecasts are critical to this business objective. We will connect OLYMPUS to the Crop Impact Model (CIM), an existing model previously developed by Aerial Vantage, which provides crop growth and yield predictions. The CIM utilizes historical weather information such as precipitation, daily temperature, solar irradiance, etc. along with past county-level statistics for future prediction of agricultural yields of crops such as corn, soybeans, and wheat.

Lead Organization: Aerial Vantage, Inc.