Climate & weather

NOAA Cloud Optimized Zarr Reference Files (Kerchunk)

This repository contains references to datasets published to the NOAA Open Data Dissemination Program. These reference datasets serve as index files to the original data by mapping to the Zarr V2 specification. When multidimensional model output is read through zarr, data can be lazily loaded (i.e. retrieving only the data chunks needed for processing) and data reads can be scaled horizontally to optimize object storage read performance. The process used to optimize the data is called kerchunk. RPS runs the workflow in their AWS cloud environment every time a new data notification is received from a relevant source data bucket....

Listed for discovery. Access is provided by the original publisher under its terms.

Data coverage

This repository contains references to datasets published to the NOAA Open Data Dissemination Program. These reference datasets serve as index files to the original data by mapping to the Zarr V2 specification. When multidimensional model output is read through zarr, data can be lazily loaded (i.e. retrieving only the data chunks needed for processing) and data reads can be scaled horizontally to optimize object storage read performance. The process used to optimize the data is called kerchunk. RPS runs the workflow in their AWS cloud environment every time a new data notification is received from a relevant source data bucket. These are the current datasets being cloud-optimized. Refer to those pages for file naming conventions and other information regarding the specific model implementations: NOAA Operational Forecast System (OFS) NOAA Global Real-Time Ocean Forecast System (Global RTOFS) NOAA National Water Model Short-Range Forecast Filenames follow the source dataset’s conventions. For example, if the source file is nos.dbofs.fields.f024.20240527.t00z.nc Then the cloud-optimized filename is the same, with “.zarr” appended nos.dbofs.fields.f024.20240527.t00z.nc.zarr Data Aggregations We also produce virtual aggregations to group an entire forecast model run, and the “best” available forecast. Best Forecast (continuously updated) - nos.dbofs.fields.best.nc.zarr Full Model Run - nos.dbofs.fields.forecast.[YYYYMMDD].t[CC]z.nc.zarr - CC is the model run cycles, 00, 06, 12, 18 , or 03, 09, 15, 21 for nowcast and forecast runs - YYYY = year, MM = month, DD = day Cloud optimization workflows supported by RPS Group, a Tetra Tech Company

Access & permitted use

Review the publisher’s documentation for availability, eligibility and permitted uses, including commercial analysis, model training and redistribution.

NOAA data disseminated through NODD are open to the public and can be used as desired. NOAA makes data openly available to ensure maximum use of our data, and to spur and encourage exploration and innovation throughout the industry. NOAA requests attribution for the use or dissemination of unaltered NOAA data. However, it is not permissible to state or imply endorsement by or affiliation with NOAA. If you modify NOAA data, you may not state or imply that it is original, unaltered NOAA data.

Need help sourcing data?

Tell us your required fields, population, geography and time period. We can review suitable sources and licensing options.

Request sourcing help

Related data sources

Climate and weatherPublic download

NOAA Global Daily Climate Observations

Daily precipitation, temperature, snowfall and other surface observations from the Global Historical Climatology Network across international stations.

NOAA National Centers for Environmental Information
Climate & weatherExternal source; review access terms

(EXPERIMENTAL) NOAA FourCastNet Global Forecast System (FourCastNetGFS) (EXPERIMENTAL)

The FourCastNet Global Forecast System (FourCastNetGFS) is an experimental system set up by the National Centers for Environmental Prediction (NCEP) to produce medium range global forecasts. The model runs on a 0.25 degree latitude-longitude grid (about 28 km) and 13 pressure levels. The model produces forecasts 4 times a day at 00Z, 06Z, 12Z and 18Z cycles. Major atmospheric and surface fields including temperature, wind components, geopotential height, relative humidity and 2 meter temperature and 10 meter winds are available. The products are 6 hourly forecasts up to 10 days. The data format is GRIB2. The FourCastNetGFS...

NOAA
Geospatial dataExternal source; review access terms

10m Annual Land Use Land Cover (9-class)

This dataset, produced by Impact Observatory, Microsoft, and Esri, displays a global map of land use and land cover (LULC) derived from ESA Sentinel-2 imagery at 10 meter resolution for the years 2017 - 2024. Each map is a composite of LULC predictions for 9 classes throughout the year in order to generate a representative snapshot of each year. This dataset was generated by Impact Observatory, which used billions of human-labeled pixels (curated by the National Geographic Society) to train a deep learning model for land classification. Each global map was produced by applying this model to the Sentinel-2 annual scene...

Impact Observatory