METOC Data Server (MDS)

Projects

Overview

Objective

Conceptual view of the Next Generation MDS system. As shown HPAC and/or JEM clients can access these systems over HTTP(s) using Web Services SOAP and request a myriad of both metadata (data about data) and actual data, with varying degrees of fidelity. The requests are served by load balancing server farm to ensure efficient responses during periods of high user request traffic.

The METOC Data Server (MDS) provides meteorological data to software clients. These clients either display the data from various perspectives, or incorporate the data into further computations.

Description

The METOC Data Server (MDS) is a repository of four-dimensional weather data. The MDS system contains a number of data conversion programs, supporting the following file formats (not an exhaustive list): GRIB (GRIdded Binary) - GFS (formerly Avn), Eta, Ruc, WAFS, MM5.

These conversion programs ingest data into our internal format, known as Meteorological Data Volume (MDV). The ingesters run continually, processing and converting data files when they arrive from external sites. The MDV server then provides a rapid response to data requests from display applications like JViz. MDS can service requests by field name, vertical level, and geographical area.

MDS is intended for use as a high-volume server to handle many requests in a time of high demand, such as a terrorist attack. The system provides load balancing among the server machines, multiple gateways to handle many simultaneous requests, and system monitoring of the data ingesters.

Funding:

AFWA logo

Operations

The Next Generation MDS systems are now operational at selected DTRA (Defense Threat Reduction Agency) sites in Virginia and New Mexico and available to HPAC (Hazard Prediction and Assessment Capability) and JEM (Joint Effects Model) customers.

NOTE: HPAC is a DTRA Science and Technology Toolset, in the process of being replaced by JEM. JEM is now considered the single official Department of Defense Accredited Program of Record for hazard prediction and assessment purposes.

Technology

GRIB

GRIB (GRIdded Binary) data format was developed by the World Meteorological Organization (WMO) to provide a compact and extensible means of transferring large volumes of gridded data. "Gridded data" refers to the geographical layout of the data points: the numeric values represent measurements taken at regularly-space intervals in X and Y, or latitude and longitude. GRIB is used by NCEP and NOAA to deliver their data products.

The METOC Data Server (MDS) ingests two kinds of GRIB data from NCEP: GFS and NAM. GFS covers the entire world, and NAM covers the United States at a higher resolution. MDS converts the NCEP data to MDV format, stores it on a local RAID drive, and delivers it quickly to any requesting users.

MDV

MDV stands for "Meteorological Data Volume." MDV is a data format developed by NCAR's Research Applications Lab (RAL) to provide multi-dimensional access to met variables. MDV is designed for quick access to time-based data. An MDV data repository consists of a directory structure indexed by date and time, containing files that store a series of met variables sub-indexed by vertical level. This structure allows the MDV server to deliver sectional data slices to user displays such as JViz. The MDV software library also includes a large number of C++ routines to handle different mapping projections, unit conversion, and output to other data types.

Resources

Conference Publications and Presentations

DTRA Next Generation METOC Data Server (MDS) Overview. March, 2008.

Links

Global Marine Networks. Grib Weather Files

World Meteorological Organization. Guide to the Code Form FM 92-IX Ext. GRIB.

Participants

Sponsor

Defense Threat Reduction Agency
DTRA is responsible for reducing the present threat to the U.S. and its allies from weapons of mass destruction (WMD) and preventing future threats. The agency supports the United States' nuclear deterrent capability; reduces the threat from nuclear, chemical, biological, and other special and conventional weapons, and counters threats posed by WMD. DTRA has a world-wide presence with offices at Fort Belvoir and Alexandria, Virginia; Albuquerque, New Mexico; and San Francisco, California.

Collaborator

Joint Program Manager Information Systems (JPM-IS)
The mission of JPM-IS is to acquire, deliver, and support integrated capabilities that rapidly detect, monitor, and assess the conditions of the physical environment (air, sea, land, and space). This assessment outlines the effects of chemical, biological, radiological, and nuclear (CBRN) contaminants on the performance of military forces, platforms, weapons, communications, and Intelligence, Surveillance, and Reconnaissance (ISR) systems. JPM-IS enables the seamless delivery of data, information, and knowledge from sensor-to-display on C4I and combat systems to military commanders and their assigned combat and combat support forces."

You are here