Ancillary Data Sets Used for IMAPP Product Generation ----------------------------------------------------- Updated 01 February 2012 The entire set of leading edge and archived ancillary data sets used by the IMAPP Level 2 software is available from this ftp site: ftp://ftp.ssec.wisc.edu/pub/eosdb/ancillary ------------------------------------------------------------------------------- Name: Total Ozone Analysis using SBUV/2 and TOVS (TOAST) Note: The file name was updated on 30 November 2006 to exclude the 16 in the file name. The data will still be distributed from our web site with the 16 included until further notice. We now pull the files using wget from this site: ftp://www.osdpd.noaa.gov/data/ozone/toast/data/ Example File Name: TOAST16_050615.GRB Used by IMAPP Products: MODIS Aerosol (MOD04) MODIS Cloud Optical Properties (MOD06OD) File Type: Binary GRIB File Source: NOAA/NESDIS Please see more detailed information about the product at this web site: http://www.osdpd.noaa.gov/ml/air/toast.html File Content Description: Daily TOVS and SBUV/2 Total Ozone from NESDIS File Structure Description: Each file contains retrieved Total Ozone in Dobsons on a 1 degree global grid. The file is in GRIB format. Record/Line Format: Single GRIB record containing ozone on 360x181 1 degree global grid. Archived Data: A TOAST archive has been created and can be accessed through this public web site: ftp://www.orbit.nesdis.noaa.gov/pub/smcd/spb/ozone/toast/data/TOAST/GRIB ------------------------------------------------------------------------------- Name: The Near Real-Time SSM/I EASE-Grid Daily Global Ice Concentration and Snow Extent (NISE) Example File Name: NISE_SSMIF13_20020430.HDFEOS NOTE: As of 11 SEPTEMBER 2009, the file name at NSIDC has changed. The files found at this site will continue to use the original file naming convention, but if you want to order the data from NSIDC, the file name will now be of this form: NISE_SSMISF17_yyyymmdd.HDFEOS For more information about this change, please see this web site: http://nsidc.org/data/docs/daac/nise1_nise.gd.html Used by IMAPP Products: MODIS Cloud Mask (MOD35) MODIS Cloud Optical Properties (MOD06OD) File Structure Description: Each file contains NISE snow/ice extent on 721x721 northern and southern hemisphere azimuthal grids. The file is in HDF-EOS format. Record/Line Format: Snow/ice extent for the northern and southern hemispheres stored in separate HDF-EOS Grid objects. Product Description: The Near Real-Time SSM/I EASE-Grid Daily Global Ice Concentration and Snow Extent (NISE) product is generated by the National Snow and Ice Data Center (http://nsidc.org). This data set was originally designed to provide NASA EOS researchers with near real-time, daily, global snow extent and sea ice concentration data. The MODIS Instrument Team uses the NISE data as input to their products. Data access is unrestricted but users are strongly encouraged to register with NSIDC as users of the data. Registered users automatically receive notification of changes in the product-generation algorithm and of modifications in data manipulation and formatting. Registered users automatically receive E-mail notification of any data production problems. NSIDC requests that prospective data users explain how the data will be used and agree to contribute comments regarding the usefulness, relevance, and accuracy of the data. Such feedback is essential to ensure ongoing product improvement. A link to register for the data and read more about the product can be found at: http://nsidc.org/data/nise1.html ------------------------------------------------------------------------------ Name: Daily SSMI sea ice concentration from the National Centers for Environmental Prediction (NCEP) Example File Name: eng.020430 Real time data is acquired from this site daily: ftp://ftpprd.ncep.noaa.gov/pub/data/nccf/com/omb/prod/sice.YYYYMMDD Used by IMAPP Products: MODIS Cloud Mask (MOD35) MODIS Cloud Optical Properties (MOD06OD) File Type: Binary GRIB File Structure Description: Each file contains SSMI sea ice concentration on a 0.5 degree global grid. The file is in GRIB format. For more information about this product, please see this web site: http://polar.ncep.noaa.gov/seaice/ Record/Line Format: Single GRIB record containing ice concentration on 720x360 0.5 degree global grid. Archived Data: The official Sea Ice distribution site is: ftp://polar.ncep.noaa.gov/pub/cdas ------------------------------------------------------------------------------ Name: 6 hourly Global Data Assimilation System T126 resolution analysis from NCEP. Example File Name: gdas1.PGrbF00.020430.00z Used by IMAPP Products: MODIS Cloud Top Properties, Cloud Mask, Atmospheric Profiles and Cloud Optical Properties (MOD06CT, MOD35, MOD07, MOD06OD) AIRS UW-Madison Single FOV Retrievals For more information about these models and files, please see: http://www.nco.ncep.noaa.gov/pmb/products/gfs/#GDAS These files are created 4 times per day and staged at these sites: ftp://ftp.ncep.noaa.gov/pub/data/nccf/com/gfs/prod/gdas.YYYYMMDD http://www.ftp.ncep.noaa.gov/data/nccf/com/gfs/prod/gdas.YYYYMMDD File naming conventions at the above sites: eg: gdas1.t00z.pgrbanl.grib2 These grib2 files are converted to grib1 and placed on the archive. The conversion (cnvgrib) software can be found at: http://www.nco.ncep.noaa.gov/pmb/docs/grib2/download/ File Type: Binary GRIB1 File Content Description: 6 hourly Global Data Assimilation System T126 resolution analysis from NCEP. File Structure Description: Each file contains fields of z, u, v, temp, vert vel, rh, and absolute vorticity, most of which are on 26 mandatory pressure levels (1000 - 10mb). vv is on 1000-100mb and rh is on 1000-300mb. There are additional single level fields as well, for example, boundary level winds, temps, and rh, trop temp, pressure and winds. The grid is a 1 x 1 deg global grid (GRIB grid #3). The file is in GRIB format. Record/Line Format: 26 GRIB records containing atmospheric temperatures (K) at 26 pressure levels 21 GRIB records containing water vapor mixing ratios (g/kg) at 21 pressure levels 1 GRIB record containing a land mask (0=water, 1=land) 1 GRIB record containing surface temperature (K) 1 GRIB record containing pressure (hPa) at mean sea level 1 GRIB record containing precipitable water (g/cm**2) 1 GRIB record containing surface wind u component (m/s) 1 GRIB record containing surface wind v component (m/s) 1 GRIB record containing ice concentration (%) ------------------------------------------------------------------------------ Name: 6 hourly Global Forecast System (GFS) Numerical Weather Prediction Fields Example File Name: gfs.tyy.051201.pgrbfxx where xx is the forecast time step for the yy hour analysis (run) time. Used by IMAPP Products: MODIS Cloud Mask and Atmospheric Profiles (MOD35, MOD07) These files are used in the Cloud Mask and Atmospheric Profiles processing for real-time execution when the GDAS analysis files matching the overpass times are not available. The GDAS files are available from 6-9 hours after real-time. The GDAS files should be used whenever possible, because they are scientifically better suited for retrievals. The GDAS files should always be used for the MOD06CT Cloud Top Properties processing, even if the files are behind real-time. AIRS Clear Sky Retrievals AMSU Liquied Water Path (LWP) For more information about these models and files, please see: http://www.nco.ncep.noaa.gov/pmb/products/gfs These files are created in real time and staged at these realtime sites: ftp://ftp.ncep.noaa.gov/pub/data/nccf/com/gfs/prod/gfs.YYYYMMDD http://www.ftp.ncep.noaa.gov/data/nccf/com/gfs/prod/YYYYMMDD File Type: Binary GRIB1 File Content Description: 6 hourly Global Data Assimilation System T126 resolution analysis from NCEP. File Structure Description: Each file contains fields of z, u, v, temp, vert vel, rh, and absolute vorticity, most of which are on 26 mandatory pressure levels (1000 - 10mb). vv is on 1000-100mb and rh is on 1000-300mb. There are additional single level fields as well, for example, boundary level winds, temps, and rh, trop temp, pressure and winds. The grid is a 1 x 1 deg global grid (GRIB grid #3). The file is in GRIB format. Record/Line Format: 26 GRIB records containing atmospheric temperatures (K) at 26 pressure levels 21 GRIB records containing water vapor mixing ratios (g/kg) at 21 pressure levels 1 GRIB record containing a land mask (0=water, 1=land) 1 GRIB record containing surface temperature (K) 1 GRIB record containing pressure (hPa) at mean sea level 1 GRIB record containing precipitable water (g/cm**2) 1 GRIB record containing surface wind u component (m/s) 1 GRIB record containing surface wind v component (m/s) 1 GRIB record containing ice concentration (%) A gfs archive exists at NCDC: ftp://nomads.ncdc.noaa.gov/GFS/Grid3/ ------------------------------------------------------------------------------ Name: Weekly Optimum Interpolation (OI) Sea Surface Temperature (SST) Analysis Example File Name: oisst.20050608 Used by IMAPP Products: MODIS Cloud Mask (MOD35), Cloud Top Properties (MOD06CT) Cloud Optical Properties (MOD06OD) Sea Surface Temperature File Type: Binary File Source: NCEP ftp://ftp.emc.ncep.noaa.gov/cmb/sst/oisst_v2/ File Content Description: Weekly Reynolds Sea Surface Temperature The week starts on Wednesday and ends on Tuesday. File Structure Description: Each file contains Reynolds SST (C) on a 1 degree global grid. Record/Line Format: The files were written in IEEE binary (big-endian). Each file contains four records described as follows: rec 1: date and version number (8 4-byte integer words) rec 2: gridded sst values in degC (360*180 4-byte real words) rec 3: normalized error variance (360*180 4-byte real words) rec 4: gridded ice concentration (360*180 1-byte integer words) (This is the layout as seen by a fortran code reading sequential access data) Fore more detailed information concerning this product, please refer to this web page: ftp://ftp.emc.ncep.noaa.gov/cmb/sst/oisst_v2/README There is an archive of the SST files that can be found at: ftp://ftp.emc.ncep.noaa.gov/cmb/sst/oisst_v2/ ------------------------------------------------------------------------------ FILE REQUIRED TO RUN IMAPP DB CRAS Note: No file archved for DB CRAS exists before 9 September 2008 There is only a 1 week archive of GFS grib2 files ------------------------------------------------------------------------------ Name: NOAA IMS DAILY NORTHERN HEMISPHERE SNOW AND ICE ANALYSIS AT 24 KM RESOLUTION Example File Name: ims2008268_24km.asc Used by IMAPP Products: DB CRAS File Type: ASCII File Source: National Oceanic and Atmospheric Administration (NOAA) For more information, please see: http://nsidc.org/data/g02156.html File Content Description: Daily Northern Hemisphere Snow and Ice Coverage File Structure Description: Each file contains ASCII values of 0-4 on a 1024x1024 polar stereogrphic grid where: 1 (sea), 2 (land), 3 (sea ice), 4 (snow), 0 (outside Northern Hemisphere). An archive of the data sets exists at the National Snow and Ice Data Center: ftp://sidads.colorado.edu/pub/DATASETS/NOAA/G02156/24km/yyyy/ where yyyy is the year. ------------------------------------------------------------------------------ Name: NCEP DAILY HALF DEGREE REAL-TIME SEA SURFACE TEMPERATURE GRID Example File Name: rtgssthr_grb_0.5.grib2 Used by IMAPP Products: DB CRAS File Type: GRIB2 File Source: National Center for Environmental Prediction (NCEP) For more information on this product, please see: http://polar.ncep.noaa.gov/sst/ and Gemmill, William, Bert Katz and Xu Li, 2007: Daily Real-Time Global Sea Surface Temperature - High Resolution Analysis at NOAA/NCEP. NOAA / NWS / NCEP / MMAB Office Note Nr. 260, 39 pp File Content Description: Each file contains global sea surface temperatures on a 0.5 degree global grid in degrees Kelvin. The file is in GRIB2 format. Record/Line Format: Single GRIB2 record containing sea surface temperatures on a 720x360 0.5 degree global grid. Files are also available for download in read time from NOAA at: ftp://ftpprd.ncep.noaa.gov/pub/data/nccf/com/gfs/prod/sst.yyyymmdd where yyyy is the year mm in the month and dd is the day ------------------------------------------------------------------------------ Name: WMO GLOBAL NOAAPORT SURFACE OBSERVATIONS (4 TIMES DAILY - 00, 06, 12 and 18 UTC) Example File Name: 25Sep08.00z.sfc Used by IMAPP Products: DB CRAS File Type: ASCII File Source: WMO NOAAPORT File Content Description: Each file contains global surface observations written in 13 columns containing the : DATE TIME LATITUDE LONGITUDE SURFACE PRESSURE[MB] 12 HOUR PRECIP[MM] TEMPATURE[K] DEWPOINT TEMPERATURE[K] WIND SPEED [KTS] WSPD DIR SNO WX1 CIGC WIND DIRECTION SNOW DEPTH CURRENT WEATHER CLOUD CEILING ------------------------------------------------------------------------------ Name: 3 and 6 hourly Global Forecast System (GFS) Numerical Weather Prediction Fields Example File Name: gfs.p5.20080925_00_000.ldm.grib2 gfs.05.yyyymmdd_yy_xxx.ldm.grib2 where yyyy is the year, mm is the numerical month, dd is the day of the mon, xxx is the forecast time step for the yy hour analysis (run) time. Used by IMAPP Products: DB CRAS These files are used for the DB CRAS 12 hour pre-forecast "spin-up" and the 72 hour forecast. Three hour forecasts for the 12 and 00 UTC run times are used for the spin-up (00,03,06,09 and 12 hour GFS forecast files), and 6 hour forecasts from the 18 and 06 run times are used for the 00 and 12 CRAS 72 hour forecasts (06,12,18,24,30,36,42,48,54,60,66, 72,78 GFS forecast files). File Type: GRIB2 File Source: NOAA NCEP File Content Description: Each file contains only the grids that are used by DB CRAS. These fields are: HGT:1000 mb HGT:975 mb HGT:950 mb HGT:925 mb HGT:900 mb HGT:850 mb HGT:800 mb HGT:750 mb HGT:700 mb HGT:650 mb HGT:600 mb HGT:550 mb HGT:500 mb HGT:450 mb HGT:400 mb HGT:350 mb HGT:300 mb HGT:250 mb HGT:200 mb HGT:150 mb HGT:100 mb HGT:70 mb HGT:50 mb HGT:30 mb HGT:20 mb HGT:10 mb TMP:1000 mb TMP:975 mb TMP:950 mb TMP:925 mb TMP:900 mb TMP:850 mb TMP:800 mb TMP:750 mb TMP:700 mb TMP:650 mb TMP:600 mb TMP:550 mb TMP:500 mb TMP:450 mb TMP:400 mb TMP:350 mb TMP:300 mb TMP:250 mb TMP:200 mb TMP:150 mb TMP:100 mb TMP:70 mb TMP:50 mb TMP:30 mb TMP:20 mb TMP:10 mb RH:1000 mb RH:975 mb RH:950 mb RH:925 mb RH:900 mb RH:850 mb RH:800 mb RH:750 mb RH:700 mb RH:650 mb RH:600 mb RH:550 mb RH:500 mb RH:450 mb RH:400 mb RH:350 mb RH:300 mb RH:250 mb RH:200 mb RH:150 mb RH:100 mb CLWMR:1000 mb CLWMR:975 mb CLWMR:950 mb CLWMR:925 mb CLWMR:900 mb CLWMR:850 mb CLWMR:800 mb CLWMR:750 mb CLWMR:700 mb CLWMR:650 mb CLWMR:600 mb CLWMR:550 mb CLWMR:500 mb CLWMR:450 mb CLWMR:400 mb CLWMR:350 mb CLWMR:300 mb CLWMR:250 mb CLWMR:200 mb CLWMR:150 mb CLWMR:100 mb UGRD:1000 mb UGRD:975 mb UGRD:950 mb UGRD:925 mb UGRD:900 mb UGRD:850 mb UGRD:800 mb UGRD:750 mb UGRD:700 mb UGRD:650 mb UGRD:600 mb UGRD:550 mb UGRD:500 mb UGRD:450 mb UGRD:400 mb UGRD:350 mb UGRD:300 mb UGRD:250 mb UGRD:200 mb UGRD:150 mb UGRD:100 mb UGRD:70 mb UGRD:50 mb UGRD:30 mb UGRD:20 mb UGRD:10 mb VGRD:1000 mb VGRD:975 mb VGRD:950 mb VGRD:925 mb VGRD:900 mb VGRD:850 mb VGRD:800 mb VGRD:750 mb VGRD:700 mb VGRD:650 mb VGRD:600 mb VGRD:550 mb VGRD:500 mb VGRD:450 mb VGRD:400 mb VGRD:350 mb VGRD:300 mb VGRD:250 mb VGRD:200 mb VGRD:150 mb VGRD:100 mb VGRD:70 mb VGRD:50 mb VGRD:30 mb VGRD:20 mb VGRD:10 mb PRES:sfc PWAT:atmos col PRMSL:MSL ACPCP:sfc APCP:sfc