DATABANK CHANGELOG (users can use this file to determine overall current status, including information related to previous changes and errata). ******************************************************************************** 09/19/2011 All Stage 1 sources have been tarred to conserve space and to follow the format described below. Each tar bundle will be timestamped based upon the day files were originally uploaded to FTP. Date of upload was logged in the stage 1 source readme file. All Stage 2 sources have been re-named to follow the format described below. Also note that they are now timestamped withinin the file name. This date is based upon when stage 1 data was converted into stage 2 and then uploaded to FTP. Note that the stage 2 file may not be the same day as its stage 1 counterpart All Stage 1 and Stage 2 sources have been named into a common file format. They are listed below STAGE1: SOURCENAME.TIMESCALE.stage1.YYYYMMDD.tar.gz SOURCENAME = name of the source TIMESCALE = daily, monthly, etc YYYYMMDD = date file was uploaded to FTP STAGE2: SOURCENAME.TIMESCALE.stage2.x.y.YYYYMMDD.tar.gz SOURCENAME = name of the source TIMESCALE = daily, monthly, etc x = integer to be incremented with major data additions y = integer to be incremented with minor data additions YYYYMMDD = date file was converted from stage 1 to stage 2 and uploaded to FTP ******************************************************************************** 09/21/2011 The daily source: ECA_KNMI, will now be updated once a month, usually around the 15th of each month. The latest version of ECA_KNMI will be in the following directories: Latest Stage1: /pub/data/globaldatabank/daily/stage1/eca_knmi/ Latest Stage2: /pub/data/globaldatabank/daily/stage2/eca_knmi/ Since it is of great importance to note earlier versions of stage1/2 data, an archive has been created on the FTP site. The archived versions of ECA_KNMI will be in the following directories: Archived Stage1: /pub/data/globaldatabank/archive/daily/stage1/eca_knmi/ Archived Stage2: /pub/data/globaldatabank/archive/daily/stage2/eca_knmi/ ******************************************************************************** 09/26/2011 New daily data source added: Ecuador. Stage 1 and Stage 2 completed New monthly data source added: ghcnmv2. Stage 2 completed ******************************************************************************** 09/27/2011 New monthly data source added: antarctica-scar-reader. Stage 2 completed ******************************************************************************** 09/29/2011 All Stage 2 daily sources have also been converted to Stage 2 monthly sources, in order to add more stations to the monthly side of the databank. The WMO criteria for calculating a monthly average was used: 1) No more than 5 missing days in a given month 2) No more than 3 consecutive missing days in a given month Data is placed here: /pub/data/globaldatabank/monthly/stage2/day2month/ ******************************************************************************** 09/30/2011 Mexico source has been updated to include available lat/lon/elevation. Both the daily and the daily converted to monthly versions have been updated and placed on the ftp site. The older versions have been placed in the archive ******************************************************************************** 10/03/2011 New source added: Max/Min Data from Russ Vose. Stage1 and Stage2 completed ******************************************************************************** 10/04/2011 Station inventory maps have been generated for all the sources, as well as one for ALL daily and ALL monthly sources ******************************************************************************** 10/06/2011 New Source Added: Max/Min daily data from Channel Islands in the UK -Stage 1 complete -Stage 2 complete -Conversion to Monthly Stage2 complete ******************************************************************************** 10/07/2011 New Sources Added: GHCN-Daily - raw (no qc flags), put into daily stage3 (common stage2/3 format) - operational (with qc flags), put into daily stage4 (ghcn-d format) - monthly version of GHCN-D raw, put into monthly stage2 format - monthly version of GHCN-D operational, put into monthly stage2 format ******************************************************************************** 10/20/2011 -East Africa monthly data has been updated to address some formatting concerns. Older version has been put in the archive - A new maps folder has been created within daily/monthly stage 2 folders. In there one will find the location of ALL records, plus records per decade Daily Stage 2 Maps are here: /pub/data/globaldatabank/daily/stage2/MAPS Monthly Stage 2 Maps are here: /pub/data/globaldatabank/monthly/stage2/MAPS ******************************************************************************** 10/21/2011 Maps have been updated to dictate which stage they are, what is the time stamp of the data, as well as the date map was generated. It should be clear that these are NON-UNIQ station records, and that is now in the title ******************************************************************************** 01/10/2012 -East Africa monthly data has been updated so that every single source is considered a unique station. Older version has been placed in the archive ******************************************************************************** 01/11/2012 New Daily Source Added: Russia -Stage 1 complete -Stage 2 complete -Conversion to Monthly Stage2 complete ******************************************************************************** 01/13/2012 -Three sources already in the databank have been updated to address formatting concerns, as well as making sure every single source is considered a unique station. Older versions have been placed in the archive The sources are the following: - DAILY: ispd-tunisia-morocco - DAILY: usforts - MONTHLY: russsource -New Daily Source Added: swiss-digihom -Stage 1 complete -Stage 2 complete -Conversion to Monthly Stage2 complete -New Daily Source Added: beyrout -Stage 1 complete -Stage 2 complete -Conversion to Monthly Stage2 complete -All monthly/daily maps have been updated in the following folders: /pub/data/globaldatabank/daily/stage2/MAPS/ /pub/data/globaldatabank/monthly/stage2/MAPS/ ******************************************************************************** 01/20/2012 - READMES Updated ******************************************************************************** 02/10/2012 - Monthly version of ghcnd-raw was updated to address some formatting issues. Older version placed in the archive ******************************************************************************** 04/27/2012 - New Daily Sources Added: Greenland and GSOD - New Monthly Sources Added: climat_uk,mcdw,wmssc,crutem4 - A bug was found within the code to convert daily sources to monthly sources. All day-to-month sources have been updated to accomidate this bug fix and older versions placed in the archive - Monthly Version of GHCN-D updated ******************************************************************************** 04/30/2012 - Some monthly databank sources have been updated. Older versions have been placed in the archive: canada, ukmet-hist - Stage 2 MAPS updated (daily and monthly) ******************************************************************************** 05/07/2012 - 2 Monthly sources have been updated: WWR, Colonial Era Archive ******************************************************************************** 05/08/2012 - 3 Monthly sources have been updated: GHCNSOURCE, GHCN-M v2, KNMI ******************************************************************************** 05/09/2012 - New Daily Source Added: Argentina -Stage 1 complete -Stage 2 complete -Conversion to Monthly Stage2 complete - 2 Daily Sources have been updated: Japan, Australia ******************************************************************************** 05/10/2012 - 3 Daily Sources have been updated: usforts, spain, vietnam - Daily to monthly counterparts also updated ******************************************************************************** 05/11/2012 - Stage 2 MAPS updated (daily and monthly) ******************************************************************************** 05/17/2012 - TWO New Daily Sources Added: antarctica-aws, antarctica-palmer -Stage 1 complete -Stage 2 complete -Conversion to Monthly Stage2 complete ******************************************************************************** 07/18/2012 - New Monthly Source Added: germany -Stage 1 complete -Stage 2 complete ******************************************************************************** 07/20/2012 - Daily Source (ecaknmi) and Monthly Source (knmi) updated - Stage 2 MAPS Updated (Daily and Monthly) ******************************************************************************** 07/31/2012 - New Daily Source Added: giessen -Stage 1 complete -Stage 2 complete -Conversion to Monthly Stage2 complete -Beyrout data source added into this source (since it originated from giessen) ******************************************************************************** 08/06/2012 - New Daily Source Added: india -Stage 1 complete -Stage 2 complete -Conversion to Monthly Stage2 complete - Monthly version of GHCN-D Updated - Stage 2 MAPS Updated (Daily and Monthly) ******************************************************************************** 09/04/2012 - New Daily Source Added: brazil-inmet -Stage 1 complete -Stage 2 complete -Conversion to Monthly Stage2 complete ******************************************************************************** 10/01/2012 - 5 Daily sources have been updated: antarctica-aws, antarctica-palmer, ecaknmi, ghcnd-raw, giessen - Stage 1, Stage 2, and monthly version Stage 2 all updated - 3 Monthly sources have been updated: climat-uk, knmi, ukmet-hist - Stage 1 and Stage 2 updated - Stage 2 MAPS Updated (Daily and Monthly) ******************************************************************************** 10/04/2012 - The Stage 3 Monthly dataset has been released in beta form. More information can be found in the following directory: ftp://ftp.ncdc.noaa.gov/pub/data/globaldatabank/monthly/stage3/ ******************************************************************************** 11/29/2012 - TWO New Daily Sources Added: uruguay, gsn-sweden -Stage 1 complete -Stage 2 complete -Conversion to Monthly Stage2 complete - TWO New Monthly Sources Added: canada-raw, eklima -Stage 1 complete -Stage 2 complete - 1 Daily sources have been updated: giessen - Stage 1, Stage 2, and monthly version Stage 2 all updated - 1 Monthly sources have been updated: crutem4 - Stage 1 and Stage 2 updated - Stage 2 MAPS Updated (Daily and Monthly) ******************************************************************************** 12/06/2012 - The second beta of the Stage 3 Monthly dataset has been released. More information can be found in the following directory: ftp://ftp.ncdc.noaa.gov/pub/data/globaldatabank/monthly/stage3/ - Beta 1 has been moved to the archive ftp://ftp.ncdc.noaa.gov/pub/data/globaldatabank/archive/monthly/stage3/beta1/ ******************************************************************************** 01/31/2013 - The following two daily sources were updated due to bugs in code: vietnam, mexico - day2month versions also updated - Central Asia stage1 dataset had TMAX file and TMIN file switched. File name change was made, and all stage1 / stage2 monthly data have been updated - Scanned images from costa-rica were added to stage0 daily folder ******************************************************************************** 02/26/2013 - The format of ALL STAGE TWO DATA has changed. This was done to ensure the same exact format for Stage2 Daily, Stage2 Monthly, and Stage3 Monthly Data. All stage2 sources have been updated, with earlier versions placed in the archive - The sources ecaknmi and sacaknmi have changed to ecad and sacad, respectively. - New Daily Source Added: hadisd -Stage 1 complete -Stage 2 complete -Conversion to Monthly Stage2 complete - Stage 2 MAPS Updated (Daily and Monthly) ******************************************************************************** 03/15/2013 - The third beta of the Stage 3 Monthly dataset has been released. More information can be found in the following directory: ftp://ftp.ncdc.noaa.gov/pub/data/globaldatabank/monthly/stage3/ - Beta 2 has been moved to the archive ftp://ftp.ncdc.noaa.gov/pub/data/globaldatabank/archive/monthly/stage3/beta2/ ******************************************************************************** 05/16/2013 - 2 Daily sources have been updated: ecad, sacad - Stage 1, Stage 2, and monthly version Stage 2 all updated - 3 Monthly sources have been updated: climat-uk, knmi, mcdw - Stage 1 and Stage 2 updated - 2 New Monthly Sources Added: mcdw-unpublished, climat-prelim -Stage 1 complete -Stage 2 complete