3 August 2009, eaton Processing to create 1850-2005 dataset for 20th century transient runs from the decadal avg data provided by Jean-Francois Lamarque. The strategy for creating the dataset is to use the existing 1850 climatology at the beginning, and use the final dataset from JF, /ptmp/lamar/IPCC_AR5/Climatologies_20090730/aero_1.9x2.5_L26_2000-2009.nc, as the climatology for year 2000 and for year 2006. The simulation that produced the new data held emissions fixed from year 2000 onward, so the 2000-2009 is effectively a 2000 climatology. We replicate it at year 2006 so our simulations can run through year 2005. The new datasets are prepended with the existing 1850 climatology because there are long CLM spinup runs that used this forcing and we want to keep that constant. The 1850 climo data is replicated at year 1849 just so we have the boundary months needed to start the simulation at 1 Jan 1850. The details follow: 1. Convert decadal avg files from r8 to r4 data, and remove the variables T,PS,P0. These variables aren't present in the 1850 climo dataset, so they need to be removed in order to use ncrcat to glue all the data together. This step is done using the cam interpolation routine from tools/interpic_new/. % /blhome/eaton/bin/interpic -e T,PS,P0 -p 4 -t /fis/cgd/cseg/csm/inputdata/atm/cam/coords/fv_1.9x2.5_L26.nc /ptmp/lamar/IPCC_AR5/Climatologies_20090730/aero_1.9x2.5_L26_1850-1859.nc aero_1.9x2.5_L26_1850-1859.r4.nc % /blhome/eaton/bin/interpic -e T,PS,P0 -p 4 -t /fis/cgd/cseg/csm/inputdata/atm/cam/coords/fv_1.9x2.5_L26.nc /ptmp/lamar/IPCC_AR5/Climatologies_20090730/aero_1.9x2.5_L26_1860-1869.nc aero_1.9x2.5_L26_1860-1869.r4.nc % /blhome/eaton/bin/interpic -e T,PS,P0 -p 4 -t /fis/cgd/cseg/csm/inputdata/atm/cam/coords/fv_1.9x2.5_L26.nc /ptmp/lamar/IPCC_AR5/Climatologies_20090730/aero_1.9x2.5_L26_1870-1879.nc aero_1.9x2.5_L26_1870-1879.r4.nc % /blhome/eaton/bin/interpic -e T,PS,P0 -p 4 -t /fis/cgd/cseg/csm/inputdata/atm/cam/coords/fv_1.9x2.5_L26.nc /ptmp/lamar/IPCC_AR5/Climatologies_20090730/aero_1.9x2.5_L26_1880-1889.nc aero_1.9x2.5_L26_1880-1889.r4.nc % /blhome/eaton/bin/interpic -e T,PS,P0 -p 4 -t /fis/cgd/cseg/csm/inputdata/atm/cam/coords/fv_1.9x2.5_L26.nc /ptmp/lamar/IPCC_AR5/Climatologies_20090730/aero_1.9x2.5_L26_1890-1899.nc aero_1.9x2.5_L26_1890-1899.r4.nc % /blhome/eaton/bin/interpic -e T,PS,P0 -p 4 -t /fis/cgd/cseg/csm/inputdata/atm/cam/coords/fv_1.9x2.5_L26.nc /ptmp/lamar/IPCC_AR5/Climatologies_20090730/aero_1.9x2.5_L26_1900-1909.nc aero_1.9x2.5_L26_1900-1909.r4.nc % /blhome/eaton/bin/interpic -e T,PS,P0 -p 4 -t /fis/cgd/cseg/csm/inputdata/atm/cam/coords/fv_1.9x2.5_L26.nc /ptmp/lamar/IPCC_AR5/Climatologies_20090730/aero_1.9x2.5_L26_1910-1919.nc aero_1.9x2.5_L26_1910-1919.r4.nc % /blhome/eaton/bin/interpic -e T,PS,P0 -p 4 -t /fis/cgd/cseg/csm/inputdata/atm/cam/coords/fv_1.9x2.5_L26.nc /ptmp/lamar/IPCC_AR5/Climatologies_20090730/aero_1.9x2.5_L26_1920-1929.nc aero_1.9x2.5_L26_1920-1929.r4.nc % /blhome/eaton/bin/interpic -e T,PS,P0 -p 4 -t /fis/cgd/cseg/csm/inputdata/atm/cam/coords/fv_1.9x2.5_L26.nc /ptmp/lamar/IPCC_AR5/Climatologies_20090730/aero_1.9x2.5_L26_1930-1939.nc aero_1.9x2.5_L26_1930-1939.r4.nc % /blhome/eaton/bin/interpic -e T,PS,P0 -p 4 -t /fis/cgd/cseg/csm/inputdata/atm/cam/coords/fv_1.9x2.5_L26.nc /ptmp/lamar/IPCC_AR5/Climatologies_20090730/aero_1.9x2.5_L26_1940-1949.nc aero_1.9x2.5_L26_1940-1949.r4.nc % /blhome/eaton/bin/interpic -e T,PS,P0 -p 4 -t /fis/cgd/cseg/csm/inputdata/atm/cam/coords/fv_1.9x2.5_L26.nc /ptmp/lamar/IPCC_AR5/Climatologies_20090730/aero_1.9x2.5_L26_1950-1959.nc aero_1.9x2.5_L26_1950-1959.r4.nc % /blhome/eaton/bin/interpic -e T,PS,P0 -p 4 -t /fis/cgd/cseg/csm/inputdata/atm/cam/coords/fv_1.9x2.5_L26.nc /ptmp/lamar/IPCC_AR5/Climatologies_20090730/aero_1.9x2.5_L26_1960-1969.nc aero_1.9x2.5_L26_1960-1969.r4.nc % /blhome/eaton/bin/interpic -e T,PS,P0 -p 4 -t /fis/cgd/cseg/csm/inputdata/atm/cam/coords/fv_1.9x2.5_L26.nc /ptmp/lamar/IPCC_AR5/Climatologies_20090730/aero_1.9x2.5_L26_1970-1979.nc aero_1.9x2.5_L26_1970-1979.r4.nc % /blhome/eaton/bin/interpic -e T,PS,P0 -p 4 -t /fis/cgd/cseg/csm/inputdata/atm/cam/coords/fv_1.9x2.5_L26.nc /ptmp/lamar/IPCC_AR5/Climatologies_20090730/aero_1.9x2.5_L26_1980-1989.nc aero_1.9x2.5_L26_1980-1989.r4.nc % /blhome/eaton/bin/interpic -e T,PS,P0 -p 4 -t /fis/cgd/cseg/csm/inputdata/atm/cam/coords/fv_1.9x2.5_L26.nc /ptmp/lamar/IPCC_AR5/Climatologies_20090730/aero_1.9x2.5_L26_1990-1999.nc aero_1.9x2.5_L26_1990-1999.r4.nc % /blhome/eaton/bin/interpic -e T,PS,P0 -p 4 -t /fis/cgd/cseg/csm/inputdata/atm/cam/coords/fv_1.9x2.5_L26.nc /ptmp/lamar/IPCC_AR5/Climatologies_20090730/aero_1.9x2.5_L26_2000-2009.nc aero_1.9x2.5_L26_2000-2009.r4.nc 2. Concatenate all this data and replicate the last decade to provide boundary data to allow the simulation to run through 2005. % ncrcat aero_1.9x2.5_L26_1850-1859.r4.nc \ aero_1.9x2.5_L26_1860-1869.r4.nc aero_1.9x2.5_L26_1870-1879.r4.nc \ aero_1.9x2.5_L26_1880-1889.r4.nc aero_1.9x2.5_L26_1890-1899.r4.nc \ aero_1.9x2.5_L26_1900-1909.r4.nc aero_1.9x2.5_L26_1910-1919.r4.nc \ aero_1.9x2.5_L26_1920-1929.r4.nc aero_1.9x2.5_L26_1930-1939.r4.nc \ aero_1.9x2.5_L26_1940-1949.r4.nc aero_1.9x2.5_L26_1950-1959.r4.nc \ aero_1.9x2.5_L26_1960-1969.r4.nc aero_1.9x2.5_L26_1970-1979.r4.nc \ aero_1.9x2.5_L26_1980-1989.r4.nc aero_1.9x2.5_L26_1990-1999.r4.nc \ aero_1.9x2.5_L26_2000-2009.r4.nc aero_1.9x2.5_L26_2000-2009.r4.nc \ aero_1.9x2.5_L26_1850-2005_c090731.nc.tmp 3. Prepend the existing 1850 climatology (2 copies) to the new data. % ncrcat aero_1.9x2.5_L26_1850clim_c090420.nc \ aero_1.9x2.5_L26_1850clim_c090420.nc \ aero_1.9x2.5_L26_1850-2005_c090803.nc.386000 \ aero_1.9x2.5_L26_1850-2005_c090803.nc 4. Fix the time/date variables. Here is the .cdl file that contains the times and dates. netcdf date_time_1849-2006_c090803 { dimensions: time = UNLIMITED ; // (228 currently) variables: int date(time) ; date:long_name = "date" ; date:format = "YYYYMMDD" ; double time(time) ; time:long_name = "time" ; time:units = "days since 1849-01-01 00:00" ; time:calendar = "noleap" ; data: date = 18490115, 18490215, 18490315, 18490415, 18490515, 18490615, 18490715, 18490815, 18490915, 18491015, 18491115, 18491215, 18500115, 18500215, 18500315, 18500415, 18500515, 18500615, 18500715, 18500815, 18500915, 18501015, 18501115, 18501215, 18550115, 18550215, 18550315, 18550415, 18550515, 18550615, 18550715, 18550815, 18550915, 18551015, 18551115, 18551215, 18650115, 18650215, 18650315, 18650415, 18650515, 18650615, 18650715, 18650815, 18650915, 18651015, 18651115, 18651215, 18750115, 18750215, 18750315, 18750415, 18750515, 18750615, 18750715, 18750815, 18750915, 18751015, 18751115, 18751215, 18850115, 18850215, 18850315, 18850415, 18850515, 18850615, 18850715, 18850815, 18850915, 18851015, 18851115, 18851215, 18950115, 18950215, 18950315, 18950415, 18950515, 18950615, 18950715, 18950815, 18950915, 18951015, 18951115, 18951215, 19050115, 19050215, 19050315, 19050415, 19050515, 19050615, 19050715, 19050815, 19050915, 19051015, 19051115, 19051215, 19150115, 19150215, 19150315, 19150415, 19150515, 19150615, 19150715, 19150815, 19150915, 19151015, 19151115, 19151215, 19250115, 19250215, 19250315, 19250415, 19250515, 19250615, 19250715, 19250815, 19250915, 19251015, 19251115, 19251215, 19350115, 19350215, 19350315, 19350415, 19350515, 19350615, 19350715, 19350815, 19350915, 19351015, 19351115, 19351215, 19450115, 19450215, 19450315, 19450415, 19450515, 19450615, 19450715, 19450815, 19450915, 19451015, 19451115, 19451215, 19550115, 19550215, 19550315, 19550415, 19550515, 19550615, 19550715, 19550815, 19550915, 19551015, 19551115, 19551215, 19650115, 19650215, 19650315, 19650415, 19650515, 19650615, 19650715, 19650815, 19650915, 19651015, 19651115, 19651215, 19750115, 19750215, 19750315, 19750415, 19750515, 19750615, 19750715, 19750815, 19750915, 19751015, 19751115, 19751215, 19850115, 19850215, 19850315, 19850415, 19850515, 19850615, 19850715, 19850815, 19850915, 19851015, 19851115, 19851215, 19950115, 19950215, 19950315, 19950415, 19950515, 19950615, 19950715, 19950815, 19950915, 19951015, 19951115, 19951215, 20000115, 20000215, 20000315, 20000415, 20000515, 20000615, 20000715, 20000815, 20000915, 20001015, 20001115, 20001215, 20060115, 20060215, 20060315, 20060415, 20060515, 20060615, 20060715, 20060815, 20060915, 20061015, 20061115, 20061215 ; time = 14, 45, 73, 104, 134, 165, 195, 226, 257, 287, 318, 348, 379, 410, 438, 469, 499, 530, 560, 591, 622, 652, 683, 713, 2204, 2235, 2263, 2294, 2324, 2355, 2385, 2416, 2447, 2477, 2508, 2538, 5854, 5885, 5913, 5944, 5974, 6005, 6035, 6066, 6097, 6127, 6158, 6188, 9504, 9535, 9563, 9594, 9624, 9655, 9685, 9716, 9747, 9777, 9808, 9838, 13154, 13185, 13213, 13244, 13274, 13305, 13335, 13366, 13397, 13427, 13458, 13488, 16804, 16835, 16863, 16894, 16924, 16955, 16985, 17016, 17047, 17077, 17108, 17138, 20454, 20485, 20513, 20544, 20574, 20605, 20635, 20666, 20697, 20727, 20758, 20788, 24104, 24135, 24163, 24194, 24224, 24255, 24285, 24316, 24347, 24377, 24408, 24438, 27754, 27785, 27813, 27844, 27874, 27905, 27935, 27966, 27997, 28027, 28058, 28088, 31404, 31435, 31463, 31494, 31524, 31555, 31585, 31616, 31647, 31677, 31708, 31738, 35054, 35085, 35113, 35144, 35174, 35205, 35235, 35266, 35297, 35327, 35358, 35388, 38704, 38735, 38763, 38794, 38824, 38855, 38885, 38916, 38947, 38977, 39008, 39038, 42354, 42385, 42413, 42444, 42474, 42505, 42535, 42566, 42597, 42627, 42658, 42688, 46004, 46035, 46063, 46094, 46124, 46155, 46185, 46216, 46247, 46277, 46308, 46338, 49654, 49685, 49713, 49744, 49774, 49805, 49835, 49866, 49897, 49927, 49958, 49988, 53304, 53335, 53363, 53394, 53424, 53455, 53485, 53516, 53547, 53577, 53608, 53638, 55129, 55160, 55188, 55219, 55249, 55280, 55310, 55341, 55372, 55402, 55433, 55463, 57319, 57350, 57378, 57409, 57439, 57470, 57500, 57531, 57562, 57592, 57623, 57653 ; } 5. Use ncgen to convert the cdl file above to netcdf. Then extract the time,date variables from this file and use them to overwrite the time,date variables in the file containing the concatenated time samples. % ncgen -b date_time_1849-2006_c090803.cdl % ncks --append -v date,time date_time_1849-2006_c090803.nc aero_1.9x2.5_L26_1850-2005_c090803.nc 6. Use ncwa to zonally avg the final dataset and take a look with ncview. Looks OK. 7. Move to final location: % mv aero_1.9x2.5_L26_1850-2005_c090803.nc \ /fis/cgd/cseg/csm/inputdata/atm/cam/chem/trop_mozart_aero/aero