20070315: njc Got instructions yesterday on fixing the .alongtrack and .ind files. The LMG cruises all seemed to work ok. The NBP cruises must be a bit different. Not really - extra line of headers in middle of NBP0104 (removed and then ok) and nbp0103 called a file in the directory that didn't belong. Once removed, it worked too. NBP0103: nbp0103alongtrack.ind: datafile = /data12/sodata/nbp0103/geopdata/jgof/nbp0103.alongtrack datafieldopts = \ separators = '\t \n' removals = \ gmtdate; dummy1; gmttime; day_gmt; month_gmt; #transvar (ori) = \ gmttime = time_gmt; date = date_gmt; mPAR = par_d; sstemp = temp_ss; sscond = cond_ss; sssal = sal_ss; wspd_t = wind_speed_c; wdir_t = wind_dir_c; airtemp = temp_air; rel_hum = humidity; metpress = press_bar; transvar = \ date = date_gmt; mPAR = par_d; sstemp = temp_ss; sscond = cond_ss; sssal = sal_ss; wspd_t = wind_speed_c; wdir_t = wind_dir_c; airtemp = temp_air; rel_hum = humidity; metpress = press_bar;PSP = radiation_l; PIR = radiation_s timedateparams = /data12/sodata/lmg0103/JGOF/JGOF/lmg0103.timedateparams --------------------------------------------------------- command window: [ncopley@gb6 jgof]$ /data5/globec/methods/defgb "@nbp0103alongtrack.ind" Content-type: text/plain &c P. Wiebe, Ch. Scientist &v0 date_gmt[width=8] &v1 lat[width=8] lon[width=9] sog[width=5] head[width=6] head2[width=6] cmg[width=6] par_d[width=7] temp_ss[width=7] cond_ss[width=7] sal_ss[width=7] depth_w[width=7] wind_speed_c[width=12] wind_dir_c[width=6] temp_air[width=8] humidity[width=8] press_bar[width=9] flvolt[width=6] radiation_l[width=11] radiation_s[width=11] yrday_gmt[width=9] time_gmt[width=8] &r &x Error opening data file /data12/sodata/nbp0103/geopdata/jgof/jg097.dat : (what's this from?) No such file or directory Lowest level file open is at level 0 Name = /data12/sodata/nbp0103/geopdata/jgof/nbp0103.alongtrack Last record read was # 5 (Count includes comments, blanks, etc; excludes addl diag info, if any) No remote ID info This msg issued Thu Mar 15 12:26:33 2007 This msg from method defgb. Source: defgb version 4.1b 24 Jul 2003 : ** jg097.dat is not present in the directory with all the rest of the .dat file: nbp0103/geopdata/jgof Those files run from jg116 to jg154. So how was this working before?? on web: /globec/soglobec/alongtrack --cruiseid eq NBP0103,date_gmt eq apr07_2002-- Level 2 Directory DocumentationPlotting and Other Operations... Level 0 - At last level - Flat list # Along track data, including CTD, MET and navigation information # The JGOFS data set is obtained primarily by applying calibrations to raw data # and decimating to whole minute intervals. Several fields are derived # from more than a single raw input. # See documentation for details. &x Error opening data file /data12/sodata/nbp0103/geopdata/jgof/jg097.dat : Error reading JGOFS object defgb(@/data12/sodata/nbp0103/geopdata/jgof/nbp0103alongtrack.ind) Lowest level file open is at level 1 File is JGOFS object. Object name = defgb(@/data12/sodata/nbp0103/geopdata/jgof/nbp0103alongtrack.ind) Number of calls to jdbreada executed so far: 0 REMOTE_HOST = mistral1.whoi.edu This msg issued Thu Mar 15 15:18:21 2007 This msg from method defgb. Source: defgb version 4.1b 24 Jul 2003 : Dicky says to rem out the line calling jg097.dat in the .alongrrack file. ==================================== NBP0104: made same corrections to .ind and .alongtrack as I did for LMG cruises. When I ran it using /data5/globec/methods/defgb "@nbp0104.timedateparams" it started to run through the lines but choked at line 127 of jg206.dat. jg206.dat line 1: gmtdate gmttime lat lon sog head head2 cmg mPAR sstemp sscond sssal depth_w wspd_t wdir_t airtemp rel_hum metpress flvolt dummy1 PSP PIR line 127: (matches line 1) gmtdate gmttime lat lon sog head head2 cmg mPAR sstemp sscond sssal depth_w wspd_t wdir_t airtemp rel_hum metpress flvolt dummy1 PSP PIR I found a duplicate header line there, deleted it, reran. It ran through for a long time in the command window but when I look at it on the web, an error displays. last 3 lines that ran on command line: 21:03:00 -52.8020 -67.9341 5.91 0.00 324.66 321.51 113.39 nd nd nd nd 12.49 346.47 4.30 82.00 1002.30nd 34.52 224.28 241.87708 2103.00 21:04:00 -52.8008 -67.9360 6.34 0.00 323.33 317.09 109.17 nd nd nd nd 12.76 357.16 4.30 82.00 1002.30nd 32.98 224.28 241.87778 2104.00 21:05:00 0.0000 0.0000 6.34 0.00 324.71 321.01 104.96 nd nd nd nd 13.17 354.10 4.40 81.00 1002.30 nd 31.43 224.28 241.87847 2105.00 &e on web: # Along track data, including CTD, MET and navigation information # The JGOFS data set is obtained primarily by applying calibrations to raw data # and decimating to whole minute intervals. Several fields are derived # from more than a single raw input. # See documentation for details. New variable name in file Name = gmttime Lowest level file open is at level 2 File is JGOFS object. Object name = defgb(@/data12/sodata/nbp0104/geopdata/jgof/nbp0104alongtrack.ind) Number of calls to jdbreada executed so far: 0 REMOTE_HOST = mistral1.whoi.edu This msg issued Thu Mar 15 15:20:04 2007 This msg from method defgb. Source: defgb version 4.1b 24 Jul 2003 : ==================================== 070316: njc I noticed that the date_gmt and the yrday_gmt didn't match for all the cruises. March 18 was coming out as yrday 7 but it should be day 77. Dicky is going to contact Raytheon Polar Services and confirm that they are really collecting yrday0_gmt and hopefully get them to correct their documentation. My job is to replace all instances of yrday_gmt with yrday0_gmt. These are in the .timedateparams file and all the .alongrack files. The .info file also needs to be fixed - it doesn't mention yrday at all 'cause I just added it. [20091103 - added yrday_gmt to parameter list] Also fix alongtrack.dat: From Dicky: The only file used by the browser that isn't used by running defgb on-line is the top-toplevel in /data12/sodata. It's called 'alongtrack.dat' and it controls all the alongtracks. The variable needs to be changed there as well.