bird_effort 070321 - njc: This object has no lat/lon data so a join is required to be able to map the data. No datetimeparams needed in this dataset. ======================= Top Level: directory = gb6.whoi.edu\data12\sodata\cribic: allbirdeffort.dat: # Effort Log as part of the Bird Studies # Chris Ribic and Erik Chapman, SIs # Notes: N = Night; D = Day; # StartCode: 0=Start; 1=End; 0.5=change in conditions # Visibility Code = see documentation # Precipitation: 0=none; 1=fog; 2=rain; 3=snow, including sleet or hail # Cloud cover = eighths # Ice Concentration = tenths # Primary Ice cover = see documentation cruiseid year > yrday_gmt time_gmt lat[width=8] lon[width=8] startcode visib time_of_day precip_type cloud_cover ice_conc ice_cover_type[width=55] comments dummy1 dummy2 date_gmt #NBP0103 2001 {/globec/soglobec/bird_effort0103} NBP0103 2001 nbp0103/effort0103_log_joined.dat #NBP0104 2001 {/globec/soglobec/bird_effort0104} #NBP0202 2002 {/globec/soglobec/bird_effort0202} #NBP0204 2002 {/globec/soglobec/bird_effort0204} ====================== allbirdeffort.ind: #allbirdeffort.ind datafile = allbirdeffort.dat #transvar = \ pptn_type = precip_type; pri_ice_cover = ice_cover_type #timedateparams = \ invar1name = year; invar1template = YYYY; invar2name = yrday_gmt; invar2template = J; invar3name = time_gmt; invar3template = HH:MM:SS; outtimename = time_gmt; outjulianname = yrday_gmt; outjulianformat = j ; varlist = /data12/sodata/cribic/effort_log.varlist #varlist = /data12/sodata/cribic/effort_log.varlist removals = \ dummy1; dummy2; date_gmt; datafieldopts = \ separators=\t,\n; significant_embedded_separators_in_fixed_field = FALSE ======================= -add joined variables from alongtrack file to this list (dummy1,dummy2,date_gmt,lat,lon) effort_log.varlist: #Bird Studies variable list for Effort Log. # cruiseid year yrday_gmt time_gmt startcode visib n_d_flag pptn_type cloud_cover ice_conc pri_ice_cover comments dummy1 dummy2 date_gmt lat lon time_of_day precip_type ice_cover_type ======================= ======================= next level, NBP0103: directory = gb6.whoi.edu\data12\sodata\cribic\nbp0103: ======================== Original data file. effort0103_log_joined-ori.dat: cruiseid year date_gmt yrday_gmt time_gmt startcode visib time_of_day precip_type cloud_cover ice_conc ice_cover_type comments lat lon NBP0103 2001 apr29_2001 119.53403 1249.00 0 2 D 0 8 0 nd 20 + winds and snow up until beginning of transect. Weather cleared during effort. -65.8141 -70.3954 NBP0103 2001 apr29_2001 119.69236 1637.00 0.5 0 D 0 7 0 nd "fewer clouds-visibility improves" -65.9473 -69.9187 NBP0103 2001 apr29_2001 119.71111 1704.00 1 0 D 0 7 0 nd nd -65.9685 -69.8473 NBP0103 2001 apr29_2001 119.80000 1912.00 0 0 D 0 7 0 nd nd -65.9905 -69.8203 ======================== New data file. -added lat/lon with join. -renamed cruiseid and year to dummy's because they're already listed in top level .ind file (allbirdeffort.dat). effort0103_log_joined.dat: dummy1,dummy2,date_gmt,yrday_gmt,time_gmt,lat,lon,startcode,visib,time_of_day,precip_type,cloud_cover,ice_conc,ice_cover_type,comments NBP0103,2001,apr29_2001,119.5340,1249,-65.8141,-70.3954,0,2,D,0,8,0,nd, 20 + winds and snow up until beginning of transect. Weather cleared during effort. NBP0103,2001,apr29_2001,119.6924,1637,-65.9473,-69.9187,0.5,0,D,0,7,0,nd,fewer clouds-visibility improves NBP0103,2001,apr29_2001,119.7111,1704,-65.9685,-69.8473,1,0,D,0,7,0,nd,nd ========================== timedateparams - all lines rem'ed out. effort0103_log.timedateparams: # Timedateparams for bird effort #outtimename = time_gmt; #invar1name = time_gmt; #invar1template = HH:MM:SS #invar2name = yrday_gmt; #invar2template = j; #outjulianname = yrday_gmt; #outjulianformat = J; ======================== -new data file name added. -removals for dummy1 and dummy2 added - also removed in top level (allbirdeffort.ind). -rem out inpwidths line -rem out timedateparams -varlist - new path/file designation effort0103_log.ind: #/data12/sodata/cribic/nbp0103/effort0103_log.dat /data12/sodata/cribic/nbp0103/effort0103_log_joined.dat #inpwidths = /data12/sodata/cribic/effort_log.widths removals = \ dummy1; dummy2; date_gmt; datafieldopts = \ separators=\t,\n; significant_embedded_separators_in_fixed_field = FALSE #timedateparams = \ outjulianname = yrday_gmt; outjulianformat = J; invar2name = yrday_gmt; invar2template = j; outtimename = time_gmt; invar1name = time_gmt; invar1template = HH:MM:SS #timedateparams = /data12/sodata/cribic/nbp0103/effort0103_log.timedateparams #latlonparams = \ inlonname=lon; inlonconvention=W; inlonformat=degdecmin; inlatname = lat; inlatconvention=S; inlatformat=degdecmin diagnostics = \ addl-error_sink=/tmp/effort_log.err; other_comment_sink=/dev/null varlist = /data12/sodata/cribic/effort_log.varlist dispwidths = /data12/sodata/cribic/effort_log.dispwidths #transvar = \ n_d_flag = time_of_day; ======================= ======================= 070326 -njc: In effort0103_log.dat, need to change some variables to match info file and other data files: pptn_type -> precip_type pri_ice_cover -> ice_cover_type effort0104_log-joined.dat and effort0202_log-joined.dat: Did the join on 070323 and today I edited it - imported in to excel and got things in columns - tough because of long comments and everything is separated with spaces, not tabs or commas. Changed n_d_flag to time_of_day, made sure lat and long formats were 4 digits, time format also 4 digits. Having problems with effort0204 - won't flatlist. Warren working on it. 070328: Got joined data for 0204 and reformatted it to match others.