Data Management Office and NEP
Presented at the U.S. GLOBEC Northeast Pacific Scientific Investigator Meeting
Robert C. Groman
 10-12 January 2006

Background
U.S. GLOBEC Program Office and Data Management Office for Georges Bank
DMO supports NEP and SO Projects
NEP responsibilities shared with H. Batchelder
Follow the data          button

JGOFS/GLOBEC Data Management System
Support for investigators at geographically different sites
Client support for most (all?) computing platforms (PC, Macintosh, Unix, Linux) – Web based, using standard browsers
Distributed data servers
Data contributor directly controls data
Always up to date
Easier to grow computing resources
But,  can also use a central facility if one wishes

Data Policy Characteristics
Dissemination to scientific investigators on a timely basis
Data served when "useful"
Available to others outside the Program
Data use must follow data acknowledgement policy
Handle data, model output and images
Relationship to OPeNDAP (DODS) and value added web sites

Data Objects and Methods
What’s a data object?
What are methods?
Default method (defgb)
Restructuring (rs)
Combining with Perl scripts

Slide 6

Slide 7

Data may reside on remote servers

Information About Your Data
Metadata is crucial for others to be able to use other investigator’s data.
This information comes from the contributing investigator(s).
To see the metadata, click on the text in the last column of the directory or on the “Documentation” button.

What is Interoperability?

Implementing Data Interoperability
Consistent field names
You may get a call from George H.
Global Change Master Directory (GCMD)  and Directory Interchange Format (DIF) record (for data discovery)
Enhancing JGOFS/GLOBEC software to use XML-based “info” file

Data can be viewed – level 0

Next level: 1

Next level: 2

Or plotted

Selecting X-Y plotting options

Simple Plot

Or downloaded

Download Utility

Data Projection
Selecting just the field names you want
Try an on-line example

Data Selection
Selecting out data with certain values
temp < 4 and depth > 120
taxon contains calanus
Try an on-line example

Other download options

Northeast Pacific/CGOA
[As of 6 Jan 2006]

Northeast Pacific/CCS
[As of 6 Jan 2006]

What is missing?

Data Management Advisory Group
Set up by DMO several years ago.
DMAG advises DMO on issues such as field names and
units.
Membership: D. Allison, H. Batchelder, J. Bisagni,
C. Flagg, K. Garrison, R. Goldsmith, B. Groman,
G. Heimerdinger, E. Hofmann, S. Howard, J. Manning,
W. Sass, P. Smith

Software Tools
GeoZui3D
EZGZ interface between JGOFS/GLOBEC and GeoZui3D
EasyKrig (download)
Digitizer application

Data Visualization Enhancements
Better Able to Handle:
Acoustic backscatter data (curtain plots)
Arbitrarily spaced scalar & vector data
Axes, labels, grids, bounding boxes
Underlying bathymetry surfaces
Multiple color maps for each object
Point-and-click object identification
3D thumbnails and list boxes for easier selection and previewing of variables

Software Design Criteria

Slide 30

Bathymetry off Cape Cod

Script file to load layers/colors/data points

Mark Benfield Stellwagon Bank abundance 3D gridded scalar field via kriging

Zoomed in

Same view but with only higher density (counts) shown

Rotated view with different lighting

Curtain without points

Curtain without points, rotated

Isosurfaces

Isosurfaces zoomed in

Isosurfaces zoomed in but higher counts only

Slide 42

Following GeoZui3D slides not used during presentation

Curtain with points

Curtain slicer

Curtain slicer rotated

All slices

Display reference grid

Example of gradient vectors

Visualization Tools

GeoZui3D & EZGZ

Slide 52