From raw data to observing products with SSDS: fishes to wishes

The Shore Side Data System (SSDS) (http://sscb.mbari.org) has been collecting real-time oceanographic data from Monterey Bay for over two years. While the system is not yet ready for public distribution, its data may be accessed readily by Web browsers, external computer software (via Web services), and the HOOVES desktop application. One of SSDS´ hallmarks is its ability to accept data from new platforms and instruments, and immediately provide access to that data via public interfaces. With the support of a well-designed data observing infrastructure such as SIAM, advanced features like variable- and instrument-based data access are also instantly available. The system can accept data from any type of instrument and make it available in the original format, or (for described data) as individual data items. Many users in MBARI´s science and engineering community have taken advantage of the SSDS interfaces to view and automatically process near-real-time and archival data ingested by the system. With its Java Enterprise Architecture-based services, SSDS provides ready access to data and its descriptive metadata ncluding data provenance and geospatial and temporal metadata. In this paper we use SSDS as an example to consider all parts of the data life cycle in a modern observatory data system. We identify lessons and make recommendations for future observing system developers. We will particularly emphasize topics applicable to the ocean observing communities such as OOI and IOOS.