ALBERT

Description: The BSRN Toolbox is a software package supplied by the WRMC and is freely available to all station scientists and data users. The main features of the package include a download manager for Station- to-Archive files, a tool to convert files into human readable TAB-separated ASCII-tables (similar to those output by the PANGAEA database), and a tool to check data sets for violations of the "BSRN Global Network recommended QC tests, V2.0" quality criteria. The latter tool creates quality codes, one per measured value, indicating if the data are "physically possible," "extremely rare," or if "intercomparison limits are exceeded.” In addition, auxiliary data such as solar zenith angle or global calculated from diffuse and direct can be output. All output from the QC tool can be visualized using PanPlot (doi:10.1594/PANGAEA.816201).

Description: Among the worldwide expeditions conducted with German research vessels (RVs), an enormous amount of hydro-acoustic data, especially bathymetry, is acquired. Since 1995, the BSH (German Federal Maritime and Hydrographic Agency) is collecting bathymetric datasets, mainly from the RVs METEOR, M.S.MERIAN & SONNE. The institute built up a static website (http://www.bsh.de/de/Meeresdaten/Seevermessung_und_Wracksuche/Bathymetrie/index.jsp) that allows reviewing all the track lines of the research vessels where data is available. Although mandatory, some of the datasets never reached BSH. Upon request, the accessible data will be available for download via FTP from the BSH web-portal. For a more contemporary and sustainable approach in accessing bathymetric metadata and data of all German research vessels, we created a bathymetry showcase within the MaNIDA project (2011/2-2014; http://www.manida.org/) and the resulting “Data Portal German Marine Research” (http://manida.awi.de/). A PostGIS database based on the ISO 19139-2:2012 standard was set up and a solitaire frontend-GUI developed, which allows ingestion of cruise metadata and the automatic acquisition of hydro-acoustic metadata on the entity level (per recorded raw data survey-line). In parallel, the dataset will be archived in PANGAEA (https://www.pangaea.de/) and metadata then completed with the link to the stored dataset. The Bathy-Meta-Database and its services run as a surplus-portal of PANGAEA. This development lead to our participation of the EMODnet Bathymetry Project (http://portal.emodnet-bathymetry.eu/) where metadata is shown for every grid-cell of the compilation of bathymetric datasets while an adapted, world-wide GEBCO dataset (http://www.gebco.net/) fills the gaps across the European seas. The most recent development deals with retrieving metadata from processed bathymetry, based on further software development and the utilization of the open-source suite MB-System (http://www.mbari.org/products/research-software/mb-system/), which concatenates the long-term storage of raw & processed bathymetry in PANGAEA.

Description: DASHBOARD.awi.de is a component of our data flow framework designed to enable a semi-automated flow of sensor observations to archives (acronym O2A). The dramatic increase in the number and type of platforms and respective sensors operated by Alfred Wegener Institute along with complex project-driven requirements in terms of satellite communication, sensor monitoring, quality control and validation, processing pipelines, visualization, and archival under FAIR principles, led us to build a generic and cost-effective data flow framework. Most important, all components and services which make up this framework are extensible and exchangeble, were built using open access technologies (e.g. elastic search) and vocabularies (SeaVox NERC 2.0 vocabulary) and are compliant with various interoperability standards recommended by the international community. In this poster we illustrate the DASHBOARD.awi.de component which is a web-based monitoring environment for supporting scientists in the graphing, mapping and simple analysis of time series. With a set of fit-for-purpose widgets including data download, scientists are able to identify gaps and outliers in the streamed data. Morover, we are in the process of building alerting solutions for individual parameters using the parameter properties available from SENSOR.awi.de (e.g. min/max parameter range). The streaming services attached to this component are using the near real-time data transfered from remote field sites to local databases and storage systems. For this sake, we are participating in the RDA "Array Database Assessment" Working Group and "Big Data" Interest Group. The graphing solutions built within DASHBOARD.awi.de can be easily re-used in other context (e.g. project web pages) . Our solutions support the OGC standard Observations and Measurements (O&M), JSON and CSV as exchange data format. To date, ~ 150 individual parameters are being transfered in near real-time from remote sites to our onshore storage systems and monitored by scientists. In the week of the 11th RDA Plenary Berlin, we will be able to interact with live data from Polarstern crossing the Drake Passage, on its way to Antarctica. Scientific Discipline/Research Area: Data flow, standardized vocabulary, Visualisation, Streaming. Relevance/Link to RDA: The streaming services attached to this component are using the near real-time data transfered from remote field sites to local databases and storage systems. For this sake, we are participating in the RDA "Array DB Assesment" Working Group and "Big Data" Interest Group.

Description: The second Data Science Symposium at AWI gathered several data science related talks from AWI, GEOMAR and HZG.

Description: DATA.awi.de is a component of our data flow framework designed to enable a semi-automated flow of sensor observations to archives (acronym O2A). The dramatic increase in the number and type of platforms and respective sensors operated by Alfred Wegener Institute along with complex project-driven requirements in terms of satellite communication, sensor monitoring, quality control and validation, processing pipelines, visualization, and archival under FAIR principles, led us to build a generic and cost-effective data flow framework. Most important, all components and services which make up this framework are extensible and exchangeble, were built using open access technologies (e.g. elastic search) and vocabularies (SeaVox NERC 2.0 vocabulary) and are compliant with various interoperability standards recommended by the international community. In this poster we illustrate the DATA.awi.de component which is a one-stop-shop framework for enabling discovery and dissemination of heterogeneous scientific information. Because the metadata and data generated and captured by the other O2A components are machine-readable and interoperable, we were able to build harvesting and indexing solutions which enable scientists and other stakeholders to discover content ranging from platforms/sensors, tracklines, field reports, near real-time data to quality-controlled data, map products and peer-reviewed publications. Scientific Disciplin/Research Area: Findability, Interoperability, Integration, Re-use. Relevance/Link to RDA: In the context of our harvesting approach, we are interacting with the RDA "Brokering Framework" Working Group and "Brokering" Interest Group.

Description: The linkage of data beyond disciplinary boundaries is essential for marine research. Sufficient national and international data infrastructures are fundamental for central and easy access to the variety of existing, but distributed datasets in marine science. The Marine Network for Integrated Data Access (MaNIDA) provides a national networked approach in accessing and mining of federated marine research data infrastructures together with data management strategies and data workflows. In that course the MaNIDA consortium conceptualized and developed the “Data Portal German Marine Research” for coherent discovery, view, download and dissemination of scientific data and publications. The data portal is based on a central harvesting and interfacing approach by connecting distributed data sources. Here we inform about the specific details of the portal in terms of content, functionality, services, architecture, interfaces, standards and the contributing data providers.

Description: Over the last two decades, the Alfred Wegener Institute (AWI) has been continuously committing to develop and sustain an e-Infrastructure for coherent discovery, visualization, dissemination and archival of scientific information in polar and marine regions. Most of the data originates from research activities being carried out in a wide range of AWI-operated research platforms: vessels, land-based stations, ocean-based stations and aircrafts. Archival and publishing in PANGAEA repository along with DOI assignment to individual datasets is a typical end-of-line step for most data owners. Within AWI, a workflow for data acquisition from vessel-mounted devices along with ingestion procedures for the raw data into the institutional archives has been well-established for many years. However, the increasing number of ocean-based stations and respective sensors along with heterogeneous project-driven requirements towards satellite communication, sensor monitoring, QA/QC control and validation, processing algorithms, visualization and dissemination has recently lead us to build a more generic and cost-effective framework. This framework, hereafter named O2A, has as main strength its seamless flow of sensor observation to archives and the fact that it complies with internationally used OGC standards and thus assuring interoperability in international context (e.g. SOS/SWE, WPS, WMS WFS,..). O2A is comprised of several extensible and exchangeable modules (e.g. controlled vocabularies and gazetteers, file type and structure validation, aggregation solutions, processing algorithms, etc) as well as various interoperability services. At the first data tier level, not only each sensor is being described following SensorML data model standards but the data is being fed to an SOS interface offering streaming solutions along with support to O&M encoding. Project administrators or data specialists are now able to monitor the individual sensors displayed in a map by simply clicking on the station and viewing the near real-time data for the selected station and sensor. In addition, the monitoring dashboards we built provide assistance to data scientists and administrators in terms of early detection of malfunction of sensors (e.g., email/SMS notification), filtering of data values for certain range (e.g. temperature values above a certain range) and data aggregation (e.g. calculation of daily averages).

Description: Timely access to quality data and linkage of data beyond disciplinary boundaries is essential for the marine research community. Therefore the national "Marine Network for Integrated Data Access" is establishing the "Data Portal German Marine Research" to facilitate seamless access to marine data and services and to promote the exchange and dissemination of marine data interlinked with corresponding scientific publications. In that course the data portal was conceptualized and developed to provide a "one-stop-shop" approach to marine research data from various data providers in terms of coherent discovery, view, download and dissemination of scientific data and publications. The data portal is based on a central harvesting and interfacing approach by connecting distributed data sources. To achieve interoperability the data portal makes use of internationally endorsed standards (e.g., ISO, OGC, OAI-PMH). In this paper we provide information on details of content, functionality, services, architecture, interfaces and standards of the data portal and the network of contributing data providers.