D5.5 Interoperability Demonstrator
Deliverable 5.5 consists of two sections. The first one is related to the interoperability between Copernicus data infrastructures; specifically, we have demonstrated that Sentinel metadata hosted in the STFC CEDA environment can be extracted and used to create a searchable catalogue in the Catapult SEDAS environment.
This has been achieved by developing two new plugins for the SEDAS/archive4EO solution. The first plugin logs onto the CEDA environment and copies Sentinel manifest files into SEDAS/archive4EO for ingestion. The second plugin allows manifest files to be ingested by SEDAS/archive4EO. archive40 is developed by Deimos Space and has been deployed to a number of live environments where it has ingested and catalogued 10s of millions of records.
If required this proof of concept could be made live fairly easily. However some extra work may be required to ensure that the STFC service listing manifest files can be applied to a date or date range to allow new manifest files to be collected using a clear handshaking protocol.
The second section of the report concerns the activities carried out to extend the set of interfaces provided by the Ophidia Framework and how it has been used to calculate impact indicators in the context of the project. Specifically, to support users for their analytics and scientific operations on large volumes of data, the Ophidia Big Data Analytics Framework has been extended to support an OGC-WPS compliant interface.
With the aim of addressing interoperability aspects (e.g. within ESGF) in terms of data access and exposed services, this interface has been developed on top of the Ophidia server providing a web-based method for remotely submitting the execution of processes to the Ophidia platform and accessing the results. By means of the WPS interface, the Ophidia framework has been used to compute some impact analysis indicator starting from large input datasets (order of tens/hundreds of Gigabytes) like the SWE climatological mean, snow-off, snow-on and Length-of-snow-season, SST mean, anomaly and climatological mean.
The resulting indicators are available on the CLIPC Portal for downloading and further analysis and combine functions.
Download the deliverable here.