Skip to content

[New Notebook]: Reconcile the RA datasets at NCEI vs data available through IOOS Data Catalog #278

@MathewBiddle

Description

@MathewBiddle

Programming Language

Python

Module/Software/IOOS data service?

IOOS Data Catalog CKAN, NCEI Geoportal REST API, ISO xml metadata

Module/Software/IOOS data service?

See the following notebooks:

Provide a description.

Do some matching between records at NCEI and records available through the IOOS data catalog. Essentially come up with a list of datasets that aren't at NCEI.

@ocefpaf we have published two notebooks in the CodeLab which is a start to this analysis. Linked below. I would just need to smash them together to see what we get.

  1. https://ioos.github.io/ioos_code_lab/content/code_gallery/data_access_notebooks/2017-06-12-NCEI_RA_archive_history.html
  2. https://ioos.github.io/ioos_code_lab/content/code_gallery/data_access_notebooks/2024-09-17-CKAN_API_Query.html

I think collecting the metadata will be easy. But, trying to match what is at NCEI to what's available from the RAs in the IOOS data catalog will be tricky. At first glance, metadata doesn't match across the two. And the frequency at which we harvest and records change in the data catalog is a moving target.

Sub-issues

Metadata

Metadata

Labels

Notebook ideaFor new notebook proposals

Type

No type

Projects

Status

In Progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions