Home

What is the POD Data Lake?

The POD Data Lake is an open source system to aggregate MARC bibliographic and holdings data for institutions that participate in the Platform for Open Data (POD) initiative. Data providers contribute their data to the Data Lake by uploading data sets, and data consumers download data for downstream use.

General documentation

• Creating and managing API tokens
• Data provider and usage framework

Data provider documentation

• Data requirements
• Uploading data using the API
• Streams and their files
• Retention policy

Data consumer documentation

• Harvesting using ResourceSync
• Harvesting using OAI-PMH (to be implemented)

Getting help

• If you need assistance as a data provider for the production data lake, please contact Bob Persing ([email protected]) first.
• If you are a data consumer or need general assistance, please send a message to the pod-tech Google Group ([email protected]) or post in the POD Slack team's #general channel.