DCAT-AP Hub

This library enables easy downloading and loading of datasets whose metadata is provided in the DCAT-AP format. Currently, only JSON-LD is supported.

How To Install

pip install dcat-ap-hub

How To Load Datasets

from dcat_ap_hub import download_data, load_data

url = "https://ki-daten.hlrs.de/hub/repo/datasets/dcc5faea-10fd-430b-944b-4ac03383ca9f~~1.jsonld"

dataset_dir = download_data(url, base_dir="../datasets")
data = load_data(dataset_dir, summarize=True, lazy=True)

How To Load Huggingface Models

from dcat_ap_hub import load_hf_model

url = "https://ki-daten.hlrs.de/hub/repo/datasets/6f75de8b60a9f8a2fdf7b69cbd86d9e64bcb3837.jsonld"
model, processor, metadata = load_hf_model(url)

Funding

This project is funded by the European High Performance Computing Joint Undertaking under Grant Agreement No. 101234027.