Skip to main content

Serve DC on DCOR data via the CKAN API interface

Project description

PyPI Version Build Status Coverage Status

This CKAN plugin provides an API for accessing DC data. The python package dclab implements a client library (dclab.rtdc_dataset.fmt_dcor) to access this API. Shape-Out 2 offers a GUI via File - Load DCOR data.

This plugin implements:

  • The DCOR API for accessing DC datasets online (dcserv).

  • A background job that generates a condensed dataset after a resource has been created.

  • A background job that uploads the condensed dataset to the S3 object store. The temporary location of the condensed dataset that is created can be set by setting the ckanext.dc_serve.tmp_dir configuration option.

  • A route that makes the condensed dataset available via “/dataset/{id}/resource/{resource_id}/condensed.rtdc” (S3 object store data is made available via a redirect)

  • A route overriding the default route for downloading a resource via “/dataset/{id}/resource/{resource_id}/download/resource_name” (S3 object store data is made available via a redirect)

  • Extends the template to show a condensed resource download button

  • CLI:

    • add CKAN command run-jobs-dc-serve that runs all background jobs for all resources (if not already done)

  • Configuration keywords:

    • the ckanext.dc_serve.create_condensed_datasets boolean parameter can be set to False to prevent DCOR from generating condensed resource files

    • ckanext.dc_serve.tmp_dir specifies the location of a directory used for creating temporary files when condensing datasets; if not specified, a temporary directory is used

Installation

pip install ckanext-dc_serve

Add this extension to the plugins and defaul_views in ckan.ini:

ckan.plugins = [...] dc_serve

Testing

Testing is implemented via GitHub Actions. You may also set up a local docker container with CKAN and MinIO. Take a look at the GitHub Actions workflow for more information.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ckanext_dc_serve-0.17.2.tar.gz (750.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ckanext_dc_serve-0.17.2-py3-none-any.whl (751.1 kB view details)

Uploaded Python 3

File details

Details for the file ckanext_dc_serve-0.17.2.tar.gz.

File metadata

  • Download URL: ckanext_dc_serve-0.17.2.tar.gz
  • Upload date:
  • Size: 750.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.9.22

File hashes

Hashes for ckanext_dc_serve-0.17.2.tar.gz
Algorithm Hash digest
SHA256 747b8766d10ae16232c57e470485bd5471b9d362c06c51cbeadbf5266d1fdc79
MD5 0e1d0b281cd47abeefb4e25ad0e81010
BLAKE2b-256 2a8a1877300f947c692d15bcba718554c10e440bdd9ab2b1db135f63a65d37f7

See more details on using hashes here.

File details

Details for the file ckanext_dc_serve-0.17.2-py3-none-any.whl.

File metadata

File hashes

Hashes for ckanext_dc_serve-0.17.2-py3-none-any.whl
Algorithm Hash digest
SHA256 0e9a974cc9c9c2dfc2ebd346e185b8e30336422d7259e4cc2ad5fb6fbbdedaa8
MD5 c02c89623bdfed4cb0d2b94da8e3cddb
BLAKE2b-256 bcc4e85ca87007845576bde85517b94719d03257a8d3f5c9896ec0c7da33d479

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page