Skip to main content

Singer target for data.world

Project description

A Singer target that writes data to data.world

How to use it

target-datadotworld works together with any other Singer Tap to move data from sources like SalesForce, HubSpot, Marketo, MySQL and more to data.world.

Install and Run

First, make sure Python 3.6 is installed on your system.

target-datadotworld can be run with any Singer Tap, but we’ll use tap-fixerio which pulls currency exchange rate data - as an example.

These commands will install tap-fixerio and target-datadotworld with pip, and then run them together, piping the output of tap-fixerio to target-datadotworld:

? pip install target-datadotworld tap-fixerio
? tap-fixerio | target-datadotworld -c config.json
INFO Replicating the latest exchange rate data from fixer.io
INFO Tap exiting normally

The data will be written to the dataset specified in config.json. In this specific case, under a stream named exchange-rates.

If you’re using a different Tap, substitute tap-fixerio in the final command above to the command used to run your Tap.

Configuration

target-datadotworld requires configuration file that is used to store your data.world API token, dataset information and other additional configuration.

The following attributes are required:

  • api_token: Your data.world API token

  • dataset_id: The title of the dataset where the data is to be stored. Must only contain lowercase letters, numbers, and dashes.

Additionally, the following optional attributes can be provided. They determine the parameters for creating a new dataset if dataset_id refers to a dataset that doesn’t yet exist:

  • dataset_title: Text with no more than 60 characters

  • dataset_visibility: OPEN or PRIVATE

  • dataset_license: Public Domain, PDDL, CC-0, CC-BY, ODC-BY, CC-BY-SA, ODC-ODbL, CC BY-NC, CC BY-NC-SA or Other

  • dataset_owner: If not the same as the owner of the API token (e.g. if the dataset is to be created under an organization account, as opposed to the user’s own)

Example:

{
    "api_token": "your_token",
    "dataset_id": "fixerio-data",
    "dataset_title": "Fixerio Data",
    "dataset_license": "Other",
    "dataset_owner": "my-company",
    "dataset_visibility": "PRIVATE"
}

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

target-datadotworld-1.0.0b1.tar.gz (13.8 kB view hashes)

Uploaded Source

Built Distribution

target_datadotworld-1.0.0b1-py2.py3-none-any.whl (16.0 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page