Skip to main content

Singer tap for DBF files

Project description

tap-dbf

Singer tap for the dBase file format.

Configuration

Setting Required Default Description
path True None Glob expression where the files are located. Stream names will be extracted from the file name.
fs_root False file:// The root of the filesystem to read from.
ignore_missing_memofile False 0 Whether to proceed reading the file even if the memofile is not present.
s3 False None S3 configuration.
s3.key False None The AWS key ID.
s3.secret False None The AWS secret key.
s3.endpoint_url False None The S3 endpoint URL.
gcs False None GCS configuration.
gcs.token False None OAuth 2.0 token for GCS.
stream_maps False None Config object for stream maps capability. For more information check out Stream Maps.
stream_map_config False None User-defined config values to be used within map expressions.
faker_config False None Config for the Faker instance variable fake used within map expressions. Only applicable if the plugin specifies faker as an addtional dependency (through the singer-sdk faker extra or directly).
faker_config.seed False None Value to seed the Faker generator for deterministic output: https://faker.readthedocs.io/en/master/#seeding-the-generator
faker_config.locale False None One or more LCID locale strings to produce localized output for: https://faker.readthedocs.io/en/master/#localization
flattening_enabled False None 'True' to enable schema flattening and automatically expand nested properties.
flattening_max_depth False None The max depth to flatten schemas.
batch_config False None
batch_config.encoding False None Specifies the format and compression of the batch files.
batch_config.encoding.format False None Format to use for batch files.
batch_config.encoding.compression False None Compression format to use for batch files.
batch_config.storage False None Defines the storage layer to use when writing batch files
batch_config.storage.root False None Root path to use when writing batch files.
batch_config.storage.prefix False None Prefix to use when writing batch files.

JSON example

{
  "path": "tests/data/files/*.dbf",
  "ignore_missing_memofile": true
}

Filesystems

Local

Example configuration:

{
  "path": "/files/*.dbf",
  "fs_root": "file://data",
  "ignore_missing_memofile": true
}

The fs_root key is optional and defaults to the current working directory:

{
  "path": "data/files/*.dbf",
  "ignore_missing_memofile": true
}

S3

You need to install the package with the s3 extra:

pip install 'tap-dbf[s3]'

Example configuration:

{
  "path": "/*.dbf",
  "fs_root": "s3://files",
  "ignore_missing_memofile": true,
  "s3": {
    "key": "someKey",
    "secret": "someSecret",
    "endpoint_url": "http://localhost:9000"
  }
}

Google Cloud Storage

You need to install the package with the gcs extra:

pip install 'tap-dbf[gcs]'

Example configuration:

{
  "path": "/*.dbf",
  "fs_root": "gcs://files",
  "ignore_missing_memofile": true,
  "gcs": {
    "token": "cloud"
  }
}

See https://gcsfs.readthedocs.io/en/latest/#credentials for more information about the token key.

Roadmap

  • Google Drive filesystem
  • Dropbox filesystem

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tap_dbf-0.1.25.tar.gz (171.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tap_dbf-0.1.25-py3-none-any.whl (11.8 kB view details)

Uploaded Python 3

File details

Details for the file tap_dbf-0.1.25.tar.gz.

File metadata

  • Download URL: tap_dbf-0.1.25.tar.gz
  • Upload date:
  • Size: 171.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for tap_dbf-0.1.25.tar.gz
Algorithm Hash digest
SHA256 2061a63314411865d37163d2f18fc830bac6a1fd21228f331d9bd9adae437f5f
MD5 e7a7a7c09c269bb1da1f9eb53a889b31
BLAKE2b-256 e9451596b96d2b1addda6b7464dfc48054f7f2efe588f89760fc8737ad320a19

See more details on using hashes here.

Provenance

The following attestation bundles were made for tap_dbf-0.1.25.tar.gz:

Publisher: release.yaml on reservoir-data/tap-dbf

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file tap_dbf-0.1.25-py3-none-any.whl.

File metadata

  • Download URL: tap_dbf-0.1.25-py3-none-any.whl
  • Upload date:
  • Size: 11.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for tap_dbf-0.1.25-py3-none-any.whl
Algorithm Hash digest
SHA256 505b6a5f5b53285d082635948b03c5e454463e892c24fec7774974394baf421b
MD5 5d686fd20005e6e0b417f64204ed79d7
BLAKE2b-256 4b8591671e352ad0d606f5cd2d6a82cc3c30c624ffcb9f1a05309aa50698beea

See more details on using hashes here.

Provenance

The following attestation bundles were made for tap_dbf-0.1.25-py3-none-any.whl:

Publisher: release.yaml on reservoir-data/tap-dbf

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page