Singer tap for DBF files

Navigation

Verified details

These details have been verified by PyPI
Project links
GitHub Statistics
Maintainers
Avatar for edgarrm92 from gravatar.com edgarrm92

Unverified details

These details have not been verified by PyPI
Meta
Classifiers

Project description

tap-dbf

Singer tap for the dBase file format.

Configuration

Setting Required Default Description
path True None Glob expression where the files are located. Stream names will be extracted from the file name.
fs_root False file:// The root of the filesystem to read from.
ignore_missing_memofile False 0 Whether to proceed reading the file even if the memofile is not present.
s3 False None S3 configuration.
s3.key False None The AWS key ID.
s3.secret False None The AWS secret key.
s3.endpoint_url False None The S3 endpoint URL.
gcs False None GCS configuration.
gcs.token False None OAuth 2.0 token for GCS.
stream_maps False None Config object for stream maps capability. For more information check out Stream Maps.
stream_map_config False None User-defined config values to be used within map expressions.
faker_config False None Config for the Faker instance variable fake used within map expressions. Only applicable if the plugin specifies faker as an addtional dependency (through the singer-sdk faker extra or directly).
faker_config.seed False None Value to seed the Faker generator for deterministic output: https://faker.readthedocs.io/en/master/#seeding-the-generator
faker_config.locale False None One or more LCID locale strings to produce localized output for: https://faker.readthedocs.io/en/master/#localization
flattening_enabled False None 'True' to enable schema flattening and automatically expand nested properties.
flattening_max_depth False None The max depth to flatten schemas.
batch_config False None
batch_config.encoding False None Specifies the format and compression of the batch files.
batch_config.encoding.format False None Format to use for batch files.
batch_config.encoding.compression False None Compression format to use for batch files.
batch_config.storage False None Defines the storage layer to use when writing batch files
batch_config.storage.root False None Root path to use when writing batch files.
batch_config.storage.prefix False None Prefix to use when writing batch files.

JSON example

{
  "path": "tests/data/files/*.dbf",
  "ignore_missing_memofile": true
}

Filesystems

Local

Example configuration:

{
  "path": "/files/*.dbf",
  "fs_root": "file://data",
  "ignore_missing_memofile": true
}

The fs_root key is optional and defaults to the current working directory:

{
  "path": "data/files/*.dbf",
  "ignore_missing_memofile": true
}

S3

You need to install the package with the s3 extra:

pip install 'tap-dbf[s3]'

Example configuration:

{
  "path": "/*.dbf",
  "fs_root": "s3://files",
  "ignore_missing_memofile": true,
  "s3": {
    "key": "someKey",
    "secret": "someSecret",
    "endpoint_url": "http://localhost:9000"
  }
}

Google Cloud Storage

You need to install the package with the gcs extra:

pip install 'tap-dbf[gcs]'

Example configuration:

{
  "path": "/*.dbf",
  "fs_root": "gcs://files",
  "ignore_missing_memofile": true,
  "gcs": {
    "token": "cloud"
  }
}

See https://gcsfs.readthedocs.io/en/latest/#credentials for more information about the token key.

Roadmap

  • Google Drive filesystem
  • Dropbox filesystem

Project details

Verified details

These details have been verified by PyPI
Project links
GitHub Statistics
Maintainers
Avatar for edgarrm92 from gravatar.com edgarrm92

Unverified details

These details have not been verified by PyPI
Meta
Classifiers

Release history Release notifications | RSS feed

This version

0.1.15

0.1.14

0.1.13

0.1.12

0.1.11

0.1.10

0.1.9

0.1.8

0.1.7

0.1.6

0.1.5

0.1.4

0.1.3

0.1.2

0.1.2a1 pre-release

0.1.1

0.1.1a3 pre-release

0.1.0

0.1.0b2 pre-release

0.1.0b1 pre-release

0.0.2

0.0.1

0.0.1a2 pre-release

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tap_dbf-0.1.15.tar.gz (15.7 kB view details)

Uploaded Source

Built Distribution

tap_dbf-0.1.15-py3-none-any.whl (11.8 kB view details)

Uploaded Python 3

File details

Details for the file tap_dbf-0.1.15.tar.gz.

File metadata

  • Download URL: tap_dbf-0.1.15.tar.gz
  • Upload date:
  • Size: 15.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for tap_dbf-0.1.15.tar.gz
Algorithm Hash digest
SHA256 0c21f1963d1f2e3eaf247c680f256531a8934fbf88ce78ee1fdc412e656e2951
MD5 3f00db116ad589dd0cf13404b4eb5d11
BLAKE2b-256 9e54ad8b9b2dd22728e31d0dcbe1a0cbe5b486cab669a5ee6797e5e4d42e397c

See more details on using hashes here.

Provenance

The following attestation bundles were made for tap_dbf-0.1.15.tar.gz:

Publisher: release.yaml on edgarrmondragon/tap-dbf

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file tap_dbf-0.1.15-py3-none-any.whl.

File metadata

  • Download URL: tap_dbf-0.1.15-py3-none-any.whl
  • Upload date:
  • Size: 11.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for tap_dbf-0.1.15-py3-none-any.whl
Algorithm Hash digest
SHA256 da4ea30d11c516090494a9abb52ef1cbb1692d03da0f70ff5d02d15e50476ec6
MD5 afe59649711c31efe8d7e6309b37c2df
BLAKE2b-256 1da585067a6e090d53a2117c0b2ebab5d35ab791684eef66bdaf5e0d8503c660

See more details on using hashes here.

Provenance

The following attestation bundles were made for tap_dbf-0.1.15-py3-none-any.whl:

Publisher: release.yaml on edgarrmondragon/tap-dbf

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page