All connectors that are part of the Unstract platform
Project description
Unstract Connectors
This is Unstract's python package which helps connect to a number of different filesystems and databases.
Filesystems
Filesystems are supported with the help of fsspec libraries that provide a uniform interface to these connectors.
The following filesystems are supported
- Google Drive
- S3/Minio
- Unstract Cloud Storage
- Box
- Dropbox (issues exist around file discovery/listing)
- HTTP(S)
Databases
The following databases are supported
- Snowflake
- PostgreSQL
- MySQL
- MSSQL
- Redshift
- MariaDB
- BigQuery
Installation
Local Development
To get started with local development,
- Create and source a virtual environment if you haven't already following these steps.
- If you're using Mac, install the below library needed for PyMSSQL
brew install pkg-config freetds
- Install the required dependencies with
pdm install
Environment variables
If the GCSHelper is used, the following environment variables need to be set
- GOOGLE_SERVICE_ACCOUNT : The service account JSON to perform authentication with Google Cloud Storage account.
- GOOGLE_PROJECT_ID : The project ID associated with the Google Cloud Storage account.
Running tests
TODO: Use a test framework and document way to run tests
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
unstract_connectors-0.0.3.tar.gz
(18.5 kB
view hashes)
Built Distribution
Close
Hashes for unstract_connectors-0.0.3.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9a974a87449cd5df60f9bfacb5d6c41abe97e18b4b18a1a5d0220c85bb564527 |
|
MD5 | ef57d48f3ba59fa8cfa5294b11b5a930 |
|
BLAKE2b-256 | 315246fbf078fe92e0b6720118828c9be72edee2491ec09eefc754d15d32c1e9 |
Close
Hashes for unstract_connectors-0.0.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 91f49837580faf2241e22086661a8ea32dd0484d61fdf6e08176c371e8d01d8c |
|
MD5 | 75bebdbd0c3f4f4dec300816adc01992 |
|
BLAKE2b-256 | df46a889e7f374696dcd2fb93ad8a880e4f9601f5f77a2f1c6432e19fe960bb7 |