All connectors that are part of the Unstract platform
Project description
Unstract Connectors
This is Unstract's python package which helps connect to a number of different filesystems and databases.
Filesystems
Filesystems are supported with the help of fsspec libraries that provide a uniform interface to these connectors.
The following filesystems are supported
- Google Drive
- S3/Minio
- Unstract Cloud Storage
- Box
- Dropbox (issues exist around file discovery/listing)
- HTTP(S)
Databases
The following databases are supported
- Snowflake
- PostgreSQL
- MySQL
- MSSQL
- Redshift
- MariaDB
- BigQuery
Installation
Local Development
To get started with local development,
- Create and source a virtual environment if you haven't already following these steps.
- If you're using Mac, install the below library needed for PyMSSQL
brew install pkg-config freetds
- Install the required dependencies with
pdm install
Environment variables
If the GCSHelper is used, the following environment variables need to be set
- GOOGLE_SERVICE_ACCOUNT : The service account JSON to perform authentication with Google Cloud Storage account.
- GOOGLE_PROJECT_ID : The project ID associated with the Google Cloud Storage account.
Running tests
TODO: Use a test framework and document way to run tests
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
unstract_connectors-0.0.2.tar.gz
(19.3 kB
view hashes)
Built Distribution
Close
Hashes for unstract_connectors-0.0.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 83f27886b9c4590c4cca38406b06f3022cb65c15f8baee2745f0b027297f93a3 |
|
MD5 | 92823c799f30eb427e48da7e6fa87dc8 |
|
BLAKE2b-256 | 70b947f37c379034c60a1fab7433dca111866fb30cf9c1d81c16369414389aa2 |
Close
Hashes for unstract_connectors-0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1ebaf7e74bbcbf7480e14d721bf5dd5d2f4dd6d4c6672ca7eec6fe70289f8d1e |
|
MD5 | 44651e2179806ffb8dbfaead6d1de335 |
|
BLAKE2b-256 | 5212e69609da466897d6eb7cf855d397f7c908d393ac8bf006b3eafbeacfc3b2 |