All connectors that are part of the Unstract platform
Project description
Unstract Connectors
This is Unstract's python package which helps connect to a number of different filesystems and databases.
Filesystems
Filesystems are supported with the help of fsspec libraries that provide a uniform interface to these connectors.
The following filesystems are supported
- Google Drive
- S3/Minio
- Unstract Cloud Storage
- Box
- Dropbox (issues exist around file discovery/listing)
- HTTP(S)
Databases
The following databases are supported
- Snowflake
- PostgreSQL
- MySQL
- MSSQL
- Redshift
- MariaDB
- BigQuery
Installation
Local Development
To get started with local development,
- Create and source a virtual environment if you haven't already following these steps.
- If you're using Mac, install the below library needed for PyMSSQL
brew install pkg-config freetds
- Install the required dependencies with
pdm install
Environment variables
If the GCSHelper is used, the following environment variables need to be set
- GOOGLE_SERVICE_ACCOUNT : The service account JSON to perform authentication with Google Cloud Storage account.
- GOOGLE_PROJECT_ID : The project ID associated with the Google Cloud Storage account.
Running tests
TODO: Use a test framework and document way to run tests
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
unstract_connectors-0.0.1.tar.gz
(18.7 kB
view hashes)
Built Distribution
Close
Hashes for unstract_connectors-0.0.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0ab70829f3028d5ff588308a60a1829090f4ceb227a2b42926903cb103d190df |
|
MD5 | ca6a58c3f9a7a34a3df0310d8116a8c8 |
|
BLAKE2b-256 | e9c6354fd72702fdb0fc92ca49ad64e5368215c82773d44d7c3cd49e635acc69 |
Close
Hashes for unstract_connectors-0.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6a53ab35412454772694c633c72060e24fd9d91febcbb379e90ec6dbe820751d |
|
MD5 | f613397f5ed6d76bbef5774976fbcf97 |
|
BLAKE2b-256 | 07b0533bc6e623b323de73bc980be7982aca40f83a707776288f3d287a94ea66 |