Delpha Database Management System
Project description
DelphaDBManagement
Management API for Delpha to work around Data inside the Cassandra Cluster
This repository is python based yet, to be open to other languages (Java, JavaScript, ...) Module to handle DB Managmenet on our Cassandra Cluster.
Security Objectives
Need a really secure way to handle data :
Private Keys will be generated by Delpha only and will be stored inside an authentication table inside Cassandra. Users will need to match a given private key to access the DBMS. This key will be bound to the dedicated organisation, and only one Private Key will be tagged as Admin and unlock all the DBMS access.
Installation
Requirements
Python : >3.8
Install Dependencies
Common
pip install -r requirements.txt
Salesforce Manager
Salesforce Data Manager using Salesforce API.
- Parameter : instance_name: Salesforce Instance name
- Parameter : client_id: Consumer ID for authorized app
- Parameter : client_secret: Consumer Secret for authorized app
- Parameter : username: usernam to login to Instance of Salesforce
- Parameter : param password: password to login to Instance of Salesforce
- Parameter : param security_token: User's security token
sf_manager = SalesforceManager(instance_name, consumer_key, consumer_secret, salesforce_username, salesforce_pwd, personnal_token)
sf_manager.help()
res, size = sf_manager.query("SELECT Name from Contact")
Cassandra Manager
Cassandra Database manager : CassandraManager.
- Parameter : username: String Cassandra username to connect
- Parameter : password: String password username to connect
- Parameter : pem_file_path: String path of the .pem file to use for 2FA connection
- Parameter : key_space: String session keyspace to set for the Cluster
cass_cluster = CassandraManager(username, password, key_file_path, "delpha_actions")
cass_cluster.execute("SELECT * FROM actions_conv_by_user").all()
Dictionnary part of Cassandra Database manager : DictionaryManager.
manager = DictionaryManager(cass_cluster)
manager.list_tables
['keyspace1', 'keyspace2', ...]
AWS Manager
Delpha AWS data Handler (AppFlows) : AWSManager.
- Parameter : key: String AWS key
- Parameter : secret: String AWS secret
- Parameter : flow_type: String Flow type to handle ['contact', 'account']
- Parameter : region: String AWS region
handler = AWSManager(aws_key_id, aws_secret, 'contact') #Setup contact Flow (contact dataset)
df = handler.get_flow_parquet_data()
flow_status, flow_last_execution_record = handler.start_flow(flow_name) #Start flow on AWS side
handler.ensure_spark_format(flow_name) #Check if data is in right format (.parquet)
handler.get_last_flow_id(flow_name) #Get last folder Name in bucket for specific flow.
How to - Pip publish package
python setup.py sdist bdist_wheel
twine upload dist/*
License
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for delpha_db_manager-1.1.4-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 931992aa14d65ae19b1d631119f2db466fe6d7c135ef277e329feb08099bfb50 |
|
MD5 | 0d59e709586b391aeff923157819d6cb |
|
BLAKE2b-256 | ce38d8bfbdef0778bdc05e8fdee6dbd6a523c76d7237ce5fc9c4d659b3f51900 |