Skip to main content
Join the official 2019 Python Developers SurveyStart the survey!

A Python library to upload and download data from database systems

Project description

SnowPy

Current release: SnowPy [v0.1.2]

'SnowPy' is a Python package providing a set of user-friendly functions to help upload and download data from database systems such as Microsoft SQL Server, Snowflake, (more to come). 'SnowPy' intially realsed as data tools for the mltoolkit project (https://mltoolkit.github.io/MLToolKit).

Introduction

SnowPy is a Python library to upload and download data from database system

Installation

pip install SnowPy

If the installation failed with dependancy issues, execute the above command with --no-dependencies

pip install SnowPy --no-dependencies

Functions

Usage

import snowpy

Warning: Python Variable, Function or Class names

The Python interpreter has a number of built-in functions. It is possible to overwrite thier definitions when coding without any rasing a warning from the Python interpriter. (https://docs.python.org/3/library/functions.html) Therfore, AVOID THESE NAMES as your variable, function or class names.

absallanyasciibinboolbytearraybytes
callablechrclassmethodcompilecomplexdelattrdictdir
divmodenumerateevalexecfilterfloatformatfrozenset
getattrglobalshasattrhashhelphexidinput
intisinstanceissubclassiterlenlistlocalsmap
maxmemoryviewminnextobjectoctopenord
powprintpropertyrangereprreversedroundset
setattrslicesortedstaticmethodstrsumsupertuple
typevarszip__import__

If you accedently overwrite any of the built-in function (e.g. list), execute the following to bring built-in defition.

del(list)

Functions

|- MSSQL
| |- execute_mssql_query
| |- read_data_mssql
| |- write_data_mssql
| |- read_data_mssql_bcp
| |- write_data_mssql_bcp
|- MySQL
|  |- To be integrated...
|- Snowflake
|  |- execute_snowflake_sql_query
|  |- read_data_snowflake
|  |- write_data_snowflake
|- CSV
|  |- read_data_csv
|  |- write_data_csv

SnowPy Example

# to be posted

Data Loading

# to be posted

License

Copyright 2019 Sumudu Tennakoon

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.

Cite as

@misc{SnowPy2019,
  author =  "Sumudu Tennakoon",
  title = "SnowPy: A Python library to upload and download data from database systems",
  year = 2019,
  publisher = "GitHub",
  howpublished = {\url{https://mltoolkit.github.io/SnowPy/}},
  version = "0.1.0"
}

SnowPy Project Timeline

2018-07-02 [v0.0.1]: Initialte MLToolKit project. 2019-07-02 [v0.0.1]: Snowpy functions first released as etl tools for MLToolKit project (https://mltoolkit.github.io/MLToolKit/). 2019-07-02 [v0.1.0]: First Release of SnowPy as seperate package. 2019-11-11 [v0.1.1]: Bug Fixes and enhancements 2019-11-16 [v0.1.2]: Bug Fixes, Integrate MSSQL BCP support

Future Release Plan

TBD [v0.1.5]: Integrate Data Exchage Server. TBD [v0.1.6]: Integrate MySQL support. TBD [v0.1.7]: Comprehensive Documentation

References

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for snowpy, version 0.1.2
Filename, size File type Python version Upload date Hashes
Filename, size snowpy-0.1.2-py3-none-any.whl (14.7 kB) File type Wheel Python version py3 Upload date Hashes View hashes
Filename, size snowpy-0.1.2.tar.gz (11.8 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page