Skip to main content

Serialization/De-serialization Support for the SQLAlchemy Declarative ORM

SQLAthanor - Serialization/De-serialization for SQLAlchemy

Branch

Unit Tests

latest

Build Status (Travis CI) Code Coverage Status (Codecov) Documentation Status (ReadTheDocs)

v.0.7

Build Status (Travis CI) Code Coverage Status (Codecov) Documentation Status (ReadTheDocs)

v.0.6

Build Status (Travis CI) Code Coverage Status (Codecov) Documentation Status (ReadTheDocs)

v.0.5

Build Status (Travis CI) Code Coverage Status (Codecov) Documentation Status (ReadTheDocs)

v.0.4

Build Status (Travis CI) Code Coverage Status (Codecov) Documentation Status (ReadTheDocs)

v.0.3

Build Status (Travis CI) Code Coverage Status (Codecov) Documentation Status (ReadTheDocs)

v.0.2

Build Status (Travis CI) Code Coverage Status (Codecov) Documentation Status (ReadTheDocs)

v.0.1

Build Status (Travis CI) Code Coverage Status (Codecov) Documentation Status (ReadTheDocs)

develop

Build Status (Travis CI) Code Coverage Status (Codecov) Documentation Status (ReadTheDocs)

SQLAthanor is a Python library that extends SQLAlchemy’s fantastic Declarative ORM to provide easy-to-use record serialization/de-serialization with support for:

  • JSON

  • CSV

  • YAML

  • Python dict

The library works as a drop-in extension - change one line of existing code, and it should just work. Furthermore, it has been extensively tested on Python 2.7, 3.4, 3.5, 3.6, 3.7, and 3.8 using SQLAlchemy 0.9 and higher.

COMPLETE DOCUMENTATION: http://sqlathanor.readthedocs.org/en/latest/index.html


Installation

To install SQLAthanor, just execute:

$ pip install sqlathanor

Dependencies

Python 3.x

Python 2.7

* SQLAlchemy v.0.9 or higher
* PyYAML v3.10 or higher
* simplejson v3.0 or higher
* SQLAlchemy v.0.9 or higher
* PyYAML v3.10 or higher
* simplejson v3.0 or higher

Why SQLAthanor?

Odds are you’ve used SQLAlchemy before. And if you haven’t, why on earth not? It is hands down the best relational database toolkit and Object Relational Mapper (ORM) available for Python, and has helped me quickly write code for many APIs, software platforms, and data science projects. Just look at some of these great features.

As its name suggests, SQLAlchemy focuses on the problem of connecting your Python code to an underlying relational (SQL) database. That’s a super hard problem, especially when you consider the complexity of abstraction, different SQL databases, different SQL dialects, performance optimization, etc. It ain’t easy, and the SQLAlchemy team has spent years building one of the most elegant solutions out there.

But as hard as Pythonically communicating with a database is, in the real world with microservices, serverless architectures, RESTful APIs and the like we often need to do more with the data than read or write from/to our database. In almost all of the projects I’ve worked on over the last two decades, I’ve had to:

  • hand data off in some fashion (serialize) for another program (possibly written by someone else in another programming language) to work with, or

  • accept and interpret data (de-serialize) received from some other program (possibly written by someone else in another programming language).

Python objects (pickled or not) are great, but they’re rarely the best way of transmitting data over the wire, or communicating data between independent applications. Which is where formats like JSON, CSV, and YAML come in.

So when writing many Python APIs, I found myself writing methods to convert my SQLAlchemy records (technically, model instances) into JSON or creating new SQLAlchemy records based on data I received in JSON. So after writing similar methods many times over, I figured a better approach would be to write the serialization/de-serialization code just once, and then re-use it across all of my various projects.

Which is how SQLAthanor came about.

It adds simple methods like to_json(), new_from_csv(), and update_from_csv() to your SQLAlchemy declarative models and provides powerful configuration options that give you tons of flexibility.

Key SQLAthanor Features

  • Easy to adopt: Just tweak your existing SQLAlchemy import statements and you’re good to go.

  • With one method call, convert SQLAlchemy model instances to:

    • CSV records

    • JSON objects

    • YAML objects

    • Python dict objects (technically, OrderedDict objects but they behave just like dict)

  • With one method call, create or update SQLAlchemy model instances from:

    • Python dict or OrderedDict objects

    • CSV records

    • JSON objects

    • YAML objects

  • Decide which serialization formats you want to support for which models.

  • Decide which columns/attributes you want to include in their serialized form (and pick different columns for different formats, too).

  • Default validation for de-serialized data for every SQLAlchemy data type.

  • Customize the validation used when de-serializing particular columns to match your needs.

  • Works with Declarative Reflection and the SQLAlchemy Automap extension.

  • Programmatically generate Declarative Base Models from serialized data.

  • Programmatically generate SQLAlchemy Table objects from serialized data.

SQLAthanor vs Alternatives

For a comparison of SQLAthanor to various alternative serialization/de-serialization approaches, please see full documentation: https://sqlathanor.readthedocs.io/en/latest/index.html#sqlathanor-vs-alternatives


Complete Documentation

SQLAthanor is a complex library that integrates with other complex libraries. We strongly recommend that you review our comprehensive documentation at:

https://sqlathanor.readthedocs.org/en/latest/index.html


Questions and Issues

You can ask questions and report issues on the project’s Github Issues Page


Contributing

We welcome contributions and pull requests! For more information, please see the Contributor Guide


Testing

We use TravisCI for our build automation, Codecov.io for our test coverage, and ReadTheDocs for our documentation.

Detailed information about our test suite and how to run tests locally can be found in our Testing Reference.


License

SQLAthanor is made available under an MIT License.

Metadata

Release files for sqlathanor 0.7.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for sqlathanor 0.7.0
File Size Uploaded
sqlathanor-0.7.0.tar.gz 58.5 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for sqlathanor 0.7.0
File Interpreter ABI Platform
sqlathanor-0.7.0-py2.py3-none-any.whl Python 3, Python 2 none any Details

Total release size: 124.9 kB

Release files / sqlathanor-0.7.0.tar.gz

Download URL sqlathanor-0.7.0.tar.gz
Size 58.5 kB
Tags Source
SHA-256 checksum
How to use checksums
301bd78ef7e56c02ed9f4a5795d9cc89d3c3a18c646b7c0dc42bd38d78264a11
BLAKE2b-256 checksum
How to use checksums
ef7edd5d85f262748a85a8be238f8b523a28969ec6c46e88b68b5c800090dc95
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.3.0 pkginfo/1.6.1 requests/2.25.1 setuptools/49.2.1 requests-toolbelt/0.9.1 tqdm/4.55.0 CPython/3.9.1

Release files / sqlathanor-0.7.0-py2.py3-none-any.whl

Download URL sqlathanor-0.7.0-py2.py3-none-any.whl
Size 66.4 kB
Tags Python 2 Python 3
SHA-256 checksum
How to use checksums
36cdb27e5eb688848259c3138c4f4ffbc4a9b60c281206419f96259bd2e915ab
BLAKE2b-256 checksum
How to use checksums
8e372134638bfb850d147b728a09e01ad4a8a9caecf730af4dd7c1abb48852e6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.3.0 pkginfo/1.6.1 requests/2.25.1 setuptools/49.2.1 requests-toolbelt/0.9.1 tqdm/4.55.0 CPython/3.9.1

Release history Release notifications | RSS feed

This release

0.7.0 This release

2 release files

0.6.0

2 release files

0.5.1

1 release file

0.5.0

1 release file

0.4.0

1 release file

0.3.1

1 release file

0.3.0

1 release file

0.2.2

1 release file

0.2.1

1 release file

0.2.0

1 release file

0.1.1

1 release file

0.1.0

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page