Skip to main content

SQL for Humans

Project description

Records: SQL for Humans™

https://img.shields.io/pypi/v/records.svg https://travis-ci.org/kennethreitz/records.svg?branch=master https://img.shields.io/badge/SayThanks.io-☼-1EAEDB.svg

Records is a very simple, but powerful, library for making raw SQL queries to most relational databases.

https://farm1.staticflickr.com/569/33085227621_7e8da49b90_k_d.jpg

Just write SQL. No bells, no whistles. This common task can be surprisingly difficult with the standard tools available. This library strives to make this workflow as simple as possible, while providing an elegant interface to work with your query results.

Database support includes RedShift, Postgres, MySQL, SQLite, Oracle, and MS-SQL (drivers not included).


☤ The Basics

We know how to write SQL, so let’s send some to our database:

import records

db = records.Database('postgres://...')
rows = db.query('select * from active_users')    # or db.query_file('sqls/active-users.sql')

Grab one row at a time:

>>> rows[0]
<Record {"username": "model-t", "active": true, "name": "Henry Ford", "user_email": "model-t@gmail.com", "timezone": "2016-02-06 22:28:23.894202"}>

Or iterate over them:

for r in rows:
    print(r.name, r.user_email)

Values can be accessed many ways: row.user_email, row['user_email'], or row[3].

Fields with non-alphanumeric characters (like spaces) are also fully supported.

Or store a copy of your record collection for later reference:

>>> rows.all()
[<Record {"username": ...}>, <Record {"username": ...}>, <Record {"username": ...}>, ...]

If you’re only expecting one result:

>>> rows.first()
<Record {"username": ...}>

Other options include rows.as_dict() and rows.as_dict(ordered=True).

☤ Features

  • Iterated rows are cached for future reference.

  • $DATABASE_URL environment variable support.

  • Convenience Database.get_table_names method.

  • Command-line records tool for exporting queries.

  • Safe parameterization: Database.query('life=:everything', everything=42).

  • Queries can be passed as strings or filenames, parameters supported.

  • Transactions: t = Database.transaction(); t.commit().

  • Bulk actions: Database.bulk_query() & Database.bulk_query_file().

Records is proudly powered by SQLAlchemy and Tablib.

☤ Data Export Functionality

Records also features full Tablib integration, and allows you to export your results to CSV, XLS, JSON, HTML Tables, YAML, or Pandas DataFrames with a single line of code. Excellent for sharing data with friends, or generating reports.

>>> print(rows.dataset)
username|active|name      |user_email       |timezone
--------|------|----------|-----------------|--------------------------
model-t |True  |Henry Ford|model-t@gmail.com|2016-02-06 22:28:23.894202
...

Comma Separated Values (CSV)

>>> print(rows.export('csv'))
username,active,name,user_email,timezone
model-t,True,Henry Ford,model-t@gmail.com,2016-02-06 22:28:23.894202
...

YAML Ain’t Markup Language (YAML)

>>> print(rows.export('yaml'))
- {active: true, name: Henry Ford, timezone: '2016-02-06 22:28:23.894202', user_email: model-t@gmail.com, username: model-t}
...

JavaScript Object Notation (JSON)

>>> print(rows.export('json'))
[{"username": "model-t", "active": true, "name": "Henry Ford", "user_email": "model-t@gmail.com", "timezone": "2016-02-06 22:28:23.894202"}, ...]

Microsoft Excel (xls, xlsx)

with open('report.xls', 'wb') as f:
    f.write(rows.export('xls'))

Pandas DataFrame

>>> rows.export('df')
    username  active       name        user_email                   timezone
0    model-t    True Henry Ford model-t@gmail.com 2016-02-06 22:28:23.894202

You get the point. All other features of Tablib are also available, so you can sort results, add/remove columns/rows, remove duplicates, transpose the table, add separators, slice data by column, and more.

See the Tablib Documentation for more details.

☤ Installation

Of course, the recommended installation method is pipenv:

$ pipenv install records[pandas]
✨🍰✨

☤ Command-Line Tool

As an added bonus, a records command-line tool is automatically included. Here’s a screenshot of the usage information:

Screenshot of Records Command-Line Interface.

☤ Thank You

Thanks for checking this library out! I hope you find it useful.

Of course, there’s always room for improvement. Feel free to open an issue so we can make Records better, stronger, faster.

v0.5.1 (09-01-2017)

  • Depend on tablib[pandas].

  • Support for Bulk quies: Database.bulk_query() & Database.bulk_query_file().

v0.5.0 (11-15-2016)

  • Support for transactions: t = Database.transaction(); t.commit()

v0.4.3 (02-16-2016)

  • The cake is a lie.

v0.4.2 (02-15-2016)

  • Packaging fix.

v0.4.1 (02-15-2016)

  • Bugfix for Python 3.

v0.4.0 (02-13-2016)

  • Refactored to be fully powered by SQLAlchemy!

  • Support for all major databases (thanks, SQLAlchemy!).

  • Support for non-alphanumeric column names.

  • New Record class, for representing/accessing result rows.

  • ResultSet renamed RecordCollection.

  • Removed Interactive Mode from the CLI.

v0.3.0 (02-11-2016)

  • New record command-line tool available!

  • Various improvements.

v0.2.0 (02-10-2016)

  • Results are now represented as Record, a namedtuples class with dict-like qualities.

  • New ResultSet.export method, for exporting to various formats.

  • Slicing a ResultSet now works, and results in a new ResultSet.

  • Lots of bugfixes and improvements!

v0.1.0 (02-07-2016)

  • Initial release.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

records_csp-0.5.3.1.tar.gz (11.0 kB view details)

Uploaded Source

Built Distribution

records_csp-0.5.3.1-py3-none-any.whl (10.0 kB view details)

Uploaded Python 3

File details

Details for the file records_csp-0.5.3.1.tar.gz.

File metadata

  • Download URL: records_csp-0.5.3.1.tar.gz
  • Upload date:
  • Size: 11.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.8.13

File hashes

Hashes for records_csp-0.5.3.1.tar.gz
Algorithm Hash digest
SHA256 4fb37fbf1ee4251fe232ef225507e68a35d2515834b654517f93f575db0e5aa7
MD5 d892af979f1839a4e3b4656d55abbd76
BLAKE2b-256 67ee0c2ba4cf5cb9478cd92d68147e19d8e9d341796209334d91dfc6c5c1044c

See more details on using hashes here.

File details

Details for the file records_csp-0.5.3.1-py3-none-any.whl.

File metadata

File hashes

Hashes for records_csp-0.5.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 14dfe3e98dcdb93bc9a071eb6d647a409cdd4edc4abf3da55718c5b6a670fa4b
MD5 6889eabddd1413ea5ff5e87713442c12
BLAKE2b-256 389aae70d8627b5aca4d86177c4a35f41aeb029047b7cc3f11acf98a2991e124

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page