Skip to main content

PynamoDB

https://img.shields.io/pypi/v/pynamodb.svg https://img.shields.io/travis/pynamodb/PynamoDB/master.svg https://img.shields.io/coveralls/pynamodb/PynamoDB/master.svg

A Pythonic interface for Amazon’s DynamoDB that supports Python 2 and 3.

DynamoDB is a great NoSQL service provided by Amazon, but the API is verbose. PynamoDB presents you with a simple, elegant API.

Useful links:

Installation

From PyPi:

$ pip install pynamodb

From GitHub:

$ pip install git+https://github.com/pynamodb/PynamoDB#egg=pynamodb

Upgrading

The following steps can be used to safely update PynamoDB assuming that the data stored in the item’s UnicodeSetAttribute is not JSON. If JSON is being stored, these steps will not work and a custom migration plan is required. Be aware that values such as numeric strings (i.e. “123”) are valid JSON.

When upgrading services that use PynamoDB with tables that contain UnicodeSetAttributes with a version < 1.6.0, first deploy version 1.5.4 to prepare the read path for the new serialization format.

Once all services that read from the tables have been deployed, then deploy version 2.2.0 and migrate your data using the provided convenience methods on the Model. (Note: these methods are only available in version 2.2.0)

def get_save_kwargs(item):
    # any conditional args needed to ensure data does not get overwritten
    # for example if your item has a `version` attribute
    {'version__eq': item.version}

# Re-serialize all UnicodeSetAttributes in the table by scanning all items.
# See documentation of fix_unicode_set_attributes for rate limiting options
# to avoid exceeding provisioned capacity.
Model.fix_unicode_set_attributes(get_save_kwargs)

# Verify the migration is complete
print("Migration Complete? " + Model.needs_unicode_set_fix())

Once all data has been migrated then upgrade to a version >= 3.0.1.

Basic Usage

Create a model that describes your DynamoDB table.

from pynamodb.models import Model
from pynamodb.attributes import UnicodeAttribute

class UserModel(Model):
    """
    A DynamoDB User
    """
    class Meta:
        table_name = "dynamodb-user"
    email = UnicodeAttribute(null=True)
    first_name = UnicodeAttribute(range_key=True)
    last_name = UnicodeAttribute(hash_key=True)

PynamoDB allows you to create the table if needed (it must exist before you can use it!):

UserModel.create_table(read_capacity_units=1, write_capacity_units=1)

Create a new user:

user = UserModel("John", "Denver")
user.email = "djohn@company.org"
user.save()

Now, search your table for all users with a last name of ‘John’ and whose first name begins with ‘D’:

for user in UserModel.query("John", first_name__begins_with="D"):
    print(user.first_name)

Examples of ways to query your table with filter conditions:

for user in UserModel.query("John", filter_condition= (UserModel.email=="djohn@company.org")):
    print(user.first_name)
for user in UserModel.query("John", UserModel.email=="djohn@company.org"):
    print(user.first_name)
# Deprecated, use UserModel.email=="djohn@company.org" instead
for user in UserModel.query("John", email__eq="djohn@company.org"):
    print(user.first_name)

Retrieve an existing user:

try:
    user = UserModel.get("John", "Denver")
    print(user)
except UserModel.DoesNotExist:
    print("User does not exist")

Advanced Usage

Dax usage

from pynamodb.models import Model
from pynamodb.indexes import GlobalSecondaryIndex, AllProjection
from pynamodb.attributes import NumberAttribute, UnicodeAttribute

class UserModel(Model):
    """
    A DynamoDB User
    """
    class Meta:
        table_name = "dynamodb-user"
        dax_read_endpoints = ['xxxx:8111']
        dax_write_endpoints = ['xxxx:8111']
    email = UnicodeAttribute(null=True)
    first_name = UnicodeAttribute(range_key=True)
    last_name = UnicodeAttribute(hash_key=True)

Want to use indexes? No problem:

from pynamodb.models import Model
from pynamodb.indexes import GlobalSecondaryIndex, AllProjection
from pynamodb.attributes import NumberAttribute, UnicodeAttribute

class ViewIndex(GlobalSecondaryIndex):
    class Meta:
        read_capacity_units = 2
        write_capacity_units = 1
        projection = AllProjection()
    view = NumberAttribute(default=0, hash_key=True)

class TestModel(Model):
    class Meta:
        table_name = "TestModel"
    forum = UnicodeAttribute(hash_key=True)
    thread = UnicodeAttribute(range_key=True)
    view = NumberAttribute(default=0)
    view_index = ViewIndex()

Now query the index for all items with 0 views:

for item in TestModel.view_index.query(0):
    print("Item queried from index: {0}".format(item))

It’s really that simple.

Want to use DynamoDB local? Just add a host name attribute and specify your local server.

from pynamodb.models import Model
from pynamodb.attributes import UnicodeAttribute

class UserModel(Model):
    """
    A DynamoDB User
    """
    class Meta:
        table_name = "dynamodb-user"
        host = "http://localhost:8000"
    email = UnicodeAttribute(null=True)
    first_name = UnicodeAttribute(range_key=True)
    last_name = UnicodeAttribute(hash_key=True)

Want to enable streams on a table? Just add a stream_view_type name attribute and specify the type of data you’d like to stream.

from pynamodb.models import Model
from pynamodb.attributes import UnicodeAttribute
from pynamodb.constants import STREAM_NEW_AND_OLD_IMAGE

class AnimalModel(Model):
    """
    A DynamoDB Animal
    """
    class Meta:
        table_name = "dynamodb-user"
        host = "http://localhost:8000"
        stream_view_type = STREAM_NEW_AND_OLD_IMAGE
    type = UnicodeAttribute(null=True)
    name = UnicodeAttribute(range_key=True)
    id = UnicodeAttribute(hash_key=True)

Want to backup and restore a table? No problem.

# Backup the table
UserModel.dump("usermodel_backup.json")

# Restore the table
UserModel.load("usermodel_backup.json")

Features

  • Python 3.3, 3.4, 2.6, and 2.7 support

  • An ORM-like interface with query and scan filters

  • Compatible with DynamoDB Local

  • Supports the entire DynamoDB API

  • Full table backup/restore

  • Support for Unicode, Binary, JSON, Number, Set, and UTC Datetime attributes

  • Support for Global and Local Secondary Indexes

  • Provides iterators for working with queries, scans, that are automatically paginated

  • Automatic pagination for bulk operations

  • Complex queries

  • Support for Global and Local Secondary Indexes

  • Batch operations with automatic pagination

  • Iterators for working with Query and Scan operations

Metadata

Release files for pynamodb-dax 0.0.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pynamodb-dax 0.0.2
File Size Uploaded
pynamodb-dax-0.0.2.tar.gz 101.3 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for pynamodb-dax 0.0.2
File Interpreter ABI Platform
pynamodb_dax-0.0.2-py2.py3-none-any.whl Python 3, Python 2 none any Details

Total release size: 209.4 kB

Release files / pynamodb-dax-0.0.2.tar.gz

Download URL pynamodb-dax-0.0.2.tar.gz
Size 101.3 kB
Tags Source
SHA-256 checksum
How to use checksums
151222f63fa8e4c76d4e0e93124c374e3c4ca5297872f227732cbde48afdff43
BLAKE2b-256 checksum
How to use checksums
67c0e9ba7d7f9abc8b49ba025e8c410e3a49dedb38a8e962e14ca419b708d062
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.2.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/46.1.3.post20200330 requests-toolbelt/0.9.1 tqdm/4.47.0 CPython/3.8.2

Release files / pynamodb_dax-0.0.2-py2.py3-none-any.whl

Download URL pynamodb_dax-0.0.2-py2.py3-none-any.whl
Size 108.1 kB
Tags Python 2 Python 3
SHA-256 checksum
How to use checksums
a39eddd671960314aebc5a1d8bdbf7aab08ee88b9a6e93cd3765924e1073f6c0
BLAKE2b-256 checksum
How to use checksums
7a2d19284f96e5970771c0bb65996ffdc6aa12108c7f57c85c8629f2f6cf25ce
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.2.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/46.1.3.post20200330 requests-toolbelt/0.9.1 tqdm/4.47.0 CPython/3.8.2

Release history Release notifications | RSS feed

0.0.6

2 release files

0.0.5

2 release files

0.0.4

2 release files

0.0.3

2 release files

This release

0.0.2 This release

2 release files

0.0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page