django-mysql 0.2.4

Extensions to Django for use with MySQL/MariaDB

The dolphin-pony - proof that cute + cute = double cute.

Django-MySQL is a non-inventively named package that helps you use some MySQL/MariaDB-specific features in the world of Django.

What kind of features?

Includes:

• QuerySet extensions - ‘smart’ iteration, approx_count for quick estimates of count(), query hints, quick pt-visual-explain of the underlying query

• Model fields for storing lists and sets in comma-separated strings, with the ability to query them

• ORM expressions for MySQL-specific functions

• A new cache backend that makes use of MySQL’s upserts and does compression

• Handler API for quicker-than-SQL reads using the ‘NoSQL’ HANDLER commands

• Status variable inspection and utility methods

• Named locks for easy locking of e.g. external resources

• Table lock manager for hard to pull off data migrations

To see them all, check out the exposition at http://django-mysql.readthedocs.org/en/latest/exposition.html .

Requirements

Tested with all combinations of:

• Python: 2.7, 3.4

• Django: 1.7, 1.8, master

• MySQL: 5.5, 5.6 / MariaDB: 5.5, 10.0, 10.1

• mysqlclient: 1.3.6 (Python 3 compatible version of MySQL-python)

Any combination of these should be good, and also MySQL-python should work since it’s just an older version of mysqlclient.

History

0.2.4 (pending release)

• Pending release

0.2.3 (2015-10-12)

• Allow approx_count on QuerySets for which only query hints have been used

• Added index query hints to QuerySet methods, via query-rewriting layer

• Added ordering parameter to GroupConcat to specify the ORDER BY clause

• Added index query hints to QuerySet methods, via query-rewriting layer

• Added sql_calc_found_rows() query hint that calculates the total rows that match when you only take a slice, which becomes available on the found_rows attribute

• Made SmartChunkedIterator work with reverse()’d QuerySets

0.2.2 (2015-09-03)

• SmartChunkedIterator now takes an argument chunk_size as the initial chunk size

• SmartChunkedIterator now allows models whose primary key is a ForeignKey

• Added iter_smart_pk_ranges which is similar to iter_smart_chunks but yields only the start and end primary keys for each chunks, in a tuple.

• Added prefix methods to MySQLCache - delete_with_prefix, get_with_prefix, keys_with_prefix

• Added Bit1BooleanField and NullBit1BooleanField model fields that work with boolean fields built by other databases that use the BIT(1) column type

0.2.1 (2015-06-22)

• Added Regexp database functions for MariaDB - RegexpInstr, RegexpReplace, and RegexpSubstr

• Added the option to not limit the size of a MySQLCache by setting MAX_ENTRIES = -1.

• MySQLCache performance improvements in get, get_many, and has_key

• Added query-rewriting layer added which allows the use of MySQL query hints such as STRAIGHT_JOIN via QuerySet methods, as well as adding label comments to track where queries are generated.

• Added TableLock context manager

0.2.0 (2015-05-14)

• More database functions added - Field and its complement ELT, and LastInsertId

• Case sensitive string lookup added as to the ORM for CharField and TextField

• Migration operations added - InstallPlugin, InstallSOName, and AlterStorageEngine

• Extra ORM aggregates added - BitAnd, BitOr, and BitXor

• MySQLCache is now case-sensitive. If you are already using it, an upgrade ALTER TABLE and migration is provided at the end of the cache docs.

• (MariaDB only) The Lock class gained a class method held_with_prefix to query held locks matching a given prefix

• SmartIterator bugfix for chunks with 0 objects slowing iteration; they such chunks most often occur on tables with primary key “holes”

• Now tested against Django master for cutting edge users and forwards compatibility

0.1.10 (2015-04-30)

• Added the MySQLCache backend for use with Django’s caching framework, a more efficient version of DatabaseCache

• Fix a ZeroDivision error in WeightedAverageRate, which is used in smart iteration

0.1.9 (2015-04-20)

• pt_visual_explain no longer executes the given query before fetching its EXPLAIN

• New pt_fingerprint function that wraps the pt-fingerprint tool efficiently

• For List fields, the new ListF class allows you to do atomic append or pop operations from either end of the list in a single query

• For Set fields, the new SetF class allows you to do atomic add or remove operatiosn from the set in a single query

• The @override_mysql_variables decorator has been introduced which makes testing code with different MySQL configurations easy

• The is_mariadb property gets added onto Django’s MySQL connection class automatically

• A race condition in determining the minimum and maximum primary key values for smart iteration was fixed.

0.1.8 (2015-03-31)

• Add Set and List fields which can store comma-separated sets and lists of a base field with MySQL-specific lookups

• Support MySQL’s GROUP_CONCAT as an aggregate!

• Add a functions module with many MySQL-specific functions for the new Django 1.8 database functions feature

• Allow access of the global and session status for the default connection from a lazy singleton, similar to Django’s connection object

• Fix a different recursion error on count_tries_approx

0.1.7 (2015-03-25)

• Renamed connection_name argument to using on Lock, GlobalStatus, and SessionStatus classes, for more consistency with Django.

• Fix recursion error on QuerySetMixin when using count_tries_approx

0.1.6 (2015-03-21)

• Added support for HANDLER statements as a QuerySet extension

• Now tested on Django 1.8

• Add pk_range argument for ‘smart iteration’ code

0.1.5 (2015-03-11)

• Added manage.py command dbparams for outputting database paramters in formats useful for shell scripts

0.1.4 (2015-03-10)

• Fix release process

0.1.3 (2015-03-08)

• Added pt_visual_explain integration on QuerySet

• Added soundex-based field lookups for the ORM

0.1.2 (2015-03-01)

• Added get_many to GlobalStatus

• Added wait_until_load_low to GlobalStatus which allows you to wait for any high load on your database server to dissipate.

• Added smart iteration classes and methods for QuerySets that allow efficient iteration over very large sets of objects slice-by-slice.

0.1.1 (2015-02-23)

• Added Model and QuerySet subclasses which add the approx_count method

0.1.0 (2015-02-12)

• First release on PyPI

• Locks

• GlobalStatus and SessionStatus