GINO Is Not ORM - a Python asyncio ORM on SQLAlchemy core.
- Free software: BSD license
- Requires: Python 3.5
- Robust SQLAlchemy-asyncpg bi-translator with no hard hack
- Asynchronous SQLAlchemy-alike engine and connection
- Asynchronous dialect API
- Asynchronous-friendly CRUD objective models
- Well-considered contextual connection and transaction management
- Reusing native SQLAlchemy core to build queries with grammar sugars
- Support Sanic, Tornado and aiohttp
- Rich PostgreSQL JSONB support
pip install gino aiocontextvars
import asyncio from gino import Gino db = Gino() class User(db.Model): __tablename__ = 'users' id = db.Column(db.Integer(), primary_key=True) nickname = db.Column(db.Unicode(), default='noname') async def main(): await db.set_bind('postgresql://localhost/gino') # Create tables await db.gino.create_all() # Create object, `id` is assigned by database u1 = await User.create(nickname='fantix') print(u1.id, u1.nickname) # 1 fantix # Returns all user objects with "d" in their nicknames users = await User.query.where(User.nickname.contains('d')).gino.all() print(users) # [<User object>, <User object>] # Find one user object, None if not found user = await User.query.where(User.nickname == 'daisy').gino.first() print(user) # <User object> or None # Execute complex statement and return command status status, result = await User.update.values( nickname='No.' + db.cast(User.id, db.Unicode), ).where( User.id > 10, ).gino.status() print(status) # UPDATE 8 # Iterate over the results of a large query in a transaction as required async with db.transaction(): async for u in User.query.order_by(User.id).gino.iterate(): print(u.id, u.nickname) asyncio.get_event_loop().run_until_complete(main())
About The Name
About the name GINO Is Not ORM - because I don’t really like ORM (smile). GINO does perform the Object-Relational Mapping work under the Data Mapper Pattern, but it is just not a traditional ORM. The Objects in GINO are completely stateless from database - they are pure plain Python objects in memory. Changing their attribute values does not make them “dirty” - or in a different way of thinking they are always “dirty”. Any access to database must be explicitly executed. Using GINO is more like making up SQL clauses with Models and Objects, executing them to make changes in database, or loading data from database and wrapping the results with Objects again. Objects are just row data containers, you are still dealing with SQL which is represented by Models and SQLAlchemy core grammars. Besides if you don’t like ORM at all, you can use GINO without ORM:
import sqlalchemy as sa metadata = sa.MetaData() user = sa.Table( 'users', metadata, sa.Column('id', sa.BigInteger(), primary_key=True), sa.Column('nickname', sa.Unicode()), ) import gino async def main(): e = await gino.create_engine('postgresql://localhost/gino') users = await e.all(sa.select([user])) print(users) # prints something like this: # [(1, 'fantix'), (2, 'fantix'), (3, 'fantix'), (5, 'fantix')] import asyncio asyncio.get_event_loop().run_until_complete(main())
or a bit more GINO-ish:
from gino import Gino db = Gino() user = db.Table( 'users', db, db.Column('id', db.BigInteger(), primary_key=True), db.Column('nickname', db.Unicode()), ) async def main(): async with db.with_bind('postgresql://localhost/gino'): users = await db.select([user]).gino.all() print(users) import asyncio asyncio.get_event_loop().run_until_complete(main())
There are a few tasks in GitHub issues marked as help wanted. Please feel free to take any of them and pull requests are greatly welcome.
To run tests (please read more in CONTRIBUTING.rst):
$ python setup.py test
Meanwhile, these are also very much appreciated:
Projects using GINO
Credit goes to all contributors listed or not listed in the AUTHORS file. This project is inspired by asyncpgsa, peewee-async and asyncorm. asyncpg and SQLAlchemy as the dependencies did most of the heavy lifting. This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.
Special thanks to my wife Daisy and her outsourcing company DecentFoX Studio, for offering me the opportunity to build this project. We are open for global software project outsourcing on Python, iOS and Android development. And we are hiring!
This is also version 1.0 beta 3.
- Backported fix for custom JSON/JSONB type support (#402 #403)
- Updated library support (Contributed by Tony Wang in #275 #309)
- Added none_as_none() (#281 #282)
- Added ARRAY alias in asyncpg dialect module (Contributed by Mykyta Holubakha in #289)
- Added Model.lookup() to prevent updating whole table without primary key (#287 #288)
- Added DB_ECHO in extension options (Contributed by Mykyta Holubakha in #298)
- Fixed broken JSON/JSONB result processor since 0.5.8 (Contributed by Tony Wang in #291 #305)
- Removed bad rollback after a failing commit (Contributed by Tony Wang in #302 #304)
- Fixed to raise UninitializedError if bind is None (Contributed by Tony Wang in #307 #310)
- Added friendly error message when using abstract models by mistake (#224)
- Supported Python 3.7 (Contributed by Tony Wang in #265)
- Updated documentation
- Fixed a bug in TupleLoader (Contributed by Pavol Vargovcik in #279 #280)
- Added aiocontextvars as required dependency required for Python 3.5 and 3.6 (#228)
- Added Quart support (#213)
- Fixed Tornado options parsing (#231)
- Improve coding style and test coverage
- Fix for failing binary type (#225)
- Added prepared statement support (#14)
- Added dsn in extension config (Contributed by Yurii Shtrikker in #215)
- Added support for inline model constraints (Contributed by Kinware in #198)
- Added docs and tests for using SSL (#202)
- Added declared_attr (#204)
- Allowed ModelLoader passively load partial model (#216)
- Added Python 3.5 support (#187)
- Added support to use dict as ident for Model.get (#192)
- Added result loader (partial relationship support) (#13)
- Added documentation on relationship and transaction (#146)
This is also version 1.0 beta 2.
Migrating to GINO 0.6
1. Task Local
We created a new Python package aiocontextvars from previous local.py. If you made use of the task local features, you should install this package.
Previous gino.enable_task_local() and gino.disable_task_local() are replaced by aiocontextvars.enable_inherit() and aiocontextvars.disable_inherit(). However in GINO 0.5 they controls the whole task local feature switch, while aiocontextvars by default offers task local even without enable_inherit(), which controls whether the local storage should be passed between chained tasks. When enabled, it behaves the same as enabled in 0.5, but you cannot completely turn off the task local feature while aiocontextvars is installed.
There is no gino.get_local() and gino.reset_local() relevant in aiocontextvars. The similar thing is aiocontextvars.ContextVar instance through its get(), set() and delete() methods.
Previous gino.is_local_root() is now not aiocontextvars.Context.current().inherited.
GINO 0.6 hides asyncpg.Pool behind the new SQLAlchemy-alike gino.GinoEngine. Instead of doing this in 0.5:
async with db.create_pool('postgresql://...') as pool: # your code here
You should change it to this in 0.6:
async with db.with_bind('postgresql://...') as engine: # your code here
This equals to:
engine = await gino.create_engine('postgresql://...') db.bind = engine try: # your code here finally: db.bind = None await engine.close()
engine = await db.set_bind('postgresql://...') try: # your code here finally: await db.pop_bind().close()
Or even this:
db = await gino.Gino('postgresql://...') try: # your code here finally: await db.pop_bind().close()
Choose whichever suits you the best.
Obviously GinoEngine doesn’t provide asyncpg.Pool methods directly any longer, but you can get the underlying asyncpg.Pool object through engine.raw_pool property.
GinoPool.get_current_connection() is now changed to current_connection property on GinoEngine instances to support multiple engines.
GinoPool.execution_option is gone, instead update_execution_options() on GinoEngine instance is available.
GinoPool().metadata is gone, dialect is still available.
GinoPool.release() is removed in GinoEngine and Gino, the release() method on GinoConnection object should be used instead.
These methods exist both in 0.5 GinoPool and 0.6 GinoEngine: close(), acquire(), all(), first(), scalar(), status().
Similarly, GinoConnection in 0.6 is no longer a subclass of asyncpg.Connection, instead it has a asyncpg.Connection instance, accessable through GinoConnection.raw_connection property.
GinoConnection.metadata is deleted in 0.6, while dialect remained.
GinoConnection.execution_options() is changed from a mutable dict in 0.5 to a method returning a copy of current connection with the new options, the same as SQLAlchemy behavior.
GinoConnection.release() is still present, but its default behavior has been changed to permanently release this connection. You should add argument permanent=False to remain its previous behavior.
And all(), first(), scalar(), status(), iterate(), transaction() remained in 0.6.
4. Query API
All five query APIs all(), first(), scalar(), status(), iterate() now accept the same parameters as SQLAlchemy execute(), meaning they accept raw SQL text, or multiple sets of parameters for “executemany”. Please note, if the parameters are recognized as “executemany”, none of the methods will return anything. Meanwhile, they no longer accept the parameter bind if they did. Just use the API on the GinoEngine or GinoConnection object instead.
Transaction interface is rewritten. Now in 0.6, a GinoTransaction object is provided consistently from all 3 methods:
async with db.transaction() as tx: # within transaction async with engine.transaction() as tx: # within transaction async with engine.acquire() as conn: async with conn.transaction() as tx: # within transaction
And different usage with await:
tx = await db.transaction() try: # within transaction await tx.commit() except: await tx.rollback() raise
The GinoConnection object is available at tx.connection, while underlying transaction object from database driver is available at tx.transaction - for asyncpg it is an asyncpg.transaction.Transaction object.
- Backported a fix for failing binary type (#225)
- Abandoned 0.6.4 and keep 0.6.x stable
- Backported doc for transaction
Abandoned version, please use 0.7.0 instead.
- Added aiohttp support
- Added support for calling create() on model instances (Contributed by Kinware in #178 #180)
- Fixed get() by string, and misc environment issues (Contributed by Tony Wang in #191 193 #183 #184)
- Fixed SQLAlchemy prefetch issue (#141)
- Fixed issue that mixin class on Model not working (#174)
- Added more documentation (Thanks Olaf Conradi for reviewing)
- Fixed create and drop for Enum type (#160)
- A bit more documentation (#159)
- [Breaking] API Refactored, Pool replaced with Engine
- New API Engine replaced asyncpg Pool (#59)
- Supported different dialects, theoretically
- Used aiocontextvars instead of builtin task local (#89)
- [Breaking] Fixed query API with multiparams (executemany) to return correctly (#20)
- [Breaking] The query methods no longer accept the parameter bind
- [Breaking] Gino no longer exposes postgresql types
- Added echo on engine (#142)
- Added tests to cover 80% of code
- Added gino extension on SchemaItem for create_all and so on (#76 #106)
- Added gino extension on model classes for create() or drop()
- Added _update_request_cls on CRUDModel (#147)
- Rewrote the documentation (#146)
This is also version 1.0 beta 1.
- Preparing for 0.6.0 which will be a breaking release
- Fixed wrong value of Enum in creation (Contributed by Sergey Kovalev in #126)
This is an emergency fix for 0.5.6.
- Fixed broken lazy connection (Contributed by Ádám Barancsuk in #114)
- Added Model.outerjoin
- Changed to use unnamed statement when possible (#80 #90)
- Added more example (Contributed by Kentoseth in #109)
- Added Model.join and made Model selectable (Contributed by Ádám Barancsuk in #112 #113)
- Ensured clean connection if transaction acquire fails (Contributed by Vladimir Goncharov in #87)
- Added ability to reset local storage (#84)
- Fixed bug in JSON property update
- Added update chaining feature
- Updated example (Contributed by Kinware in #75)
- Added Model.insert (Contributed by Neal Wang in #63)
- Fixed issue that non-lazy acquiring fails dirty (#79)
- Fixed no module named cutils error (Contributed by Vladimir Goncharov in #73)
- Added missing driver name on dialect (#67)
- Fixed dialect to support native decimal type (#67)
This is an emergency fix for 0.5.0.
- Reverted the extension, back to pure Python (#60)
- Used SQLAlchemy RowProxy
- Added first_or_404
- Fixed bug that GinoPool cannot be inherited
- [Breaking] Internal refactor: extracted and isolated a few modules, partially rewritten
- Extracted CRUD operations
- Core operations are moved to dialect and execution context
- Removed guess_model, switched to explicit execution options
- Turned timeout parameter to an execution option
- Extracted pool, connection and api from asyncpg_delegate
- Added support for SQLAlchemy execution options, and a few custom options
- [Breaking] Made Model.select return rows by default (#39)
- Moved get_or_404 to extensions (#38)
- Added iterator on model classes (#43)
- Added Tornado extension (Contributed by Vladimir Goncharov)
- Added Model.to_dict (#47)
- Added an extension module to update asyncpg.Record with processed results
Early Development Releases
Considered as alpha releases.
- Support select on model instance
- Made get_or_404 more friendly when Sanic is missing (Contributed by Neal Wang in #23 #31)
- Delegated sqlalchemy.__all__ (Contributed by Neal Wang in #10 #33)
- [Breaking] Rewrote JSON/JSONB support (#29)
- Added lazy parameter on db.acquire (Contributed by Binghan Li in #32)
- Added Sanic integration (Contributed by Binghan Li, Tony Wang in #30 #32 #34)
- Fixed iterate API to be compatible with asyncpg (#32)
- Unified exceptions
- [Breaking] Changed update API (#29)
- Bug fixes
- Supported __table_args__ (#12)
- Introduced task local to manage connection in context (#19)
- Added query.gino extension for in-place execution
- Refreshed README (#3)
- Adopted PEP 487 (Contributed by Tony Wang in #17 #27)
- Used weakref on __model__ of table and query (Contributed by Tony Wang)
- Delegated asyncpg timeout parameter (Contributed by Neal Wang in #16 #22)
- Supported any primary key (Contributed by Tony Wang in #11)
- Supported SQLAlchemy result processor
- Added rich support on JSON/JSONB
- Bug fixes
- Added update and delete API
- Changed API, no longer reuses asyncpg API
- Added db.bind
- API changed: parameter conn renamed to optional bind
- Delegated asyncpg Pool with db.create_pool
- Internal enhancement and bug fixes
- First release on PyPI.
Release history Release notifications | RSS feed
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.