A database driver for Django to connect to an Informix db via ODBC
Project description
Django InformixDB
==================
A database driver for Django to connect to an Informix database via pyodbc.
**Some limitations**:
- Does not support default values
- Informix automatically creates indexes on foreign keys, but Django attempts to do that
manually; the current implementation here just attempts to catch the error on index
creation. It may unintentionally catch other index creation errors where the index
already exists.
Configure local environment
---------------------------
The following environment variables should exist:
INFORMIXDIR
The path to the Informix client install directory
INFORMIXSERVER
The name of the Informix service to which we need to connect
INFORMIXSQLHOSTS
The path to the ``sqlhosts`` file that the Informix driver should use
LD_LIBRARY_PATH
The path(s) to the various Informix library files: Usually
``$INFORIMIXDIR/lib:$INFORMIXDIR/lib/cli:$IMFORMIXDIR/lib/esql``
You will also need to add an entry within your ``sqlhosts`` file for each remote/local Informix
server connection in the following format::
<INFORMIX_SERVER_NAME> onsoctcp <INFORMIX_HOST_NAME> <INFORMIX_SERVICE_NAME>
For example::
dev onsoctcp localhost 9088
You may alternatively use a symbolic name in that line in place of the port number, typically ``sqlexec`` and
then configure the port number in the ``/etc/services`` file::
sqlexec 9088/tcp
Configure settings.py
---------------------
Django’s settings.py uses the following to connect to an Informix database:
.. code-block:: python
'default': {
'ENGINE': 'django_informixdb',
'NAME': 'myproject',
'SERVER': 'ifxserver',
'USER' : 'testuser',
'PASSWORD': 'passw0rd',
'OPTIONS': {
'DRIVER': '/path/to/iclit09b.so'. # Or iclit09b.dylib on macOS
'CPTIMEOUT': 120,
'ISOLATION_LEVEL': 'READ_UNCOMMITTED',
'LOCK_MODE_WAIT': 0,
},
'TEST': {
'NAME': 'myproject',
'CREATE_DB': False
}
}
CPTIMEOUT
This will set connection pooling timeout.
Possible values:
0 - Turn off connection pooling
nn - timeout set nn seconds
ISOLATION_LEVEL
This will set database isolation level at connection level
Possible values:
READ_COMMITED
READ_UNCOMMITTED
SERIALIZABLE
LOCK_MODE_WAIT
This will set database LOCK MODE WAIT at connection level
Application can use this property to override the default server
process for accessing a locked row or table.
The default value is 0 (do not wait for the lock).
Possible values:
-1 - WAIT until the lock is released.
0 - DO NOT WAIT, end the operation, and return with error.
nn - WAIT for nn seconds for the lock to be released.
.. note:
The ``DRIVER`` option is optional, default locations will be used per platform if it is not provided.
.. note:
The ``TEST`` option sets test parametes. Use ``NAME`` to override the name of the test database
and set ``CREATE_DB`` to ``False`` to prevent Django from attempting to create a new test
database.
Using with the Docker Informix Dev Database
-------------------------------------------
The docker image from IBM for the Informix developer database image behaves a little differently compared to other images. As such it needs a little extra handling, and doesn't seem to work with docker-compose
Firstly we need to download and getting it running:
.. code-block:: bash
$ docker run -itd --name iif_developer_edition --privileged -p 9088:9088 -p 9089:9089 -p 27017:27017 \
-p 27018:27018 -p 27883:27883 -e LICENSE=accept ibmcom/informix-developer-database:latest
This will download the image if it doesn't exist, and then run it with the name ``iif_developer_edition``. The first time this run, the image will do a bunch of initial setup stuff. As we used the ``-d`` option, it will run in the background as a detached process. So don't be concerned that you do not see anything in the output.
You can stop and restart the container with:
.. code-block:: bash
$ docker stop iif_developer_edition
$ docker start iif_developer_edition
It seems that the Informix ODBC driver does not currently support creating databases. So we will need to do
that manually, by attaching to the running container
.. code-block:: bash
$ docker attach iif_developer_edition
This will give you a shell on the running container, and you can therefore use dbaccess to create your database.
You can exit this shell using ``Ctrl-p`` ``Ctrl-q`` without shutting down the whole container.
This Django database adaptor for Informix requires transaction support to be enabled in our database.
This is not the default within the Informix Developer image. So you need to enable it on a per database basis:
.. code-block:: bash
$ docker attach iif_developer_edition
$ ontape -s -B <DB_NAME>
Again, you can detach using ``Ctrl-p`` ``Ctrl-q``.
Finally you need to ensure that our local dev database is included in the ``sqlhosts`` file. e.g.:
.. code-block:: bash
dev onsoctcp localhost 9088
You should now be able to point Django to our local test database using the syntax detailed above.
Using Django InformixDB with docker-compose
-------------------------------------------
It is possible to use the Informix developer docker image with docker-compose with a little effort.
Example docker-compose.yml
.. code-block:: yaml
version: '3'
services:
db:
image: ibmcom/informix-developer-database
tty: true # Needed to ensure container doesn't self terminate
environment:
LICENSE: accept
privileged: true
ports:
- "9088:9088"
- "9089:9089"
- "27017:27017"
- "27018:27018"
- "27883:27883"
The key entry in the compose file which is out of the ordinary is `tty: true`. This allocates a (virtual) TTY to the container. The Informix developer database container expects a `tty` and terminates without one when run inside docker-compose.
Once it is up and running with `docker-compose up` you can run a `bash` shell on the running container with:
.. code-block:: bash
docker exec -it informix_db_1 bash
Where `informix_db_1` is the name of the running container. From this shell you can create your DB with `dbaccess` etc.
.. warning::
This approach still requires the SDK to installed locally and the appropriate environmental variables to be set up. Along with entries in `sqlhosts` and `/etc/services`
Testing against an Informix Database
------------------------------------
Due to a bug in the Informix ODBC driver, it is not currently possible to run Django tests normally. Specifically, it is not possible for Django to create a test database. As such, you will need to do it manually. By default Django will attempt to create a database with a name equal to the default database name with a ``test_`` prefix. e.g. if you database name is ``my_database``, the test database name would be ``test_my_database``. This can be overridden with the ``NAME`` option under ``TEST``.
To prevent Django from attempting to create a test database, set the ``CREATE_DB`` option
under ``TEST`` to ``False``: see 'Configure settings.py' above.
You can follow the steps above, in the section on using Informix locally with Docker to create a test database. Then when running the test you can tell Django to re-use an existing database, rather than trying to create a new one with the ``-k`` parameter:
.. code-block:: bash
./manage.py test -k
For django_informixdb Developers
--------------------------------
To run the django_informixdb test suite, you need to set the INFORMIXDIR environment variable, and the tests
expect an Informix database at host "dev". Change that host in `test/testproject/settings.py` if you need to.
Then run the test suite with:
tox
This will run the tests under Django 1 and 2.
Release History
---------------
Version 1.2.0
- Fix bug in DecimalField handling under Django 2+
Version 1.1.0
- Added LOCK_MODE_WAIT option
Version 1.0.0
- Initial public release
==================
A database driver for Django to connect to an Informix database via pyodbc.
**Some limitations**:
- Does not support default values
- Informix automatically creates indexes on foreign keys, but Django attempts to do that
manually; the current implementation here just attempts to catch the error on index
creation. It may unintentionally catch other index creation errors where the index
already exists.
Configure local environment
---------------------------
The following environment variables should exist:
INFORMIXDIR
The path to the Informix client install directory
INFORMIXSERVER
The name of the Informix service to which we need to connect
INFORMIXSQLHOSTS
The path to the ``sqlhosts`` file that the Informix driver should use
LD_LIBRARY_PATH
The path(s) to the various Informix library files: Usually
``$INFORIMIXDIR/lib:$INFORMIXDIR/lib/cli:$IMFORMIXDIR/lib/esql``
You will also need to add an entry within your ``sqlhosts`` file for each remote/local Informix
server connection in the following format::
<INFORMIX_SERVER_NAME> onsoctcp <INFORMIX_HOST_NAME> <INFORMIX_SERVICE_NAME>
For example::
dev onsoctcp localhost 9088
You may alternatively use a symbolic name in that line in place of the port number, typically ``sqlexec`` and
then configure the port number in the ``/etc/services`` file::
sqlexec 9088/tcp
Configure settings.py
---------------------
Django’s settings.py uses the following to connect to an Informix database:
.. code-block:: python
'default': {
'ENGINE': 'django_informixdb',
'NAME': 'myproject',
'SERVER': 'ifxserver',
'USER' : 'testuser',
'PASSWORD': 'passw0rd',
'OPTIONS': {
'DRIVER': '/path/to/iclit09b.so'. # Or iclit09b.dylib on macOS
'CPTIMEOUT': 120,
'ISOLATION_LEVEL': 'READ_UNCOMMITTED',
'LOCK_MODE_WAIT': 0,
},
'TEST': {
'NAME': 'myproject',
'CREATE_DB': False
}
}
CPTIMEOUT
This will set connection pooling timeout.
Possible values:
0 - Turn off connection pooling
nn - timeout set nn seconds
ISOLATION_LEVEL
This will set database isolation level at connection level
Possible values:
READ_COMMITED
READ_UNCOMMITTED
SERIALIZABLE
LOCK_MODE_WAIT
This will set database LOCK MODE WAIT at connection level
Application can use this property to override the default server
process for accessing a locked row or table.
The default value is 0 (do not wait for the lock).
Possible values:
-1 - WAIT until the lock is released.
0 - DO NOT WAIT, end the operation, and return with error.
nn - WAIT for nn seconds for the lock to be released.
.. note:
The ``DRIVER`` option is optional, default locations will be used per platform if it is not provided.
.. note:
The ``TEST`` option sets test parametes. Use ``NAME`` to override the name of the test database
and set ``CREATE_DB`` to ``False`` to prevent Django from attempting to create a new test
database.
Using with the Docker Informix Dev Database
-------------------------------------------
The docker image from IBM for the Informix developer database image behaves a little differently compared to other images. As such it needs a little extra handling, and doesn't seem to work with docker-compose
Firstly we need to download and getting it running:
.. code-block:: bash
$ docker run -itd --name iif_developer_edition --privileged -p 9088:9088 -p 9089:9089 -p 27017:27017 \
-p 27018:27018 -p 27883:27883 -e LICENSE=accept ibmcom/informix-developer-database:latest
This will download the image if it doesn't exist, and then run it with the name ``iif_developer_edition``. The first time this run, the image will do a bunch of initial setup stuff. As we used the ``-d`` option, it will run in the background as a detached process. So don't be concerned that you do not see anything in the output.
You can stop and restart the container with:
.. code-block:: bash
$ docker stop iif_developer_edition
$ docker start iif_developer_edition
It seems that the Informix ODBC driver does not currently support creating databases. So we will need to do
that manually, by attaching to the running container
.. code-block:: bash
$ docker attach iif_developer_edition
This will give you a shell on the running container, and you can therefore use dbaccess to create your database.
You can exit this shell using ``Ctrl-p`` ``Ctrl-q`` without shutting down the whole container.
This Django database adaptor for Informix requires transaction support to be enabled in our database.
This is not the default within the Informix Developer image. So you need to enable it on a per database basis:
.. code-block:: bash
$ docker attach iif_developer_edition
$ ontape -s -B <DB_NAME>
Again, you can detach using ``Ctrl-p`` ``Ctrl-q``.
Finally you need to ensure that our local dev database is included in the ``sqlhosts`` file. e.g.:
.. code-block:: bash
dev onsoctcp localhost 9088
You should now be able to point Django to our local test database using the syntax detailed above.
Using Django InformixDB with docker-compose
-------------------------------------------
It is possible to use the Informix developer docker image with docker-compose with a little effort.
Example docker-compose.yml
.. code-block:: yaml
version: '3'
services:
db:
image: ibmcom/informix-developer-database
tty: true # Needed to ensure container doesn't self terminate
environment:
LICENSE: accept
privileged: true
ports:
- "9088:9088"
- "9089:9089"
- "27017:27017"
- "27018:27018"
- "27883:27883"
The key entry in the compose file which is out of the ordinary is `tty: true`. This allocates a (virtual) TTY to the container. The Informix developer database container expects a `tty` and terminates without one when run inside docker-compose.
Once it is up and running with `docker-compose up` you can run a `bash` shell on the running container with:
.. code-block:: bash
docker exec -it informix_db_1 bash
Where `informix_db_1` is the name of the running container. From this shell you can create your DB with `dbaccess` etc.
.. warning::
This approach still requires the SDK to installed locally and the appropriate environmental variables to be set up. Along with entries in `sqlhosts` and `/etc/services`
Testing against an Informix Database
------------------------------------
Due to a bug in the Informix ODBC driver, it is not currently possible to run Django tests normally. Specifically, it is not possible for Django to create a test database. As such, you will need to do it manually. By default Django will attempt to create a database with a name equal to the default database name with a ``test_`` prefix. e.g. if you database name is ``my_database``, the test database name would be ``test_my_database``. This can be overridden with the ``NAME`` option under ``TEST``.
To prevent Django from attempting to create a test database, set the ``CREATE_DB`` option
under ``TEST`` to ``False``: see 'Configure settings.py' above.
You can follow the steps above, in the section on using Informix locally with Docker to create a test database. Then when running the test you can tell Django to re-use an existing database, rather than trying to create a new one with the ``-k`` parameter:
.. code-block:: bash
./manage.py test -k
For django_informixdb Developers
--------------------------------
To run the django_informixdb test suite, you need to set the INFORMIXDIR environment variable, and the tests
expect an Informix database at host "dev". Change that host in `test/testproject/settings.py` if you need to.
Then run the test suite with:
tox
This will run the tests under Django 1 and 2.
Release History
---------------
Version 1.2.0
- Fix bug in DecimalField handling under Django 2+
Version 1.1.0
- Added LOCK_MODE_WAIT option
Version 1.0.0
- Initial public release
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
django_informixdb-1.2.0.tar.gz
(22.1 kB
view details)
File details
Details for the file django_informixdb-1.2.0.tar.gz
.
File metadata
- Download URL: django_informixdb-1.2.0.tar.gz
- Upload date:
- Size: 22.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/39.0.1 requests-toolbelt/0.8.0 tqdm/4.23.4 CPython/3.6.5
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | cda2e876035b35bff1c70153b3a73a55dcb9d46a97f0f21ac55755b205d67c48 |
|
MD5 | 655fad732b02b9b96d621aca39f6e256 |
|
BLAKE2b-256 | a87eadc813a4a9ea0540763cf4051b4abefe81ff5257eca839bfb70f88a1a2e4 |