Mocking framework for Exasol Python UDFs
Project description
UDF Mock for Python
This projects provides a mock runner for Python3 UDFs which allows you to test your UDFs locally without a database.
Note: This project is in a very early development phase. Please, be aware that the behavior of the mock runner doesn't perfectly reflect the behaviors of the UDFs inside the database and that the interface still can change. In any case, you need to verify your UDFs with integrations test inside the database.
Getting started
Attention: We changed the default branch to main and the master branch is deprecated.
Installing via pip
pip install exasol-udf-mock-python
Installing via poetry
Add it to your tool.poetry.dependencies
or tool.poetry.dev-dependencies
[tool.poetry.dev-dependencies]
exasol-udf-mock-python = "^0.1.0"
...
How to use the Mock
The mock runner runs your python UDF in a python environment in which no external variables, functions or classes are visble. This means in practice, you can only use things you defined inside your UDF and what gets provided by the UDF frameworks, such as exa.meta and the context for the run function. This includes imports, variables, functions, classes and so on.
You define a UDF in this framework within in a wrapper function.
This wrapper function then contains all necessary imports, functions,
variables and classes.
You then handover the wrapper function to the UDFMockExecutor
which runs the UDF inside if the isolated python environment.
The following example shows, how you use this framework:
The following example shows the general setup for a test with the Mock:
def udf_wrapper():
def run(ctx):
return ctx.t1+1, ctx.t2+1.1, ctx.t3+"1"
executor = UDFMockExecutor()
meta = MockMetaData(
script_code_wrapper_function=udf_wrapper,
input_type="SCALAR",
input_columns=[Column("t1", int, "INTEGER"),
Column("t2", float, "FLOAT"),
Column("t3", str, "VARCHAR(20000)")],
output_type="RETURNS",
output_columns=[Column("t1", int, "INTEGER"),
Column("t2", float, "FLOAT"),
Column("t3", str, "VARCHAR(20000)")]
)
exa = MockExaEnvironment(meta)
result = executor.run([Group([(1,1.0,"1"), (5,5.0,"5"), (6,6.0,"6")])], exa)
Checkout the tests for more information about, how to use the Mock.
Limitations or missing features
Some of the following limitations are fundamental, other are missing feature and might get removed by later releases:
- Data type checks for outputs are more strict as in real UDFs
- No support for Import or Export Specification or Virtual Schema adapter
- No support for dynamic input and output parameters
- No support for exa.import_script
- No BucketFS
- Execution is not isolated in a container
- Can access and manipulate the file system of the system running the Mock
- UDF inside of the database only can write /tmp to tmp and only see the file system of the script-language container and the mounted bucketfs
- Can use all python package available in the system running the Mock
- If you use package which are currently not available in the script-language containers, you need create your own container for testing inside of the database
- Does not emulate the ressource limitations which get a applied in the database
- Can access and manipulate the file system of the system running the Mock
- Only one instance of the UDF gets executed
- No support for Python2, because Python2 is officially End of Life
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file exasol_udf_mock_python-0.3.0.tar.gz
.
File metadata
- Download URL: exasol_udf_mock_python-0.3.0.tar.gz
- Upload date:
- Size: 11.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.2.2 CPython/3.10.12 Linux/6.5.0-1025-azure
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | d8a39504aabd3d9e3e5e7c6f2771cf14181f1fc09d8095115be68df0ced562cf |
|
MD5 | 5e135d1600409d6d1e0ad95d37495920 |
|
BLAKE2b-256 | 13789a7ac7fca2bcc24f132c6dfdc4f5e9e45dc409aa221ee4278558f5b80762 |
File details
Details for the file exasol_udf_mock_python-0.3.0-py3-none-any.whl
.
File metadata
- Download URL: exasol_udf_mock_python-0.3.0-py3-none-any.whl
- Upload date:
- Size: 13.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.2.2 CPython/3.10.12 Linux/6.5.0-1025-azure
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | a5c59b5ecbb4efc700d5b35ebda2415b69da42a33bbf9feba377e95a3535bb94 |
|
MD5 | ba11402bc2dee7a58c8ef6c708b35126 |
|
BLAKE2b-256 | d05339fccc4c5353866822a1f11042e6449bb377bee8ec395dc7bc0451554949 |