iaparc_inference
The IA Parc inference plugin allows developers to easily integrate their inference pipeline into IA Parc's production module.
Installation
pip install iaparc-inference
Usage
-
If your inference pipeline support batching:
from iaparc_inference import IAPListener # Define a callback to query your inference pipeline # To load your model only once it is recommended to use a class: class MyModel: def __init__(self, model_path: str): ## Load your model in pytorch, tensorflow or any other backend def batch_query(batch: list, parameters: Optional) -> list: ''' execute your pipeline on a batch input Note: "parameters" is an optional argument. It can be used to handle URL's query parameters It's a list of key(string)/value(string) dictionaries ''' if __name__ == '__main__': # Initiate your model class my_model = MyModel("path/to/my/model") # Initiate IAParc listener listener = IAPListener(my_model.batch_query) # Start the listener listener.run()
-
If your inference pipeline do not support batching:
from iaparc_inference import IAPListener # Define a callback to query your inference pipeline # To load your model only once it is recommended to use a class: class MyModel: def __init__(self, model_path: str): ## Load your model in pytorch, tensorflow or any other backend def single_query(one_input, parameters: Optional): ''' execute your pipeline on a single input Note: "parameters" is an optional argument. It can be used to handle URL's query parameters It's a key(string)/value(string) dictionary ''' if __name__ == '__main__': # Initiate your model class my_model = MyModel("path/to/my/model") # Initiate IAParc listener listener = IAPListener(my_model.single_query, batch=1) # Note that batch size is forced to 1 here # Start the listener listener.run()
Features
- Dynamic batching
- Autoscalling
- Support both synchronous and asynchronous queries
- Data agnostic
License
This project is licensed under the Apache License Version 2.0 - see the Apache LICENSE file for details.
1 maintainer
Metadata
1 maintainer
Release files for iaparc-inference 0.6.5
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| iaparc_inference-0.6.5.tar.gz | 17.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| iaparc_inference-0.6.5-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 37.0 kB
Release files / iaparc_inference-0.6.5.tar.gz
| Download URL | iaparc_inference-0.6.5.tar.gz |
|---|---|
| Size | 17.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
424ce2a41d081cd05a65782319c7311198b8f0723d1b17adb627202ce992c3ae
|
|
BLAKE2b-256 checksum How to use checksums |
0300fc25f7d380d3f49de73ff34c945eadf92f9dc3c18a7cf5755d20bb6167d5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.10.16
|
Release files / iaparc_inference-0.6.5-py3-none-any.whl
| Download URL | iaparc_inference-0.6.5-py3-none-any.whl |
|---|---|
| Size | 19.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
5cf6a4c93a42ecbfa0452868fd50f41b09149771411210baead10eddb464ae70
|
|
BLAKE2b-256 checksum How to use checksums |
04f6613cc0fbad838d77c815d2750184d8ddb34bcc65b2fee71b2052785a1559
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.10.16
|
