Sinapsis Data Tools
Mono repo with packages to read, write, process data, including images, audios, videos, bytes objects. The packages can be easily extensible to handle other types of data.
🐍 Installation • 📦 Packages • 📚 Usage example • 📙 Documentation • 🔍 License
🐍 Installation
This mono repo consists of different packages to handle data:
sinapsis-data-analysissinapsis-data-readerssinapsis-data-visualizationsinapsis-data-writerssinapsis-generic-data-tools
Install using your package manager of choice. We encourage the use of uv
Example with uv:
uv pip install sinapsis-data-readers --extra-index-url https://pypi.sinapsis.tech
or with raw pip:
pip install sinapsis-data-readers --extra-index-url https://pypi.sinapsis.tech
Change the name of the package for the one you want to install.
with uv:
uv pip install sinapsis-data-readers[all] --extra-index-url https://pypi.sinapsis.tech
or with raw pip:
pip install sinapsis-data-readers[all] --extra-index-url https://pypi.sinapsis.tech
Change the name of the package accordingly.
uv pip install sinapsis-data-tools[all] --extra-index-url https://pypi.sinapsis.tech
apt-get install -y ffmpeg
📦 Packages
Packages summary
-
Sinapsis Data Readers
- Audio Readers
Read audio files from several formats using Pydub, Soundfile, among others. - Dataset Readers
Read and manipulate tabular datasets from the scikit libraries, among others. - Image Readers
Read and manipulate images from COCO, paths in CSVs, whole folders, etc. - Text Readers
Read text data from a simple string and other sources. - Video Readers
Read videoframes using CV2, Dali, FFMPEG, Torch, among others.
- Audio Readers
-
Sinapsis Data Visualization
Visualize data distributions and manifolds, as well as draw all kinds of annotations on images, such as bounding boxes, keypoints, labels, oriented bounding boxes, segmentation masks, etc. -
Sinapsis Data Writers
Write data to many kinds of files.- Annotation Writers
Save text annotations to JSON, geometries to polygons, etc. - Audio Writers
Save to audio files using Soundfile, among others. - Image Writers Save to image files using CV2, among others.
- Video Writers
Save to video files using CV2 or FFMPEG, among others.
- Annotation Writers
-
Sinapsis Generic Data Tools
Wide range of miscellaneous tools to manipulate your data.
For example, for ImageSaver use sinapsis info --example-template-config ImageSaver to produce the following example config:
agent:
name: my_test_agent
description: agent to save image locally
templates:
- template_name: InputTemplate
class_name: InputTemplate
attributes: {}
- template_name: ImageSaver
class_name: ImageSaver
template_input: InputTemplate
attributes:
save_dir: /path/to/save/dir
extension: jpg
root_dir: '/path/to/sinapsis/cache'
save_full_image: true
save_bbox_crops: false
save_mask_crops: false
min_bbox_dim: 5
📚 Usage example
Example agent config
You can copy and paste the following config and run it using the sinapsis cli, changing thedata_dir attribute in the FolderImageDatasetCV2 and the root_dir attribute in the ImageSaver template
agent:
name: my_test_agent
description: agent to save image locally
templates:
- template_name: InputTemplate
class_name: InputTemplate
attributes: {}
- template_name: FolderImageDatasetCV2
class_name: FolderImageDatasetCV2
attributes:
data_dir: /path/to/image
pattern: '**/*'
batch_size: 1
load_on_init: true
label_path_index: 0
is_ground_truth: false
- template_name: ImageSaver
class_name: ImageSaver
template_input: FolderImageDatasetCV2
attributes:
save_dir: /path/to/save/dir
extension: jpg
root_dir: '/path/to/sinapsis/cache'
save_full_image: true
save_bbox_crops: false
save_mask_crops: false
min_bbox_dim: 5
To run, simply use:
sinapsis run name_of_the_config.yml
📙 Documentation
Documentation for this and other sinapsis packages is available on the sinapsis website
Tutorials for different projects within sinapsis are available at sinapsis tutorials page
🔍 License
This project is licensed under the AGPLv3 license, which encourages open collaboration and sharing. For more details, please refer to the LICENSE file.
For commercial use, please refer to our official Sinapsis website for information on obtaining a commercial license.
1 maintainer
Metadata
1 maintainer
Release files for sinapsis-data-tools 0.2.31
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| sinapsis_data_tools-0.2.31.tar.gz | 95.3 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| sinapsis_data_tools-0.2.31-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 244.1 kB
Release files / sinapsis_data_tools-0.2.31.tar.gz
| Download URL | sinapsis_data_tools-0.2.31.tar.gz |
|---|---|
| Size | 95.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
20511c88366b519d6664685989c5eb06cd48917ea7124e0b56064c1aca0f21f0
|
|
BLAKE2b-256 checksum How to use checksums |
3d27063cef02bdf3e206ed73c2f61f05686a18fc1d1a4aa7f76688e4936502f0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.5.16
|
Release files / sinapsis_data_tools-0.2.31-py3-none-any.whl
| Download URL | sinapsis_data_tools-0.2.31-py3-none-any.whl |
|---|---|
| Size | 148.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
38c77190cf35036cb92a0d455a546777ac579f02271c5dda8719644ac3e74178
|
|
BLAKE2b-256 checksum How to use checksums |
0b8232a99798e502d364332677c626dfcd4105e3c03f20cb785f865f1b2451ce
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.5.16
|
