Skip to main content

"A set of interop services to integrate and transfer data between different applications, model and storage technologies for the bclearer framework."

Project description

bclearer-interop-services

A set of I/O and interop connectors for the bclearer framework. It provides adapters to read and write data between in-memory “universe” representations and a variety of storage, file formats, and application services.

Installation

pip install bclearer-interop-services

Key Features

  • Dictionary Service Convert data to and from generic Python dictionaries (e.g., mapping objects to table dictionaries).
  • DataFrame Service Utilities for standardizing, filtering, merging, and converting Pandas (and PySpark) DataFrames.
  • Delimited Text Read/write CSV and other delimited formats.
  • Excel Services Import/export Excel (.xlsx) files.
  • JSON, XML, HDF5, Parquet Native serializers and readers for common data formats.
  • Relational Database Services Access MS Access, SQLite, and other RDBMS via SQL interfaces.
  • Document Store Services MongoDB and JSON file store support.
  • Graph Services Neo4j connector and network analysis utilities.
  • EA Interop Service COM-based, SQL, and XML import/export for Enterprise Architect models.
  • Session & Orchestration Helpers to manage connections, sessions, and orchestrate multi-step data flows.

Basic Usage

Below is a simple example using the Dictionary and DataFrame services:

from bclearer_interop_services.b_dictionary_service.table_as_dictionary_service import TableAsDictionaryFromCsvFileReader
from bclearer_interop_services.b_dictionary_service.table_as_dictionary_service import TableAsDictionaryToDataFrameConverter

# Read data from a CSV file into a table-as-dictionary
reader = TableAsDictionaryFromCsvFileReader()
table_dict = reader.read('data/example.csv')

# Convert the table-as-dictionary to a Pandas DataFrame
converter = TableAsDictionaryToDataFrameConverter()
df = converter.convert(table_dict)

# Standardize column names and filter rows using the DataFrame service
from bclearer_interop_services.dataframe_service.dataframe_helper import DataFrameHelper

helper = DataFrameHelper()
df = helper.standardize_column_names(df)
df_filtered = df[df['status'] == 'ACTIVE']

Documentation

Full documentation and examples can be found in the GitHub repository.

License

This project is licensed under the MIT License. See the LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bclearer_interop_services-0.3.8.tar.gz (588.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

bclearer_interop_services-0.3.8-py3-none-any.whl (1.0 MB view details)

Uploaded Python 3

File details

Details for the file bclearer_interop_services-0.3.8.tar.gz.

File metadata

  • Download URL: bclearer_interop_services-0.3.8.tar.gz
  • Upload date:
  • Size: 588.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.3 CPython/3.12.11 Linux/6.11.0-1015-azure

File hashes

Hashes for bclearer_interop_services-0.3.8.tar.gz
Algorithm Hash digest
SHA256 9d1c786b7991cca0b43c44c0ab6bd133e333a1c4b230f2cc23a455c903dde3e9
MD5 ac0746406701a122c7b95a0ccf3c85bf
BLAKE2b-256 264f9a22f42a762c6af77f89f0df231865a26af38a05f7dd4cd6b7627312d95e

See more details on using hashes here.

File details

Details for the file bclearer_interop_services-0.3.8-py3-none-any.whl.

File metadata

File hashes

Hashes for bclearer_interop_services-0.3.8-py3-none-any.whl
Algorithm Hash digest
SHA256 10a78d1d91864cd41b0a0f5129f38ecf7c71cbfaf2be9940e234683c420a2e6c
MD5 e913b59a44020cd8708dd1e78a3da180
BLAKE2b-256 28b18d69ffa760eead1bba0c34748e04a7908eae6acff65bb7d1c78d98040d9d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page