Skip to main content

Lightweight Python SDK for ABRomics API

Project description

ABRomics Lightweight Python SDK

A lightweight Python SDK for interacting with the ABRomics API, including resumable file uploads via TUS protocol.

Installation

From PyPI (Recommended)

pip install abromics-library

From Source

git clone https://gitlab.com/ifb-elixirfr/abromics/abromics-library.git
cd abromics-library
pip install -e .

Prerequisites

  • Python 3.8+
  • ABRomics backend running
  • API key with complete_workflow_upload scope

Quick Start

1. Get Your API Key

  1. Go to your ABRomics web interface
  2. Navigate to the API Keys page
  3. Create a new API key with scope complete_workflow_upload
  4. Copy the API key (starts with abk_)

2. Set Environment Variables (Optional)

export ABROMICS_API_KEY="abk_your_api_key_here"
export ABROMICS_BASE_URL="http://localhost:8000"  # Your ABRomics backend URL

Usage

Command Line Interface (CLI)

The ABRomics CLI provides 1 essential command:

Command Description
complete-upload-workflow Complete workflow: TSV processing + file uploads

Complete Workflow

# One command does everything: validates TSV, creates samples, uploads files
abromics complete-upload-workflow \
  --metadata-tsv "/path/to/samples_fastq_projects.tsv" \
  --data-dir "/path/to/sequence/files"

What this command does:

  • ✅ Auto-detects file types (FASTQ/FASTA)
  • ✅ Creates samples from TSV metadata
  • ✅ Uploads sequence files to samples
  • ✅ Handles multiple projects automatically

Python Library

Basic Usage

from abromics import AbromicsClient

# Initialize client
client = AbromicsClient(
    api_key="abk_your_api_key_here",
    base_url="http://localhost:8000"
)

# Step 1: Create project
project = client.projects.create(
    name="My Genomic Project",
    template=2,
    description="Project for genomic analysis"
)

# Step 2: Complete workflow (auto-detects file types)
result = client.batch.process_tsv_and_upload(
    project_id=project.id,
    tsv_file="samples_metadata.tsv",
    files_directory="/path/to/sequence/files"
)

if result['success']:
    print("✅ Workflow completed successfully!")

Advanced Usage

# Individual operations
sample = client.samples.create(
    project_id=project.id,
    metadata={
        "Sample ID": "SAMPLE_001",
        "Host species": "Homo sapiens",
        "Microorganism scientific name": "Escherichia coli",
        "Country": "France"
    }
)

# File upload with progress tracking
def progress_callback(message, current, total):
    print(f"{message}: {current}/{total}")

uploader = client.upload.create_uploader()
result = uploader.upload_file(
    file_path="/path/to/sequence.fastq.gz",
    metadata={
        "sample_id": str(sample.id),
        "file_type": "FASTQ_GZ",
        "type": "PAIRED_FORWARD"
    },
    progress_callback=progress_callback
)

TSV File Format

The TSV file should contain sample metadata with these columns:

Required Fields (marked with *)

  • Sample ID * - Unique sample identifier
  • Strain ID * - Unique strain identifier
  • Host species * - Host species name
  • Microorganism scientific name * - Scientific name of microorganism
  • Country * - Country where sample was collected
  • Sample type * - Type of sample
  • Sample source * - Source of the sample
  • Instrument model * - Sequencing instrument model
  • Collected date * - Date when sample was collected
  • Project Name * - Name of the project

File Type Fields (one of these)

  • R1 fastq filename * + R2 fastq filename * - For FASTQ files
  • Fasta filename * - For FASTA files

Optional Fields

  • Region - Region where sample was collected
  • Place - Specific place where sample was collected
  • Travel countries - Countries visited before collection
  • Accession number - Public database accession number
  • Sample comment - Additional comments about the sample

Example TSV

Sample ID *	Strain ID *	R1 fastq filename *	R2 fastq filename *	Host species *	Microorganism scientific name *	Country *	Project Name *
SAMPLE_001	ST-001	sample_R1.fastq.gz	sample_R2.fastq.gz	Homo sapiens	Escherichia coli	France	My Project

Examples

CLI Examples

# Complete workflow
abromics complete-upload-workflow \
  --metadata-tsv "examples/samples_fastq_projects.tsv" \
  --data-dir "examples/sequence_files/"

Python Examples

# Run the example script
python examples/python_library_example.py

Configuration

Environment Variables

export ABROMICS_API_KEY="abk_your_api_key_here"        # Required
export ABROMICS_BASE_URL="http://localhost:8000"       # Optional

Priority Order

  1. Command-line arguments (--api-key, --base-url)
  2. Environment variables (ABROMICS_API_KEY, ABROMICS_BASE_URL)
  3. Default values (base URL only)

API Reference

Client

client = AbromicsClient(api_key, base_url, timeout)

Projects

# Create project
project = client.projects.create(name, template, description)

# List projects
projects = client.projects.list()

# Get project
project = client.projects.get(project_id)

Samples

# Create sample
sample = client.samples.create(project_id, metadata)

# List samples
samples = client.samples.list(project_id=1)

# Get sample
sample = client.samples.get(sample_id)

Batch Operations

# Complete workflow
result = client.batch.process_tsv_and_upload(
    project_id, tsv_file, files_directory
)

Troubleshooting

Common Issues

  1. API Key Error: Make sure you have a valid API key with the correct scope
  2. File Not Found: Check that TSV file and data directory paths are correct
  3. Connection Error: Ensure the ABRomics backend is running on the specified URL
  4. Permission Error: Verify your API key has the complete_workflow_upload scope
  5. Mixed File Types: Don't mix FASTQ and FASTA files in the same directory

Getting Help

  • Check the main library documentation above
  • Verify your TSV file structure matches the expected format
  • Ensure all required fields are present and non-empty
  • Check that sequence files exist in the specified directory

Development

# Install in development mode
pip install -e .

# Run tests
pytest

# Run CLI
python -m abromics.cli --help

License

MIT License

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

abromics_library-1.0.0.tar.gz (20.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

abromics_library-1.0.0-py3-none-any.whl (23.9 kB view details)

Uploaded Python 3

File details

Details for the file abromics_library-1.0.0.tar.gz.

File metadata

  • Download URL: abromics_library-1.0.0.tar.gz
  • Upload date:
  • Size: 20.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.8

File hashes

Hashes for abromics_library-1.0.0.tar.gz
Algorithm Hash digest
SHA256 e60e6f7753329fa2d1ad6821f22172a0d100d3d437cc6c7efec4fc5106075a4c
MD5 febcdc8c1ca8d3b4eea654c6956540df
BLAKE2b-256 0ad9089a5040fa496d2d976f5a71554a3c2e37fcae6c97f8a04ab58502cba959

See more details on using hashes here.

File details

Details for the file abromics_library-1.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for abromics_library-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 11abc289f58c1639f705fbdf92820413e93cfcc0a77dea9e7835bd2e152aa5be
MD5 31c1f792b32c3d0fc0ae2778d4075c44
BLAKE2b-256 562e145e2c78fef4d56f0a80e074069792000698ae1d2c0912583c7a3324a78c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page