Skip to main content

Lightweight Python SDK for ABRomics API

Project description

ABRomics Lightweight Python SDK

A lightweight Python SDK for interacting with the ABRomics API, including resumable file uploads via TUS protocol.

Installation

From PyPI (Recommended)

pip install abromics-library

From Source

git clone https://gitlab.com/ifb-elixirfr/abromics/abromics-library.git
cd abromics-library
pip install -e .

Prerequisites

  • Python 3.8+
  • ABRomics backend running
  • API key with complete_workflow_upload scope

Quick Start

1. Get Your API Key

  1. Go to your ABRomics web interface
  2. Navigate to the API Keys page
  3. Create a new API key with scope complete_workflow_upload
  4. Copy the API key (starts with abk_)

2. Set Environment Variables (Optional)

export ABROMICS_API_KEY="abk_your_api_key_here"
export ABROMICS_BASE_URL="http://localhost:8000"  # Your ABRomics backend URL

Usage

Command Line Interface (CLI)

The ABRomics CLI provides 1 essential command:

Command Description
complete-upload-workflow Complete workflow: TSV processing + file uploads

Complete Workflow

# One command does everything: validates TSV, creates samples, uploads files
abromics complete-upload-workflow \
  --metadata-tsv "/path/to/samples_fastq_projects.tsv" \
  --data-dir "/path/to/sequence/files"

What this command does:

  • ✅ Auto-detects file types (FASTQ/FASTA)
  • ✅ Creates samples from TSV metadata
  • ✅ Uploads sequence files to samples
  • ✅ Handles multiple projects automatically

Python Library

Basic Usage

from abromics import AbromicsClient

# Initialize client
client = AbromicsClient(
    api_key="abk_your_api_key_here",
    base_url="http://localhost:8000"
)

# Step 1: Create project
project = client.projects.create(
    name="My Genomic Project",
    template=2,
    description="Project for genomic analysis"
)

# Step 2: Complete workflow (auto-detects file types)
result = client.batch.process_tsv_and_upload(
    project_id=project.id,
    tsv_file="samples_metadata.tsv",
    files_directory="/path/to/sequence/files"
)

if result['success']:
    print("✅ Workflow completed successfully!")

Advanced Usage

# Individual operations
sample = client.samples.create(
    project_id=project.id,
    metadata={
        "Sample ID": "SAMPLE_001",
        "Host species": "Homo sapiens",
        "Microorganism scientific name": "Escherichia coli",
        "Country": "France"
    }
)

# File upload with progress tracking
def progress_callback(message, current, total):
    print(f"{message}: {current}/{total}")

uploader = client.upload.create_uploader()
result = uploader.upload_file(
    file_path="/path/to/sequence.fastq.gz",
    metadata={
        "sample_id": str(sample.id),
        "file_type": "FASTQ_GZ",
        "type": "PAIRED_FORWARD"
    },
    progress_callback=progress_callback
)

TSV File Format

The TSV file should contain sample metadata with these columns:

Required Fields (marked with *)

  • Sample ID * - Unique sample identifier
  • Strain ID * - Unique strain identifier
  • Host species * - Host species name
  • Microorganism scientific name * - Scientific name of microorganism
  • Country * - Country where sample was collected
  • Sample type * - Type of sample
  • Sample source * - Source of the sample
  • Instrument model * - Sequencing instrument model
  • Collected date * - Date when sample was collected
  • Project Name * - Name of the project

File Type Fields (one of these)

  • R1 fastq filename * + R2 fastq filename * - For FASTQ files
  • Fasta filename * - For FASTA files

Optional Fields

  • Region - Region where sample was collected
  • Place - Specific place where sample was collected
  • Travel countries - Countries visited before collection
  • Accession number - Public database accession number
  • Sample comment - Additional comments about the sample

Example TSV

Sample ID *	Strain ID *	R1 fastq filename *	R2 fastq filename *	Host species *	Microorganism scientific name *	Country *	Project Name *
SAMPLE_001	ST-001	sample_R1.fastq.gz	sample_R2.fastq.gz	Homo sapiens	Escherichia coli	France	My Project

Examples

CLI Examples

# Complete workflow
abromics complete-upload-workflow \
  --metadata-tsv "examples/samples_fastq_projects.tsv" \
  --data-dir "examples/sequence_files/"

Python Examples

# Run the example script
python examples/python_library_example.py

Configuration

Environment Variables

export ABROMICS_API_KEY="abk_your_api_key_here"        # Required
export ABROMICS_BASE_URL="http://localhost:8000"       # Optional

Priority Order

  1. Command-line arguments (--api-key, --base-url)
  2. Environment variables (ABROMICS_API_KEY, ABROMICS_BASE_URL)
  3. Default values (base URL only)

API Reference

Client

client = AbromicsClient(api_key, base_url, timeout)

Projects

# Create project
project = client.projects.create(name, template, description)

# List projects
projects = client.projects.list()

# Get project
project = client.projects.get(project_id)

Samples

# Create sample
sample = client.samples.create(project_id, metadata)

# List samples
samples = client.samples.list(project_id=1)

# Get sample
sample = client.samples.get(sample_id)

Batch Operations

# Complete workflow
result = client.batch.process_tsv_and_upload(
    project_id, tsv_file, files_directory
)

Troubleshooting

Common Issues

  1. API Key Error: Make sure you have a valid API key with the correct scope
  2. File Not Found: Check that TSV file and data directory paths are correct
  3. Connection Error: Ensure the ABRomics backend is running on the specified URL
  4. Permission Error: Verify your API key has the complete_workflow_upload scope
  5. Mixed File Types: Don't mix FASTQ and FASTA files in the same directory

Getting Help

  • Check the main library documentation above
  • Verify your TSV file structure matches the expected format
  • Ensure all required fields are present and non-empty
  • Check that sequence files exist in the specified directory

Development

# Install in development mode
pip install -e .

# Run tests
pytest

# Run CLI
python -m abromics.cli --help

Publishing

For instructions on how to publish a new version to PyPI, see HowToPublish.md.

License

MIT License

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

abromics_library-1.0.4.tar.gz (22.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

abromics_library-1.0.4-py3-none-any.whl (25.5 kB view details)

Uploaded Python 3

File details

Details for the file abromics_library-1.0.4.tar.gz.

File metadata

  • Download URL: abromics_library-1.0.4.tar.gz
  • Upload date:
  • Size: 22.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.9

File hashes

Hashes for abromics_library-1.0.4.tar.gz
Algorithm Hash digest
SHA256 40f14ca0113e93e7fd47fcf3fd46fab286a865a05c49beea301b81d4424cc5b6
MD5 8da7a5002a748b8fddab0cb6940f2efc
BLAKE2b-256 4b7b484995d70644e2d91dd9727cb0b7014fc2392e847eb6b5d5a7bd2a8b73bf

See more details on using hashes here.

File details

Details for the file abromics_library-1.0.4-py3-none-any.whl.

File metadata

File hashes

Hashes for abromics_library-1.0.4-py3-none-any.whl
Algorithm Hash digest
SHA256 4f173fd53bf7cf75d872267065e53ebaa090a24ef835d62df99a25c33d219ce5
MD5 72e3773f1b6edb04078c691e79e72d89
BLAKE2b-256 0f1c6d72d2ebe6e2d139d019d8a99168362ffe85fcaf1d5505f29d3863614b09

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page