Skip to main content

Sync and query BDSC datasets locally

This project has been archived.

The maintainers of this project have marked this project as archived. No new releases are expected.

Project description

bdsc-cli

This package has been renamed. Install bdsc now: pipx install bdsc

Small CLI for syncing public Bloomington Drosophila Stock Center datasets and querying them locally.

Repo:

Primary source:

What it does:

  • syncs BDSC CSV datasets into a local cache
  • builds a local SQLite index
  • supports local text search and stock lookups
  • exposes optional live search against BDSC's current web endpoint

No third-party Python dependencies.

Install

Another computer:

brew tap gumadeiras/tap
brew install bdsc-cli

PyPI with pipx:

pipx install bdsc-cli

PyPI with plain pip:

python3 -m pip install bdsc-cli

Source install:

git clone https://github.com/gumadeiras/bdsc-cli.git
cd bdsc-cli
python3 -m pip install .

Repo-local dev install:

cd ~/git/bdsc-cli
python3 -m venv .venv
. .venv/bin/activate
python -m pip install -e .

Check the CLI:

bdsc --help

Build release artifacts locally:

python -m pip install -e .[release]
python -m build
python -m twine check dist/*

Quickstart

Create a local cache and index:

bdsc sync

Then query it:

bdsc find Chronos
bdsc find 'Or56a Lexa'
bdsc report optogenetics
bdsc find --gene Or56a --property lexA
bdsc find --gene Or42b --driver-family lexA
bdsc find RRID:BDSC_77118
bdsc find FBti0195688
bdsc stock 77118

Usage

Default state directory:

~/.local/share/bdsc-cli

Sync datasets and build the local index:

bdsc sync

Use find for nearly all interactive querying:

bdsc find Chronos
bdsc find Chronis
bdsc find 'Or56a Lexa'
bdsc find FBgn0003996 --json
bdsc find RRID:BDSC_77118
bdsc find FBti0195688
bdsc find --kind property VALIUM20
bdsc find --kind property-exact lexA
bdsc find --kind driver-family QF
bdsc find --kind relationship RNAi
bdsc find --gene Or56a --property lexA
bdsc find --gene Or42b --driver-family lexA
bdsc find --gene Or42b --driver-family qf
bdsc find --dataset genes --property olfactory --relationship coding --jsonl

Use canned reports for common retrieval buckets:

bdsc report olfactory
bdsc report drivers --jsonl
bdsc report optogenetics --limit 50

Inspect cache/index status:

bdsc status

Use a custom cache/index location:

bdsc sync --state-dir ./data
bdsc find Chronos --state-dir ./data

Structured output for scripts or agents:

bdsc status --json
bdsc find Chronos --json
bdsc find FBgn0003996 --dataset genes --json
bdsc find --gene Or56a --property lexA --json
bdsc export components --limit 5 --format jsonl
bdsc stock 77118 --json

Query commands return all matches by default. Use --limit N when you want a bounded result set.

Commands

  • bdsc sync: download the BDSC CSV datasets; builds the index by default
  • bdsc build-index: rebuild the SQLite index from previously downloaded CSVs
  • bdsc status: show local dataset freshness and index metadata
  • bdsc find [query]: primary query command; free-text lookup or compound filters
  • bdsc report <name>: canned reports for olfactory, drivers, optogenetics
  • bdsc export <dataset>: stream normalized rows as jsonl, csv, or tsv
  • bdsc terms <scope>: inspect available property/relationship vocab
  • bdsc stock <stknum>: local stock details
  • legacy compatibility shims still exist for search, gene, component, fbid, rrid, property, property-exact, driver-family, relationship, lookup, filter, live-search

Find

Use find when the caller does not want to choose a dedicated query command up front.

Auto-detect rules:

  • digits -> stock
  • RRID:BDSC_* or BDSC_* -> rrid
  • FBgn... -> gene
  • FBti... / FBal... / similar FB.. ids in the component table -> fbid
  • transgene/component-like text (P{...}, brackets, attP, CyO) -> component
  • multi-term or dotted construct fragments -> local full-text search
  • --kind property when you want property-driven lookup explicitly
  • single bare terms -> gene, then local full-text search fallback if no gene hits

Examples:

bdsc find Chronos
bdsc find RRID:BDSC_77118
bdsc find --kind component 'P{10XUAS-Chronos'
bdsc find --kind property VALIUM20
bdsc find --kind property-exact lexA
bdsc find --kind driver-family qf

Export

Use export when another tool wants direct normalized rows instead of search-oriented output.

Datasets:

  • stocks
  • components
  • genes
  • properties

Examples:

bdsc export stocks --limit 3
bdsc export genes --query Chronos --kind gene
bdsc export components --query FBti0195688 --kind fbid --format jsonl
bdsc export properties --query VALIUM20 --kind property --format tsv
bdsc export components --gene Or56a --property lexA --format jsonl
bdsc export components --gene Or42b --driver-family qf --format jsonl
bdsc export genes --property olfactory --relationship coding --format csv
bdsc export components --format tsv --output components.tsv
bdsc export genes --format csv --output genes.csv
bdsc export properties --limit 20 --format jsonl

export --query uses the same lookup kinds as find --kind:

  • stock
  • rrid
  • gene
  • fbid
  • component
  • property
  • property-exact
  • driver-family
  • relationship
  • search
  • auto

You can also stack explicit filter flags on export; multiple flags combine as AND:

  • --stock
  • --rrid
  • --gene
  • --component
  • --fbid
  • --property
  • --property-exact
  • --driver-family
  • --relationship
  • --search

Compound Find

find also subsumes compound filters. Default dataset: components.

Examples:

bdsc find --gene Or56a --property lexA
bdsc find --gene Or67d --property qf
bdsc find --gene Or42b --driver-family lexA
bdsc find --gene Or56a --property-exact lexA
bdsc find --dataset stocks --property optogenetic
bdsc find --dataset genes --property olfactory --relationship coding --jsonl

Reports

Use report for curated high-level buckets that would otherwise need multiple queries or OR filters.

Reports:

  • olfactory: receptor-family genes (Or*, Orco, Ir*, Obp*)
  • drivers: GAL4 / lexA / QF / split-driver / FLP-like driver surfaces
  • optogenetics: common optogenetic effectors plus optogenetic-tagged properties

Examples:

bdsc report olfactory
bdsc report olfactory --dataset genes --jsonl
bdsc report drivers --limit 50 --json
bdsc report optogenetics --dataset components --jsonl

Terms

Use terms when you need to discover the vocabulary before filtering.

Scopes:

  • properties
  • property-descriptions
  • relationships

Examples:

bdsc terms properties --limit 20
bdsc terms properties --query VALIUM --json
bdsc terms relationships --limit 20
bdsc terms property-descriptions --query optogenetic --jsonl

Notes

  • sync uses conditional HTTP headers when possible (ETag, If-Modified-Since) to avoid re-downloading unchanged files.
  • Local lookup is built from the public CSV dumps, not the private site search endpoints.
  • search now uses a two-stage index: exact/prefix FTS first, trigram fuzzy fallback second. Typos and loose spacing/punctuation usually still find the intended stock without having the exact BDSC string.
  • find is the intended interactive entrypoint; dedicated legacy query commands still work but are no longer the main documented path.
  • direct lookup paths also rerank fuzzy candidates when exact/prefix matching misses.
  • use property-exact or driver-family when property is too broad for a reliable LexA/QF/GAL4-style answer.
  • tag pushes like vX.Y.Z run the release workflow: build artifacts, create a GitHub release, publish to PyPI, and update gumadeiras/homebrew-tap.
  • The live endpoint is undocumented and may change without notice.
  • BDSC data is large enough that the first full sync/index can take a few minutes depending on network and disk speed.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bdsc_cli-0.2.3.tar.gz (31.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

bdsc_cli-0.2.3-py3-none-any.whl (24.9 kB view details)

Uploaded Python 3

File details

Details for the file bdsc_cli-0.2.3.tar.gz.

File metadata

  • Download URL: bdsc_cli-0.2.3.tar.gz
  • Upload date:
  • Size: 31.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for bdsc_cli-0.2.3.tar.gz
Algorithm Hash digest
SHA256 a681494b568f20a37c3a833129c1a00d8795cfe0fb1a5e0da127928c6e4fcdfd
MD5 79b7ae198d98be8cf94ccaee5663d777
BLAKE2b-256 faceafb2f297604b45178a0461e967df3e5a183ae73acf0a949be1a94aa05c7e

See more details on using hashes here.

Provenance

The following attestation bundles were made for bdsc_cli-0.2.3.tar.gz:

Publisher: release.yml on gumadeiras/bdsc-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file bdsc_cli-0.2.3-py3-none-any.whl.

File metadata

  • Download URL: bdsc_cli-0.2.3-py3-none-any.whl
  • Upload date:
  • Size: 24.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for bdsc_cli-0.2.3-py3-none-any.whl
Algorithm Hash digest
SHA256 e28acbe6e9c8978b5fff263aabd15a3caf3a389983e9b510df4868b1a5e7e288
MD5 ffba9de9a0edf9643046bdae80dfaf20
BLAKE2b-256 d8d36a51f5958b7b47117d68c4a164a36f210e63525422e3be4590c4e5159263

See more details on using hashes here.

Provenance

The following attestation bundles were made for bdsc_cli-0.2.3-py3-none-any.whl:

Publisher: release.yml on gumadeiras/bdsc-cli

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page