CytoTable 1.2.0

Transform CellProfiler and DeepProfiler data for processing image-based profiling readouts with Pycytominer and other Cytomining tools.

CytoTable

Diagram showing data flow relative to this project.

Summary

Image-based profiling often entails preparing data for analysis by transforming the outputs of image analysis tools into a consistent, analysis-ready format. CytoTable streamlines analyses by harmonizing CellProfiler (.csv or .sqlite), cytominer-database (.sqlite), DeepProfiler (.npz), or other sources such as IN Carta output data at scale. This helps biologists by lowering the barrier between image acquisition and data interpretation, enabling them to focus on biological insights rather than file formats or data wrangling.

CytoTable creates Parquet or AnnData files for both independent analysis and for input into Pycytominer. The output files (such as Parquet and AnnData file formats) have a documented data model, including referenceable schema where appropriate (for validation within Pycytominer or other image-based profiling projects).

The name for the project is inspired by:

• Cyto: "1. (biology) cell." (Wiktionary: Cyto-)
• Table:
  • "1. Furniture with a top surface to accommodate a variety of uses."
  • "3.1. A matrix or grid of data arranged in rows and columns."
    (Wiktionary: Table)

Installation

Install CytoTable from PyPI or from source:

# install from pypi
pip install cytotable

# install directly from source
pip install git+https://github.com/cytomining/CytoTable.git

Getting started

Check out the following resources to get started with CytoTable! We created tutorials which follow a narrative-driven approach. We also provide Jupyter notebooks for pragmatic, hands-on explanations.

We suggest image analysts begin with the tutorials and explore the example notebooks afterwards.

Resource	What it covers	Link
Tutorial	CellProfiler SQLite or CSV to Parquet	Open tutorial
Tutorial	NPZ embeddings to Parquet	Open tutorial
Tutorial	Multi-plate merge with tablenumber	Open tutorial
Example notebook	CytoTable mise en place (general overview)	Open notebook
Example notebook	CytoTable from the cloud (cloud-based overview)	Open notebook

Contributing, Development, and Testing

We test CytoTable using ubuntu-latest and macos-latest GitHub Actions runner images.

Please see contributing.md for more details on contributions, development, and testing.

Relationship to other projects

CytoTable focuses on image-based profiling data harmonization and serialization. At scale, CytoTable transforms data into file formats which can be directly integrated with:

Please let us know how you use CytoTable (we'd love to add your project to this list)!

• Pycytominer for the bioinformatics pipeline for image-based profiling.
• coSMicQC for quality control.
• CytoDataFrame for interactive visualization of profiles with single cell images.

References

• Pycytominer
• cytominer-database
• DeepProfiler
• CellProfiler
• cytominer-eval