CA Biositing Pipeline
ETL pipeline for the CA Biositing project — extracting biomass feedstock data from Google Sheets and external sources, transforming it with pandas, and loading it into PostgreSQL.
Workflows are orchestrated with Prefect and share
database models from the companion
ca-biositing-datamodels
package.
Installation
pip install ca-biositing-pipeline
Quick Start
from ca_biositing.pipeline.flows.primary_ag_product import primary_ag_product_flow
# Run the primary agricultural product ETL flow
primary_ag_product_flow()
What's Included
- Extract — Pull data from Google Sheets, shapefiles, and public datasets (USDA Census/Survey, LandIQ, Billion Ton)
- Transform — Clean and reshape with pandas and pyjanitor
- Load — Upsert into PostgreSQL with foreign-key resolution
- Flows — Prefect flows combining extract/transform/load steps
Key Dependencies
ca-biositing-datamodels— shared database models- Prefect — workflow orchestration
- pandas — data manipulation
- gspread — Google Sheets integration
- GeoPandas — geospatial data handling
Links
Contributors
Acknowledgement
We acknowledge software engineering support from the University of Washington Scientific Software Engineering Center (SSEC), as part of the Schmidt Sciences Virtual Institute for Scientific Software (VISS).
License
CA Biositing Pipeline is licensed under the open source BSD 3-Clause License.
1 maintainer
Metadata
1 maintainer
Release files for ca-biositing-pipeline 2026.4.6
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| ca_biositing_pipeline-2026.4.6.tar.gz | 515.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| ca_biositing_pipeline-2026.4.6-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 1.0 MB
Release files / ca_biositing_pipeline-2026.4.6.tar.gz
| Download URL | ca_biositing_pipeline-2026.4.6.tar.gz |
|---|---|
| Size | 515.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
d87e3d841baa9be8da5cd6bb64b957d62a27b753221a18fb7054f05900d94368
|
|
BLAKE2b-256 checksum How to use checksums |
e7d85985834b02c03ef57aff8a770d67d7c30b7bc12cdf1dce6354fedefc4390
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Apr 6, 2026.
Transparency logRelease files / ca_biositing_pipeline-2026.4.6-py3-none-any.whl
| Download URL | ca_biositing_pipeline-2026.4.6-py3-none-any.whl |
|---|---|
| Size | 513.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
8b3be3693be95bcd9891e4ba35d77571fd94951cbb1a4949c7ccd3050ba42395
|
|
BLAKE2b-256 checksum How to use checksums |
7973b05840445421801b91e1abaf856652eda18fc85580ff8078cbc6a6e46063
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Apr 6, 2026.
Transparency log
