Steve CLI
A simple CLI tool to run jobs from jobs.yaml with proper environment setup. Perfect for local development and testing of automation kernel jobs.
Installation
Install from local development
cd /home/frank/Projects/7frank/tilt-ts-4/apps/example-hehnke/packages/steve-cli
uv venv
uv pip install -e .
Install from GitHub
uv add steve-cli
OR
uv add git+https://github.com/your-org/tilt-ts-4.git#subdirectory=apps/example-hehnke/packages/steve-cli
Usage
Run a job
steve extract-data
steve transform-data
steve validate-data
This will:
- Look for
jobs.yamlin the current directory - Find the specified job by name
- Set all environment variables from the job's
envsection - Execute the job's command with the proper environment
List available jobs
steve ls
Shows all jobs in jobs.yaml with their commands, schedules, dependencies, and environment variables.
Get help
steve help
steve --help
Use custom jobs file
steve -f path/to/custom.yaml extract-data
steve ls -f path/to/custom.yaml
Example
Given a jobs.yaml file:
jobs:
- name: extract-data
cron: "0 2 * * *"
command: ["uv", "run", "src/extract.py"]
env:
SOURCE_URL: "https://jsonplaceholder.typicode.com/users"
OUTPUT_PATH: "/data/raw/extracted_data.parquet"
- name: transform-data
dependsOn: ["extract-data"]
command: ["uv", "run", "src/transform.py"]
env:
INPUT_PATH: "/data/raw/extracted_data.parquet"
OUTPUT_PATH: "/data/processed"
Running steve extract-data will:
- Set
SOURCE_URL=https://jsonplaceholder.typicode.com/users - Set
OUTPUT_PATH=/data/raw/extracted_data.parquet - Execute:
uv run src/extract.py
Features
- ✅ Simple: Just
steve <job-name>to run any job - ✅ Environment: Automatically sets environment variables from
jobs.yaml - ✅ Discovery: Auto-finds
jobs.yamlin current directory - ✅ Listing: See all available jobs with
steve ls - ✅ Flexible: Supports custom jobs file paths
- ✅ Colorful: Nice colored output for better readability
- ✅ Error handling: Clear error messages for missing jobs or files
File Metadata Extraction
Steve automatically extracts metadata from files read or written via MetadataRegistry. The extractor is chosen by file extension — no configuration needed.
| Extension | Extractor | Requires |
|---|---|---|
.parquet, .pq |
ParquetExtractor |
pip install steve-cli[polars] |
.csv, .tsv, .txt |
CsvExtractor |
stdlib only |
.json, .jsonl, .ndjson |
JsonExtractor |
stdlib only |
.xlsx, .xls, .xlsm |
ExcelExtractor |
pip install steve-cli[excel] |
| anything else | GenericExtractor |
stdlib only |
Adding a custom extractor
Implement MetadataExtractorPort, declare which extensions it handles, and register it once at startup:
from steve_cli.storage.metadata.port import MetadataExtractorPort, FileMetadata, ColumnMetadata
from steve_cli.storage.metadata.registry import MetadataRegistry
class AvroExtractor(MetadataExtractorPort):
extensions = (".avro",)
def extract(self, data: bytes, path: str) -> FileMetadata:
import fastavro, io
reader = fastavro.reader(io.BytesIO(data))
schema = reader.writer_schema
columns = [
ColumnMetadata(name=f["name"], type=str(f["type"]))
for f in schema.get("fields", [])
]
records = list(reader)
return FileMetadata(
format="avro",
size_bytes=len(data),
rows=len(records),
columns=columns,
)
MetadataRegistry.register("avro", AvroExtractor)
After registration, MetadataRegistry.extract(data, "output.avro") picks AvroExtractor automatically. You can also force a specific extractor for any file via the env var:
METADATA_EXTRACTOR=avro steve jobs run my-job
Why Steve?
Named after Steve Jobs - because it helps you run jobs locally! 😄
Requirements
- Python 3.8+
- click >= 8.0.0
- pyyaml >= 6.0
Development
# Install in development mode
uv pip install -e .
# Run tests (when added)
pytest
# Format code
black steve_cli/
isort steve_cli/
use cli
source .venv/bin/activate steve
uv build uv publish
1 maintainer
Metadata
1 maintainer
Release files for steve-cli 0.3.14
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| steve_cli-0.3.14.tar.gz | 26.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| steve_cli-0.3.14-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 60.6 kB
Release files / steve_cli-0.3.14.tar.gz
| Download URL | steve_cli-0.3.14.tar.gz |
|---|---|
| Size | 26.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
c81f5ea1c3c605b448355e9c313a3abb9c9db77df5597fab21514f0b285d00dd
|
|
BLAKE2b-256 checksum How to use checksums |
ad7ac00e26fc25d04712c72480b16718416a41b963955a3e7519f45ffafe1b18
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.21 {"installer":{"name":"uv","version":"0.11.21","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"25.04","id":"plucky","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
Release files / steve_cli-0.3.14-py3-none-any.whl
| Download URL | steve_cli-0.3.14-py3-none-any.whl |
|---|---|
| Size | 34.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
b6fbc476908bd63b4a7d010415f9eba38a87881a0fae2cd0b5e1e85d3704f46c
|
|
BLAKE2b-256 checksum How to use checksums |
25c8054ada92a2bf682010f91e47c07adf57bc9a0a4957cab27a1197a3862dd5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.21 {"installer":{"name":"uv","version":"0.11.21","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"25.04","id":"plucky","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
