Flightline - Synthetic data generation from sample files
Project description
Flightline
Synthetic data generation from sample files.
The Problem
You can't download real production files to test locally due to security/compliance constraints. Flightline solves this by analyzing a sample file and generating N valid synthetic variations.
How It Works
- Learn - Analyze a sample file to create a profile describing the schema, data types, business logic, and PII fields
- Generate - Use the profile to generate N realistic synthetic records
Installation
pip install flightline-ai
For development:
# Clone the repo and install in editable mode
pip install -e .
Usage
Step 1: Learn from a sample file
flightline learn path/to/sample.json
This analyzes your file and creates a profile at ./flightline_output/profile.json.
Step 2: Generate synthetic data
flightline generate -n 10
This generates 10 synthetic records based on the profile, saved to ./flightline_output/synthetic_<timestamp>.json.
You can also use the shorthand:
flightline gen -n 10
Choosing a Model
Both commands support a --model flag to choose any model available on OpenRouter:
# Use Claude
flightline learn sample.json --model anthropic/claude-sonnet-4
# Use a cheaper model for generation
flightline gen -n 100 --model openai/gpt-4o-mini
See OpenRouter Models for all available models.
Environment Variables
OPENROUTER_API_KEY- Your OpenRouter API key (required). Get one at https://openrouter.ai/keys
Output
All generated files are saved to ./flightline_output/:
profile.json- The learned schema and rulessynthetic_<timestamp>.json- The generated synthetic records
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file flightline_ai-0.1.0.tar.gz.
File metadata
- Download URL: flightline_ai-0.1.0.tar.gz
- Upload date:
- Size: 19.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.9.16
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e307c1851e9665d57ae5c7827a5d1fd12e7813736ec964440d9b74190d13370f
|
|
| MD5 |
3e2e0d4704c8abcdb8ad0db16bc1f902
|
|
| BLAKE2b-256 |
f0adbeaae6f7eb8a6431c3f53a09c1b77170b6051418fd1979cdd83ba318bae5
|
File details
Details for the file flightline_ai-0.1.0-py3-none-any.whl.
File metadata
- Download URL: flightline_ai-0.1.0-py3-none-any.whl
- Upload date:
- Size: 13.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.9.16
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
dfa97d0d81fc3df75c4ce2ed061cec065d91a45f95204c2bcd7f7e560499c698
|
|
| MD5 |
23551249e1aeeb1bc3aeff3b49b50809
|
|
| BLAKE2b-256 |
b9591318e419725616ffe9543099cd954889235dcda246089ea14ad4d382b76a
|