Skip to main content

Flightline - Synthetic data generation from sample files

Project description

Flightline

Synthetic data generation from sample files.

The Problem

You can't download real production files to test locally due to security/compliance constraints. Flightline solves this by analyzing a sample file and generating N valid synthetic variations.

How It Works

  1. Learn - Analyze a sample file to create a profile describing the schema, data types, business logic, and PII fields
  2. Generate - Use the profile to generate N realistic synthetic records

Installation

pip install flightline-ai

For development:

# Clone the repo and install in editable mode
pip install -e .

Usage

Step 1: Learn from a sample file

flightline learn path/to/sample.json

This analyzes your file and creates a profile at ./flightline_output/profile.json.

Step 2: Generate synthetic data

flightline generate -n 10

This generates 10 synthetic records based on the profile, saved to ./flightline_output/synthetic_<timestamp>.json.

You can also use the shorthand:

flightline gen -n 10

Choosing a Model

Both commands support a --model flag to choose any model available on OpenRouter:

# Use Claude
flightline learn sample.json --model anthropic/claude-sonnet-4

# Use a cheaper model for generation
flightline gen -n 100 --model openai/gpt-4o-mini

See OpenRouter Models for all available models.

Environment Variables

Output

All generated files are saved to ./flightline_output/:

  • profile.json - The learned schema and rules
  • synthetic_<timestamp>.json - The generated synthetic records

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

flightline_ai-0.1.1.tar.gz (20.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

flightline_ai-0.1.1-py3-none-any.whl (13.7 kB view details)

Uploaded Python 3

File details

Details for the file flightline_ai-0.1.1.tar.gz.

File metadata

  • Download URL: flightline_ai-0.1.1.tar.gz
  • Upload date:
  • Size: 20.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.16

File hashes

Hashes for flightline_ai-0.1.1.tar.gz
Algorithm Hash digest
SHA256 93f130f9429a11ab2679c30329dd3330cf95a16a7e8c0ec52fdee73218b3406a
MD5 19657f4dd1077eb2b85432e2e95591fb
BLAKE2b-256 a143ab4f47755f8d08c3d248cfc81020424d06051187d4e79aad7e3363e98a8a

See more details on using hashes here.

File details

Details for the file flightline_ai-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: flightline_ai-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 13.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.16

File hashes

Hashes for flightline_ai-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 32b4ad2d8ad3d6a7d83c1b2c8807b8cdb236bc61d37db8996f0810ac2162398b
MD5 240532bd6207461df086a6a29fa56550
BLAKE2b-256 ca7c8cd28198ac51f1983d56929eaa1c40f135a304c9d36ef7e2574b26d36faa

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page