Skip to main content

Flightline - Synthetic data generation from sample files

Project description

Flightline

Synthetic data generation from sample files.

The Problem

You can't download real production files to test locally due to security/compliance constraints. Flightline solves this by analyzing a sample file and generating N valid synthetic variations.

How It Works

  1. Learn - Analyze a sample file to create a profile describing the schema, data types, business logic, and PII fields
  2. Generate - Use the profile to generate N realistic synthetic records

Installation

pip install flightline-ai

For development:

# Clone the repo and install in editable mode
pip install -e .

Usage

Step 1: Learn from a sample file

flightline learn path/to/sample.json

This analyzes your file and creates a profile at ./flightline_output/profile.json.

Step 2: Generate synthetic data

flightline generate -n 10

This generates 10 synthetic records based on the profile, saved to ./flightline_output/synthetic_<timestamp>.json.

You can also use the shorthand:

flightline gen -n 10

Choosing a Model

Both commands support a --model flag to choose any model available on OpenRouter:

# Use Claude
flightline learn sample.json --model anthropic/claude-sonnet-4

# Use a cheaper model for generation
flightline gen -n 100 --model openai/gpt-4o-mini

See OpenRouter Models for all available models.

Environment Variables

Output

All generated files are saved to ./flightline_output/:

  • profile.json - The learned schema and rules
  • synthetic_<timestamp>.json - The generated synthetic records

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

flightline_ai-0.1.0.tar.gz (19.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

flightline_ai-0.1.0-py3-none-any.whl (13.4 kB view details)

Uploaded Python 3

File details

Details for the file flightline_ai-0.1.0.tar.gz.

File metadata

  • Download URL: flightline_ai-0.1.0.tar.gz
  • Upload date:
  • Size: 19.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.16

File hashes

Hashes for flightline_ai-0.1.0.tar.gz
Algorithm Hash digest
SHA256 e307c1851e9665d57ae5c7827a5d1fd12e7813736ec964440d9b74190d13370f
MD5 3e2e0d4704c8abcdb8ad0db16bc1f902
BLAKE2b-256 f0adbeaae6f7eb8a6431c3f53a09c1b77170b6051418fd1979cdd83ba318bae5

See more details on using hashes here.

File details

Details for the file flightline_ai-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: flightline_ai-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 13.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.16

File hashes

Hashes for flightline_ai-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 dfa97d0d81fc3df75c4ce2ed061cec065d91a45f95204c2bcd7f7e560499c698
MD5 23551249e1aeeb1bc3aeff3b49b50809
BLAKE2b-256 b9591318e419725616ffe9543099cd954889235dcda246089ea14ad4d382b76a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page