Skip to main content

Flightline - Synthetic data generation from sample files

Project description

Flightline

Synthetic data generation from sample files.

The Problem

You can't download real production files to test locally due to security/compliance constraints. Flightline solves this by analyzing a sample file and generating N valid synthetic variations.

How It Works

  1. Learn - Analyze a sample file to create a profile describing the schema, data types, business logic, and PII fields
  2. Generate - Use the profile to generate N realistic synthetic records

Installation

pip install flightline-ai

For development:

# Clone the repo and install in editable mode
pip install -e .

Usage

Step 1: Learn from a sample file

flightline learn path/to/sample.json

This analyzes your file and creates a profile at ./flightline_output/profile.json.

Step 2: Generate synthetic data

flightline generate -n 10

This generates 10 synthetic records based on the profile, saved to ./flightline_output/synthetic_<timestamp>.json.

You can also use the shorthand:

flightline gen -n 10

Choosing a Model

Both commands support a --model flag to choose any model available on OpenRouter:

# Use Gemini (default)
flightline learn sample.json --model google/gemini-3-flash-preview

# Use a specific model for generation
flightline gen -n 100 --model google/gemini-3-flash-preview

See OpenRouter Models for all available models.

Environment Variables

Output

All generated files are saved to ./flightline_output/:

  • profile.json - The learned schema and rules
  • synthetic_<timestamp>.json - The generated synthetic records

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

flightline_ai-0.1.2.tar.gz (85.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

flightline_ai-0.1.2-py3-none-any.whl (43.0 kB view details)

Uploaded Python 3

File details

Details for the file flightline_ai-0.1.2.tar.gz.

File metadata

  • Download URL: flightline_ai-0.1.2.tar.gz
  • Upload date:
  • Size: 85.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.6

File hashes

Hashes for flightline_ai-0.1.2.tar.gz
Algorithm Hash digest
SHA256 2edef982c39581efe787537021d9f5ed2255cd22719d3da5d32f4d6c99850d96
MD5 fa25b6d585f431f04d83524f4ea5e5e7
BLAKE2b-256 8a4aa277408d0546c8bf0ead186f882e064fbc929ec3102d767a9a75ff3c481c

See more details on using hashes here.

File details

Details for the file flightline_ai-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: flightline_ai-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 43.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.6

File hashes

Hashes for flightline_ai-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 681e894d3ddf7daaa554b8af2891aefd7d54cf07b78110448c334432f9caa3c3
MD5 715f72adf1b8d29a7fcec51cef1d143f
BLAKE2b-256 dbae6d8f3384b04f3018867e5a962d1b679606715e76a904bce902b461e0e6c8

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page