Skip to main content

Agent-Based Synthetic Educational Data Generation for ODL Research

Project description

SynthEd: From synthetic data to simulated learners

Status: v1.0.0 CI pytest Python 3.10+ Code style: ruff codecov DOI License: MIT

Agent-based simulation environment for Open & Distance Learning (ODL) research. SynthEd generates behaviorally grounded and temporally coherent learning trajectories by combining persona-driven agent modeling with 11 established theoretical frameworks. Built for researchers in learning analytics, educational data mining, and dropout prediction.

pip install -e ".[dev]"
python run_pipeline.py --n 200

From statistical similarity to behavioral fidelity. Traditional synthetic data methods optimize for distributional match. SynthEd optimizes for behavioral coherence -- each data point emerges from a simulated student's evolving motivations, decisions, and life context.


Why SynthEd?

Challenge Traditional Approach SynthEd Approach
Privacy regulations (GDPR/KVKK) Anonymization (re-identification risk) Agents are fictional -- no real individuals
Class imbalance in dropout data Oversampling (SMOTE) -- loses context Parameter-level control of dropout rates
Temporal incoherence GAN/VAE post-hoc smoothing Persona + memory produces coherent trajectories

Key Features

  • 11 Theory Modules -- Tinto, Bean & Metzner, Kember, SDT, Garrison CoI, Moore, Rovai, Baulke, Epstein & Axtell, Gonzalez, Unavoidable Withdrawal
  • Trait-Based Calibration -- Sobol sensitivity (66 params) + Optuna Bayesian optimization against real OULAD data, validated Grade B on held-out modules
  • Multi-Semester Simulation -- Carry-over mechanics for engagement, GPA, coping, dropout phases
  • GPA Feedback Loop -- Cumulative GPA anchors cost-benefit, non-fit perception, and competence beliefs
  • OULAD-Compatible Export -- 7-table CSV matching the Open University Learning Analytics Dataset schema
  • Adaptive Parameter Bounds -- auto_bounds() adjusts calibration space when demographics change
  • 5-Level Validation Suite -- 21 statistical tests (distributions, correlations, temporal coherence, privacy, backstory)
  • Optional LLM Enrichment -- Persona-grounded narrative backstories via OpenAI, Ollama, or any compatible provider
  • 4 Benchmark Profiles -- Developing, Western, Corporate, Mega University with CLI report generation
  • InstitutionalConfig -- 5 institution-level quality parameters that modulate theory constants
  • NSGA-II Calibration -- Multi-objective optimization with Pareto front exploration
  • 565 Tests -- 98% coverage, CI across Python 3.10/3.11/3.12

Quick Start

git clone https://github.com/theaiagent/SynthEd.git
cd SynthEd
pip install -e ".[dev]"
python run_pipeline.py              # 200 students, 14 weeks
python run_pipeline.py --n 500      # Custom population
python run_pipeline.py --oulad      # OULAD-compatible export
python run_pipeline.py --benchmark  # Run all 4 benchmark profiles
from synthed.pipeline import SynthEdPipeline

pipeline = SynthEdPipeline(output_dir="./output", seed=42)
report = pipeline.run(n_students=300)
print(f"Dropout: {report['simulation_summary']['dropout_rate']:.1%}")

Use Cases

  1. Dropout Prediction -- Generate labeled training data with known ground-truth trajectories
  2. Intervention Simulation -- Model "what-if" scenarios by adjusting population parameters
  3. Privacy-Safe Benchmarking -- Share synthetic datasets publicly for reproducible research

Documentation

Document Content
User Guide Installation, configuration, calibration pipeline, OULAD export, LLM enrichment, troubleshooting
Theory & Architecture 11 theoretical anchors, factor clusters, architecture diagram, project structure, validation suite, test inventory

Roadmap

  • Multi-semester simulation with carry-over
  • 11 theory modules (Tinto, Bean & Metzner, Kember, SDT, Garrison, Moore, Rovai, Baulke, Epstein & Axtell, Gonzalez, Unavoidable Withdrawal)
  • Trait-based calibration (Sobol + Optuna + OULAD validation)
  • Benchmark reports with CLI (--benchmark)
  • OULAD-compatible 7-table export
  • LLM enrichment with cost control and streaming
  • Disability severity (Beta distribution)
  • InstitutionalConfig (5 quality parameters modulating theory constants)
  • NSGA-II multi-objective calibration with Pareto front
  • Spectrum refactoring (binary -> continuous for family/internet)
  • GraphRAG integration (curriculum modeling)
  • LLM-augmented mode (forum posts, assignment text)
  • Parquet/Arrow export
  • PyPI package publication
  • Interactive dashboard

Legal Disclaimer

SynthEd generates entirely fictional synthetic data. No real individuals are represented or identifiable. Outputs are intended for research, development, and educational purposes. SynthEd is under active development -- APIs and output formats may change between versions.

See full Legal Disclaimer and Responsible Use guidelines.


Contributing

Contributions welcome! See the User Guide for development setup.

ruff check synthed/ tests/ --select E,F,W --ignore E501
python -m pytest tests/ -v --tb=short

License

MIT License. See LICENSE.

Citation

If you use SynthEd in your research, please cite using the CITATION.cff file or the Zenodo DOI above.

Contributors

Contributor Role
Halis Aykut Cosgun Lead Developer, Data Scientist & AI Engineer, Researcher -- Yozgat Bozok University
Evrim Genc Kumtepe Research Advisor -- Anadolu University
Claude (Anthropic) AI pair programmer -- implementation, testing, code review

Acknowledgments

Conceptually inspired by TinyTroupe (Microsoft), MiroFish, and Agent Lightning. OULAD reference data: Kuzilek et al. (2017).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

synthedu-1.0.1.tar.gz (206.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

synthedu-1.0.1-py3-none-any.whl (198.8 kB view details)

Uploaded Python 3

File details

Details for the file synthedu-1.0.1.tar.gz.

File metadata

  • Download URL: synthedu-1.0.1.tar.gz
  • Upload date:
  • Size: 206.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for synthedu-1.0.1.tar.gz
Algorithm Hash digest
SHA256 9ffd4a2e521a086947848969bad3f4f5054334ab0b4de3dfbbb881405d6696c3
MD5 b87e78365ad90c713a7b3e9ca78425d2
BLAKE2b-256 f665c9afbfefd8f55afb666165ddbfd10e6d03f14fd89081c155ad3f326d980b

See more details on using hashes here.

Provenance

The following attestation bundles were made for synthedu-1.0.1.tar.gz:

Publisher: publish.yml on theaiagent/SynthEd

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file synthedu-1.0.1-py3-none-any.whl.

File metadata

  • Download URL: synthedu-1.0.1-py3-none-any.whl
  • Upload date:
  • Size: 198.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for synthedu-1.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 9d56d8f65f583ec34f12140f09c7000329784c51cd37f067ca80e7a8c38694be
MD5 1dbbccaea388a685326fdb05670cdd85
BLAKE2b-256 b1e8bb66b173d3fb654826be6d79ec3ffbab66499b970af243c8fc4200c8a305

See more details on using hashes here.

Provenance

The following attestation bundles were made for synthedu-1.0.1-py3-none-any.whl:

Publisher: publish.yml on theaiagent/SynthEd

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page