AstroGPT

A project for training and evaluating astronomical language models.

Project Structure

├── src/
│   ├── data/
│   ├── tokenizer/
│   ├── model/
│   ├── training/
│   └── astro_eval/    ← Reusable Evaluation Framework (astro-eval)
├── datasets/
├── configs/
├── checkpoints/
├── notebooks/
├── tests/
├── requirements.txt
└── README.md

LLM Evaluation Package (astro-eval)

The repository includes a decoupled model evaluation and benchmarking library located under src/astro_eval/.

Setup

Ensure dependencies are built:

uv build --clear
pip install dist/astro_eval-0.1.0-py3-none-any.whl

For full usage details, command-line arguments, and Python developer API documentation, see the Astro-Eval README.