SAGE Data 📊
Dataset management module for SAGE benchmark suite
Provides unified access to multiple datasets through a two-layer architecture:
- Sources: Physical datasets (qa_base, bbh, mmlu, gpqa, locomo, orca_dpo)
- Usages: Logical views for experiments (rag, libamm, neuromem, agent_eval)
Quick Start
Automatic Setup (Recommended)
# Clone the repository
git clone https://github.com/intellistream/sageData.git
cd sageData
# Run quickstart script (handles everything including Git LFS)
./quickstart.sh
The quickstart.sh script will:
- ✅ Detect and install Git LFS if needed (for dataset files)
- ✅ Pull LFS-tracked data files automatically
- ✅ Verify build/runtime prerequisites
- ✅ Optionally install package dependencies
Note: Some datasets (like LibAMM benchmark files) use Git LFS. The quickstart script will handle this automatically, but you can also manually install Git LFS:
- Ubuntu/Debian:
sudo apt install git-lfs - macOS:
brew install git-lfs - Windows: Download from git-lfs.github.com
Manual Setup
# Install Git LFS (if needed)
git lfs install
# Pull LFS data files
git lfs pull
# Use existing non-venv Python environment (recommended: conda)
# conda activate <your-env>
python -m pip install -e ".[dev]"
from sage.data import DataManager
manager = DataManager.get_instance()
# Access datasets by logical usage profile
rag = manager.get_by_usage("rag")
qa_loader = rag.load("qa_base") # already instantiated
queries = qa_loader.load_queries()
# Or fetch a specific data source directly
bbh_loader = manager.get_by_source("bbh")
tasks = bbh_loader.get_task_names()
🛠️ CLI 使用方式(精简版)
安装后可直接使用 sage-data 命令:
sage-data list # 显示数据源状态(已下载/缺失/远程)
sage-data usage rag # 查看某个 usage 的数据映射
sage-data download locomo # 下载指定数据源(仅支持部分源)
# 选项
sage-data list --json # JSON 输出,便于脚本处理
sage-data --data-root /path # 指定自定义数据根目录
当前支持自动下载的源:locomo, longmemeval, memagentbench, mmlu。 其他如 gpqa, orca_dpo 采用按需在线加载(Hugging
Face),qa_base/bbh 等随包内置。
Available Datasets
| Dataset | Description | Download Required | Storage |
|---|---|---|---|
| qa_base | Question-Answering with knowledge base | ❌ No (included) | Local files |
| locomo | Long-context memory benchmark | ✅ Yes (python -m locomo.download) |
Local files (2.68MB) |
| bbh | BIG-Bench Hard reasoning tasks | ❌ No (included) | Local JSON files |
| mmlu | Massive Multitask Language Understanding | 📥 Optional (python -m mmlu.download --all-subjects) |
On-demand or Local (~160MB) |
| gpqa | Graduate-Level Question Answering | ✅ Auto (Hugging Face) | On-demand (~5MB cached) |
| orca_dpo | Preference pairs for alignment/DPO | ✅ Auto (Hugging Face) | On-demand (varies) |
See examples/ for detailed usage examples.
📖 Examples
python examples/qa_examples.py # QA dataset usage
python examples/locomo_examples.py # LoCoMo dataset usage
python examples/bbh_examples.py # BBH dataset usage
python examples/mmlu_examples.py # MMLU dataset usage
python examples/gpqa_examples.py # GPQA dataset usage
python examples/orca_dpo_examples.py # Orca DPO dataset usage
python examples/integration_example.py # Cross-dataset integration
License
MIT License - see LICENSE file.
🔗 Links
- Repository: https://github.com/intellistream/sageData
- Issues: https://github.com/intellistream/sageData/issues
❓ Common Issues
Q: Where's the LoCoMo data?
A: Run python -m locomo.download to download it (2.68MB from Hugging Face).
Q: How to download MMLU for offline use?
A: Run python -m mmlu.download --all-subjects to download all subjects (~160MB).
Q: GPQA access error?
A: You need to accept the dataset terms on Hugging Face:
https://huggingface.co/datasets/Idavidrein/gpqa
Q: How to use Orca DPO for alignment research?
A: Use DataManager.get_by_source("orca_dpo") to get the loader, then use format_for_dpo() to
prepare data for training.
Version: 0.1.0 | Last Updated: December 2025
Metadata
Release files for isage-data 0.2.3.10
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| isage_data-0.2.3.10.tar.gz | 169.3 kB | Without provenance | Details for isage_data-0.2.3.10.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| isage_data-0.2.3.10-py2.py3-none-any.whl | Python 3, Python 2 | none | any | Details for isage_data-0.2.3.10-py2.py3-none-any.whl |
Total release size: 377.5 kB
Release files / isage_data-0.2.3.10.tar.gz
| Download URL | isage_data-0.2.3.10.tar.gz |
|---|---|
| Size | 169.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
0f325bed3b1e314899c9e236d504b67f3cce6f33080e8b5372995abf4efc3a3b
|
|
BLAKE2b-256 checksum How to use checksums |
1a14a4ab063feaa3b4e6fa0d6a4837063cd6bb3a1869442d729a41d3a2642668
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.11.14
|
Release files / isage_data-0.2.3.10-py2.py3-none-any.whl
| Download URL | isage_data-0.2.3.10-py2.py3-none-any.whl |
|---|---|
| Size | 208.3 kB |
| Tags | Python 2 Python 3 |
|
SHA-256 checksum How to use checksums |
9cb6812e502b6bff8a865a6e2bf042f177f3cec1d537dd41fd73c69d33ebe176
|
|
BLAKE2b-256 checksum How to use checksums |
2bca989a555a8634e9aa99cdfecf75f3d18c891e4d159f6e6ff3d4bf43b600e8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.11.14
|
Security for isage-data 0.2.3.10
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.