mask-llm 0.1.0

Privacy-safe LLM data cleaning for fine-tuning datasets

mask-llm

Privacy-safe data cleaning for LLM fine-tuning datasets.

Sensitive data (names, emails, phone numbers) is masked locally before leaving your machine. Only anonymized text is sent to the cloud for cleaning.

Install

pip install mask-llm python -m spacy download en_core_web_sm

Usage

python -m mask_llm
--input your_data.jsonl
--output cleaned_data.jsonl
--key sk-your-api-key

Output fine-tuning format

python -m mask_llm
--input your_data.jsonl
--output cleaned_data.jsonl
--key sk-your-api-key
--finetune

How it works

1. PII detected and masked locally (never leaves your machine)
2. Anonymized text sent to cleaning API
3. Results restored with original values locally
4. Output as standard JSONL for fine-tuning