Nirnaya-Flash

Nirnaya-Flash makes typed decisions about text in a single forward pass. You give it a state (a string or JSON) and a set of questions; it returns an answer and a calibrated probability for every allowed outcome. It never generates text, so there is nothing to parse.

• 421M parameters (ModernBERT-large encoder plus a small decision transformer), English, 512 tokens.
• Every question in a request is answered in one batched forward pass.
• Runs on Apple Silicon with MLX and on CPU, CUDA, or Apple MPS with PyTorch.

Quickstart

pip install nirnaya            # Apple Silicon (MLX)
pip install "nirnaya[torch]"   # PyTorch: CPU, CUDA, or Apple MPS

from nirnaya.inference.mlx_runtime import MLXFlashRuntime   # or: from nirnaya.hf.runtime import TorchFlashRuntime

model = MLXFlashRuntime.from_pretrained("9337aaric/Nirnaya-Flash")
answers = model.predict(
    {"ticket": "I was charged twice for March. Please refund the duplicate today or I cancel."},
    {
        "team": {
            "type": "choice",
            "instructions": "Which team should handle this ticket?",
            "criteria": {"billing": "Payments and refunds", "technical": "Bugs and outages", "sales": "Pricing"},
        },
        "churn": {"type": "noul", "instructions": "Does the customer threaten to cancel?"},
        "urgency": {"type": "score", "instructions": "How urgent is this?", "criteria": ["Routine", "Soon", "Immediate"]},
    },
)
print(answers["team"]["decision"], answers["team"]["confidence"])

HTTP server

nirnaya-serve 9337aaric/Nirnaya-Flash --port 8000
curl -s localhost:8000/v1/systemone -H 'Content-Type: application/json' -d '{
  "state": {"ticket": "I was charged twice. Please fix this ASAP."},
  "questions": {"billing": {"type": "noul", "instructions": "Is this ticket about billing?"}}
}'

The server accepts the POST /v1/systemone request and response format used by Ollama's decision API and the TypeSafe SDK, so those clients work by changing their base URL. It binds to localhost by default; set NIRNAYA_API_KEY to require a bearer token. Prompts that would exceed the 512-token context are rejected rather than silently truncated.

Transformers

from transformers import AutoModel
model = AutoModel.from_pretrained("9337aaric/Nirnaya-Flash", trust_remote_code=True)

The raw model returns option logits; use nirnaya.hf.runtime.TorchFlashRuntime for input formatting, calibration, and typed results.

Evaluation

All numbers below come from one pre-registered run on held-out test data that was never used for training, model selection, or calibration. Intervals are 95% case-clustered bootstrap intervals.

Typed Decisions in detail (calibrated): choice 74.5%, yes/no 84.2%, score 73.9%; expected calibration error 0.054; Brier score against the reference probability distributions 0.079. When the model reports confidence of at least 0.90 it is correct 98.6% of the time (21.7% of decisions). Shuffling the order of choice options changes the answer on 5.8% of choice questions.

Speed on an Apple M5 Pro (MLX, float16, one process): 1 question: 10.1 ms median; 5 questions: 35.8 ms median; 10 questions: 66.7 ms median; 50 questions: 335.0 ms median

Training

1. Foundation: the ModernBERT-large encoder and a newly initialized decision transformer were trained together on typed decisions, intent routing, yes/no reading comprehension, preference rating, and Open-Jev decision sets.
2. Specialization: four epochs mixing typed decisions with news-topic, emotion, and prompt-injection data. News and emotion options were shuffled per example so those answers do not depend on option order.
3. Calibration: temperatures were fitted on a separate held-out calibration split only.

Training data and licenses:

AG News, DAIR Emotion, and SST-5 were used only for evaluation.

Limitations

• English only, 512 tokens per question (question, options, and state together).
• Choice questions accept at most 10 options; split larger label sets into stages.
• Ordinal score questions are the weakest question type; check them on your own data.
• Fine-grained sentiment (SST-5, 32.0%) and emotion in short social-media posts (DAIR Emotion, 53.5%) are the weakest benchmarks.
• Reordering choice options changes 5.8% of typed-decision choice answers; keep option order stable in production, or average over orderings when it matters.
• Probabilities are calibrated on typed-decision data. On other domains, confidence is a useful signal but not a guarantee; validate thresholds on your own data before relying on them.
• Not intended as the sole basis for high-stakes decisions about people.

License

Code and weights are released under Apache-2.0. See NOTICE for attribution of the base model and training datasets. BoolQ is distributed under CC-BY-SA-3.0; the dataset itself is not included here.