Skip to main content

Isnād–Rijāl Framework

Grade the narrators, not just log them. Claim-level provenance for multi-agent knowledge systems — adapted from classical hadith transmission science.

CI Python 3.12+ License: Apache 2.0 DOI: 10.5281/zenodo.21211290

🌐 Full project home: https://alizahidraja.com/isnad


What & Why

In modern AI pipelines, a factual claim passes through many hands — a scraper extracts it, a model compiles it, another serves it. Each hand can drop, distort, or invent. Existing tools record what happened. ISNAD grades who transformed the claim, so it can tell you how much to trust the result.

The framework adapts hadith transmission science — one of history's most rigorous epistemologies, refined over twelve centuries — into a Python library for AI systems. Every claim carries its complete chain of transmitters (isnād); each transmitter is graded in a living registry (rijāl); chains are evaluated by their weakest link; content is criticized independently of transmission quality; and the two combine in a decision matrix that routes claims to serve, review, or quarantine.


60-Second Quickstart

pip install isnad
from isnad import Registry, Chain, ChainLinkSpec, grade_chain, decide
from isnad.types import NarratorGrade, ContentVerdict
from isnad.critics import EmbeddingCritic

# Build a chain: source → scraper → model
chain = Chain([
    ChainLinkSpec("openstax-textbook", 0, domain="physics"),
    ChainLinkSpec("pdf-scraper-v2", 1),
    ChainLinkSpec("ingest-model-v3", 2),
])

# Seed-grade known narrators (required for coverage — see §8 experiment)
reg = Registry()
reg.register("openstax-textbook", "physics", grade=NarratorGrade.RELIABLE)
reg.register("pdf-scraper-v2", "physics", grade=NarratorGrade.RELIABLE)
reg.register("ingest-model-v3", "physics", grade=NarratorGrade.ACCEPTABLE)

# Grade the chain
grades = [reg.get_grade(l.narrator_id, l.domain) for l in chain.links]
transforms = [l.transform_type for l in chain.links]
chain_grade = grade_chain(grades, transforms, is_complete=True)

# Content criticism (now functional — embedding-based)
critic = EmbeddingCritic()
verdict = critic.evaluate("p = h/λ", "p = h/lambda", ["p = mv"])
action = decide(chain_grade, verdict)

print(f"Chain: {chain_grade.value.upper()} | Content: {verdict.value} | Action: {action.value}")

LangChain Integration (5 lines)

pip install isnad[langchain]
from isnad.integrations.langchain import IsnadTracer, seed_registry
from isnad.critics import EmbeddingCritic

reg = seed_registry({"source:docs": "reliable", "model:gpt-4o": "acceptable"})
tracer = IsnadTracer(registry=reg, critic=EmbeddingCritic())
chain.invoke("What is F=ma?", config={"callbacks": [tracer]})
print(tracer.report())

What's Validated vs. What's Not

Component Status Notes
Bayesian grading ✅ Default Beta-distribution replaces hardcoded thresholds; ISNAD_POLICY env override
Weakest-link quarantine ✅ Validated 100% of REJECTED narrator claims correctly blocked
jarḥ–taʿdīl discovery ✅ Partial Correctly identifies bad narrators; good ones need seed grades
Seed-grade bootstrapping ✅ Validated Pre-grading sources/models enables practical coverage; ISNAD_SEED_CONFIG env var
Corroboration (mutābaʿāt) ✅ Wired + tested Fires on 2+ independent chains; madār detection blocks correlated chains
Content criticism ✅ Functional EmbeddingCritic (TF-IDF) catches contradictions offline; HybridCritic (NLI) + LLMCritic available
Confidence-gating ❌ Useless Self-confidence scores uncorrelated with defects
Coverage (with critic) ~50% Up from ~10% with the stub; 36% consistent, 4% contradiction on corpus

The honesty box is a feature. We tell you exactly what works, what's limited, and where you need to supply your own components.


Concept → Module Map

Concept What it does Module
isnād (chain) Ordered, gap-checked transmission chain per claim isnad/core/chain.py
rijāl (registry) Graded narrator store per (narrator, domain) isnad/core/registry.py
jarḥ–taʿdīl Evidence-driven state machine for narrator grades isnad/core/registry.py
Bayesian grading Beta-distribution narrator grades (default) isnad/core/registry.py
ittiṣāl Completeness as epistemic property (gap → DAIF) isnad/core/chain.py
Weakest-link grading Chain grade = refined minimum over narrators isnad/core/grading.py
mutābaʿāt (corroboration) Independent-chain upgrade + madār detection isnad/core/corroboration.py
matn criticism Content evaluated independently of chain quality isnad/critics/
Decision matrix 4×2 (chain × content) → action router isnad/core/decision.py
Persistence SQLAlchemy-backed registry (swap via protocol) isnad/storage/
API FastAPI service with DI + Prometheus metrics isnad/api/
CLI isnad serve isnad seed
ʿadālah / ḍabṭ Integrity and precision as two distinct axes isnad/types.py

The Decision Matrix

Content CONSISTENT Content CONTRADICTION
Ṣaḥīḥ (sound chain) SERVE — cache REVIEW — ʿilal signal (highest-value case)
Ḥasan (good chain) SERVE WITH CAVEAT REVIEW — hold, do not serve
Ḍaʿīf (weak chain) REVIEW — seek corroboration QUARANTINE
Mawḍūʿ (fabricated) REJECT + QUARANTINE NARRATOR REJECT + QUARANTINE NARRATOR

Pluggable Strategies — Extend It

The framework leaves key parameters open by design (paper §4.2/§4.3). Swap any:

Strategy Protocol Default What to provide
GradingStrategy isnad/types.py RefinedWeakestLink How links combine into chain grade
TransitionPolicy isnad/types.py BayesianTransitionPolicy Evidence → narrator grade transitions
CorroborationPolicy isnad/types.py CappedCorroborationPolicy Independent chains → claim upgrade
CorrelationDetector isnad/types.py SharedLineageDetector True independence between chains
ContentCritic isnad/critics/base.py HybridCritic / EmbeddingCritic Content contradiction detection

Swap a critic in one line:

from isnad.critics import EmbeddingCritic, LLMCritic

critic = EmbeddingCritic()                            # offline, fast
critic = LLMCritic(api_key="sk-...")                  # LLM-backed, higher quality

Good first issues:

  • Implement an alternative critic (sentence-transformers embedding, CrewAI integration)
  • Seed-grade bootstrapper from published benchmark data
  • Corroboration on a warm-grade corpus (the §8 experiment showed it's gated on warm grades)

Ecosystem


Citation

@article{raja2026grading,
  author  = {Ali Zahid Raja},
  title   = {Grading the Narrators: An Isnād–Rijāl Framework for
             Claim-Level Provenance in Multi-Agent Knowledge Systems},
  year    = 2026,
  doi     = {10.5281/zenodo.21211290},
}

@software{raja2026isnad,
  author  = {Ali Zahid Raja},
  title   = {Isnād–Rijāl Framework: Reference Implementation},
  year    = 2026,
  doi     = {10.5281/zenodo.21216873},
  orcid   = {0009-0003-7875-4590},
}

About

Built by Ali Zahid Raja · ORCID 0009-0003-7875-4590

The rigor belongs to twelve centuries of muḥaddithūn. The transfer to AI systems is the contribution claimed here. Built in public — collaborators welcome.

License: Code — Apache 2.0 · Paper & docs — CC BY 4.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

isnad-2.0.2.tar.gz (52.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

isnad-2.0.2-py3-none-any.whl (69.5 kB view details)

Uploaded Python 3

File details

Details for the file isnad-2.0.2.tar.gz.

File metadata

  • Download URL: isnad-2.0.2.tar.gz
  • Upload date:
  • Size: 52.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.25 {"installer":{"name":"uv","version":"0.11.25","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for isnad-2.0.2.tar.gz
Algorithm Hash digest
SHA256 87d08a8f4c1e4570c815a115669dc9f5b269d4a9b157a73ff9950fc8a9afb88d
MD5 6c4db0c55274100b3bbe0fcf956d37a7
BLAKE2b-256 1bb855e89dc59d80ba60ba5e96bc5bf0f3d524029036b900e4145ef627495166

See more details on using hashes here.

File details

Details for the file isnad-2.0.2-py3-none-any.whl.

File metadata

  • Download URL: isnad-2.0.2-py3-none-any.whl
  • Upload date:
  • Size: 69.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.25 {"installer":{"name":"uv","version":"0.11.25","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for isnad-2.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 38d9f1a7f804e6ffa93ca7feb153f64987cf97dce92dfe18734d2c9f97e0ef5d
MD5 ee2427b233feddbf03546d5855faf98c
BLAKE2b-256 5ed5adc648db9d411e54385ad8da9f0fea52c92d206f78a30996d030f46a05f6

See more details on using hashes here.

Release history Release notifications | RSS feed

2.0.14

2 files

2.0.13

2 files

2.0.12

2 files

2.0.11

2 files

2.0.10

2 files

2.0.9

2 files

2.0.8

2 files

2.0.7

2 files

2.0.6

2 files

2.0.5

2 files

2.0.4

2 files

2.0.3

2 files

This release

2.0.2 This release

2 files

2.0.1

2 files

2.0.0

2 files

1.0.2

2 files

1.0.0

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page