corp-entity-db 0.2.0

Entity database for organizations, people, roles, and locations with embedding search

corp-entity-db

Entity database library and search engine for organizations, people, roles, and locations. Provides embedding-based semantic search over entities imported from GLEIF, SEC Edgar, Wikidata, and Companies House.

Installation

# Default: search and resolve (no build dependencies)
pip install corp-entity-db

# With database build/import support
pip install "corp-entity-db[build]"

# With HTTP server (corp-entity-db serve)
pip install "corp-entity-db[serve]"

# With remote client (EntityDBClient)
pip install "corp-entity-db[client]"

# Everything
pip install "corp-entity-db[all]"

The default install includes sentence-transformers, USearch, and huggingface_hub for searching and downloading pre-built databases. The embedding model (google/embeddinggemma-300m, 300M params) is downloaded automatically on first use.

Quick Start

# Download the lite database + USearch indexes
corp-entity-db download

# Search organizations
corp-entity-db search "Microsoft"
corp-entity-db search "Microsoft" --hybrid

# Search people
corp-entity-db search-people "Tim Cook"

# Show database statistics
corp-entity-db status

Python API

from corp_entity_db import OrganizationDatabase, get_database_path

db = OrganizationDatabase(get_database_path())
matches = db.search("Microsoft", limit=10)
for match in matches:
    print(f"{match.record.name} ({match.record.entity_type}) - score: {match.score:.3f}")

Server Mode

Keep models warm in memory for low-latency repeated searches (requires [serve] extra):

corp-entity-db serve                  # Start on localhost:8222
corp-entity-db serve --port 9000      # Custom port

Data Sources

Source	Description	Scale
Companies House	UK registered companies + officers	~5.5M orgs, ~27.5M people
Wikidata	Organizations & notable people	~1.7M orgs, ~39.4M people
GLEIF	Legal Entity Identifier records	~2.6M orgs
SEC Edgar	US public company filers & officers	~73K orgs
Total		~9.9M orgs, ~66.9M people

Database Variants

• Lite (default download): No embedding tables, uses USearch HNSW indexes for search (~7GB)
• Full: Includes float32 and int8 embedding tables (~32GB)

HuggingFace dataset: Corp-o-Rate-Community/entity-references