Skip to main content

Clean, functional data processing for human-centric applications. Normalize and standardize names, emails, phones, departments, and job titles with a single unified API.

Project description

HumanMint

Clean, normalized contact data in one line of code.

Standardize names, emails, phones, addresses, departments, job titles, and organizations with intelligent parsing and fuzzy matching.

from humanmint import mint

result = mint(
    name="Dr. John Q. Smith, PhD",
    email="JOHN.SMITH@CITY.GOV",
    phone="(202) 555-0173 ext 456",
    department="001 - Public Works Dept",
    title="Chief of Police"
)

print(result.name_str)          # "John Q Smith"
print(result.email_str)         # "john.smith@city.gov"
print(result.phone_str)         # "+1 202-555-0173"
print(result.department_str)    # "Public Works"
print(result.title_str)         # "police chief"

Why HumanMint?

Real-world contact data is messy:

  • Names with titles: "Dr. Jane Smith, PhD"
  • Inconsistent formatting: "JOHN@EXAMPLE.COM" vs "john.smith@example.com"
  • Phone number variations: "(202) 555-0101 x101" vs "202.555.0101"
  • Departments with noise: "000171 - Public Works 202-555-0150 ext 200"
  • Abbreviated titles: "Sr. Water Engr."

HumanMint handles all of this with zero configuration.

Installation

pip install humanmint

Key Features

  • Names: Parse, normalize, infer gender, detect nicknames, strip titles
  • Emails: Validate, normalize, detect free providers (Gmail, Yahoo, etc.)
  • Phones: Format (E.164), extract extensions, validate, detect type (mobile/landline)
  • Departments: Canonicalize, categorize, fuzzy match (23K+ dept names → 64 categories)
  • Titles: Standardize, match against curated list (100K+ job titles), confidence scores
  • Addresses: Parse US postal addresses (street, city, state, ZIP)
  • Organizations: Normalize agency/org names
  • Comparison: compare(result_a, result_b) for deduplication with 0-100 similarity scores
  • Batch: Parallel processing with bulk(records, workers=4) for high throughput
  • Export: JSON, CSV, Parquet, SQL with flatten option for direct database import

Quick Examples

Field Accessor Reference

All fields provide three access patterns:

Pattern Example Description
Dict access result.title["canonical"] Access specific processing stages
Property result.title_str Shorthand for canonical/standardized form
Full dict result.title All stages: raw, normalized, canonical, is_valid

Available Properties by Field

Names:

  • name_str - Full name
  • name_first - First name
  • name_last - Last name
  • name_middle - Middle name
  • name_suffix - Suffix (Jr., Sr., etc.)
  • name_gender - Inferred gender

Emails:

  • email_str - Normalized email
  • email_domain - Domain part
  • email_valid - Is valid email
  • email_generic - Is generic inbox (info@, admin@)
  • email_free - Is free provider (Gmail, Yahoo)

Phones:

  • phone_str - Formatted phone (pretty or E.164)
  • phone_e164 - E.164 format (+12025550123)
  • phone_pretty - Pretty format (+1 202-555-0123)
  • phone_extension - Extension number
  • phone_valid - Is valid phone
  • phone_type - Type (MOBILE, FIXED_LINE, etc.)

Departments:

  • department_str - Canonical department name
  • department_category - Department category
  • department_normalized - Normalized (pre-canonical)
  • department_override - Was override applied

Titles:

  • title_str - Canonical title
  • title_raw - Original input
  • title_normalized - Normalized (intermediate)
  • title_canonical - Standardized form
  • title_valid - Is valid title
  • title_confidence - Confidence score (0.0-1.0)

Addresses:

  • address_str / address_canonical - Full formatted address
  • address_raw - Original input
  • address_street - Street address
  • address_unit - Unit/apartment number
  • address_city - City
  • address_state - State
  • address_zip - ZIP code
  • address_country - Country

Organizations:

  • organization_raw - Original input
  • organization_normalized - Normalized form
  • organization_canonical - Canonical form
  • organization_confidence - Confidence score (0.0-1.0)

Accessing title fields

result = mint(title="Chief of Police")

# Dict access - different processing stages
result.title["raw"]         # "Chief of Police" (original input)
result.title["normalized"]  # "Chief of Police" (cleaned)
result.title["canonical"]   # "police chief" (standardized form)
result.title["is_valid"]    # True

# Shorthand properties
result.title_str            # "police chief" (same as canonical)
result.title_normalized     # "Chief of Police"

Comparing records

from humanmint import compare

r1 = mint(name="John Smith", email="john@example.com")
r2 = mint(name="Jon Smith", email="john.smith@example.com")

score = compare(r1, r2)  # Returns 0-100 similarity score
# Typically: >85 = likely duplicate, >70 = similar, <50 = different

Batch processing

from humanmint import bulk

records = [
    {"name": "Alice", "email": "alice@example.com"},
    {"name": "Bob", "email": "bob@example.com"},
]

results = bulk(records, workers=4, progress=True)

Performance

Dataset Time Per Record Throughput
1,000 561 ms 0.56 ms 1,783 rec/sec
10,000 3.1 s 0.31 ms 3,178 rec/sec
50,000 14.0 s 0.28 ms 3,576 rec/sec

Documentation

  • API Reference — Full function documentation
  • Use Cases — Real-world examples (Government contacts, HR, Salesforce, etc.)
  • Fields Guide — Access all returned fields
  • Advanced — Custom weights, overrides, batch export

CLI

humanmint clean input.csv output.csv --name-col name --email-col email

Testing

pytest -q unittests

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

humanmint-0.1.17.tar.gz (1.9 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

humanmint-0.1.17-py3-none-any.whl (1.9 MB view details)

Uploaded Python 3

File details

Details for the file humanmint-0.1.17.tar.gz.

File metadata

  • Download URL: humanmint-0.1.17.tar.gz
  • Upload date:
  • Size: 1.9 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.9

File hashes

Hashes for humanmint-0.1.17.tar.gz
Algorithm Hash digest
SHA256 95943fdbdc6d5858c4eadc0df64d27c5406b213a06364b4631783148a1c5a5fb
MD5 1d72b3b45ff2ab66370d788d8467afbf
BLAKE2b-256 e6efe241605467c188dbd2fe451ae7846e615d235c79194a4d1b076d22fbe619

See more details on using hashes here.

File details

Details for the file humanmint-0.1.17-py3-none-any.whl.

File metadata

  • Download URL: humanmint-0.1.17-py3-none-any.whl
  • Upload date:
  • Size: 1.9 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.9

File hashes

Hashes for humanmint-0.1.17-py3-none-any.whl
Algorithm Hash digest
SHA256 7211c65371d3807e6748566c57fffd5db52b8802e85978f758a512ab01f72570
MD5 72c8406abc9f2f7168c444217d736fdb
BLAKE2b-256 919a6ccc0ab9b89a8a32e8fbf0c36aa0416fca97126a5a198db9e1aa0a2db846

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page