Skip to main content

Quick and dirty date parsing Python library to parse HTML dates really fast

Project description

qddate — quick and dirty date parsing for scraped HTML

CI PyPI Version Docs Coverage Gitter

qddate is a Python 3 library focused on parsing date strings extracted from messy HTML pages as fast as possible. It was born out of long-term news aggregation work and is intentionally pragmatic: fewer abstractions, lots of hard-coded optimizations, and enough language coverage to process millions of strings at scale. The parser ships as part of the "news reconstruction" toolchain that can build RSS feeds for sites that never offered one.

If you need broader language coverage (but can trade speed for flexibility), check out dateparser or dateutil.

Documentation

Full documentation is automatically published at Read the Docs.

Features

  • 712+ date patterns (expanded from 89 base patterns) and growing on demand
  • Multi-language parsing (English, Russian, Spanish, Portuguese, and more)
  • Handles left-aligned dates with trailing text: 12.03.1999 some text here
  • Prioritizes speed via pyparsing, hard-coded constants, and dirty tricks

Recent updates

1.0.10 — English weekday with abbreviated month-first dates, e.g. Thursday, Jun 25, 2026 and Monday, Jun 22, 2026 - 13:46.

1.0.9 — Spanish article dates with a comma before the year, e.g. 03 de Julio, 2026 and 30 de junio, 2026 (common on Latin American government sites).

See CHANGELOG.md for the full release history.

Limitations

  • Limited language coverage compared to larger projects
  • Adding new languages requires editing pattern tables manually
  • Rare/odd formats may still slip through
  • No relative date parsing or calendar support

Speed Optimization

  • All constants are embedded directly; no runtime configuration files
  • Only depends on datetime and pyparsing (plus packaging tooling)
  • Avoids regular expressions in favor of pre-generated pyparsing patterns
  • Aggressive pattern filtering using min/max length filters and prefix heuristics
  • Nothing is loaded from disk at runtime besides the Python modules themselves

Benchmark & Performance Notes

  • Standard benchmarks: benchmarks/bench.py compares qddate with dateparser on the bundled corpus. Run python benchmarks/bench.py to execute.
  • Webpage data benchmarks: benchmarks/benchmark_webpage_data.py tests qddate against other libraries using real-world text snippets extracted from webpages. Use scripts/generate_webpage_test_data.py to generate test data from government and international organization websites.
  • Comprehensive performance tests: benchmarks/comprehensive_performance_test.py provides extensive performance testing with detailed metrics, pattern analysis, and regression detection. See benchmarks/README_PERFORMANCE_TEST.md for details.
  • PERFORMANCE_ANALYSIS.md documents the 2025 profiling work (length-based indexing, prefix caching, packrat parsing, etc.) and how to evaluate future optimizations.
  • Benchmark numbers depend on hardware, Python version, and workload. Please share your results in issues if you run the benchmark elsewhere.

Usage

The simplest way to work with qddate is through qddate.DateParser and its parse method:

import qddate

parser = qddate.DateParser()
print(parser.parse('2012-12-15'))
print(parser.parse('Fri, 12 Dec 2014 10:55:50'))
print(parser.parse('Thursday, Jun 25, 2026'))
print(parser.parse('03 de Julio, 2026'))
print(parser.parse('пятница, июля 17, 2015'))

The parser auto-detects languages for each string and returns datetime.datetime instances when it finds a match.

Dependencies

Supported Languages

  • Bulgarian
  • Czech
  • English
  • French
  • German
  • Italian
  • Polish
  • Portuguese
  • Russian
  • Spanish
  • Turkish

Thanks

The original parser dates back to 2008 and evolved from regular expressions into pyparsing over time. Thanks to the ScrapingHub team for the inspiration to clean up the code, documentation, and build tooling, and for motivating the public release.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

qddate-1.0.10.tar.gz (95.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

qddate-1.0.10-py2.py3-none-any.whl (118.8 kB view details)

Uploaded Python 2Python 3

File details

Details for the file qddate-1.0.10.tar.gz.

File metadata

  • Download URL: qddate-1.0.10.tar.gz
  • Upload date:
  • Size: 95.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for qddate-1.0.10.tar.gz
Algorithm Hash digest
SHA256 784208e5b0aaa50ef37a3232f881106579e1f4c5a5c68c70bc1b74a5f1f93186
MD5 974492363310e527dd7bc23ecb8c9fdc
BLAKE2b-256 b74c8e41dfec5966438748a3ad48821693c8a13b5e3356be360f90533fe7b5be

See more details on using hashes here.

File details

Details for the file qddate-1.0.10-py2.py3-none-any.whl.

File metadata

  • Download URL: qddate-1.0.10-py2.py3-none-any.whl
  • Upload date:
  • Size: 118.8 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for qddate-1.0.10-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 2e2056f5e81a47af0fb65686c10f4c567043ee9fd50e7bcf34baa561273d27b8
MD5 8e496560ec827f4997359a0f6b63474f
BLAKE2b-256 b1c19c2e0952b040209dc540fde3439547e3058c2f610de709879649ce10e654

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page