4 projects
commonlid
Evaluate language identification models on CommonLID and other benchmarks.
url-is-in
A Python package for efficiently checking if a URL is part of large whitelist or blacklist of URLs and domain names.
cc-pyspark
Common Crawl data processing examples for PySpark.
cdx-toolkit
A toolkit for working with CDX indices
