articleDateExtract 0.10

Automatically extracts and normalizes an online article or blog post publication date

About

articleDateExtract (Article Date Extract) is a simple open source Python module which is an extension of the articleDateExtracor, built and maintained by Krishna Kishore, that automatically detects, extracts and normalizes the publication date of an online article or blog post.

Feature

1. Extracting the publication date information when it is specified in a web page, with over 95% success rate.

A Quick Example

    import articleDateExtract

    d = articleDateExtract.extractArticlePublishedDate("http://edition.cnn.com/2015/11/28/opinions/sutter-cop21-paris-preview-two-degrees/index.html")

    print (d)

    d = articleDateExtract.extractArticlePublishedDate("http://techcrunch.com/2015/11/29/tyro-payments/")

    print (d)

Installing

Available through pip:

    $ pip install articleDateExtract

Alternatively, you can install from source:

    $ git clone https://github.com/blueshirtdeveloper/article-date-extract.git
    $ cd article-date-extract
    $ python setup.py install

Dependencies

• beautifulsoup4 >= 4.9.3
• python-dateutil >= 2.7.3
• lxml >= 4.6.1

About Krishna Kishore

I'm Krishna Kishore. I work as a full-time programmer. In my spare time I do open-sourcing. we crawl the news sites so the need for a scalable solution that will automatically extract and structure the unstructured web is critical. We use multiple signals and algorithms to automatically detect where the post text is, the author name, the comments, and of course the date. With articleDateExtract (Article Date Extract) we rely on the many "different types of standards" out there to automatically detect the date (with a success rate of over 95%).