newsdatascraper 0.0.6

Easily query articles

NewsDataScrapper

Python package that helps you easily get news data

Requirements

• Python 3.5+
• Newspaper3k
• Api Key from NewsApi

Installation

pip3 install newsdatascraper

Usage

from newsdatascraper import Scraper
#To first get the articles
new_scraper = Scraper('mock-api-key')
articles = new_scraper.fetch_all_articles(query='two-sigma')
#To access individual articles and their properties
first_article = articles.articles[0]
print(first_article.content)
#We also provide helper functions to serialize the data
articles.toCsv('test.csv')
articles.toPickle('test.pickle')
articles.toJson()

Working on the Project

Run format

black .

Run Linter

pylama -o setup.cfg .

Run tests

pytest

Run tests + code coverage

sh ./scripts/generate_coverage.sh