This library is made of two parts:
Extraction(STABLE) (requires Python 3.7+) - see examples and sample data for both real-time and historical data.Analysis(WIP)
News api download sources
Real-time data sources incorporated:
- BBC News
- FOX News
- ABC News
- NYTimes
- YahooFinance
- Sky News
- Forbes
- CNBC Finance
Historical news data from:
- NYTimes
To use your own data sources you can update the json config file or provide your own.
Other news sources:
- https://github.com/abisee/cnn-dailymail processes the https://cs.nyu.edu/~kcho/DMQA/ DeepMind Dataset (2015 - CNN & DailyMail)
- Kaggle million-headlines dataset (ABC News)
- GLUE & SUPERGLUE RTE datasets
Usage
python examples/get_historical_news_data.py
python examples/get_news_data.py
Analysis (NLP)
(WIP)
1 maintainer
Metadata
1 maintainer
Release files for newsai 0.9
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| newsai-0.9.tar.gz | 11.7 kB | Details |
Release files / newsai-0.9.tar.gz
| Download URL | newsai-0.9.tar.gz |
|---|---|
| Size | 11.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
16fae29356b3f0de5a12fc06c1cd3ca164532fc0b91433afe36eeceb0d08d18c
|
|
BLAKE2b-256 checksum How to use checksums |
2bbf0b101d7e09b84d53f1572f484f72d951cb29e4f3bdc682c76688e7362b77
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.2.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/45.2.0.post20200210 requests-toolbelt/0.9.1 tqdm/4.42.1 CPython/3.7.6
|
