A Python Package which helps to scrape news related details
Project description
news-fetch
news-fetch scrape all the news related attributes, was built on top of news-please and Newspaper3K which helps to reduce most of NaN or '' or [] or 'None' values while scraping. Platform-independent and written in Python 3. This package can be very easily used by programmers and developers to provide access to the New's data to their programs.
| Source | Link |
|---|---|
| PyPI: | https://pypi.org/project/news-fetch/ |
| Repository: | https://santhoshse7en.github.io/news-fetch/ |
| Documentation: | https://santhoshse7en.github.io/news-fetch_doc/ |
Dependencies
- beautifulsoup4
- fake_useragent
- selenium
- chromedriver-binary
- pandas
Dependencies Installation
Use the package manager pip to install following
pip install -r requirements.txt
Usage
Download it by clicking the green download button here on Github. To extract URLs from targeted website call google_search function, you only need to parse argument of keyword and newspaper link.
>>> from newsfetch.news import google_search
>>> google = google_search('Alcoholics Anonymous', 'https://timesofindia.indiatimes.com/')
Directory of google search results urls
To scrape the all news details call newspaper function
>>> from newsfetch.news import newspaper
>>> news = newspaper('https://www.bbc.co.uk/news/world-48810070')
Directory of news
>>> news.headline
'g20 summit: trump and xi agree to restart us china trade talks'
Contributing
Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.
Please make sure to update tests as appropriate.
License
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
