Web scraping API for Finnish websites
Project description
finscraper
The library provides an easy-to-use API for fetching data from various Finnish websites:
| Website | Type | Spider API class |
|---|---|---|
| Ilta-Sanomat | News article | ISArticle |
| Iltalehti | News article | ILArticle |
| YLE Uutiset | News article | YLEArticle |
| Demi | Discussion thread | DemiPage |
| Suomi24 | Discussion thread | Suomi24Page |
| Vauva | Discussion thread | VauvaPage |
| Oikotie Asunnot | Apartment ad | OikotieApartment |
| Tori | Item deal | ToriDeal |
Documentation is available at https://finscraper.readthedocs.io and simple online demo here.
Installation
pip install finscraper
Quickstart
Fetch 10 news articles as a pandas DataFrame from Ilta-Sanomat:
from finscraper.spiders import ISArticle
spider = ISArticle().scrape(10)
articles = spider.get()
The API is similar for all the spiders:
Contributing
Please see CONTRIBUTING.md for more information.
Jesse Myrberg (jesse.myrberg@gmail.com)
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
finscraper-0.1.0b0.tar.gz
(21.3 kB
view hashes)
