Web scraping API for Finnish websites
Project description
finscraper
The library provides an easy-to-use API for fetching data from various Finnish websites:
Website | Type | Spider API class |
---|---|---|
Ilta-Sanomat | News article | ISArticle |
Iltalehti | News article | ILArticle |
YLE Uutiset | News article | YLEArticle |
Demi | Discussion thread | DemiPage |
Suomi24 | Discussion thread | Suomi24Page |
Vauva | Discussion thread | VauvaPage |
Oikotie Asunnot | Apartment ad | OikotieApartment |
Tori | Item deal | ToriDeal |
Documentation is available at https://finscraper.readthedocs.io and simple online demo here.
Installation
pip install finscraper
Quickstart
Fetch 10 news articles as a pandas DataFrame from Ilta-Sanomat:
from finscraper.spiders import ISArticle
spider = ISArticle().scrape(10)
articles = spider.get()
The API is similar for all the spiders:
Contributing
Please see CONTRIBUTING.md for more information.
Jesse Myrberg (jesse.myrberg@gmail.com)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
finscraper-0.1.1b0.tar.gz
(21.3 kB
view hashes)