Skip to main content

Web scraping API for Finnish websites

Project description

finscraper

Build Status Documentation Status

finscraper cover

The library provides an easy-to-use API for fetching data from various Finnish websites:

Website Type Spider API class
Ilta-Sanomat News article ISArticle
Iltalehti News article ILArticle
YLE Uutiset News article YLEArticle
Demi Discussion thread DemiPage
Suomi24 Discussion thread Suomi24Page
Vauva Discussion thread VauvaPage
Oikotie Asunnot Apartment ad OikotieApartment
Tori Item deal ToriDeal

Documentation is available at https://finscraper.readthedocs.io and simple online demo here.

Installation

pip install finscraper

Quickstart

Fetch 10 news articles as a pandas DataFrame from Ilta-Sanomat:

from finscraper.spiders import ISArticle

spider = ISArticle().scrape(10)

articles = spider.get()

The API is similar for all the spiders:

Finscraper in action

Contributing

Please see CONTRIBUTING.md for more information.


Jesse Myrberg (jesse.myrberg@gmail.com)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for finscraper, version 0.1.1b0
Filename, size File type Python version Upload date Hashes
Filename, size finscraper-0.1.1b0.tar.gz (21.3 kB) File type Source Python version None Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page