Skip to main content

A scraper of statistical data from the Siris database of Skolverket, built on top of Statscraper.

Project description

This is a non-official scraper for statistical data from the Skolverket’s (https://www.skolverket.se/skolutveckling/statistik/)[SIRIS database] built on top of the Statscraper package <https://github.com/jplusplus/statscraper>. It lets you interact with the stat export interface in a pythonic way.

Install

pip install siris_scraper

Example usage

from siris.scraper import SirisScraper

# Init scraper
scraper = SirisScraper()

# List all schooltypes
skolformer = scraper.items

# Select a dataset
dataset = skolformer.get_by_label(u"Grundskolan")\
  .items.get_by_label("Kommunnivå")\
  .items.get_by_label("Personal")\
  .items.get_by_label("Personalstatistik")


# Make a query
res = dataset.fetch()  # Get latest available data
#res = dataset.fetch({"period": "2015"})  # Get data for a given period
#res = dataset.fetch({"period": "*"})  # Get data all periods

# List all avilable periods
print(dataset.periods)

# Use the result
# ...in Python Pandas for example
dataframe = res.pandas

Develop

Set up:

pip install -r requirements.txt

Run tests:

make tests

Deploy

To pypi:

python3 deploy_to_pypi.py

Todo

  • Handle filtering in export (“Begränsa träfflista”)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

siris_scraper-0.4.0.tar.gz (7.3 kB view details)

Uploaded Source

Built Distribution

siris_scraper-0.4.0-py3-none-any.whl (7.3 kB view details)

Uploaded Python 3

File details

Details for the file siris_scraper-0.4.0.tar.gz.

File metadata

  • Download URL: siris_scraper-0.4.0.tar.gz
  • Upload date:
  • Size: 7.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.6.0 importlib_metadata/6.0.0 pkginfo/1.8.1 requests/2.28.2 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.8.10

File hashes

Hashes for siris_scraper-0.4.0.tar.gz
Algorithm Hash digest
SHA256 57794dcdb3ace3da91f4baccfa33d5007c2d40a5e9c00fd764a3adcf161a6891
MD5 2388e6b702b823ef2840cc8519277890
BLAKE2b-256 374a775620603df5adab8679a8451c51037b1c0bc7565018f680caf0b7782a5e

See more details on using hashes here.

File details

Details for the file siris_scraper-0.4.0-py3-none-any.whl.

File metadata

  • Download URL: siris_scraper-0.4.0-py3-none-any.whl
  • Upload date:
  • Size: 7.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.6.0 importlib_metadata/6.0.0 pkginfo/1.8.1 requests/2.28.2 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.8.10

File hashes

Hashes for siris_scraper-0.4.0-py3-none-any.whl
Algorithm Hash digest
SHA256 c0fa906109de04c542d905480acf2a639c1da9fb663d0c8aeb185284f6cd2869
MD5 388649b85c14f40f178e1db8c5db3dd7
BLAKE2b-256 611a567bd705dacbf08783dbf7af4d95b1deb5d90c28a62088178bc4672c6a42

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page