Skip to main content

Scraper for ALLRIS

Project description

Apache License 2.0 Python 3.7 and 3.8 version 0.3.5

This scraper requires your username and password and performs the following tasks for you:

  • login
  • download of all agendas and motions related to upcoming meetings of committees and plenary sessions
    • Only considers meetings where you already have been invited formally through ALLRIS.

IMPORTANT: All districts are supported but official committee abbreviations will only work for Eimsbüttel as of now.

Requirements

Initial setup

  1. Install ALLRIS scraper pip install twomartens.allrisscraper (you need Python 3.7+)
  2. Run ALLRIS scraper a first time tm-allrisscraper (creates config ini in your current working directory)
  3. Fill out the config file with your login credentials and an absolute path on your system to store PDFs of files

Configuration

[Default]
; possible values for district: Altona, Bergedorf, Eimsbüttel, Hamburg-Nord,
; Hamburg-Mitte, Harburg, Wandsbek
district = Eimsbüttel
; if you are not from Eimsbüttel your domain ending will differ
username = max.mustermann@eimsbuettel.de
; password is stored in clear text, therefore ini file should have most
; restrictive read permissions
password = VerySecurePassword
; location for storage of PDFs (trailing slash is IMPORTANT)
pdflocation = /path/to/storage/of/PDFs/

Usage after initial setup

Run ALLRIS scraper: tm-allrisscraper (takes a few seconds to finish)

In the specified location for download you will find the following structure:

  • YYYY-MM-DD_Abbreviation of committee or plenary session/ (one directory for each meeting)
  • files inside the directory: Einladung.pdf (contains invitation), Mappe.pdf (contains all motions in one document), and Tagesordnung.pdf (agenda)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for twomartens.allrisscraper, version 0.3.5
Filename, size File type Python version Upload date Hashes
Filename, size twomartens.allrisscraper-0.3.5-py3-none-any.whl (13.5 kB) File type Wheel Python version py3 Upload date Hashes View hashes
Filename, size twomartens.allrisscraper-0.3.5.tar.gz (15.6 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page