Scraper for ALLRIS
Project description
ALLRIS Scraper
This scraper requires your username and password and performs the following tasks for you:
- login
- download of all agendas and motions related to upcoming meetings of committees and plenary sessions
- Only considers meetings where you already have been invited formally through ALLRIS.
IMPORTANT: All districts are supported but official committe abbreviations will only work for Eimsbüttel as of now.
Requirements
- Python 3.7+
- Firefox installed
- geckodriver binary in PATH
Initial setup
- Install ALLRIS scraper
pip install twomartens.allrisscraper
(you need Python 3.7+) - Run ALLRIS scraper a first time
tm-allrisscraper
(creates config ini in your current working directory) - Fill out the config file with your login credentials and an absolute path on your system to store PDFs of files
Configuration
[Default]
; possible values for district: Altona, Bergedorf, Eimsbüttel, Hamburg-Nord,
; Hamburg-Mitte, Harburg, Wandsbek
district = Eimsbüttel
; if you are not from Eimsbüttel your domain ending will differ
username = max.mustermann@eimsbuettel.de
; password is stored in clear text, therefore ini file should have most
; restrictive read permissions
password = VerySecurePassword
; location for storage of PDFs (trailing slash is IMPORTANT)
pdflocation = /path/to/storage/of/PDFs/
Usage after initial setup
Run ALLRIS scraper: tm-allrisscraper
(takes a few seconds to finish)
In the specified location for download you will find the following structure:
YYYY-MM-DD_Abbreviation of committee or plenary session/
(one directory for each meeting)- files inside the directory
Einladung.pdf
(contains invitation),Mappe.pdf
(contains all motions in one document), andTagesordnung.pdf
(agenda)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for twomartens.allrisscraper-0.3.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | a92efd3b565074e4628e65c4b6a2200d1220a0f1324c5a391934e358c75f2407 |
|
MD5 | d0e4613fa878771141c125a6715fc38c |
|
BLAKE2b-256 | a32d6fcd6f4706310de7eb042d120e022d34a900c23fe4b94ed58d3519f828a0 |
Close
Hashes for twomartens.allrisscraper-0.3.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b9083e8070f6970e50cd64864d6b4fbd9eaa1b08fe613e81f742fb3ea45f01ec |
|
MD5 | 82ee4d3fa0d75bc82cb4cb36b0636de7 |
|
BLAKE2b-256 | 5adc8f78b750f1ebfbe0cbc78e35efd23c896033701c9cd5775d9a77ddc28849 |