Scraper for ALLRIS
Project description
ALLRIS Scraper
This scraper requires your username and password and performs the following tasks for you:
- login
- download of all agendas and motions related to upcoming meetings of committees and plenary sessions
- Only considers meetings where you already have been invited formally through ALLRIS.
IMPORTANT: All districts are supported but official committe abbreviations will only work for Eimsbüttel as of now.
Requirements
- Python 3.7+
- Firefox installed
- geckodriver binary in PATH
Initial setup
- Install ALLRIS scraper
pip install twomartens.allrisscraper
(you need Python 3.7+) - Run ALLRIS scraper a first time
tm-allrisscraper
(creates config ini in your current working directory) - Fill out the config file with your login credentials and an absolute path on your system to store PDFs of files
Configuration
[Default]
; possible values for district: Altona, Bergedorf, Eimsbüttel, Hamburg-Nord,
; Hamburg-Mitte, Harburg, Wandsbek
district = Eimsbüttel
; if you are not from Eimsbüttel your domain ending will differ
username = max.mustermann@eimsbuettel.de
; password is stored in clear text, therefore ini file should have most
; restrictive read permissions
password = VerySecurePassword
; location for storage of PDFs (trailing slash is IMPORTANT)
pdflocation = /path/to/storage/of/PDFs/
Usage after initial setup
Run ALLRIS scraper: tm-allrisscraper
(takes a few seconds to finish)
In the specified location for download you will find the following structure:
YYYY-MM-DD_Abbreviation of committee or plenary session/
(one directory for each meeting)- files inside the directory
Einladung.pdf
(contains invitation),Mappe.pdf
(contains all motions in one document), andTagesordnung.pdf
(agenda)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for twomartens.allrisscraper-0.3.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 02114aef08cb36f3a537f2640926c9f4e9c26618463b7474f73870c4c439f55f |
|
MD5 | 3127b70ff63694bdd7680c81902a92a6 |
|
BLAKE2b-256 | 740d3824d5bc93309d4ac404a5486393245bc1689e08f813d578a3fa4b48d0ed |
Close
Hashes for twomartens.allrisscraper-0.3.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d0c91f1e6905a006dc08a9bd7ff2198c07c6e1ee32e79d572a915c9a1cb89149 |
|
MD5 | bc9df0dad023f03c3c48ae3da966267e |
|
BLAKE2b-256 | ed3df241dbc754a1dd6355610b249cf1f460ef6e5ae6bade0ca382acacf1137c |