Scraper for ALLRIS
Project description
ALLRIS Scraper
This scraper requires your username and password and performs the following tasks for you:
- login
- download of all agendas and motions related to upcoming meetings of committees and plenary sessions
- Only considers meetings where you already have been invited formally through ALLRIS.
IMPORTANT: All districts are supported but official committe abbreviations will only work for Eimsbüttel as of now.
Requirements
- Python 3.7+
- Firefox installed
- geckodriver binary in PATH
Initial setup
- Install ALLRIS scraper
pip install twomartens.allrisscraper
(you need Python 3.7+) - Run ALLRIS scraper a first time
tm-allrisscraper
(creates config ini in your current working directory) - Fill out the config file with your login credentials and an absolute path on your system to store PDFs of files
Configuration
[Default]
; possible values for district: Altona, Bergedorf, Eimsbüttel, Hamburg-Nord,
; Hamburg-Mitte, Harburg, Wandsbek
district = Eimsbüttel
; if you are not from Eimsbüttel your domain ending will differ
username = max.mustermann@eimsbuettel.de
; password is stored in clear text, therefore ini file should have most
; restrictive read permissions
password = VerySecurePassword
; location for storage of PDFs (trailing slash is IMPORTANT)
pdflocation = /path/to/storage/of/PDFs/
Usage after initial setup
Run ALLRIS scraper: tm-allrisscraper
(takes a few seconds to finish)
In the specified location for download you will find the following structure:
YYYY-MM-DD_Abbreviation of committee or plenary session/
(one directory for each meeting)- files inside the directory
Einladung.pdf
(contains invitation),Mappe.pdf
(contains all motions in one document), andTagesordnung.pdf
(agenda)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for twomartens.allrisscraper-0.3.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 58f3b9e87980eca3209e349f532153702dbae72d6ca1cb42bfe2163f17da6397 |
|
MD5 | 6f0cbf2b2522a8770091e15a6229acc1 |
|
BLAKE2b-256 | afbf3577dd1f467d0349a7587662d03bb5b3bb357539b58aeb73119cb2f7c7c1 |
Close
Hashes for twomartens.allrisscraper-0.3.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a33569a5a83f28c2c798652a52207eeb078ebc666e2f38890d445a8cd252115c |
|
MD5 | a5b14e496529a06dd0a8858391efe8c0 |
|
BLAKE2b-256 | 1e0985bf98bbe48beb3af03d44ed62f338108de4f20650e9789f36a924e40e87 |