climafeis

CLI Python application for scraping daily climate data from Canal CLIMA UNESP Ilha Solteira using requests and BeautifulSoup 4.

Installation

1. Make sure Python 3.8 or higher and pip are installed
2. Run pip install climafeis

Development

1. Check Python's version python -V

2. Install Python 3.8 or higher and pip, if they aren't already installed:

   • Windows winget install Python.Python.3.X (replace X with the desired minor version)
   • Ubuntu based distros apt install python3 python3-pip
   • Arch based distros pacman -S python python-pip
   • Fedora dnf install python3 python3-pip

3. Install poetry

4. Clone this repo git clone https://github.com/joaofauvel/climafeis.git && cd climafeis

5. Install requirements poetry install

Output headers

Reference

Usage

Daily data from ILHA_SOLTEIRA station from 30/05/2020 (dd/MM/YYYY) to 03/05/2020
climafeis ILHA_SOLTEIRA 30/05/2020 03/06/2020

Daily data from MARINOPOLIS station from 30/05/2020 to today
climafeis MARINOPOLIS 30/05/2020

Daily data from ILHA_SOLTEIRA station from 30/05/2020 to today, supplying username and password
climafeis ILHA_SOLTEIRA 30/05/2020 -U user -P password

usage: climafeis [-h] [-U USER] [-P PW] [-o OUT] [-l LOG] [-v] station start [end]

Scrape daily climate date from Canal CLIMA (https://clima.feis.unesp.br)

positional arguments:
station               station name: ILHA_SOLTEIRA, MARINOPOLIS, JUNQUEIROPOLIS, PARANAPUA, IRAPURU, 
                        POPULINA, SANTA_ADELIA_PIONEIROS, SANTA_ADELIA, BONANCA, ITAPURA, DRACENA
start                 start date dd/MM/YYYY (30/05/2020)
end                   end date dd/MM/YYYY (03/05/2020). Default: today

options:
-h, --help            show this help message and exit
-U USER, --user USER  override Canal CLIMA user set in the environment variable $USER_CLIMAFEIS
-P PW, --pw PW        override Canal CLIMA password set in the environment variable $PASSWD_CLIMAFEIS
-o OUT, --output OUT  output file. Default: <station>.csv
-l LOG, --log LOG     output log file. Default: stdout
-v, --verbose