Skip to main content

Scrape daily climate data from Canal CLIMA

Project description

climafeis

CLI Python application for scraping daily climate data from Canal CLIMA UNESP Ilha Solteira using requests and BeautifulSoup 4.

Installation

  1. Make sure Python 3.8 or higher and pip are installed
  2. Run pip install climafeis

Development

  1. Check Python's version python -V

  2. Install Python 3.8 or higher and pip, if they aren't already installed:

    • Windows winget install Python.Python.3.X (replace X with the desired minor version)
    • Ubuntu based distros apt install python3 python3-pip
    • Arch based distros pacman -S python python-pip
    • Fedora dnf install python3 python3-pip
  3. Install poetry

  4. Clone this repo git clone https://github.com/joaofauvel/climafeis.git && cd climafeis

  5. Install requirements poetry install

Output headers

Header Description
Date Observation date (dd-mm-yyyy)
Tmean Mean temperature (ºC)
Tmax Max temperature (ºC)
Tmin Min temperature (ºC)
RHmean Mean relative humidity (%)
RHmax Max relative humidity (%)
RHmin Min relative humidity (%)
Pmean Mean pressure (kPa)
Rn Net radiation (MJ/m^2*day)
Rl Liquid radiation (MJ/m^2*day)
G Soil heat flux (MJ/m^2*day)
PAR (μmoles/m^2)
ETcat Evapotranspiration Class A Tank (mm/day)
ET0pm Reference evapotranspiration Penman–Monteith (mm/day)
ET0cat Reference evapotranspiration Class A Tank (mm/day)
U2max Max windspeed at 2 meters (m/s)
U2mean Mean windspeed at 2 meters (m/s)
U2dir Wind direction at 2 meters (º)
Rain Rainfall (mm)
Insolation Solar insolation (h/day)

Reference

Usage

Daily data from ILHA_SOLTEIRA station from 30/05/2020 (dd/MM/YYYY) to 03/05/2020
climafeis ILHA_SOLTEIRA 30/05/2020 03/06/2020

Daily data from MARINOPOLIS station from 30/05/2020 to today
climafeis MARINOPOLIS 30/05/2020

Daily data from ILHA_SOLTEIRA station from 30/05/2020 to today, supplying username and password
climafeis ILHA_SOLTEIRA 30/05/2020 -U user -P password


usage: climafeis [-h] [-U USER] [-P PW] [-o OUT] [-l LOG] [-v] station start [end]

Scrape daily climate date from Canal CLIMA (https://clima.feis.unesp.br)

positional arguments:
station               station name: ILHA_SOLTEIRA, MARINOPOLIS, JUNQUEIROPOLIS, PARANAPUA, IRAPURU, 
                        POPULINA, SANTA_ADELIA_PIONEIROS, SANTA_ADELIA, BONANCA, ITAPURA, DRACENA
start                 start date dd/MM/YYYY (30/05/2020)
end                   end date dd/MM/YYYY (03/05/2020). Default: today

options:
-h, --help            show this help message and exit
-U USER, --user USER  override Canal CLIMA user set in the environment variable $USER_CLIMAFEIS
-P PW, --pw PW        override Canal CLIMA password set in the environment variable $PASSWD_CLIMAFEIS
-o OUT, --output OUT  output file. Default: <station>.csv
-l LOG, --log LOG     output log file. Default: stdout
-v, --verbose

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

climafeis-1.0.10.tar.gz (17.1 kB view details)

Uploaded Source

Built Distribution

climafeis-1.0.10-py3-none-any.whl (17.6 kB view details)

Uploaded Python 3

File details

Details for the file climafeis-1.0.10.tar.gz.

File metadata

  • Download URL: climafeis-1.0.10.tar.gz
  • Upload date:
  • Size: 17.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.6.1 CPython/3.11.4 Windows/10

File hashes

Hashes for climafeis-1.0.10.tar.gz
Algorithm Hash digest
SHA256 e1d745d119ccf487e8c63ff4e155c60457b332089c7c0ec0049047f06a72d391
MD5 c0cb4ef2d5166c13e7fab2d9e36a30b2
BLAKE2b-256 c828ee8bf07e252ca5348ccf919e08d747e19ff1ba3f257d3a8f260b22e5c871

See more details on using hashes here.

File details

Details for the file climafeis-1.0.10-py3-none-any.whl.

File metadata

  • Download URL: climafeis-1.0.10-py3-none-any.whl
  • Upload date:
  • Size: 17.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.6.1 CPython/3.11.4 Windows/10

File hashes

Hashes for climafeis-1.0.10-py3-none-any.whl
Algorithm Hash digest
SHA256 a975f6abad75392352494b77c61cf7167f0bd2ecd30b255df6aa3614fc90d8c4
MD5 2a3444519bba8c9a596fc59660ffafb3
BLAKE2b-256 55d636d5bd10d3e92204cd3243683bf6827259c8b103f331608fe8f240ed20cf

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page