Skip to main content

A package to scrape AgriMet weather data

Project description

agrimetscraper

introduction

agrimetscraper crawls AgriMet weather data and summarise for later data usage.

basic usage

Python virtual environment is preferred

pip install agrimetscraper

startproject -p <yourproject> -t <select database type: mongodb or sql or atlas>

It will create a directory for your project, this folder will contain yourproject-config, yourproject-log, yourproject-database, yourproject-stations

If you choose 'atlas', the program will prompt you for your atlas connection string and the password

cd into your project, change .ini file if needed

There are two baseurls for agrimet API: one is for daily, the other is for instant, are all defined in ini file

run project: python runproject.py -f "instant"|"daily" -n dbtable

set scheduler in .ini file (this program uses crontab)

**For instant data, program will aggregate 15 minutes into 1 hour interval and average the parameters

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for agrimetscraper, version 0.4.2
Filename, size File type Python version Upload date Hashes
Filename, size agrimetscraper-0.4.2-py3-none-any.whl (22.0 kB) File type Wheel Python version py3 Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page