A package to scrape AgriMet weather data
Project description
agrimetscraper
introduction
agrimetscraper crawls AgriMet weather data and summarise for later data usage.
basic usage
Python virtual environment is preferred
pip install agrimetscraper
startproject -p <yourproject> -t <select database type: mongodb or sql or atlas>
It will create a directory for your project, this folder will contain yourproject-config, yourproject-log, yourproject-database, yourproject-stations
If you choose 'atlas', the program will prompt you for your atlas connection string and the password
cd into your project, change .ini file if needed
There are two baseurls for agrimet API: one is for daily, the other is for instant, are all defined in ini file
run project: python runproject.py -f "instant"|"daily" -n dbtable
set scheduler in .ini file (this program uses crontab)
**For instant data, program will aggregate 15 minutes into 1 hour interval and average the parameters
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
File details
Details for the file agrimetscraper-0.4.2-py3-none-any.whl
.
File metadata
- Download URL: agrimetscraper-0.4.2-py3-none-any.whl
- Upload date:
- Size: 22.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.19.1 setuptools/40.5.0 requests-toolbelt/0.8.0 tqdm/4.26.0 CPython/3.7.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | a046d5022a240cccf4c068198b96ad262c5fa67ad6dd3bf63a9eec70137bbc1c |
|
MD5 | 6f7b1c87b6cfdd1a9d73566d0494e207 |
|
BLAKE2b-256 | 285621c00fea3e67f349ccada5a3dc0ebfa94f5502b87b7426ded87ff7aecffd |