Skip to main content

Bezier curve simulation (including reductions the dimension from 3 to 2)

Project description

1   HistoricalWeatherTW 台灣歷史天氣爬蟲

This script is to crawl the information of 觀測資料查詢 website

Data from 觀測資料查詢系統

2   Usage

  1. Prepare station.csv.

    Note

    station.csv (you can find it from the https://e-service.cwb.gov.tw/wdps/obs/state.htm)

  2. run the function of collect_weather_tw you will see the result!

    def collect_weather_tw(station_csv_path: Path, output_path,
                           end_date: datetime.date, begin_date: datetime.date,
                           query_format,
                           convert2num):
    

You can refer to __init__.py for more help

  1. Prepare config.yaml and use this path as input parameter
  2. run __init__.py

2.1   QUICKLY START

from Carson.Tool.HistoricalWeatherTW import collect_weather_tw, QueryFormat
from pathlib import Path
import datetime
import os

if __name__ == '__main__':
    STATION_CSV = '../config/CSV/station_test.csv'
    OUTPUT_PATH = Path(f'../temp/year_result.csv')
    BEGIN_DATE = datetime.date(2019, 10, 1)
    END_DATE = datetime.date(2019, 10, 2)
    QUERY_FORMAT = QueryFormat.DAY
    CONVERT2NUM = True
    collect_weather_tw(Path(STATION_CSV), OUTPUT_PATH,
                       BEGIN_DATE, END_DATE,
                       QUERY_FORMAT,
                       CONVERT2NUM)
    os.startfile(OUTPUT_PATH)

3   Data

資料會以觀測站ID+站名儲存

Note

There have some non-numeric forms of the original data. Such as indefinite wind direction V, rain track T, etc. the variable of CONVERT2NUM will replace them with numbers.

3.1   資料欄位如下

ObsTime 觀測時間(LST)

StnPres 測站氣壓(hPa)

SeaPres 海平面氣壓(hPa)

Temperature 氣溫(℃)

Tddewpoint 露點溫度(℃)

RH 相對溼度(%)

WS 風速(m/s)

WD 風向(360degree)

WSGust 最大陣風(m/s)

WDGust 最大陣風風向(360degree)

Precp 降水量(mm)

PrecpHour 降水時數(hr)

SunShine 日照時數(hr)

GloblRad 全天空日射量(MJ/㎡)

Visb 能見度(km)

4   Release note

4.1   v4.0

Encapsulated as API

4.2   v3.0

Features:

  • All outputs into a single file. (making it easier to use for SQL)
  • The output header field will automatically grab the content on the web page (not use hard coding)
  • You can choose the type of query (year, month, day) according to your needs.

Other:

  • Make the code easier to read.

4.3   V2.0

加入全台觀測站

4.4   V1.0

第一版

Project details


Release history Release notifications

This version

4.1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for carson-tool.HistoricalWeatherTW, version 4.1.0
Filename, size File type Python version Upload date Hashes
Filename, size carson-tool.HistoricalWeatherTW-4.1.0.tar.gz (6.8 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page