periodical-requests-recorder 0.2.4

No project description provided

periodical_requests_recorder

Usage

periodical_recorder example.yaml

yaml data format example.

gmail_address: [e-mail]
gmail_oauth: <s>"~/yagmail_secret.json"</s>
tasks:
  -
    name: <s>"some_data"</s>
    url: <s>"https://example.com/somedata.csv"</s>
    record_dir: <s>"~/hist_data/"</s>
    output_file_format: <s>"{name}/{name}_%Y-%m-%d.csv"</s>
    cron_expr: <s>"0</s> <s>*</s> <s>*</s> <s>*</s> <s>*</s> <s>*</s> <s>*"</s>
    encoding: <s>"ms932"</s>
  -
    name: <s>"some_data_2"</s>
    url: <s>"https://www.google.com/"</s>
    record_dir: <s>"~/hist_data/"</s>
    output_file_format: <s>"{name}/{name}_%Y-%m-%d.txt"</s>
    cron_expr: <s>"@reboot"</s>
    target_elements:
      -
        element: <s>"#gws-output-pages-elements-homepage_additional_languages__als"</s>
        index: 3

Request result will be stored in the record_dir with your output_file_format.

If you set up yagmail, error messages will be sent to your address.

cron_expr format is the same as Crython.

Installation

You can install this with pip.

Requirements

Compatibility

Licence

Authors

periodical_requests_recorder was written by fx-kirin.