Skip to main content

Export

Project description

Export CSV To Influx: Process CSV data, and export the data to influx db

Install

Use the pip to install the library. Then the binary export_csv_to_influx is ready.

` pip install ExportCsvToInflux `

Features

  1. Allow to use binary export_csv_to_influx to run exporter

  2. Allow to check dozens of csv files in a folder

  3. Auto convert csv data to int/float/string in Influx

  4. Allow to limit string length in Influx

  5. Allow to judge the csv has new data or not

  6. Allow to use the latest file modify time as time column

  7. Auto Create database if not exist

  8. Allow to drop database before inserting data

  9. Allow to drop measurements before inserting data

  10. Allow to match or filter the data by using string or regex.

  11. Allow to count, and generate count measurement

Command Arguments

You could use export_csv_to_influx -h to see the help guide.

-c, –csv, Input CSV file path, or the folder path. Mandatory

-d, –delimiter, CSV delimiter. Default: ‘,’.

-lt, –lineterminator, CSV lineterminator. Default: ‘n’.

-s, –server, InfluxDB Server address. Default: localhost:8086.

-u, –user, InfluxDB User name. Default: admin

-p, –password, InfluxDB Password. Default: admin

-db, –dbname, InfluxDB Database name. Mandatory

-m, –measurement, Measurement name. Mandatory

-t, –time_column, Timestamp column name. Default: timestamp. If no timestamp column, the timestamp is set to the last file modify time for whole csv rows.

-tf, –time_format, Timestamp format. Default: ‘%Y-%m-%d %H:%M:%S’ e.g.: 1970-01-01 00:00:00.

-tz, –time_zone, Timezone of supplied data. Default: UTC.

-fc, –field_columns, List of csv columns to use as fields, separated by comma. Mandatory

-tc, –tag_columns, List of csv columns to use as tags, separated by comma. Mandatory

-b, –batch_size, Batch size when inserting data to influx. Default: 500.

-lslc, –limit_string_length_columns, Limit string length column, separated by comma. Default: None.

-ls, –limit_length, Limit length. Default: 20.

-dd, –drop_database, Drop database before inserting data. Default: False.

-dm, –drop_measurement, Drop measurement before inserting data. Default: False.

-mc, –match_columns, Match the data you want to get for certain columns, separated by comma. Match Rule: All matches, then match. Default: None.

-mbs, –match_by_string, Match by string, separated by comma. Default: None.

-mbr, –match_by_regex, Match by regex, separated by comma. Default: None.

-fic, –filter_columns, Filter the data you want to filter for certain columns, separated by comma. Filter Rule: Any one filter success, the filter. Default: None.

-fibs, –filter_by_string, Filter by string, separated by comma. Default: None.

-fibr, –filter_by_regex, Filter by regex, separated by comma. Default: None.

-ecm, –enable_count_measurement, Enable count measurement. Default: False.

-fi, –force_insert_even_csv_no_update, Force insert data to influx, even csv no update. Default: False.

For more info, please refer to the https://github.com/Bugazelle/export-csv-to-influx

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ExportCsvToInflux-0.1.11.tar.gz (12.8 kB view details)

Uploaded Source

File details

Details for the file ExportCsvToInflux-0.1.11.tar.gz.

File metadata

  • Download URL: ExportCsvToInflux-0.1.11.tar.gz
  • Upload date:
  • Size: 12.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.19.1 setuptools/18.5 requests-toolbelt/0.9.1 tqdm/4.32.2 CPython/2.7.10

File hashes

Hashes for ExportCsvToInflux-0.1.11.tar.gz
Algorithm Hash digest
SHA256 cd1bf09fce88fced0e88e2a32718a6f7353a6ce26d6da324dd4ea15f63f62e94
MD5 d68c4112d14572ae54aadcf318b464cf
BLAKE2b-256 7292e901067bea4814c2b193144f15b72028719a90866a7f73336c0cc9336338

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page