Skip to main content

make processing 2d data more convenient

Project description

Data Process

Make processing 2d data more convenient

Install

pip install data-process

Module description

  • collect_csv_data: Collect data in a directory contains CSV files
  • date: Generate current date and time; get the range of and start, end day of a period date; convert bettween string and datetime.datetime type
  • date_range: Get the range of date from the start, end, range gap you provided
  • decimal_helper: Convert float to Decimal type
  • dict_helper: Replace the keys of a dict; infinite defaultdict data structure; get data by a series of keys
  • filter_date: Filter a series date string by the given start, end date
  • green_dict: Make the dict compatibal with the json.dumps, especially for date(time) type
  • group_by: Group a series of dict by a list of functions; degroup a deep grouped dict by the depths
  • io_csv: Read, write csv files
  • io_json: Read, write json files
  • io_files: List files in a glob pattern directories
  • io_lines: Read as lines from a file except the lines are blank or start with '#'
  • iter_dict: Convert dict for output, handled by the type of values separately
  • join: Left, right, inner, outer join a series of dict as like in SQL
  • list_helper: Flat a nested list
  • pandas_helper: Functions wrapper for using pandas conveniently. Convert pandas.DataFrame to a list of dict; aggregate DataFrame by a field.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

data-process-0.3.9.tar.gz (10.4 kB view hashes)

Uploaded source

Built Distribution

data_process-0.3.9-py3-none-any.whl (13.1 kB view hashes)

Uploaded py3

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page