Skip to main content

A tool designed for rapid data processing and filtering, specifically tailored for handling CSV files for log analysis.

Project description

snip-snap-csv

MIT License

A tool designed for rapid data processing and filtering, specifically tailored for handling CSV files for log analysis.

[!NOTE]
This project is in the early stages of development. Please be aware that frequent changes and updates are likely to occur.

Usage

$ sscsv {{initializer}} {{Arguments}} - {{chainable}} {{Arguments}} - {{chainable}} {{Arguments}} - {{finalizer}} {{Arguments}}

e.g. Below is an example of reading a CSV file, extracting rows that contain 4624 in the EventID column, and displaying the top 3 rows them sorted by the Timestamp column.

$ sscsv load Security.csv - isin 'Event ID' 4624 - sort 'Date and Time' - head 3
2024-06-26T17:29:19+0000 [DEBUG] 1 files are loaded. Security.csv
2024-06-26T17:29:19+0000 [DEBUG] filter condition: 4624 in Event ID
2024-06-26T17:29:19+0000 [DEBUG] sort by Date and Time (asc).
2024-06-26T17:29:19+0000 [DEBUG] heading 3 lines.
shape: (3, 5)
┌─────────────┬───────────────────────┬─────────────────────────────────┬──────────┬───────────────┐
│ Level        Date and Time          Source                           Event ID  Task Category │
│ ---          ---                    ---                              ---       ---           │
│ str          str                    str                              i64       str           │
╞═════════════╪═══════════════════════╪═════════════════════════════════╪══════════╪═══════════════╡
│ Information  10/6/2016 01:00:55 PM  Microsoft-Windows-Security-Aud…  4624      Logon         │
│ Information  10/6/2016 01:04:05 PM  Microsoft-Windows-Security-Aud…  4624      Logon         │
│ Information  10/6/2016 01:04:10 PM  Microsoft-Windows-Security-Aud…  4624      Logon         │
└─────────────┴───────────────────────┴─────────────────────────────────┴──────────┴───────────────┘

Archtecture

initializer -> chainable manipulations... -> finalizer

initializer

  • load

chainable manipulation

  • select
  • isin
  • contains
  • head
  • tail
  • sort
  • changetz

finalizer

  • headers
  • stat
  • showquery
  • show
  • dump

Planned Features:

  • CSV cache (.pkl)
  • Filtering based on specific conditions (OR, AND conditions)
  • Grouping for operations like count
  • Joining with other tables
  • Config Batch
  • Export Config

License

snip-snap-csv is released under the MIT License.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sscsv-0.1.0.tar.gz (4.8 kB view hashes)

Uploaded Source

Built Distribution

sscsv-0.1.0-py3-none-any.whl (6.0 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page