Skip to main content

Rover IO is a suite of tools that traverses your directories and performs IO file operations.

Project description

Rover IO

Rover IO is a suite of tools that traverses your directories and performs IO file operations.

Build Status Coverage Status PyPi Licence

Showcase

Rover IO is the perfect companion to any source control workflow. Find files still containing secrets or search for specific file types or strings of characters you may have forgotten to add to your gitignore. Rename massive collections of files sequentially and recursively (perfect for something like a photo library).

Install

# Install tool
pip3 install roverio

# Install locally
make install

Usage

File Extension

File Extension searches for all files in a path with the specified file extension and returns all the specified results.

Usage:
    roverio-file-extension --path ~/code/my_project --extension ".py"

Options:
    -h, --help                              show this help message and exit
    -p PATH, --path PATH                    Where File Extension will search for files with the specified file extension.
    -e EXTENSION, --extension EXTENSION     The file extension to search a path for.

Phone Email Searcher

Phone Email Searcher searches for files that may contain phone numbers or email addresses.

Usage:
    roverio-phone-email-searcher --path ~/code/my_project --phone --email

Options:
    -h, --help   show this help message and exit
    --path PATH  Where Phone/Email Searcher will search.
    -p, --phone  Search for phone numbers in the directory specified.
    -e, --email  Search for emails in the directory specified.

Readmy Readmes

Readmy Readmes is a fantastic tool to help find the holes in your project's documentation. Quickly iterate over every project README you have to search for key phrases you know should be there.

Each rule must be on its own line in your rules test file. Depending on the path you specify, you can search all your project README's or just a single project.

Use Cases

  • Ensure you have instructions for installing, usage, and testing your project
  • Find long-forgotten TODO's that still need fixing
  • Search for a particular phrase when you can't remember where it lived
  • Find hiding README's deep in a project's structure
Usage
    roverio-readmy-readmes -p path/to/git_projects -r path/to/rules.txt -l -c -csv_path path/to/file.csv

Options:
    -h, --help            show this help message and exit
    -p PATH, --path PATH  The path where the tool will search for README's.
    -r RULES, --rules RULES
                            The path to your rule text file.
    -l, --lazy            Match rules lazily (case-insensitive).
    -c, --create_csv      Save output to a CSV file.
    --csv_path CSV_PATH   The file path where a CSV file will be saved. By default, it will be saved to the current directory.

Sample Output

| README File             | install | usage | test  | todo  |
| ----------------------- | ------- | ----- | ----- | ----- |
| adventofcode/README.md  | True    | True  | True  | False |
| algorithms/README.md    | True    | True  | True  | False |
| brew-backup/README.md   | True    | True  | False | False |
| brew-update/README.md   | False   | True  | False | False |
| build-project/README.md | True    | True  | False | False |
| build-readme/README.md  | True    | True  | True  | False |
| burn-notice/README.md   | False   | True  | False | False |
| dad/README.md           | True    | True  | True  | False |
| dev-tools/README.md     | False   | True  | True  | False |
| diff/README.md          | True    | True  | True  | False |
| dotfiles/README.md      | True    | True  | False | False |
...

Scout

Scout searches through a directory for any string of text you specify. Perfect for searching across multiple projects or large code bases.

Usage:
    roverio-scout --path ~/code/my_project --search "My string of text"

Options:
    -h, --help                  show this help message and exit
    -p PATH, --path PATH        Where Scout will search for the string specified in each file.
    -s SEARCH, --search SEARCH  The string to search for in each file of a path.

Secrets

Secrets searches a path for possible secrets in code. Perfect for finding any passwords, API keys, or secrets you were about to commit. This is accomplished through loose searching of strings of a certain length and is not foolproof in determining what an actual secret is vs a long string.

Usage:
    roverio-secrets --path ~/code/my_project --length 20

Options:
    -h, --help                    show this help message and exit
    -p PATH, --path PATH          Where Secrets will search for the string specified in each file.
    -l LENGTH, --length LENGTH    The minimum length of the secrets to search for.

Sequential Renamer

Sequential Renamer recursively renames files in a directory in a sequential manner and prepends the parent folder name. The filename is slugified and lowercased for a uniform naming scheme.

A perfect use case for Seqential Renamer is a large photo library where filenames may be all over the place such as IMG_1234.JPG and you want them renamed according to folder. This script has been tested with a library of 10,000 photos.

Usage:
    roverio-sequential-renamer --path ~/path/to/photos --force

Options:
    -h, --help            show this help message and exit
    -p PATH, --path PATH  Where Sequential Renamer will recursively rename files it finds.
    -f, --force           Force changes which take permenant effect.

Sample Output

/Users/jhammond/Downloads/Justin's Skydive 2019/IMG_2462_proc_592015324.JPG  ->  justins-skydive-2019-0.jpg
/Users/jhammond/Downloads/Justin's Skydive 2019/IMG_2494_proc_592015326.JPG  ->  justins-skydive-2019-1.jpg
/Users/jhammond/Downloads/Justin's Skydive 2019/IMG_2514_proc_592015327.JPG  ->  justins-skydive-2019-2.jpg

Development

# Get a comprehensive list of development tools
make help

# Run the scripts locally
venv/bin/python roverio/secrets.py --help

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

roverio-2.3.1.tar.gz (11.4 kB view details)

Uploaded Source

Built Distribution

roverio-2.3.1-py3-none-any.whl (13.3 kB view details)

Uploaded Python 3

File details

Details for the file roverio-2.3.1.tar.gz.

File metadata

  • Download URL: roverio-2.3.1.tar.gz
  • Upload date:
  • Size: 11.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.8.2 pkginfo/1.8.2 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

File hashes

Hashes for roverio-2.3.1.tar.gz
Algorithm Hash digest
SHA256 f45374df8b46e6a74bab78364c9e92a2d141d8f7ddd0f480b5bf4cc1d1bfcc5f
MD5 1fd8ca1cd033c0993a3a040ee33e4122
BLAKE2b-256 bf5455332d036249c644fa8949846a6989690ce2a5b3b99761593b1dd2a5ca30

See more details on using hashes here.

File details

Details for the file roverio-2.3.1-py3-none-any.whl.

File metadata

  • Download URL: roverio-2.3.1-py3-none-any.whl
  • Upload date:
  • Size: 13.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.8.2 pkginfo/1.8.2 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

File hashes

Hashes for roverio-2.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 8104649a72d169564de78e8e0383e4c21f0b504e24ab4ce5b4a376292b53b60a
MD5 b5eba1b03f189a436af53b7ee4e55709
BLAKE2b-256 7e826f0d2be8b5e9fb462e73daf93fce7279fb3e5b88ebcca0c8c8604e9c4d9c

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page