chunkwrap 0.6.2

A project that splits files and copies them to paste buffer with context for an LLM.

PLATFORM SUPPORT AND EARLY TESTING

This project aims for cross-platform, browser-based accessibility. Early testing results:

• Works as intended on:

  • Chrome on macOS (tested on MacBook Air)

  • Chrome on Android (tested on Samsung S24 FE)

  • (Likely also works on Edge and recent Chromium-based browsers)

• Known limitation:

  • Chrome on iPad (iOS): The "Play Welcome" button displays and the welcome text appears after clicking, but speech synthesis does not play audio. This appears to be a limitation of Chrome and/or Web Speech API support on iOS/iPadOS, which often blocks or fails to implement certain audio APIs for non-Safari browsers.

• Safari/iOS support:

  • Not yet tested or prioritized. Apple's browser restrictions may block speech synthesis or speech input features in web apps.

Workaround:
Users on iPad/iOS devices can still read the welcome message text and use the rest of the app, but won't hear synthesized speech until browser/OS support improves. Desktop and Android users get full audio.

If you have feedback or success/failure reports for other browsers/devices, please open an issue!chunkwrap

A Python utility for splitting large files into manageable chunks, masking secrets, and wrapping them with custom prompts for Large Language Model (LLM) processing.

Overview

chunkwrap helps you process large files with LLMs by splitting them into smaller chunks, masking sensitive data, and wrapping each chunk with your specified prompt. It tracks your place between runs, so you can work incrementally.

Features

• Automatic chunking: Split files into chunks of configurable size (default: 10,000 characters)

• Multi-file support: Combine and process multiple input files seamlessly

• Secret masking: Use TruffleHog regex patterns to redact secrets

• State management: Resume where you left off using a saved chunk index

• Clipboard integration: Automatically copies the wrapped chunk to your clipboard

• Prompt flexibility: Use different prompts for regular and final chunks

• Progress tracking: Indicates current chunk number out of total

Installation

1. Clone this repository

2. Install required dependencies:

   bash

   pip install pyperclip
   
   

Usage

Basic Usage

bash

python chunkwrap.py --prompt "Analyze this code:" --file file1.txt

With Multiple Files

bash

python chunkwrap.py --prompt "Review content:" --file file1.py file2.md

With Secret Masking

Place a truffleHogRegexes.json file in the same directory. Example:

json

{
  "AWS": "AKIA[0-9A-Z]{16}",
  "Slack": "xox[baprs]-[0-9a-zA-Z]{10,48}"
}

Each matching string will be replaced with ***MASKED-<KEY>***.

With a Custom Chunk Size

bash

python chunkwrap.py --prompt "Summarize:" --file notes.txt --size 5000

Custom Prompt for Final Chunk

bash

python chunkwrap.py --prompt "Process chunk:" --lastprompt "Wrap up and summarize:" --file main.md

Reset State and Start Over

bash

python chunkwrap.py --reset

Output Format

Your prompt here (chunk 2 of 5)
"""
[chunk content with secrets masked]
"""

The final chunk uses --lastprompt (if provided) and omits the chunk counter.

State File

A .chunkwrap_state file is created in the current directory to track your current chunk index. Delete this file or use --reset to begin again.

Requirements

• Python 3.11+

• pyperclip library

License

This project is licensed under the GNU General Public License v3.0. See the LICENSE file for details.