Frisket

I wanted a spreadsheet that did AI things for investigative journalism. The NYT made one for itself, so I made one for the rest of us. Use Frisket to analyze zillions of documents, decades of audio, centuries of video, all in a friendly (???) spreadsheet format.

Quickstart

Use the cloud version or run locally with Python 3.12:

pip install 'frisket-data[standard]'
frisket ./my-workspace

Note that is NOT installed with frisket, it's frisket-data. I got package-name-sniped!

What Frisket can do

Frisket can analyze spreadsheets, PDFs, images, videos, probably a hundred other things. You drop content in, then run AI against it in a structured way. It's a new way to do projects like:

• Extract and cross-reference every company mentioned over thousands of legal documents
• Find every time datacenters are mentioned in a YouTube channel of city council meetings
• Split a video at scene changes to analyze popular streamers
• Download and translate TikTok videos to track misinformation
• Get an email or Slack message summarizing this week's new podcast eps
• Convert recipes into structured lists of ingredients and amounts (it isn't journalism but hey)
• Summarize, categorize, restructure, and clean documents
• Automatically perform cited research on the web

Those were all done the old-fashioned hard-work way, though. No one has done anything with Frisket yet, so you can be the first.

Installation

Frisket requires Python 3.12.

Single-user

If you just want to run Frisket on your own computer, use solo mode.

pip install 'frisket-data[standard]'
frisket ./my-workspace

If you want more shiny extras, use pip install 'frisket-data[complete]'.

Team

If you're running Frisket on a server or want to support multiple uers, go for team mode.

1. Download the server install bundle (frisket-server-<version>.tar.gz)
2. Extract it, then run sudo ./frisket-install from the extracted directory
3. The installer asks a few questions and then you should be good to go. It can keep Frisket behind an SSH tunnel or serve a public domain using Caddy for HTTPS.

Codex claims it requires Linux, Docker Engine, and Docker Compose. It installs Frisket under /srv/frisket.

Hosted (cloud)

You're lazy, I get it! Go to app.frisket.dev and request access. This is a Frisket instance that I personally run.

CAVEAT: The big, fancy parts

Frisket is split into a few parts, including a lightweight server and a heavier sidecar to optionally offload intensive work. As a result, different installs have slightly different features.

For example, for OCR local/team installs can add Surya 2 natively with the sidecar's ocr extra and an upstream-supported inference backend. The standard sidecar container and Cloud uses dots.mocr instead. I haven't set the local sidecar up to easily publish yet but I promise you can ask your agentic coding environment and it can walk you through the process.

For the models included in the standard sidecar container, build the image yourself by downloading the repo and running the following commands from the repo root.

docker build -t frisket-models:local ./sidecar

Then run the sidecar and connect it to Frisket.

MODELS_TOKEN="$(openssl rand -hex 32)"

docker run -d \
    --name frisket-models \
    --restart unless-stopped \
    -p 127.0.0.1:8500:8500 \
    -e FRISKET_MODELS_TOKEN="$MODELS_TOKEN" \
    -v frisket-models-cache:/models \
    frisket-models:local

export FRISKET_MODELS_URL=http://127.0.0.1:8500
export FRISKET_MODELS_TOKEN="$MODELS_TOKEN"

frisket ./my-workspace

Extras

Local models

Fair warning: some of these aren't yet available without some additional setup.

It's easy to set up an API key to talk to AI providers like OpenAI, Anthropic, OpenRouter and Gemini. But! You can also do most everything on the privacy of your own machine.

• LM Studio and Ollama are supported out-of-the-box for local LLMs/VLMs
• Local transcription can be powered by Parakeet, Whisper, MOSS, VibeVoice-ASR
• spaCy or GLiNER for local entity extraction
• Plenty of OCR engines like RapidOCR, Surya 2, dots.mocr, PaddleOCR-VL, Tesseract
• PDF to Markdown conversion with Markitdown, Docling

Write a plugin

Plugins can add actions, panels, imports, integrations: pretty much anything. They're easy to make!

frisket plugin init --id example.my-plugin --output ./my-plugin --with action
frisket plugin build ./my-plugin
frisket plugin validate ./my-plugin

Me

Hi, I'm Soma!

I teach data journalism at Columbia's J-School where I run a year-long Data Journalism MS and a nice short summer program. I give a lot of talks on AI and wrote history's friendliest PDF-processing library.

Email me at jonathan.soma@gmail.com.

People say things like "oh buy me a coffee if you like this" but no, I'm more demanding: go look at these poor cats and then donate to my cat rescue.