Skip to main content

Find moments in your videos. Agent-first CLI for Marlin-2B: dense captioning + temporal grounding, local or hosted.

Project description

marlin

Find moments in your videos. marlin is the agent-first CLI for Marlin-2B — a 2B video VLM for dense captioning + temporal grounding. Runs free and local on Apple Silicon (MLX) or NVIDIA (vLLM) — no API key, no network for inference.

uv tool install nemostation                          # or: pipx install nemostation
marlin                                               # first run: detect Apple Silicon/NVIDIA + build the engine
marlin find "deer crossing the road" --in ./footage  # auto-indexes, then model-verified timestamps

Why timestamps are right here

Search is two-stage: coarse retrieval over timestamped dense captions, then Marlin temporal grounding inside the winning 30s chunks. Grounding short chunks matches the model's training distribution (and sidesteps vLLM's long-video timestamp bug), so spans land where the event actually is.

Agents

marlin skills install        # → .claude/skills/ + .agents/skills/

Every verb honors --json (auto when piped), long indexes run with --async + marlin status <job_id>. See skills/video-search/SKILL.md.

How it runs (auto-detected, local)

Apple Silicon NVIDIA
engine SGLang-MLX vLLM
serve auto-starts on first find (or marlin serve) same
weights gated — 1-click access form gated — 1-click form

No API key — inference is local. Agents use the same verbs with --json (clean stdout, progress on stderr). A hosted base_url swap lives in deploy/ for a future skill; it's not surfaced in the CLI yet.

Speech

marlin index --stt adds faster-whisper speech rows to the same index (pip install 'nemostation[stt]') — search meetings by what was said and what happened in one query.

Status

v0.1 — base + video-search skill. Verified end-to-end against a live endpoint; more skills (footage-catalog, dashcam-event-finder, clip-scorer) ride the same verbs next.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nemostation-0.1.3.tar.gz (3.2 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

nemostation-0.1.3-py3-none-any.whl (38.2 kB view details)

Uploaded Python 3

File details

Details for the file nemostation-0.1.3.tar.gz.

File metadata

  • Download URL: nemostation-0.1.3.tar.gz
  • Upload date:
  • Size: 3.2 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.8.13

File hashes

Hashes for nemostation-0.1.3.tar.gz
Algorithm Hash digest
SHA256 85ecb735831010e03fafab619da51903a2f22948a6d6d848cef935a86a52031f
MD5 7ba0820a15092e80fb8830b22b157625
BLAKE2b-256 d08fbfcfdc9e8f654234d105c79d7094acc888283d4fa65f6a8f319072431168

See more details on using hashes here.

File details

Details for the file nemostation-0.1.3-py3-none-any.whl.

File metadata

File hashes

Hashes for nemostation-0.1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 394f22fa9ef23ab98f18c436c626f1d9264dd66022c6431e73c36c3561c878ea
MD5 57c7b476380bff176992f62f93acde29
BLAKE2b-256 bab000ba829776ac79fa04830e13a7c6175669954a032027f3e645266edabc33

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page