Skip to main content

Find moments in your videos. Agent-first CLI for Marlin-2B: dense captioning + temporal grounding, local or hosted.

Project description

marlin

Find moments in your videos. marlin is the agent-first CLI for Marlin-2B — a 2B video VLM for dense captioning + temporal grounding. Runs free and local on Apple Silicon (MLX) or NVIDIA (vLLM) — no API key, no network for inference.

uv tool install nemostation                          # or: pipx install nemostation
marlin                                               # first run: detect Apple Silicon/NVIDIA + build the engine
marlin find "deer crossing the road" --in ./footage  # auto-indexes, then model-verified timestamps

Why timestamps are right here

Search is two-stage: coarse retrieval over timestamped dense captions, then Marlin temporal grounding inside the winning 30s chunks. Grounding short chunks matches the model's training distribution (and sidesteps vLLM's long-video timestamp bug), so spans land where the event actually is.

Agents

marlin skills install        # → .claude/skills/ + .agents/skills/

Every verb honors --json (auto when piped), long indexes run with --async + marlin status <job_id>. See skills/video-search/SKILL.md.

How it runs (auto-detected, local)

Apple Silicon NVIDIA
engine SGLang-MLX vLLM
serve auto-starts on first find (or marlin serve) same
weights gated — 1-click access form gated — 1-click form

No API key — inference is local. Agents use the same verbs with --json (clean stdout, progress on stderr). A hosted base_url swap lives in deploy/ for a future skill; it's not surfaced in the CLI yet.

Speech

marlin index --stt adds faster-whisper speech rows to the same index (pip install 'nemostation[stt]') — search meetings by what was said and what happened in one query.

Status

v0.1 — base + video-search skill. Verified end-to-end against a live endpoint; more skills (footage-catalog, dashcam-event-finder, clip-scorer) ride the same verbs next.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nemostation-0.1.2.tar.gz (2.8 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

nemostation-0.1.2-py3-none-any.whl (37.7 kB view details)

Uploaded Python 3

File details

Details for the file nemostation-0.1.2.tar.gz.

File metadata

  • Download URL: nemostation-0.1.2.tar.gz
  • Upload date:
  • Size: 2.8 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.8.13

File hashes

Hashes for nemostation-0.1.2.tar.gz
Algorithm Hash digest
SHA256 69ea2fd9542656daea64b75e49390d673f6b41372caa9e655d6863e30bd83223
MD5 6bc8e7f5c2af5b3a18d86059e7df0f07
BLAKE2b-256 1b919bdbb26c9c69824aa9664e5195f5209772f44ba5e0e2f54784b88b7fe6a7

See more details on using hashes here.

File details

Details for the file nemostation-0.1.2-py3-none-any.whl.

File metadata

File hashes

Hashes for nemostation-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 5ce2e94bc7d5cf3a32943f39643677e627cded692560aaebf35a9bac3546ea77
MD5 06eaa5fd45fbbabf06460a50e7d6ca6a
BLAKE2b-256 4710eb91073835d6dd151933637946bd58eb1219a2faf5f089ac168c79d5646c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page