Skip to main content

Find moments in your videos. Agent-first CLI for Marlin-2B: dense captioning + temporal grounding, local or hosted.

Project description

marlin

Find moments in your videos. marlin is the agent-first CLI for Marlin-2B — a 2B video VLM for dense captioning + temporal grounding. Runs free and local on Apple Silicon (MLX) or NVIDIA (vLLM) — no API key, no network for inference.

uv tool install nemostation                          # or: pipx install nemostation
marlin                                               # first run: detect Apple Silicon/NVIDIA + build the engine
marlin find "deer crossing the road" --in ./footage  # auto-indexes, then model-verified timestamps

Why timestamps are right here

Search is two-stage: coarse retrieval over timestamped dense captions, then Marlin temporal grounding inside the winning 30s chunks. Grounding short chunks matches the model's training distribution (and sidesteps vLLM's long-video timestamp bug), so spans land where the event actually is.

Agents

marlin skills install        # → .claude/skills/ + .agents/skills/

Every verb honors --json (auto when piped), long indexes run with --async + marlin status <job_id>. See skills/video-search/SKILL.md.

How it runs (auto-detected, local)

Apple Silicon NVIDIA
engine SGLang-MLX vLLM
serve auto-starts on first find (or marlin serve) same
weights gated — 1-click access form gated — 1-click form

No API key — inference is local. Agents use the same verbs with --json (clean stdout, progress on stderr). A hosted base_url swap lives in deploy/ for a future skill; it's not surfaced in the CLI yet.

Speech

marlin index --stt adds faster-whisper speech rows to the same index (pip install 'nemostation[stt]') — search meetings by what was said and what happened in one query.

Status

v0.1 — base + video-search skill. Verified end-to-end against a live endpoint; more skills (footage-catalog, dashcam-event-finder, clip-scorer) ride the same verbs next.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nemostation-0.1.4.tar.gz (3.4 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

nemostation-0.1.4-py3-none-any.whl (38.5 kB view details)

Uploaded Python 3

File details

Details for the file nemostation-0.1.4.tar.gz.

File metadata

  • Download URL: nemostation-0.1.4.tar.gz
  • Upload date:
  • Size: 3.4 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.8.13

File hashes

Hashes for nemostation-0.1.4.tar.gz
Algorithm Hash digest
SHA256 f7563f37c6ff5fe1f8347dd171b002270db0d1f9fd726109bb990d25b32a5cc9
MD5 4ff1e985c61795bcb9ef014e29822ab2
BLAKE2b-256 737489571fcb779268a67c587e1c5a496c04233685e1b8405fb147ab119be7e9

See more details on using hashes here.

File details

Details for the file nemostation-0.1.4-py3-none-any.whl.

File metadata

File hashes

Hashes for nemostation-0.1.4-py3-none-any.whl
Algorithm Hash digest
SHA256 975aaa2e155bf1e705861454f029e07be5cf98dcc131d39257605eed7f87e04a
MD5 81e51fe13df1ced573febdf78d58585b
BLAKE2b-256 5d8dc2389a3f301f98d9aac40b37ddc819196d1728c230585c1318c7b285864a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page