duplexjev

Jev-style typed decisions about speech with zero decode steps. Give it audio and one or more option groups (has the user finished? which filler? which intent? speaker gender?); every group comes back as a probability over its options from a single forward pass. Many groups about many calls share one pass, with exact prefix sharing.

Quick start, no GPU — eight default decisions about any clip through our trial API (DuplexJev-4B, rate-limited):

pip install duplexjev
duplexjev quick call.wav --api https://api.adventists.cn/duplexjev              # --lang zh for Chinese speech

from duplexjev import quick, Question
quick("call.wav", api="https://api.adventists.cn/duplexjev")                   # prints and returns the table
quick("call.wav", vllm="http://localhost:8000/v1",                              # your own `vllm serve adventists-ai/DuplexJev-4B`
      questions=[Question("product", "Which product is the user asking about?", ["phone", "laptop", "other"])])

duplexjev gateway --vllm http://localhost:8000/v1 serves the same web demo and HTTP API in front of your own vLLM server. Web demo: https://api.adventists.cn/duplexjev/

Connector checkpoints in PyTorch (one forward pass for many option groups and many clips):

pip install "duplexjev[speech]"      # add [all] for the HTTP server

from duplexjev import Decider, Question

d = Decider.from_pretrained("adventists-ai/DuplexJev-B-Gender-Qwen3-ASR-0.6B-Qwen3-32B", device="auto")
groups = [Question("turn", "Has the user finished the turn?", ["finished", "not finished"]),
          Question("gender", "What is the perceived gender of the speaker?", ["female", "male"])]

d.decide("call.wav", groups)
# {'turn': {'answer': 'finished', 'confidence': 0.97, 'probs': {...}}, 'gender': {...}}

# many clips: each option group names its clip(s) with audio=<id> | [ids] | "*"
d.decide_batch({"car1": "a.wav", "car2": "b.wav"},
               [Question("turn", "Has the user finished the turn?", ["finished", "not finished"], audio="*"),
                Question("gender", "Speaker gender", ["female", "male"], audio="car2")])
# {'car1': {'turn': ...}, 'car2': {'turn': ..., 'gender': ...}}

Ask in the language of the clip (Question(..., lang="zh") with Chinese options for Chinese speech): the DuplexJev connectors were trained with language-matched prompts. Released weights, results and licences: https://huggingface.co/adventists-ai. Local copies of the encoder and LLM: from_pretrained(..., text_model=..., audio_model=...), also offline.

Serve with tick batching: duplexjev serve --model <checkpoint> --tick-ms 160.

0.3.0: quick / duplexjev quick with a default table of eight decisions; clients for vLLM servers and the DuplexJev HTTP API that need no torch (torch moved to the speech extra); duplexjev gateway (web demo + API).

0.2.1: audio is padded to whole audio tokens at the end instead of the start (start padding cost up to 6 points on emotion); text_model / audio_model overrides work offline.

Project: https://github.com/adventists-ai/duplexjev · License: Apache-2.0