Skip to main content

newera-sdk

test

Speech-to-speech calls with tool calling, in Python. Newera listens, talks (Saudi Arabic and English) and decides when to call your functions; you write the functions. And a talking avatar: the same voice with a face, in one command (newera avatar) or a few lines of Python. See The avatar.

import asyncio
from newera import VoiceAgent

agent = VoiceAgent(api_key="nwc_live_...", instructions="You book clinic appointments.", voice="male")

@agent.tool
def get_free_slots(date: str) -> list[str]:
    """Free appointment times on a day.

    Args:
        date: The day, as YYYY-MM-DD.
    """
    return ["09:00", "10:30"]

@agent.tool(requires_confirmation=True, timeout_ms=20000)
async def book_appointment(patient_name: str, date: str, time: str) -> dict:
    """Book an appointment."""
    return {"booking_id": "B-1"}

async def main():
    async with agent.connect() as call:
        await call.send_text("I need an appointment on Saturday")
        reply = await call.wait_response()
        print(reply.transcript)          # tools ran while it waited

asyncio.run(main())

A complete agent with a mock clinic: examples/clinic_agent.py.

Install

pip install newera-sdk

The import name is newera: from newera import VoiceAgent.

It needs Python 3.9 or newer and depends on websockets (and certifi, for TLS certificates). For the live avatar call (microphone, speaker, window) install the extra:

pip install "newera-sdk[avatar]"

The avatar

A talking face that answers by voice, in real time: you stream the caller's audio in and get the assistant's speech back as video with its sound (512 x 512, 25 frames per second, lip-synced) plus the words of both sides. It speaks Arabic and English. Access is on request: your organisation must be enabled for the avatar (ask your Newera account manager). One avatar call can run at a time, across all customers; a second one is refused with AvatarBusy.

Try it: one command

pip install "newera-sdk[avatar]"
export NEWERA_API_KEY=nwc_live_...
newera avatar

Your microphone is the caller, your speaker plays the avatar, a window shows the face and the transcript is printed in the terminal. Use headphones, or the avatar hears itself and interrupts. Press Ctrl+C (or Esc, or close the window) to end the call. On macOS the terminal asks once for microphone access.

Options: --voice male|female, --language ar|en (default: detected on every turn), --model newera-s2s-mini, --instructions "...", --image me.jpg (your own face; only of a person who agreed to be animated), --idle-video, --record call.mp4, --no-window, --mute, and --input-file question.wav to replay a WAV as the caller instead of the microphone. The same from Python: from newera import talk; talk(voice="male").

In Python

import asyncio
from newera import Newera

async def main():
    client = Newera()                                   # NEWERA_API_KEY from the environment
    async with client.avatar.connect(avatar="lama", voice="female", record=True) as call:
        await call.send_file("question.wav")            # streamed at real time, as a microphone would
        reply = await call.wait_reply()
        print(reply.user_text, "->", reply.text)
        call.save_mp4("reply.mp4")                      # frames and audio muxed (needs ffmpeg)

asyncio.run(main())

examples/avatar_quickstart.py is this, complete.

client.avatar.connect(...) takes avatar (a preset face, "lama"), image (your own photo: a path, bytes or base64), voice ("male" or "female", independent of the face), language ("ar", "en", or None to detect), model ("newera-s2s" or "newera-s2s-mini"), idle_video (also stream the face while it listens), instructions, record (keep the video so save_mp4 works), and any other realtime session.update setting as a keyword (turn_detection=..., tools=...).

The call object:

  • await call.send_audio(pcm16_bytes): PCM16 mono 24 kHz, in real time, about 20 ms at a time (keep sending silence too, so turn detection works). await call.send_file("q.wav") streams a WAV at real time for you, resampling it if needed. await call.send_text("hello") is a typed turn.
  • async for event in call.events(): every server event, typed: UserTranscript(text), ReplyTextDelta(text), ReplyText(text), VideoChunk (frames: JPEG bytes, audio: the PCM16 24 kHz of exactly those frames, frame_index, start_ms, fps), Interrupted (the caller started talking: drop everything queued), Unavailable, ResponseDone, ErrorEvent, and OtherEvent for the rest of the realtime protocol. call.frames() yields (frame_index, jpeg) and call.audio() the reply audio, if that is all you need.
  • await call.wait_reply() collects the next reply: AvatarReply(user_text, text, frames, audio, chunks, first_text_s, first_video_s).
  • call.save_mp4(path) (needs ffmpeg), call.save_wav(path), call.save_frames(dir): of the recorded call.
  • await call.close() (also at the end of async with): sends session.end; call.summary then holds the connected and billed seconds.

Play the video with the audio as the clock: show frame frame_index / fps seconds into the audio of the same event; buffer about 2 seconds before a reply starts (the face is rendered a little slower than real time). newera avatar does exactly this (newera.talk.Playback); the docs have the same logic for browsers.

Before and during a call

availability = await client.avatar.availability()       # Availability(busy=False, available=True)

The answer can change a moment later, so still handle the errors; all are NeweraErrors:

exception when
AvatarBusy the avatar is in another call: tell your user, wait a few seconds, try again
AvatarUnavailable the face or Newera Core is temporarily unavailable
NotEnabled the organisation is not enabled for the avatar or the voice model
AuthenticationError missing or wrong key, or a used or expired client secret
InsufficientQuota the prepaid balance cannot cover the call
RateLimited too many requests, or the key is at its concurrent-call limit
InvalidRequest a bad session field or model (invalid_avatar_image: no usable face in the photo)
CallTimeLimit the call reached its 30-minute limit

Each has .code, .message and .close_code. A refused call is never billed.

A browser page

An API key must not sit in a web page. Your server trades it for a one-use client secret that is good for 60 seconds, and the page connects with that:

secret = await client.avatar.create_session(model="newera-s2s")      # ClientSecret(value="avs_...", expires_at=...)

examples/avatar_server_token.py is a FastAPI endpoint that returns it. The page opens wss://api.newera.ai/v1/avatar with the subprotocols ["realtime", "newera-client-secret." + secret] (see the docs for the player code). Python can connect with a secret too: client.avatar.connect(client_secret=secret).

Only send a photo (image=) of a person who agreed to be animated, and tell them what it is for.

Tools

@agent.tool turns a function into a tool. The schema comes from the function:

from becomes
the name tool name (name= overrides)
docstring summary (text before a blank line or Args:) description (description= overrides)
Args: section, Google style (name: text or name (type): text) each parameter's description
str, int, float, bool string, integer, number, boolean
Literal["a", "b"], Enum enum
Optional[X], X | None, parameters with a default optional (not in required)
list[X], dict, Union[...], Any array, object, anyOf, any value
@agent.tool(requires_confirmation=False, timeout_ms=15000)
def my_tool(...): ...

Both sync and async functions work (sync ones run in a thread, so a slow call never blocks the audio). The return value is JSON encoded and given to the model (dates, decimals, enums and dataclasses are converted). If the function raises, the model receives {"error": "ValueError: ..."} and tells the caller; the call carries on.

What Newera does around your function

  • Validation. The model's arguments are checked against the schema before your function is called. A wrong or missing argument never reaches you: the model is told and asks the caller.
  • Confirmation. With requires_confirmation=True, your function is called only after the assistant read the details back and the caller said yes. A different argument is a new question. Declare every function that changes something this way (booking, paying, cancelling, sending).
  • Speech while you work. If the model calls a tool without saying anything, Newera speaks a short line ("Sure, one moment while I check...") and, if your function takes more than 3 and 8 seconds, a progress line. You write nothing for this.
  • Timeouts. timeout_ms (1000 to 60000, default 15000) is how long Newera waits for the result; after that the model tells the caller it is taking longer and offers to retry.
  • Barge-in. If the caller interrupts while a read-only tool runs, it is cancelled (an asyncio cancel for async functions; a sync function in a thread cannot be stopped, but its result is ignored). A tool with requires_confirmation is never cancelled; its result is reported truthfully on the next turn.
  • Limits. At most 32 tools; each name ^[a-zA-Z0-9_-]{1,64}$; each schema 16 KB, all of them 64 KB; a result is cut at 32 KB; at most 6 tool steps per reply (VoiceAgent(max_tool_steps=...), up to 10). When the limit is reached the assistant tells the caller what is done and asks whether to continue.

Treat what your functions return as what the model will read to the caller, and treat what comes back from a tool as data, never as instructions.

Models

Choose the model when you create the agent. It is sent when the call connects (wss://api.newera.ai/v1/realtime?model=...).

model use it for
newera-s2s (default) conversations that need deeper reasoning: multi-step troubleshooting, consultative sales, bookings that balance several constraints, workflows that chain many tools, long calls with a lot of context, nuanced policy questions.
newera-s2s-mini fast and efficient for high-volume, well-defined conversations: customer support and FAQs, appointment booking and rescheduling, order and delivery status, reservations, lead qualification and intake, surveys and feedback calls, reminders and confirmations, replacing IVR menus, and tool-driven flows such as looking up a record or opening a ticket.
agent = VoiceAgent(api_key="nwc_live_...", model="newera-s2s-mini")

An unknown model name raises ValueError before anything connects.

Billing

Calls are billed per connected second. The clock starts when the connection opens and stops when it closes. The total is rounded up to the next whole second, with a minimum of 30 seconds per call.

  • newera-s2s: 0.20 SAR per minute (0.0033333333 SAR per second)
  • newera-s2s-mini: 0.10 SAR per minute (0.0016666667 SAR per second)

Examples: a 5-second call is billed as 30 seconds, which is 0.10 SAR on newera-s2s or 0.05 SAR on newera-s2s-mini. A call of 2 minutes 3.4 seconds is billed as 124 seconds, which is 0.41 SAR on newera-s2s or 0.21 SAR on newera-s2s-mini.

Each API key can run up to 5 calls at the same time.

Voice quality

voice_quality sets how the assistant sounds and how quickly it starts each reply. It can also be changed during a call, and applies from the next reply.

value use it for
instant the fastest start to every reply, for snappy back-and-forth: quick confirmations, short questions and answers, menu-style flows, high-volume reminder and notification calls
balanced a natural voice with a quick start; the everyday choice for most support, booking and service calls
studio (default) the most natural, polished voice, for conversations where how you sound matters most: sales, concierge and premium service, longer explanations
agent = VoiceAgent(api_key="nwc_live_...", voice_quality="balanced")

An unknown value raises ValueError before anything connects.

The call

async with agent.connect() as call:
    await call.send_audio(pcm16_bytes)      # 16-bit mono, 24 kHz by default (16 kHz: session={"newera": {"input_audio_sample_rate": 16000}}); real time, 20-100 ms chunks
    await call.send_text("hello")           # a typed turn (add respond=False to wait)
    await call.say("Welcome to the clinic") # the assistant speaks first
    async for event in call:                # every server event
        ...
    await call.end()                        # session.summary, then the call closes

event.type is the protocol's event name (protocol reference): response.audio.delta (event.audio gives the PCM16 24 kHz bytes), response.audio_transcript.delta, input_audio_buffer.speech_started (stop your playback), response.done, error, and so on. The SDK adds one event, sdk.tool_result (name, arguments, output, error, ms), after each of your functions ran.

await call.wait_response() collects events up to the next response.done and returns a Reply(transcript, audio, status, usage, events); handy for text-only scripts and tests.

VoiceAgent(...) takes api_key, instructions, voice, model (see Models), tool_choice ("auto", "none", "required", or {"type": "function", "name": ...}), max_tool_steps, auto_continue, voice_quality ("studio" (default), "balanced" or "instant", see Voice quality), session (extra session.update fields), url and headers.

auto_continue=False is the OpenAI-style flow: after your outputs the SDK sends response.create itself and the server does not continue on its own.

Browsers must not hold an API key: this SDK is for servers. Give browser clients their own short-lived credentials instead.

Tests

pip install -e '.[test]' && pytest

The tests run the SDK against a fake WebSocket server; no network, no key. tests/test_avatar_e2e.py talks to the real avatar and is skipped unless NEWERA_API_KEY is set (use a key enabled for the avatar).

Releasing

  1. Bump version in pyproject.toml (and __version__ in src/newera/__init__.py).
  2. Push to main. The publish workflow runs the tests. If that version is not yet on PyPI, it builds the package, uploads it through trusted publishing, and creates the vX.Y.Z tag and a GitHub Release. No API token is stored in the repository.
  3. A push with an unchanged version only runs the tests.

License

Apache License 2.0. See LICENSE.

Metadata

Release files for newera-sdk 0.3.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for newera-sdk 0.3.0
File Size Uploaded Provenance Actions
newera_sdk-0.3.0.tar.gz 52.6 kB With provenance Details for newera_sdk-0.3.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for newera-sdk 0.3.0
File Interpreter ABI Platform Actions
newera_sdk-0.3.0-py3-none-any.whl Python 3 none any Details for newera_sdk-0.3.0-py3-none-any.whl

Total release size: 92.9 kB

Release files / newera_sdk-0.3.0.tar.gz

Download URL newera_sdk-0.3.0.tar.gz
Size 52.6 kB
Tags Source
SHA-256 checksum
How to use checksums
47063c6c226b21f317822007eddbe5c220a5f00f2b8b55e78b462b2b9df8e194
BLAKE2b-256 checksum
How to use checksums
322cd51a70295ab83527158350f6dac8641be4163a21d1111a2e7fe611d8e75d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 16, 2026.

Transparency log

Release files / newera_sdk-0.3.0-py3-none-any.whl

Download URL newera_sdk-0.3.0-py3-none-any.whl
Size 40.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
b4211b41ec83c4de2e9c741b4f837fab02abbe8daf9b169e5d2966613e8b664f
BLAKE2b-256 checksum
How to use checksums
50358485699088125957acc2c26755001dde3da59a2dce98cbc0bc7b62654fec
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 16, 2026.

Transparency log

Security for newera-sdk 0.3.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for newera_sdk-0.3.0.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 16, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page