ScreenLane (Python)

Screen-aware voice / text command layer for AI agents — capture screen context, dictate intent, route commands to Codra, Tera, and other targets.

Part of Talocode.

Package	pip install talocode-screenlane
Import	from talocode_screenlane import ScreenLaneClient
CLI	screenlane-py
Local default	http://127.0.0.1:3070
Cloud	https://api.talocode.site + TALOCODE_API_KEY
Repo	github.com/talocode/screenlane
License	MIT

---

Why ScreenLane?

Agents often lack what’s on the user’s screen. ScreenLane sits between:

1. Capture — screen / context text
2. Intent — voice transcript or typed command
3. Route — structured command for Codra, Tera, GateLane, etc.

Open-source local server + cloud routes so you can demo offline and scale with Talocode Cloud.

---

Install

pip install -U talocode-screenlane

Python 3.10+.

---

Quickstart

Local server

# In the ScreenLane Node package / monorepo:
# screenlane serve   → http://127.0.0.1:3070

from talocode_screenlane import ScreenLaneClient

client = ScreenLaneClient()  # local default

print(client.health())
print(client.doctor())
print(client.demo())

result = client.command({
    "text": "Fix this error",
    "contextText": "TypeError: Cannot read properties of undefined",
    "target": "codra",
})
print(result)

Android workflow foundation

ScreenLane plans Android workflows locally before a future companion bridge can execute anything. Inspection can be planned without approval. Tap, type, and scroll require explicit approval. Sensitive app classes are blocked, and every request records a local receipt.

from talocode_screenlane import ScreenLaneClient

client = ScreenLaneClient()

print(client.android_doctor())

pending = client.plan_android_action({
    "action": "tap",
    "appId": "com.example.notes",
    "target": "New note",
})
print(pending["status"])  # pending_approval

approved = client.plan_android_action({
    "action": "tap",
    "appId": "com.example.notes",
    "target": "New note",
    "approved": True,
})
print(approved["status"])

print(client.list_android_receipts())

The local API exposes GET /v1/screenlane/android/doctor, POST /v1/screenlane/android/actions, and GET /v1/screenlane/android/receipts.

Cloud

import os
from talocode_screenlane import ScreenLaneClient

cloud = ScreenLaneClient(
    base_url="https://api.talocode.site",
    api_key=os.environ["TALOCODE_API_KEY"],
)

cloud.command({
    "text": "Summarize this screen",
    "contextText": "...",
    "target": "tera",
})

Environment

Variable	Purpose
TALOCODE_API_KEY	Cloud auth
TALOCODE_BASE_URL	Optional cloud base
Local URL	Passed as base_url / client default http://127.0.0.1:3070

---

Client API

Method	Purpose
health()	Liveness
doctor()	Dependency / config checks
android_doctor()	Android companion readiness and safety policy
plan_android_action(payload)	Plan an Android inspection or approval-gated action
list_android_receipts()	List local Android workflow receipts
capture(payload)	Screen / context capture
dictate(payload)	Speech / text dictation
command(payload)	Build / run agent command
send(payload)	Dispatch to target
list_contexts()	Known contexts
list_commands()	Command catalog
demo()	Deterministic demo flow

Typical payload fields: text, contextText, target, sessionId, offline flags (see CLI).

---

CLI

screenlane-py --help
screenlane-py demo
screenlane-py command --text "Fix this error" --context-text "..." --offline

---

How it fits Talocode

User screen / voice
        ↓
   ScreenLane (this)
        ↓
  Codra / Tera / GateLane / custom target

Pair with Codra for code fixes and Tera for general LLM actions.

---

Related packages

Package	Role
talocode-screenlane	This package
talocode-codra	Coding agent target
talocode-tera	Chat / rewrite target
talocode	Unified cloud client

---

Talocode ecosystem

Project	Role
ScreenLane	This product
Codra	Coding agent
Tera	AI capabilities
GateLane	MCP gateway
StackLane	Cloud control plane
SearchLane	Search capabilities for agents
Agent Browser	Browser automation
ClipLoop	Short-form video workflows
InvoiceLane	Invoicing workflows
ContextLane	Context ingestion
MemoryLane	Agent memory
Tradia	Trading intelligence

More: github.com/talocode · talocode.site · docs.talocode.site

License

MIT © Talocode