ocarina 1.1.5

Websites test framework for Igor

Ocarina

A Python browser test automation framework built on Railway Oriented Programming (ROP).

Overview

Ocarina is a pure-Python framework that provides a declarative DSL for composing browser tests.

Its defining characteristic is that every test step is a link in a Railway chain: on failure, the rest of the chain short-circuits and the error is captured as a value rather than propagated as an exception.

This keeps test code flat and the failure path explicit.

Notable features:

• Railway-based action chains with first-class success/failure handlers.
• Hierarchical test orchestration: Test → TestSuite → TestCampaign → TestCycle.
• Parallel execution with a thread-safe WebDriver pool.
• Automatic retries on transient errors.
• Conditional branching via match_page for pages that can render in multiple states.
• Fluent assertion chains via validate.
• Built-in reporters: pretty-print (ANSI), JSON, DOCX proof documents, timing, screenshots.
• Framework-agnostic POMBase; Selenium and Playwright integrations ship as adapters.
• Ships its own test runner: Ocarina is NOT a pytest plugin.

Requirements

• Python 3.14+
• (SELENIUM) A matching WebDriver binary on disk (chromedriver, geckodriver, msedgedriver) for the browser you intend to use. Safari uses the native macOS safaridriver and needs no binary on disk.
• (PLAYWRIGHT) The Playwright browser binaries, installed once with playwright install (no per-browser driver on disk; Playwright bundles its own).

Documentation

See The Ocarina Holy Book

Installation

pip install ocarina

Core concepts

• POM — page objects subclass POMBase; the base class is browser-agnostic.
• Scenario — a factory (driver, logger) -> Scenario(test_chain, setup, teardown, watchers) built from Scenario.
• Railway chain — actions are wrapped with create_act, which returns a builder with .failure(...), .success(...), and .execute().
• drive_page — drive_page composes multiple acts into a single chain.
• match_page — match_page branches on which of several states a page is in.
• validate — validate is a fluent assertion chain with alternatives and aggregated errors.
• Test orchestrators — Test (one case), TestSuite (parallel + retry policy), TestCampaign (sequential suites), TestCycle (smoke campaigns before main campaigns).

CLI flags (opinionated Selenium launcher)

Parsed by create_selenium_auto_cli_store. Headless mode is the default; use --not-headless to opt out.

Flag	Default	Notes
--driver-path	""	Path to the WebDriver binary (not used on Safari).
--browser	required	chrome, firefox, edge (Windows), safari (macOS).
--not-headless	off	Shows the browser UI.
--workers	5	Parallel workers (size of the driver pool).
--wait-timeout	10	Selenium implicit wait seconds (max 60).
--profile-path	None	Browser profile directory (not supported on Safari).
--logger	terminal+file	One of terminal, file, terminal+file, muted.
--dont-force-delete-tmp-dirs	off	Skip the post-run cleanup of Selenium temp profiles on Windows.
--exclude	[]	Exclude tests by IDs.
--only	[]	Select tests by IDs.

CLI flags (opinionated Playwright launcher)

Parsed by create_playwright_auto_cli_store. Playwright ships its own browsers, so there is no --driver-path. Headless mode is the default; use --not-headless to opt out.

Flag	Default	Notes
--browser	required	chromium, firefox, webkit (all platforms).
--not-headless	off	Shows the browser UI.
--workers	5	Parallel workers (size of the driver pool).
--wait-timeout	10	Default auto-wait timeout in seconds (max 60), set per page.
--profile-path	None	Profile directory; copied into a managed persistent context.
--logger	terminal+file	One of terminal, file, terminal+file, muted.
--video-dir	None	If set, record a session video per driver into this directory.
--trace-dir	None	If set, write a Playwright trace per driver (playwright show-trace).
--exclude	[]	Exclude tests by IDs.
--only	[]	Select tests by IDs.

Playwright adapter notes

The Playwright sync API binds every object to the thread that created it, which would otherwise clash with Ocarina's threaded pool, warmup, and watchers. The adapter confines each session to a private owner thread (PlaywrightDriver) and marshals every call onto it, so pools and warmup work unchanged. Page objects drive the browser via driver.submit(lambda page: ...). Consequences:

• Watchers are observe-only — a watcher MAY read the page from its callback via watcher.driver.submit(...) (marshalled, safe from its daemon thread), but must never mutate it (click/fill), exactly as in Selenium. Reads serialise on the owner thread, so they cost a little at high poll rates.
• wait_timeout maps to Playwright's per-page default timeout, set once at driver creation. For one-off edge cases, use Playwright's native per-call timeout= argument at the call site.
• Debug artifacts (opt-in, off by default) — pass record_video_dir / trace_dir to create_playwright_driver or create_playwright_drivers_pool (or --video-dir / --trace-dir) to capture a per-driver video and/or trace. Files are written to disk when the driver is disposed and kept — they accumulate across runs, nothing is overwritten or auto-cleaned. Network interception works today with no extra wiring: driver.submit(lambda page: page.route(...)) (the route handler runs on the owner thread — use route/request directly, never a re-entrant submit).

Reporting

The opinionated/plugins/reports package ships four reporters that can be passed to bootstrap via run_plugins:

• pretty-print — hierarchical ANSI summary on stdout.
• JSON results — structured results.
• DOCX proofs — Word document assembled from logs (requires FileLogger).
• timing — context manager that prints total test duration.

Screenshots are captured automatically on failure (when autoscreen_on_fail=True on a suite) and can also be triggered explicitly through the ITakeScreenshot port.

Full example

For a complete, runnable project:

• CI workflow,
• Real page objects,
• OTP-based login coordinated through Redis,
• Data-driven suites,
• File upload tests,
• Chaos scenarios

See ocarina-example.

Full AI example

See ocarina-with-ai-example.

Development

From a clone of this repo:

make install              # create .venv and install with dev deps
make test                 # pytest + coverage + allure results
make check-coding-style   # mypy + ruff
make ruff-format          # apply formatting
make serve-htmlcov        # open the HTML coverage report
make serve-allure         # open the Allure report

Misc

Allure report

License

MIT — Igor Casanova.

---

Built by @mojo-molotov
Fueled by figatellu and Квас.