noqa-runner 0.1.10

noqa runner

noqa-runner

AI-powered mobile test execution runner for iOS applications.

Installation

pip install noqa-runner

Quick Start

CLI

# Run with local IPA build
python -m noqa_runner run \
  --noqa-api-token $NOQA_API_TOKEN \
  --case-input-json '[
    {
      "case_instructions": "Open app and login with valid credentials"
    }
  ]' \
  --device-id "00008110-001234567890001E" \
  --apple-developer-team-id TEAM123456 \
  --app-bundle-id com.example.app \
  --build-path /path/to/app.ipa

# Run with TestFlight installation
python -m noqa_runner run \
  --noqa-api-token $NOQA_API_TOKEN \
  --case-input-json '[
    {
      "case_instructions": "Open app and verify features"
    }
  ]' \
  --device-id "00008110-001234567890001E" \
  --apple-developer-team-id TEAM123456 \
  --app-bundle-id com.example.app \
  --app-store-id 123456789

Required Options:

--noqa-api-token TEXT         noqa API authentication token [required]
--case-input-json TEXT        JSON with test cases: [{case_instructions, test_id?, case_name?}] [required]
--device-id TEXT              Device UDID for testing [required]
--apple-developer-team-id TEXT Apple Developer Team ID for code signing [required]
--app-bundle-id TEXT          App bundle ID (auto-extracted from IPA if not provided) [recommended]

Installation Options (choose one):

--build-path TEXT             Path to local IPA build file
--app-store-id TEXT           App Store ID for TestFlight installation

Other Options:

--app-context TEXT            Application context information [optional]
--agent-api-url TEXT          Agent API base URL [optional, default: https://agent.noqa.ai]
--log-level TEXT              Logging level [optional, default: INFO]
--appium-url TEXT             Appium server URL [optional, default: http://localhost:4723]

Python API

from noqa_runner import RunnerSession, RunnerTestInfo

# Create session
session = RunnerSession()

# Run with local IPA build
results = session.run(
    noqa_api_token="your-token",
    tests=[
        RunnerTestInfo(
            case_instructions="Open app and verify home screen",
        )
    ],
    device_id="00008110-001234567890001E",
    apple_developer_team_id="TEAM123456",
    app_bundle_id="com.example.app",
    app_build_path="/path/to/app.ipa",
)

# Run with TestFlight installation
results = session.run(
    noqa_api_token="your-token",
    tests=[
        RunnerTestInfo(
            case_instructions="Open app and verify features",
        )
    ],
    device_id="00008110-001234567890001E",
    apple_developer_team_id="TEAM123456",
    app_bundle_id="com.example.app",
    app_store_id="123456789",
)

for result in results:
    print(f"Test {result.case_name}: {result.status}")

Test Results

The CLI returns test results as JSON with detailed information about each test execution:

[
  {
    "case_instructions": "Complete onboarding, check that paywall has products",
    "status": "passed",
    "message": "Test completed",
    "test_conditions": [
      {
        "condition": "Onboarding process was completed successfully",
        "is_verified": true,
        "evidence": "User progressed through multiple onboarding screens, ending with 'Get started' button",
        "step_number": 4,
        "confidence": 100
      },
      ...
    ],
    "steps": [...]
  }
]

Result fields:

• case_instructions - Original test instructions
• status - Test status (passed, failed, error)
• message - Summary of test execution result
• test_conditions - List of conditions checked during test with verification results
• resolution - Device screen resolution during test
• steps - Detailed step-by-step execution history

Logging

All logs are output in JSON format with the following fields:

{
  "event": "test_started",
  "event_type": "progress",
  "test_id": "550e8400-e29b-41d4-a716-446655440000",
  "case_name": "Login Test",
  "timestamp": "2025-10-16T10:30:00Z"
}

Event types:

• progress - Test execution progress
• result - Final test result

License

Proprietary - noqa.ai

Support

For issues and questions, please contact [e-mail]