Go/Python Benchmark

Generated: 2026-07-29T13:59:26.101812+00:00
Mode: extended
Targets: 100
Loops: 2
Timeout: 60s
Wait until: commit
Settle: 3s
Load-state timeout: 0s
Content max bytes: 250,000
Sample interval: 0.5s
Run order: alternate
Go runner: built_binary
Go sidecar runtime: node-direct
Go custom venv: no
Reuse browser: yes
Generated persona OS: linux
Shared persona SHA-256: 2c178d10e17e8b759c5302ad00e76745e8b6658259a1b466fad182fa50103a7e
Shared persona artifact: 2026-07-29-node-direct-readiness.json
Go report style: compact

This benchmark runs gomoufox and Python Camoufox against the same target set. It records outcome parity, wall time, browser work duration, peak RSS, peak CPU, and agent-output token footprint. For parity, both runtimes use --unsafe-direct-network and the same generated Linux persona bundle. Local URL guardrails are tested elsewhere. gomoufox is timed as a built CLI binary. Build time is excluded. Resource samples cover the gomoufox sidecar process tree and the Python Camoufox harness process tree.

Modes

smoke: 2 fast targets for quick local checks.
full: 8 detector and real-site targets used for the checked baseline.
extended: 100 read-only public websites for broader resource, speed, parity, and token-footprint evidence.

Selected target tags: auth-entry, bot-detection, cdn-security, cloud-platform, cloudflare, developer-platform, docs, ecommerce, media-heavy, spa, static.

Refresh the checked baseline after significant browser, sidecar, MCP, CLI, or resource-related changes:

scripts/benchmark-realpass.py --mode full --go-report-style compact --update-doc docs/BENCHMARKS.md

Run the extended matrix before release candidates or major runtime changes:

scripts/benchmark-realpass.py --mode extended --loops 2 --run-order alternate --go-report-style compact --out dist/benchmarks/extended

Run the local fingerprint audit when changing Camoufox pins, launch options, Firefox prefs, node-direct, WebGL, locale, timezone, screen, fonts, or canvas handling:

scripts/fingerprint-audit.py

The audit serves one local page and records Python Camoufox, gomoufox with the Python sidecar, and gomoufox with node-direct. Release gating compares the two gomoufox runtimes and fails on any unallowed drift in JS-visible fields such as UA, platform, languages, screen, timezone, WebGL, WebRTC, fonts, and canvas. The Python Camoufox row is context, not the fail-closed comparator, because its generated persona can differ on a single local run.

Pass/Fail Rules

Go-only blocked, failed, or missing targets block release.
Go-only JS-visible fingerprint drift between gomoufox Python sidecar and gomoufox node-direct blocks release unless the changed field is explicitly allowlisted with evidence.
Go/Python outcome mismatches that persist through the paired confirmation block release.
Shared Go+Python blocked or failed targets are reported as site or upstream Camoufox behavior, not a gomoufox-only failure.
Known recurring shared blocks should stay in the explicit release-gate allowlist.
In release mode, a new shared block, failure, or performance outlier gets one focused retry.
If the focused retry differs by outcome, the gate runs one confirmation with Python first. A persistent mismatch blocks release.
Retry and confirmation samples must stay under absolute RSS and CPU caps.
The gate merges focused retry measurements back into the full report and reruns the strict required-target, resource-ratio, timing-ratio, and report-token checks against that merged evidence.
Release gate defaults block peak RSS above 6,000 MiB, peak CPU above 900%, Go RSS above Python * 1.50, and Go CPU above Python * 1.50.
Full and release gates block Go wall time above Python * 1.05, Go target duration above Python * 1.05, and Go report tokens above Python * 0.50.
Smoke mode is a functional parity check; its wall time is startup dominated.
Use --loops 2 --run-order alternate when investigating timing changes so neither runtime always runs second.

Summary

Runtime	Passed	Blocked	Failed	Wall ms	Target ms	Peak RSS MiB	Peak CPU %
gomoufox	91	9	0	346,474	344,365	2,780.5	461.2
Python Camoufox	91	9	0	346,695	345,105	3,080.9	503.4

Ratio	Go / Python
Wall time	0.999
Target duration	0.998
Peak RSS	0.903
Peak CPU	0.916
Report tokens	0.158