Comment on: Browser Arena

Hey PH! I'm Sam from Notte. 👋We built Browser Arena because we were tired of seeing benchmarks in the AI agent/browser infra space that couldn't be reproduced. Companies claiming SOTA performance based on cherry-picked runs, undisclosed infrastructure, and small sample sizes.So we built an answer: an open-source benchmark suite that tests every major cloud browser provider under identical conditions. What makes it different❓1,000 runs per providerSame AWS infrastructure, same test, same Playwright versionFull VM metadata published (region, instance type, RTT)Median, P90, P95 — not just "best case"Error rates and failure breakdowns includedCost per session calculated from real pricingMIT licensed. Clone it and run it yourself.The benchmark ⚡Minimal session lifecycle (create → connect → navigate → release). Tests both sequential and concurrent (up to 16 parallel sessions) execution.Notte performs well in the results. But we didn't build this to win (we don't in all cases), we built it so the results mean something. If another provider is faster, the leaderboard shows it. That's the point.Run it on your own infra and tell us if your numbers differ.Would love your feedback on what benchmarks you'd want to see next! 🌸