← Back to AI Insights
Gemini Executive Synthesis

A `--max-usd` spend limit feature for `harness2` runs, designed to control monetary costs associated with model-backed experiments.

Technical Positioning
Enhancing cost governance and predictability for users running resource-intensive, model-backed experiments. This positions `harness2` as a more financially responsible and enterprise-ready platform by preventing unexpected expenditure.
SaaS Insight & Market Implications
This proposal addresses a critical financial governance gap in `harness2`. Current task-based limits fail to control actual monetary expenditure, leaving users vulnerable to unpredictable costs from variable task complexity, provider price fluctuations, or runaway rollouts. Implementing a `--max-usd` flag directly tackles this by introducing a hard spending ceiling, a non-negotiable feature for any B2B SaaS platform dealing with consumption-based pricing. This capability significantly improves cost predictability and control, mitigating financial risk for users. For `harness2`, this feature is essential for enterprise adoption, demonstrating a commitment to operational transparency and fiscal responsibility, which are paramount for large-scale, budget-conscious deployments.
Proprietary Technical Taxonomy
--max-usd model-backed runs LAB stream --only-domains --max-tasks k mode model

Raw Developer Origin & Technical Request

Source Icon GitHub Issue Oct 16, 2026
Repo: google-research/harness2
Proposal: `--max-usd` spend limit for `harness2` runs

Hi, thanks for releasing Harness². I'd like to contribute a feature and wanted to check with you before I write the code.

## The problem

The experiments guide warns that model-backed runs cost money, and the full LAB stream has 1,143 tasks. Right now I can limit a run with `--only-domains` or `--max-tasks`, but both of those limit the number of tasks, not the money. The cost of a task changes with k, the mode, the model and how long each rollout goes, so I can't really tell ahead of time what `--max-tasks 20` will cost me. If a rollout gets stuck in a loop or a provider changes its price, the run keeps spending until someone looks.

The ledger already records the cost of every rollout and session, so the number is there. Nothing uses it to stop a run yet.

## What I'd like to add

I'd add a `--max-usd` flag to `harness2`, off by default. Before each task starts, the sweep adds up what the run has spent so far, including tasks from earlier runs in the same namespace. Once the total reaches the limit, it stops starting new tasks and prints how much it spent and how many tasks are left. The tasks it skipped show up in the domain summary with a `spend_limit` status. To keep going, you run the same command again with a higher limit, and it picks up where it stopped.

With `--workers` above 1, the domains run as threads, so they'd share one running total behind a lock.

## How it fits the method

I tried to keep this out of the method itself. The check only happens between tasks,...

Developer Debate & Comments

No active discussions extracted for this entry yet.

Adjacent Repository Pain Points

Other highly discussed features and pain points extracted from google-research/harness2.

Extracted Positioning
The `harness2-judge`'s grade persistence logic during task re-runs and judge failures, specifically the `_merge` operation's handling of run IDs and rollouts.
Ensuring data integrity and accurate reporting within the `harness2` system, particularly concerning task re-runs and judge reliability. The system must reflect the current state of a task, not a stale one.

Frequently Asked Questions

Market intelligence mapped to A `--max-usd` spend limit feature for `harness2` runs, designed to control monetary costs associated with model-backed experiments..

What problem does A `--max-usd` spend limit feature for `harness2` runs, designed to control monetary costs associated with model-backed experiments. solve?
Based on our AI analysis of the original developer request, its primary technical positioning is: Enhancing cost governance and predictability for users running resource-intensive, model-backed experiments. This positions `harness2` as a more financially responsible and enterprise-ready platform by preventing unexpected expenditure.
Are engineers actively discussing A `--max-usd` spend limit feature for `harness2` runs, designed to control monetary costs associated with model-backed experiments.?
Yes, we have tracked 2 direct responses and active debates regarding this specific topic originating from GitHub Issue.
Which technical concepts are associated with A `--max-usd` spend limit feature for `harness2` runs, designed to control monetary costs associated with model-backed experiments.?
Our proprietary extraction maps A `--max-usd` spend limit feature for `harness2` runs, designed to control monetary costs associated with model-backed experiments. to adjacent architectural concepts including --max-usd, model-backed runs, LAB stream, --only-domains.

Engagement Signals

2
Replies
open
Issue Status

Cross-Market Term Frequency

Quantifies the cross-market adoption of foundational terms like k and mode by tracking occurrence frequency across active SaaS architectures and enterprise developer debates.