Comment on: Show HN: Frugon – Find which LLM calls a cheaper model could handle (local, MIT)

Evals and OpenInference (OpenTelemetry) might be useful.Costed opcodes (like the shelved eWASM opcodes cost chart) would be useful for this model routing problem as well.Is this the cost to converge problem, the minimize cost to converge upon sufficiently low error problem, or the minimize cost and error problem?EA methods: mutation, crossover, selectionGradient descent as a mutation, crossover, and selection pattern; back up when the error/cost stops decreasing for too long and try a different branch.A simple experiment: vary only a nonce in the prompt and compare output value. The nonce is a parameter. The model is a hyperparameter.