HydraRoute solves 93% of tasks at zero tokens using 11 local solvers, then cascades the rest across Gemma 4 via Fireworks AI. Every query gets the cheapest solver that can handle it.
Every task flows through a cascade of increasingly powerful solvers. Most never reach the API.
11 deterministic solvers: SymPy equations, arithmetic, date math, string ops, unit conversion, regex, factual lookup, number conversion, word analysis, sentiment.
Mixture-of-Experts with only 3.8B active parameters. Handles NER, factual knowledge, and text summarization efficiently.
Full 31B dense model for logical reasoning, deductive reasoning, code generation & debugging. Self-consistency voting with 3 parallel calls.
Every feature minimizes API tokens without sacrificing accuracy.
Real API calls via Gemma 4 on Fireworks AI. Average 3.4 seconds per task.
| Category | Tasks | Pass Rate | Avg Time | Tier |
|---|---|---|---|---|
| Math | 10 | 100% | 0.7s | 0 |
| Factual Knowledge | 10 | 100% | 0.3s | 0 |
| Sentiment Classification | 10 | 100% | 2.2s | 0 |
| NER | 5 | 100% | 2.3s | 1 |
| Text Summarization | 2 | 100% | 1.4s | 1 |
| Logical Reasoning | 7 | 100% | 14.9s | 2 |
| Deductive Reasoning | 3 | 100% | 7.9s | 2 |
| Code Generation | 10 | 100% | 3.8s | 2 |
| Code Debugging | 10 | 100% | 1.9s | 2 |
Full report: benchmarks/FINAL_BENCHMARK_REPORT.md