Glossary › Model Routing
Model Routing
Sending each request to the cheapest model that can handle it, based on rules, a classifier, or a first attempt with a small model plus a verifier. A cascade is routing where escalation happens after a failed attempt.