jev-model-router

What it does

Routes a request among two or three model tiers using one ordered Jev score and explicit upgrade thresholds.

How you can use it

To cut costs, you can sort user questions between two or three language models, from cheapest to strongest. Start by listing your models in order. Write a clear sentence describing the exact kinds of tasks each model should handle.

Your developer can connect this tool using an access key from TypeSafe. You choose which model steps in if the connection fails. Note that this tool only picks a model name and does not actually send or answer the request.