Small decisions. Interesting possibilities.Submit contentSubmit

Jev Model Router

A router uses Jev to choose the model that best fits each incoming request.

Added to Jevfast

How it uses Jev

Input: each incoming request and the router’s candidate models. Jev chooses which model best fits; the selected destination receives the request. Exact Jev request and answer shape are undisclosed.

Why it is interesting

A bounded routing decision can happen before a slower generation call. The criteria and candidate list are not published.