I’m stoked to see all the commotion about TypeSafe AI's Jev. It seems to be a classifier model beefed up with some special training (RLCD?) on large amount of decisions or something? ~ Either way, it seems you end up with an LLM that takes in strings, has a world view, and provides some sort of yes/no/range/pick-from-three/odd-one-out/etc. conditional step.
I haven’t played with it yet, but a co-worker has and seems to have had good first impressions; others seem to be pretty interested as well.
Where my bitter mind goes
I think this kinda thing is _great_ for workflows and pipelines, prompt-injection detection, routing requests and jobs, extraction, classification generally, etc. ~ but ultimately when I start to think about this stuff I start to feel like I’m getting in the optimization-weeds. I guess it when you’re not paying any output tokens it’s not optimizing anymore, you’re just learning how to annunciate concisely with a/the new range of tools.