The rise of decision models
Vendors are racing to ship small, dedicated classifier models alongside their general LLMs, and competitors are matching each other's releases within days, not quarters.
-
Small, dedicated decision models are emerging as their own category alongside general LLMs, and vendors are matching each other within days
Sebastian Raschka wrote Sept 29 that TypeSafe AI's classifier model 'Jev' became 'a cultural phenomenon' in two weeks, beating general LLMs on cost and speed for classification work. OpenAI's Nikunj Handa said its own Decisions API was built in about a week after Jev 'nerd sniped' OpenAI's engineers, per swyx's Latent Space. Unsloth and llama.cpp both shipped runtime support for rival decision models, Laya and Clef, within days of each other. Raschka · Latent Space · Unsloth releases
-
Amazon released an open-source 2B decision model, Strands Decider, joining the vendor race in small classifiers - single source. Tech Insider
-
SHIPCloudflare and Amazon both ship open decision models the same day
Cloudflare released Clef and Clef-flash, Apache-licensed classifier models built on Qwen, the same day Amazon's Strands Labs open-sourced its own 2B decision model with training data included - rival vendors are now shipping these models within days of each other, not quarters. DataNorth · Digital Applied
-
WATCHCloudflare's new Clef decision models get day-one GGUF support
Independent quantizer bartowski shipped GGUF versions of Cloudflare's Clef and Clef-flash classifier models within a day of release, a sign the fast-cloning decision-model category is getting real community tooling, not just vendor benchmarks. bartowski