Having some success while testing this model out as a replacement for GPT-5 nano...

dummydummy1234 · 2026-06-23T03:55:02 1782186902

Can't you just force it to do structured output via constrained generation?

noperator · 2026-06-23T16:48:09 1782233289

Yes, I did end up figuring out a clean way to allow normal reasoning inside <think> and then force JSON _after_ the closing </think>. Example here: https://gist.github.com/noperator/6c711ab19027ea8056442df839...

nickalaso · 2026-06-23T23:09:49 1782256189

Thanks for that, and credit to you for the idea, I quickly vibe coded (heh) a working minimal tool calling harness thats allows it to make multiple tool calls each turn. Currently its working pretty damn well all things considered: https://github.com/NickalasLight/VibeHarness.git

hypfer · 2026-06-23T05:56:52 1782194212

> but I'm working around that in my harness.

How?

uberex · 2026-06-23T11:21:10 1782213670

Maybe limiting logits to what is syntactically correct? E.g. {"hello" has to be followed by whitespace or colon. Any other logits get dropped.