> The nature of LLMs means you just can't really know or force it to spit out ad garbage in a predictable manor.

You certainly can with middleware on inference.