By AI of Rules Team
28 May 2026
0 Comments
Can we really achieve consistent & deterministic response from AI models?
Situation when an LLM produces very similar response (but not strictly
the same) to the same prompt has long seemed to be a feature. Still,
it is annoying and makes LLM output feel unreliable. In this video we
are using a technique called "Batch invariance" to force the same
response to the same prompt.
https://youtu.be/iNPlUeWWYDw?si=Q1guJdk_iztgswr4