I re-read your point about the randomness. It flew over my head, but I get it now. LLMs naturally don't just pick the most likely next word, they naturally seed some randomness to it, and therefore there is nothing unusual about injecting randomness of your own into it.
🤯 nice.
