انضم إلى نوستر
2026-08-15 15:03:08 CEST
in reply to

Troed Sångberg on Nostr: Shannon's theorem regarding the limits of compressions proves that LLM don't store ...

Shannon's theorem regarding the limits of compressions proves that LLM don't store training data. You're of course correct that overfitting has happened, but it's neither intentional nor wanted because it wastes resources.