All possible books live somewhere in L-space (ook). Exploring that space efficiently is equivalent to creativity. The claim is that the space that LLMs learn is somehow sufficiently limited that it doesn’t contain novel ideas? I never saw a convincing argument why LLMs output can not be considered creative.
[−]moritzwarhier · 2026-11-15 Sun 17:11 UTC ·
link
OK, I still an confused about what point the extension of the analogy was trying to make, because I didn't consider the parent comment to be arguing for or against LLMs being able to be creative.
But LLMs don't "explore" L-space, the training process just maps all of the available conceptual landmarks inside that space. There are still enormous (infinite?) tracts of unmapped territory that LLMs never reach, and that's exactly the space where novel ideas live.