If we create a stripped-down vocabulary with greater token density to use less resources and to resolve ambiguities earlier in the semantic process, aren't we creating NEWSPEAK and dragging along the worst aspects of it? The ambiguity and multi-valence of words is what creates more connections between words, increases the directionality of associations, and expands the potential subtlety and depth of meaning. By paring down (or requiring verifiability) we make it harder to say certain things, or at least make it harder to unintentionally say something that makes MORE or DEEPER sense than what we intended. If the token density becomes extreme, you're left with something like a calculator.
Maybe this is the ultimate path toward better coding? But the worse path toward better genuine thinking?
I don't think so. It's pretty clear that LLMs use the higher level layers for reasoning, so a bit of logorrhea very possibly enriches the result quality.
This is one of the dangers. AI boosters would say that humans already do this compression and it was accelerated by mass media and then the internet, and that model memory + context can be broad enough that compared to human capabilities the opportunities for depth and variability are even greater. But I think we know which way this optimization usually goes. Even the notion of a "fine-tune for subtlety" is a contradiction.
It's my understanding that the llm is not literally thinking those words, they are just the conversion of the matrix multiplication results (numbers) into the tokens. So the matrix is "multiplying" concepts and directions to come up with the final answer - which produces a somewhat readable reasoning trace. As far as the llm is concerned the reasoning trace could be random (to us) symbols. In fact, the reasoning traces are not necessarily optimized for readability as much as they are an emergent property of the way a reasoning model is trained
This is different from the final output? I thought all traversals of the chain of language are through these mathematical means.
You could tokenize the word "good" to resolve to only represent 'the opposite of "bad"' and to exclude "as opposed to evil", demanding that this second meaning will be reserved only for the new token "double-minus evil". You've therefore forced the words to be more univalent with no overlapping tangled associations. This, it could be argued, makes thing clearer, makes things take fewer hops to go from token to token, makes the path be straighter. In English the terms conflate and wobble back-and-forth, hide each other's meanings, only to pop up again unexpectedly, sometimes confusingly, or rhetorically, metaphorically, or ambushing us manipulatively. But these "swerves" are not only de-optimizations, they are the flow of poetry, the drama of masks, etc etc etc.
I'm seeing it more like: take the concept of "good" put it in a scale of -10 (pure evil) to +10 (pure good). These concepts and the inbetweens have been ingrained into the model, the model can multiply its weights in any combination to express any level and any in between, even -2.16541 etc. So, suppose you give it a short story and ask the model to reason about it and how a character displayed good vs evil behaviour towards the story: Internally the model is making calculation that are very nuanced and extremely precise. This calculations are not the reasoning trace. The reasoning trace itself does not influence the calculations. You may read: "John starts bad and slowly becomes good" when inside the calculations are John goes from -5.245 to -4.24 to -5.221 again, and then 2.1. What matters for nuance is the inner calculations across the many matrix layers. What you see is like an independent program that looks at "-5.245 to -4.24 to -5.221 again, and then 2.1." consults the tokenizer and outputs: "John starts bad and slowly becomes good" or even "John first bad, then good". When in reality, inside, the model as been processing something more akin to "John starts the story as a despicable person, with a redemption arc that builds slowly, he can't yet be considered a good person, certainly not the kind of good person you'd leave your dog with, but he's certainly not as bad as before" the whole time. Now, what if when you continue the conversation, what does the model receive as context? It's original nuanced sentiment, or the brute reasoning trace? That I don't know. It might be that when the reasoning trace is converted from tokens back into numbers it loses all nuance, or it might be that the trace (the words you see) are not the only thing that is being saved and is not the only thing being fed back as context
If we create a stripped-down vocabulary with greater token density to use less resources and to resolve ambiguities earlier in the semantic process, aren't we creating NEWSPEAK and dragging along the worst aspects of it? The ambiguity and multi-valence of words is what creates more connections between words, increases the directionality of associations, and expands the potential subtlety and depth of meaning. By paring down (or requiring verifiability) we make it harder to say certain things, or at least make it harder to unintentionally say something that makes MORE or DEEPER sense than what we intended. If the token density becomes extreme, you're left with something like a calculator.
Maybe this is the ultimate path toward better coding? But the worse path toward better genuine thinking?
You could tokenize the word "good" to resolve to only represent 'the opposite of "bad"' and to exclude "as opposed to evil", demanding that this second meaning will be reserved only for the new token "double-minus evil". You've therefore forced the words to be more univalent with no overlapping tangled associations. This, it could be argued, makes thing clearer, makes things take fewer hops to go from token to token, makes the path be straighter. In English the terms conflate and wobble back-and-forth, hide each other's meanings, only to pop up again unexpectedly, sometimes confusingly, or rhetorically, metaphorically, or ambushing us manipulatively. But these "swerves" are not only de-optimizations, they are the flow of poetry, the drama of masks, etc etc etc.