relinquishing ai
I am giving it up. I have run the experiment of using Gen AI and seen how AI is a threat to my own creativity and critical thinking. The only functional use of AI should be to aggregate information, and even then, it is relying on “RAG” probably from Google.
llms can’t do novel design
The killing of creativity is because AI can’t do new things that people haven’t done. It’s an age-old critique that has been said about them.
Yes, they can design, if you consider design to be selecting from previous patterns of design. Ultimately, LLMs can’t imagine new designs. It can’t do the work of researching, it can’t do the work of theorizing, and it can’t be the dream-maker you want it to be.
These companies are soon to run out of “good code” to even train their models on. Even worse, when you feed in synthetic data from its output, your model will “necessarily” become degenerate1. In the case of an image generation model, it degrades to noise. In the case of LLMs, it might word-for-word give you the whole text document.
llms have no understanding of grammar2
There’s something more important than the simple understanding of sentences or words. It’s knowing how to interpret those sentences, how to form more sentences, and subsequently understanding the “semantic content” of them.
In computers, there is the ISA rule set, in linguistics, we have parts of speech, and in formal logic, there are rules of inference. The grammar difference accounts for the fundamental difference between humans and LLMs, even more so than the “stochastic parrot” bullet.