What are attention mechanisms of not being aware of what it has said so it can inform what it is about to say? Ultimately, I think people saying these generative models aren’t really “intelligent” boils down to deciding they don’t like the impact these things are having and are going to have on our society and characterizing them as a fancy statistical curve lets people short circuit that much harder conversation.
I mean, one of the core ways we measure intelligence in humans is the ability to recognize and extrapolate patterns. You wouldn’t call a lake a human, but you’d recognize they both share substantial proportions of the same chemical makeup.