François Chollet points out that AI capabilities are always highly peaked, superhuman in certain narrow fields but basically useless in others
François Chollet criticizes the peaked distribution of AI capabilities
François Chollet points out that AI capabilities are always highly peaked, superhuman in certain narrow fields but basically useless in others; the core marketing trick of the AI industry is to make people mistakenly believe that the highest peak is the baseline level.
He explains that this trick benefits from anthropomorphic cognition: human excellence in a certain field often suggests general learning ability, but machines do not work that way.
In AI development, the gap between marketing narratives and actual capabilities affects investment and expectations, with capital concentrating on areas that truly break through general capabilities rather than single benchmark hype.
Source: Public information
ABAB AI Insight
François Chollet has long criticized the limitations of the current AI paradigm using benchmarks like ARC; this comment continues his emphasis on the distinction between narrow intelligence and general intelligence, similar to early doubts about the generalization ability of deep learning.
On the capital front, the industry mobilizes funds towards large model scaling through benchmark peak marketing, motivated by maintaining valuations and financing enthusiasm, strategically using human cognitive biases to obscure actual deployment gaps.
Similar to past over-promotions of specific AI subfields, this round of AI is in a continuous phase of differentiation between marketing narratives and real capabilities.
Essentially, this relates to technological substitution and capital concentration: peak capabilities are packaged as general, with the mechanism being anthropomorphic biases that lead investors to overlook insufficient generalization, pushing resources towards parameter scaling and specific task optimization rather than true breakthroughs in cognitive architecture.
ABAB News · Laws of Cognition
Peak capabilities are never a general baseline.
Anthropomorphism is the strongest leverage in AI marketing.
The higher the benchmark peak, the greater the disappointment in actual deployment.