We don't disagree about the abilities of standard IQ tests.
In the framework I presented think about it this way:
The set of all problems can be loosely thought about as existing in some space of some dimensionality.
So say some problems take a certain amount of short term memory, or speed of computation, or background knowledge or some such. The IQ tests try and find some boundaries in this space that predict the sub-set of problems that a agent can do.
Now there are limitations. There are certain important real world problems that might required persistent work for months to solve where the person doesn't lose focus or resolve. An IQ test may do poorly at predicting success in these types of problems. And so on for other dimensions that IQ tests don't measure.
But they do measure some important dimensions and so can be useful!
Re: General Intelligence:
In the framework I presented think about it this way:
The set of all problems can be loosely thought about as existing in some space of some dimensionality.
So say some problems take a certain amount of short term memory, or speed of computation, or background knowledge or some such. The IQ tests try and find some boundaries in this space that predict the sub-set of problems that a agent can do.
Now there are limitations. There are certain important real world problems that might required persistent work for months to solve where the person doesn't lose focus or resolve. An IQ test may do poorly at predicting success in these types of problems. And so on for other dimensions that IQ tests don't measure.
But they do measure some important dimensions and so can be useful!