You are interpreting the law in strange ways. But even so, you are wrong about resulting computer power. I looks like you misinterpret "clock speed" for "performance". Adding more cores IS legit way how to sidestep MHz limit. E.g. especially for simulating neural networks, more cores are just as fine as more GHz.
The "law" states a doubling over an 18-24 month period. I've seen no doubling from 2002 to 2012. In 10 years we've gone from as you say 2.2Ghz processors to 2x 2.2Ghz processor (the current standard is still Core 2 Duo or equiv, thanks Dell
) In 5 years we've failed to double. Also note we have not accomplish successful decoupling of multi-threaded programming; this is another impediment to the large scale processing of neural nets. Just remember, these weighted nets are huge as well.
As for last 10 years, I pretty much remember that by 2002, the "state of the art" was Pentium 4 at 2Ghz with 256MB RAM. I am writing this on Sandy Bridge quadcore that is about 20 times faster and with 8GB RAM. And it was cheaper than that Pentium 4 in 2002. Remember, the law is about performance/price...
Quad cores aren't the standard and the chips are 20x faster, each core contains the capability of a single P4 x.x GHz chip. The core is the idea that your single processor was busy so pass work to be done to another core. Furthermore, the law isn't about performance over price. The law, which is 30 years old, states that processing power would double every 18-24 months. From 2002 to 2012, 10 years, we should've seen a 5x speed increase. Assuming a Quad core at 2.2Ghz per core, 8.8 GHz, assuming your mentioned 2GHz after 2 years should be 4GHz, after 2 more should be 8GHz, after 2 more should be 16GHz, 2 more 32GHz, and finally 2 more for 64GHz. That would be a 32 core processor. Moore's law was a predictio, not an actual law and it hasn't held true for a long time.
And do not let me even started about GPU's FPU processing power... Average gamer's machine has vector FPU potencial way higher than you could have bought by 2000 for thousands of dollars.
These are a
specialty processor for graphics. Sure there's documentation on them being capable of doing some impressive stuff, but, they aren't a CPU and have no positive or negative impact on neural networks unless specifically setup to do them and even then they'd be no better than your multi-core processor.
I clearly see that the major change is motherboards is that motherboard chipsets are becoming irrelevant, all logic being moved to CPU die.
The major changes are the addition of caches for SSD and GPU along with faster FSB; I'm not seeing what you're seeing that much and would gladly read any paper on this aspect. Regardless, where the instruction set resides does not factor into this discussion.
I am old enough to remember that this mantra is being repeated since at least 1990...
While old enough to have witnessed this claim, I also am wise enough to note the break through that was the
Integrated Circuit. I've specifically stated it would take another break through of equivalent level to push us beyond. I mean come on, I was running dual AMD Athlon MP 1600+ in 2000. That's 2x 1.4Ghz and I was "behind in the times" at that point and I was still clocking in at 2.8Ghz. At that time 2x 1.8 and 2x 2.0 were definitely available so 3.6Ghz and 4Ghz respectively have been available for 12 years and we're coming in at a whopping 8.8 after nearly 12 years.
As always I'm not saying never, I'm saying we need a break-through and so far, chip makers are happy just adding cores. At some point the individual core will need to become faster.