Where have you missed 3 times more IPC performance?ScottL wrote:The "law" states a doubling over an 18-24 month period. I've seen no doubling from 2002 to 2012. In 10 years we've gone from as you say 2.2Ghz processors to 2x 2.2Ghz processorYou are interpreting the law in strange ways. But even so, you are wrong about resulting computer power. I looks like you misinterpret "clock speed" for "performance". Adding more cores IS legit way how to sidestep MHz limit. E.g. especially for simulating neural networks, more cores are just as fine as more GHz.
Not sure what you mean, but I am quite sure that if you as programmer are unable to put those cores to work where possible, you should perhaps consider another career.Also note we have not accomplish successful decoupling of multi-threaded programming;
Yes, there are some 'new' things to learn, but really, there is no magic.
Sandy Bridge has 3 times more IPC. Where have you happened to miss this?Quad cores aren't the standard and the chips are 20x faster, each core contains the capability of a single P4 x.x GHz chip.
Plus, my one year old quadcore sandy-bridge notebook was exactly the same price as the dual-core core 2 I have bought 4 years ago. IMO, that is the law in action. And I am always doing basic benchmark important for my work (compiling huge C++ projects) and it really does it 3 times faster..
Sure it is. There was no possible metrics in the past. Sure, today Intel CPUs are fastest cores in the world, but it had no sense in 1990's to compare Crays with Apples...Furthermore, the law isn't about performance over price.
You really are victim of Mhz myth! 2Ghz Sandy Bridge single core is performance equivalent of 6Ghz Pentium 4 single core... (HT not included)Assuming a Quad core at 2.2Ghz per core, 8.8 GHz, assuming your mentioned 2GHz after 2 years should be 4GHz, after 2 more should be 8GHz, after 2 more should be 16GHz, 2 more 32GHz, and finally 2 more for 64GHz.
So, looking for "major breakthrough", but too lazy to write a bit of OpenCL code?These are a specialty processor for graphics. Sure there's documentation on them being capable of doing some impressive stuff, but, they aren't a CPU and have no positive or negative impact on neural networks unless specifically setup to do them and even then they'd be no better than your multi-core processor.

Memory is such a fragile thing...While old enough to have witnessed this claim, I also am wise enough to note the break through that was the Integrated Circuit. I've specifically stated it would take another break through of equivalent level to push us beyond. I mean come on, I was running dual AMD Athlon MP 1600+ in 2000.
http://en.wikipedia.org/wiki/Athlon#Athlon_XP.2FMP
"Palomino was also the first socketed Athlon officially supporting dual processing, with chips certified for that purpose branded as the Athlon MP"
"First release: October 9, 2001"
First 2Ghz x86 CPU was Northwood in 2002...That's 2x 1.4Ghz and I was "behind in the times" at that point and I was still clocking in at 2.8Ghz. At that time 2x 1.8 and 2x 2.0 were definitely available so 3.6Ghz and 4Ghz respectively have been available for 12 years and we're coming in at a whopping 8.8 after nearly 12 years.
But they do, quite a lot. It is just it is possible to make it faster without increasing clock speed. You simply invest more gates to make it smarter.As always I'm not saying never, I'm saying we need a break-through and so far, chip makers are happy just adding cores. At some point the individual core will need to become faster.
Side note: The clock speed is mostly limited by power consumption going too high. But this was EVER true in the past, during all times of Moore's law. You might have witnessed by increasing heatsinks during 1990's. Pre 1990 CPUs (80386, 68000) did not even had any heatsinks. 486 had primitive one. Pentium larger. Pentium 4 gigantic. It was just that prior Pentium 4, consumption was less than 50W and nobody cared...