I've been pondering for the last few years that Moore's Law's attention would shift instead to parallel computing. That's only been partly true though as GPUs went first, now mobile's been on board. Surprised it hasn't been more true of full-on CPUs, though quad-core chips are at least getting more common.
I imagine a world where we have individual CPUs with speeds we already know and love stacked 128 cores deep! Would they be a monstrous furnace the size of your TV remote? Probably. BUT THE POWER! Oh, the power!