[ilaksh]

If we can't make the clock speed faster what about massively increasing the size of the on chip cache? I think they call them like l2 and l3 or something. If I had 1gb of cache then maybe my whole program could run without doing much main memory access. That would be fast right?

[wmf]

Check out Haswell GT3e with 128 MB of L4 cache. It helps, but probably not enough to justify what they're charging for it.

[m_mueller]

As long as all users of your program also have that $5000 CPU (if it would exist), this might be a good idea. Cost-wise, with more than 5 users, it probably starts becoming viable to port that application to something more sane, for example $1000 GPUs like NVIDIA's Titan.