[repolfx]

I think it's definitely worth exploring this angle because modern JIT compilers have become very advanced, and there's still a lot of juice left to squeeze there. Look at some of the things Graal is doing and it looks a lot like what OOO speculation is doing - it'll recompile branches on the fly based on profiling information and things like that.

[gpderetta]

Nvidia Denver couples a software based jit/translator with an inorder VLIW backend. It is vulnerable to spectre.