I'd suggest anyone in this situation try slicehost / ubuntu / nginx / fcgi as a starting point. Reasonably fast, low memory, slicehost is awesome and has awesome tutorials. I find nginx much easier to configure than apache. These articles should cover everything. You should pretty much be able to paste the code in, but consider what you are doing first.