[flyinghamster]

I think that's what the Compute Module is for. Put it on a breakout board with just the I/O you need, and away you go.