I have an FPGA dev board and have wanted to do something like this; start with VGA generation and work my way up to sprites.