You're relying on an existing image. That concept works in Vagrant too.
And if you want quick startup and are already on a Linux host, use vagrant-lxc.