[naillo]

7b runs on my 4gb vram machine (8gb memory). I.e. quantization helps a lot too