[F_AnZzz]

You can try another demo link besides the huggingface one. It is technically more faster since the frontend is deployed in the same region as backend, which greatly reduce the network communication time.

[isaacfung]

Wow, the other link is so much faster. Almost the same speed as the much weaker llava demo on huggingface.