PgVector stores the index in memory right? Do you really want your primary db using all its memory for vectors and all its cpu for doing vector dot products?
There are significant differences in performance, accuracy, and other aspects when using a general-purpose database like PostgreSQL. These differences can lead to bottlenecks in performance and data scale. You can refer to this comparison article to learn more
https://myscale.com/blog/myscale-vs-postgres-opensearch/
Also they only offer index stored in Memory as far as I know, also lack the support of different index or more advanced ones like GPU index.
https://zilliz.com/comparison/milvus-vs-pgvector