Hacker News new | ask | show | jobs
by kumarm 1107 days ago
We are waiting to launch a new iOS app that has text generation using vertex AI for GA. So we will go live next live.

We started with GPT API but switched to Vertex AI due to speed. We will still use GPT API as backup still though.
1 comments
vthallam 1107 days ago
how does Vertex compare to GPT in terms of quality of output? Also do you use it as it is, or do any fine tuning?
link
kumarm 1107 days ago
Quality of output is at same level as GPT. The biggest issues for us:

1. text-bison limited to 1024 output tokens.

2. Output format we ask for JSON. But it is not valid json many times (, after last element, missing } after element etc). We have to write our own parsing code in the end to work around these JSON format issues.

link