| I ran the same prompt on google AI studio it had the same behavior of talking about improvements as if the code it wrote was not the first version. Other than that, the experience was completely different: - The game worked on first try - I iterated with the model making enhancements. The first version worked but didn't show scores, levels or next piece, so I asked it to implement those features. It then produced a new version which almost worked: The only problem was that levels were increasing whenever a piece fell, and I didn't notice any increase in falling speed. - So I reported the problems with level tracking and falling speed and it produced a new version which crashed immediately. I pasted the error and it was able to fix it in the next version - I kept iterating with the model, fixing issues until it finally produced a perfectly working tetris game which I played and eventually lost due to high falling speed. - As a final request, I asked it to port the latest working version of the game to JS/HTML with the implementation self contained in a file. It produced a broken implementation, but I was able to fix it after tweaking it a little bit. Gemma 3 27b on Google AI studio is easily one of the best LLMs I've used for coding. Unfortuantely I can't seem to reproduce the same results in ollama/open webui, even when running the full fp16 version. |