Replit's model seems to have focused on being cheap to train and run. StarCoder seems to be vastly better on quality.