[szmerdi]

I like the initiative and the large scale collaboration but in terms of quality, my observation on one of the newly added languages (an underrepresented one) is it outputs dramatically grammatically gibberish! As though it hasn't been through the SFT/RLHF step at all.

(P.S. I'm a native speaker of this language. I tested Aya on reasoning, creativity, and summarization with two examples per task)

[tellarin]

If you're willing, please share more details by email (in my profile). This can be very useful data to improve things.

Thanks for trying it out!