|
|
|
|
|
|
by UncleOxidant
1044 days ago
|
|
|
> On HumanEval, Copilot is 40+ on pass@1 comparing to 26 for stable code 3b. Can you put those numbers into context for those who haven't done HumanEval? Are those percentages so that 40+ means 40+% and 26 is 26%? If so does that imply both would be failing scores? |
|
|