Hacker News new | ask | show | jobs
by rvacareanu 793 days ago
If you're interested in exploring other metrics, the output of the models and code examples for how to read them are available at: https://github.com/robertvacareanu/llm4regression/tree/main/...

For example, slightly adapting the code from the `README.md` for re-creating a barplot similar to Figure 1:

``` print(cdf.groupby(by=['dataset', 'model']).apply(lambda x: np.sqrt(((x['pred'] - x['gold']) ** 2).mean()))) ```

The code above prints (the dataset is Original #3):

```

dataset model

original3 Claude 3 Opus 11.862656

           DBRX                 32.186706

           GPT-4                31.672733

           Gradient Boosting    21.985396

           KNN                  55.043003

           Linear Regression    29.987077

           Random Forest        31.688074
```