Hacker News new | ask | show | jobs
by weaponizedwords 2263 days ago
Tried it with Hearthstone related content. Title: turn 2 lethal Content: I managed to cheat out 4 prophet valens on turn 2 followed up by mind blast.

Results: shadowverse, elderscrollslegends, teamfighttactics, teemotalk, fioramains, ekkomains, ezrealmains, bobstavern, kaisamains, xcom2

Should include: hearthstone It did pick up BobsTavern which is something. I thought you would want some feedback.

1 comments

thanks! That helps a lot, although I am not familiar with that area of knowledge.

Indeed, I got some ML metrics on a test split that gives me an idea of its accuracy :) But it's just an estimation, so indeed I am looking out for feedback to know its real performance so I can debug bad cases and fix those with more data or a better model.

The test performance on subreddit r/hearthstone is 0.21 f1-score, which is not great. And looking at the confusion matrix for r/hearthstone it gets often confused with:

r/BobsTavern r/CompetitiveHS r/customhearthstone r/Blizzard

If you are curious, I uploaded the metrics (precision, recall, f1-score) and confusion matrix on the test dataset on a Google Spreadsheet.

https://docs.google.com/spreadsheets/d/1NBY1o85ZiNpcm4tcYhKk...

The sheet 'confusion_matrix_gt2' can be used to find similar subreddits.