[ktrnka]

It depends. In some cases I've implemented the core concept and tested it on my own work. In other cases I wait to see if it's replicated or used often.

When I don't have those options I read carefully, particularly any evaluation methods. If it's machine learning I also know to look for mistakes in hyperparameter tuning.

That said, an alternate approach is to just read the best papers from well respected conferences and venues in your area, rather than cherry picking particular papers.