Spectrum, brightness, etc. all help, but mostly the fact that they don't move relative to other stars very fast on a human timeframe. Even the closest star only shows motion over a decade or so. https://hubblesite.org/contents/media/images/2013/22/3192-Im...