I've never stayed in a US hostel, but hostels I've been in all have lockers for your stuff. Although I'd be nervous about a hostel in the US--again, I've never been to one--but I'd be worried that the clientelle would be a bit sketchier than your budget-conscious tourist.