That depends on country, in Poland you don't need to carry any ID on you anymore (you're then required to remember PESEL number, and recite it to police if asked; 11 digits, six of those are birthday).
In practice you can get away with not having ID on your person in most countries as long as its reasonably close by. Technically you could get in trouble though so better carry one if you might provoke the police.