It's not "Confucian-era Chinese", but google translate gives : 倒霉 which per wiktionary (https://en.wiktionary.org/wiki/倒 and https://en.wiktionary.org/wiki/霉) I don't see anything relating to poverty or impoverishment.