According to Chinese Wiktionary, it originated in the period when mobile phones where large, expensive bricks and were carried as an accessory by triad bosses ("big brothers") in Hong Kong movies. https://zh.wiktionary.org/wiki/%E5%A4%A7%E5%93%A5%E5%A4%A7