It's unlikely that anyone here's parents or grandparents were involved. Considering the east India company was abolished 160 years ago, it's more likely your great great (great) grandparents were involved.
The empire didn't end with East India Company. The British Crown simply took over. Colonies started getting freedom only after WWII, and some like Nigeria were under the Brits till 1960.
Besides, it wasn't that long ago. It was done by your parents and grandparents, and you are still enjoying the fruits of that exploitation.