That's a bit like saying that Britain wasn't sovereign during the time of the British empire. Britain, France and Germany ruled the EU, the UK designed many aspects of it.
Britain did not rule the EU, nor did it have sovereignty over the EU. The EU is a separate political entity from the UK, and had sovereignty over the government of the UK.