The forward function of the conv net should use:
t3 = self.fc(t2)
instead of:
t3 = self.fc(t1)
AFAIK the nn.functional.relu function is NOT inplace by default [1]
https://pytorch.org/docs/stable/nn.functional.html