The point is relevant whether that actual sponge on a stick came from a toilet or not. The contempt implicit in the giving is not at all clear if you don't know what a sponge on a stick was usually for.
Not really? It would be notable if I handed you a slice of pizza sat atop a wad of toilet paper, even if it's just unused paper and not actually from the bathroom.