Those two sentences are contradictory. A swimming suit is not a boat, especially in "the most literal sense."
A suborbital manned spacecraft, OTOH, is a spaceship in every sense. (It's neither an orbital spaceship nor, say, an interplanetary spaceship, but it's definitely a spaceship.)
Saying they aren't is like saying a riverboat isn't a boat because it's not ocean-going.
For the moment, I suppose you can still make a case for casual use of the term "spaceship" to include suborbital flights. I doubt that will continue for very long as private orbital spacecraft and launch vehicles become less novel; the sub-orbital minor leagues probably won't be seen by most as being the "real thing".
Presumably because in this sense, the Mercury wasn't "his spaceship" as he didn't own it or the organization that produced it (like Gagarin and the Vostok, for that matter).
Is Richard Branson not a human?