Well an L3 network is routed, so you just have routes. 32 bit route for the "server", whatever mask to reach others through the "server". The server has 32 bit routes to each client, so it works.
This is essentially how you want to build your DC networks today too (why waste ips on netid and broadcast that you never use) (for public addresses).
But you stick BGP on there to exchange route information rather than static routing.
Right. My thinking is that with VxLAN you can get each tenant in the datacenter to have its own L3 network, isolated from other tenants L3 network.
Each tenant can have multiple subnets; run BGP, etc. and the IP addresses can be re-used between different tenants.
It doesn't seem wireguard can do that with just p2p network. This was one argument I had for adding VXLAN encapsulation over IP for the above comment. You also get L2 connectivity if you want it.