Yes, they are infrastructure but not Infrastructure-as-a-Service (IaaS). IaaS is typically referring to the sort of services you don't really care about the underlying hardware at all, nor the OS.
So while you can build your own IaaS by using dokku, Kubernetes or whatever on top of dedicated servers, dedicated servers (or VPS) by themselves aren't part of IaaS.
> Infrastructure as a service (IaaS) is a cloud computing service model where a cloud services vendor provides computing resources such as storage, network, servers, and virtualization (which emulates computer hardware). This service frees users from maintaining their own data center, but they must install and maintain the operating system and application software.
So while you can build your own IaaS by using dokku, Kubernetes or whatever on top of dedicated servers, dedicated servers (or VPS) by themselves aren't part of IaaS.