No. Without any driver many devices will fall back to generic drivers. An old driver is usually far better than none. Think of a graphics card. With an out-of-date driver your screens should at least function at their designed resolution/number. With literally no driver, you will likely be back at VGA on a single screen. Have fund finding and updating drivers from a website in 640x480.
> the Intel graphics driver keeps getting downgraded by Windows Update
Windows Update won't remove your already installed driver and replace it with nothing. Not that I'd find that shocking but that's not what's supposedly happening here.