Yep, you can use up to four displays in total. That includes the internal display, so using four external monitors would mean turning off the internal one.
What are the limits for refresh rate and resolution? Also I assume DP/HDMI extension ports are done via USB-C, right? May direct connections to USB-C monitor help?