You can, but it does require one to RTFM and know/learn about the available installation options.
My automated "preseed" installs are quite minimal. I don't recall exactly how many packages I end up with on a new install but I think it was 224 -- much fewer than what you'll end up with when doing a typical installation.
If you go with the NetInst ISO you can install minimal Gnome (or whichever desktop environment you prefer) which comes without any additional software. You have to untick everything on the last step where it asks you to choose your DE, log in when the install is finished and then install gnome-core using apt install gnome-core. This is Gnome with Gnome Software, Gnome Terminal and other major pieces but without mail client, office, games etc.
My automated "preseed" installs are quite minimal. I don't recall exactly how many packages I end up with on a new install but I think it was 224 -- much fewer than what you'll end up with when doing a typical installation.