[rdsnsca]

Quitting it won't do that, MacOS keeps the icon on the last 3 programs run in the dock (task switcher).

[pseudalopex]

The task switcher is what pops up when you press Cmd+Tab. And showing recent apps in the dock is optional.