Settings > General > Window Filtering called "Show minimized windows" that you can enable. It's turned off by default, but if you flip that on, all your minimized apps and their windows will show up in the list.
The only heads-up is that live previews aren't available for minimized windows due to a system limitation, so they'll show the app icon instead.
- Show, Hide, Show at end
I'm not sure if "minimized app" is the same as "minimized window," but it seems to do what I want.