[cheschire]

It does exactly as described. Sometimes it will shift to the second window as intended. Often it will skip to the third window open instead, requiring one to continue cycling back to the second window.

[nkrisc]

You can Alt+Shift+Tab to go in reverse direction.

[gralx]

Or just release Tab while keeping Alt depressed and navigate the thumbnails with the arrow keys.