I currently have "Always visible" selected.

When I hover over the title bar for upgrouped apps, I see the Groupy popup (like I'd see if "Always hide" was selected).

Not only does this not seem to follow the "Always show" setting, but I don't expect to see Groupy at all for ungrouped windows.
Is there a way to disable this?