Installed the provided build, restarted, still happens.
Also, in response to @basj's question, no it does not happen when set to "Always place above".
Additional information that may or may not be relevant,
The primary screen is a laptop display, nvidia optimus setup. The secondary screen is a displaylink USB display.
Main screen resolution is 1920x1080, secondary screen resolution is 1366x768