I believe Fences 5 introduced some new thing to resolved an old issue on Fences keep moving to different monitors randomly. You might need to rebuild your Fences layout on Fences 5 and save it as a new layout snapshot and see if the issue still happening.
Also, you most probably need to restart Explorer.exe when you move your primary display to different monitor to reset everything on that new primary display.
Thank you,
Basj,
Stardock Community Assistant