Same thing is happening to me after updating to FF 70.0.1 from 69.something.
With all borders:

If I mouse up to the minimize/maximize/close buttons, a portion of the left side and top border turn transparent:

If you go to another tab, or minimize and restore the window, the borders will render properly again.
What is this "cleanup thing" you are talking about?