To center my icons I'm using TaskbarX.
I feel a bit stupid now, but when I disabled TaskbarX, I remember I used "Winaero Tweaker" a long time ago, to remove the border padding (I can't remember the reason anymore)
.
Resetting the border padding back to 4, solved this issue.