they all do that sir, tapered bearings are always a couple of mill higher, just make sure they are seated. If you can get rid of any thing that may contribute to that, take it off.
I had to take off a sealing ring on my xs to fit mine and they were still a bit high