Well if you are going to make it "universal", you shouldnt remove any driver. But i think you can remove the Iomega zip driver, the infrared (My last notebook has it and its a toshiba 320cds...). And the game port... if its the game port for joysticks, i think its safe to remove.
Dont know about Windows CE USB host, maybe its safe to remove, maybe its the windows mobile drivers.