Is it racist of wrong of me to genuinely hate Islam?

I think your take on the faith is completely understandable, so long as you recognise that the majority of Muslims don't actually follow a strict version of Islam. They are largely friendly, honest and hard-working people. Unfortunately the Quran itself advocates violence against non-Muslims, and the only peace it seeks is the peace that comes when all the world is subjected to Islam, whether by choice or by force, and there are many imams whose teaching reflects this intolerant interpretation of the Quran.