OK, before I post what I'm about to say, DO NOT turn this into a Firefox, IE, or "Add your browser of choice here ______" thread. I'm not doing it, and won't get involved with it.
Now that the disclaimer is out of the way. I would not remove IE. Even if you despise M$ and want to beat them with a shoe, IE is still the Internet standard. The other browsers do seem to be popular, but they have issues alot of times. On some websites you must run IE or they will not display properly.
Also, removing IE will remove critical OS files, and will cause OS instability, and all kinds of weird stuff rto happen. The time will also come when you will really need IE, and then it won't be there.
I highly recommend doing a repair install of Windows. You will then have to reload all drivers, and will more than likely have to relaod games and their profiles, along with other software that has profiles associated with it such as Riva Tuner for example.
That sounds like alot to do, but it's really not that bad. You don't havw to reloiad all software at once, just do it when you need it. On the drivers though, you will have to do those once windows has completed the repair install. With a fast system it shouldn't take longer than 15 minutes...probably faster unless there are corrupted files in there.