You know, AGP tearing may be a Driver issue and not an O/C issue? However...There are a couple of things you can try to get around AGP probs.
Try running 2X AGP, getting a faster FSB speed should more than make up for this if it helps.
Turn off fast writes, Most people get better scores with this off anyway, and it can cause instability.
Disable AGPMaster 0 Wait State if enabled in Bios, slightly relaxed AGP R/W timings may help.
and when you say "i am pretty sure it isn't my rams' fault cuz i always use one ram at the time for testing purpose"
Does this mean you've run either or both Ram sticks @200+FSB in some other Motherboard and Know for sure your Mem will run at those speeds ok? Just wondering? as wishful thinking ("i am pretty sure it isn't my rams") doesn't solve problems.
How about your Power supply line voltages? How do they look when CPU/Video are under load? Are your voltages being pulled down by that power sucking R9500 -lol- They use a fair amount more power than a GF3. I could see this causing similar probs to what you describe. Something to check.
Good luck reaching the magic 200fsb. ;-)
P.S. Which of the many workarounds did you use to unlock lower Multis on your CPU? 5th L3 bridge? CPU Socket Wire trick?