Ha, that's interesting. What speeds did you get it up to?
I managed to get mine working by setting the FSB to 112/36.xx or something. CPU is running at 1460 MHz reliably. I believe my processor is actually a Tualeron because it has only 256K of L2. Regardless, my goal was to reinstate this vintage hardware to enable a nightly/weekly backup of my media server. I installed Ubuntu Server 12.04.2 LTS successfully with a 2TB drive and 640MB RAM. USB boot doesn't seem to work, had to grab the DVD drive from another machine to make it work. Using an Addonics SATA/IDE adapter successfully, with dd reporting 64 MB/s read/write rates.
Nice thing about these older 130 nanometer CPUs is they're generally very fault and heat tolerant, as well as being relatively low power consumers (33W or less). Now I do have a P3-800E and a P3-500 which I believe have lower TDP, but wasn't sure whether it was worth taking a hit in CPU speed. It's a bit of a dog with even XFCE running in the most minimal mode possible.
Hopeful I can get it working reliably with WOL and startup/shutdown script invocation. Had a chance to play with IPMI on a newer server mobo and really prefer that to WOL, but beggers can't be choosers!