What kind of computer is it? One you built or is it OEM?
At that time, overclocking was still in it's infancy and manufacturer's weren't really keen on providing that ability. If it's an OEM-built (Compaq, IBM, etc.) then the motherboard probably won't have any options that will allow overclocking. If, however, it is a custom built system, it might depending on the motherboard. Otherwise, you might have to change some jumpers and/or do some modding to overclock.
You MIGHT be able to get one of those programs that overclocks through windows to work - could be worth a shot.