**notice all the "most likely" in my text, this is because it is not an exact. your best bet is to understand the settings and find your happy medium, you might be able to find a 10-15% OC without adjusting voltage, but will need to fine tune many more settings to get a 20-30% overclock.
when you boot in to windows, its nice to open CPUz, check the common things like core speed (notice multiplier and bus speed too) and ht link in the cpu tab, and NB Freq and Dram Freq from the memory tab; this will tell you where you currently are. you can always change something like HT Link (or whatever your bios calls it) down by one notch, boot up in to windows/cpuz and see how that change affected the #s. (<--this is how I got familiar with the bios settings and what they changed)
I believe you're aiming for highest core speed (made up of multiplier x bus speed), ht link between 1800-2000, NB freq between 2200-2600, Dram Freq between 600-685.
**You'll most likely want to start by opening the bios settings for HT Link and NB Freq and turn them down (example: if the setting was at 1800, turn it to 1600; if the setting was at multiplier 10x, turn it down to 9x) this allows you to increase the bus speed without pushing the HTlink/NBfreq too far. once you find your happy bus speed setting you can adjust these to their maximums. you might need to turn them down by 2 settings depending on how far you push the bus speed.
Most likely you can leave the multiplier untouched (but then you won't really be looking for the highest bus speed, but actually the highest bus speed AT that particular multiplier) and can simply start by raising the bus speed 10mhz at a time, boot in to windows, open cpuz and hardware monitor, run a stress test for 10 mins, confirm that temperatures are within reason and your system is stable. [[<-- rinse and repeat until you reach a heat wall ((too much heat)) or unstability, then adjust HT link / NB Freq to to find optimal performance.]]
Since you don't know what cooler you have, I wouldn't suggest jumping up to 1.42 volts on the cpu. start lower, 1.35ish cpu volts was great for me as a starting point. There are many volts settings, so don't get too excited. start simple (a little cpu voltage) and if you reach instability and want MOAR volts.... ASK the guys here, they know their OC stuffs well.
IF you look at my sig you can see what i had to set to reach +1ghz, at 3.5ghz I only needed + .10 cpu voltage but to reach 3.8ghz i needed more cpu voltage and NB voltage to find stability.