How many programs do you have running? Hit Ctrl-Alt-Delete one time and it brings up a box of running programs. If you have a ton of programs running then windows is closing them before shutdown which is the delay.
There are a lot of open files Windows uses when it's running and it has to close them down as well as any apps you have going before it can shut down. A faster hard drive subsystem can help speed this process up.