Dvd and cd drives not clearing from explorer

Hi when I put disc into my optical drives(DVDs or cdrw) when viewed from my computer they show up fine reading the discs ok but when I swap Cd's or DVDs with a different one then reopen explorer it still shows the old CD name and data? I have to right click then eject through the menu then do the same for loading them after that they show up OK but it's annoying to have to keep on doing this.
Cheers for any ideas on how to fix this