Rubbing alcohol, or even a fresh dab of thermal paste often work well to remove olde thermal paste, or the pesky gum of the remainder of thermal pads. Sandpaper isn't the best way to do it.
Auto-body wet and dry sandpaper is often a rip-off at auto specialty stores. Home Depot, Lowe's or other home-improvement stores may be a better source.