Hehe it's often the other way around: lowering the latency may mean you'll have to decrease the memory speed for stability's sake.
Cache latency follows the same principles as RAM timing does. It's the time delays take in the involved chips between data operations. And yes- less is better and taxes the chips more. That is also the reason why "CL2" RAM is more expensive than commoner's fare. =)