Yeah, it would be worth it. Flowrate doesn't "see" the smallest part of the system as some people may claim. Restriction is a result of adding together all the restrictions in the system, so taking out some of the more restrictive points will always improve flowrate. Might not always improve your results noticably, but should always help in theory.
The best spot to employ larger hoses and fittings is right before the pump inlet. Less restriction there makes life easier for the pump, decreases chances of cavitation, and improves the pump's efficiency. I personally run 1" ID to the inlet of my pump, and I try to use 5/8" ID wherever I can.