Sorry for the late comment, but...
I think I'll need to re-rip my whole library. My playback quality is not as good as DVD/BLU-RAY. I'm guessing I had a setting wrong as it looks more like 720. Fortunately I've only ripped maybe 25-30 titles so far. I'm going to try and plug in these values and compare to my current rips.
you were probably using the "fast1080p" setting. start with the "HQ1080p" setting and make the changes from there. just be prepared for the encoding to take a lot longer if the settings are going to output a significantly higher quality and larger file.
if your playback devices support x265, you can try using that encoder as well. its more efficient, smaller files, better quality.