Yes. It's our job to scrutinize things in absurdum until we find ANY kind of difference regarding anomalities. And then we pick the one that seemed to be a bit better, and carry on.
This goes for everything else as well, EQ, compression, monitors, converters etc. The day we end this kind of behavior is either the day we stopped trying to improve audio or the day when we finally figured it all out.
I don't think one will ever figure it all out, though.