The problem with that attitude is that it starts with the idea that it is better to use a click track. If you have trouble working with it, playing with it, then the problem is with you. You need to practice playing with a click track, get better at it, and everything will be better.
Not everyone buys into that. Yes, if everyone plays with the click, everyone stays together. A good band can do that anyway. The click insures that your tempos are consistent. A good band can do that anyway. A good band can also hold tight while putting a little groove into their playing, which requires adjusting the tempo up or down per the mood, and a click track can't do that.
What it comes down to is this: There is nothing inherently better about playing an entire song at exactly the same tempo all the way through, and there are many, many songs for which this isn't possible in the first place. Any time there's a fermata, a meter or tempo change, or even a slight ritardando or accelerando, your click track can't do that. If all you play for four hours a night are songs that are exactly the same all the way through, that sounds boring as hell and I'm glad I've never played in a band like that. Standing up there being a bunch of machines for four hours. Yay.