Absolutely. I'm much more selective in where I work now so I've not had to do this for the past decade. But the first decade I was working, I was drawn to money figures without paying a lot of attention to the work environment.
With that said, I would still walk out on an abusive employer...