I've never left a company because of my managers, in fact my managers were almost always one of the reasons that I stayed as long as I did. The true reasons, at least in my case, for leaving was always the lack of freedom to make my own decisions and the companies' support for "non project related" work. In fact, my manager did as much as he could to support my endeavors, everything within his realm of power at least.