Yes. Even as a "non-artist", it's well worth avoiding this trap. I'm very careful to not let my software engineering day job get too close to my (quite extensive) electronics hobby.
My job can be stressful at times, which I don't consider to be strictly negative, but I have noticed just how much this has impacted my enjoyment of, for example, reading technical articles that are too close to my work subject matters. On the other side, I still have great fun on reading challenging articles, application notes or whole books on different subjects in electronics and signal processing, and my way to ensure that it keeps being fun, is to keep it away from being relevant for my income.
My job can be stressful at times, which I don't consider to be strictly negative, but I have noticed just how much this has impacted my enjoyment of, for example, reading technical articles that are too close to my work subject matters. On the other side, I still have great fun on reading challenging articles, application notes or whole books on different subjects in electronics and signal processing, and my way to ensure that it keeps being fun, is to keep it away from being relevant for my income.