I think it's because music is a dialogue, a relationship. The artist is saying something, and your interpretation of the art is a response to that. That's why great (to you) songs often feel like they were written for you, personally, when that's obviously untrue.

If you find out that the relationship is based on a lie, then the relationship can switch from "great" to "horrible" instantly.