I think a lot of people need to understand separating the art from the artist. For example, I am a huge Kanye West fan and I love his music. Do I support him as a person? Absolutely not. But I can still appreciate and love his music.
Same thing with the Smiths, Motley Crue, Led Zeppelin, the Rollling Stones, etc. A lot of these people weren't necessarily good people, but I still love the music. Even John Lennon, who I've been very adamant that I do not like him as a person, but his music and his talent was amazing.
Even Harry Potter. I'd never in a million years defend JK Rowling but Harry Potter is something that's always been dear to my heart and special.
I don't think you should tear down others for liking controversial artists, either, as long as they aren't defending something they've done that's wrong, let them enjoy the art