Sometimes the villain ruins shows for me

Ever watch shows/series where the villain puts you off the enjoyment of the show?
I am watching series 1 of Bloodline and the villain - Danny - grates on me. I would happily push him off the jetty.
The show is filmed on the Florida Keys, centred around Islamorada