What's the best way to 'lose' friends who you no longer have anything in common with?

When your lives are going down really different paths and you have divergent views on almost everything? Can you do this without seeming like an asshole?