What’s more important to you:

The director because the movie can still be good even if one actor screws up his acting. But again if the director is truly good, he wouldn't let a miscast happen

Director's vision is on display. If the director is bad, the movie is bad, even if good actors are with the movie.

The director seta the tone, the flavor

Story and characters.

Brian DePalma always got my attention in the 80s starting with “Dressed to Kill” and then “Body Double”.

It's the directors vision. The actors are just employees.