Is it selfish to prioritize your own peace over someone else's need for attention?

What are some effective ways to focus on personal growth and learning when you're surrounded by super talented people at work or school?