What is the best way to decline someone's request for the window seat?

If they're in an aisle seat, I'd happily agree to it. Keeps me from having to crawl over people when I go to the restroom.