I bought an Amazon Kindle and I feel guilty because of who it’s supporting but part of me still wants to keep it.

You should return it and then buy it back cheaper as used stock. That way you're preventing them from getting full retail. Also, steal one on the way out of the store and sell it on the black market