Given that we live only a small part of what there is in us - what happens with the rest?

When I was younger, I used to worry about potential and abilities that might be wasted. Now that I am older, I see that it doesn't matter so much.