I think that it means that there's something about that place that makes you nervous. Maybe it's an enclosed space and you have a mild fear of enclosed spaces that's so mild that you're not aware of it. Maybe it's near a cliff and you have a fear of heights. Maybe it's particularly crowded and you have a mild fear of crowds. Maybe some detail of it reminds you of somewhere where some bad shit happened to you. Maybe there's a person or people in that place that make you uneasy because there's something wrong with them.