Peanuts sounds like a very rude name for food.

Not really peas are small and nuts are large. So small nuts. Everything else was named after those two things.