How do you decide what area is best to paddle out in?

Im sure this has prob been asked a few times, but I wasnt able to find anything on it. What are you looking for when you on the beach before heading into the water. It seems to be that the common sense would be to look for the most calm area to paddle out in? Is there something more to it? I have been surfing this past year off and on and i still have trouble getting out to the lineup without exhausting myself. Thanks