Building Confidence

I haven't had a chance to surf that much this past year and I went out for a surf yesterday and found I had an unnatural fear once I got in the water - I was the same when I was learning to surf, I would only want to go out in small surf but I seem to have relapsed. I grew up with a phobia of the ocean but overcame it bit by bit because I wanted to surf so bad. Can anyone offer any advice on how to overcome being freaked out in the water? I'm not sure what my fears are but they seem to be getting the best of me, which is strange because I would throw myself down handrails and 10+ stairs on a skateboard as a kid! Cheers.