Thanks for the replies!
Your right, I’m thinking it’s my turtle roll was the problem. Really, I should have found a better place to paddle in. Where I was surfing was quite a way from the rip (which I used when I first got there). I was getting tired so I was just paddling the quickest route back (mindful of others). But, the tide was getting fairly low and it getting a bit dumpy (?). Couple that with me being tired and I really struggled.
Got to learn to be smarter and not bash my way through.