9 ft to 8.2, so much harder to paddle??

I'm a beginner and used to use a 9' ft softtop. But today I tried 8'2", which is so hard to paddle out AND catching the wave. I don't think the board is too small for my size (5'9" and 164 p), since I saw some big guys use 7'ish shortboard. Or the difference lie in shortboard and longboard??
Btw, local wave is 2-4 ft.
Btw, local wave is 2-4 ft.