Problem with position when it is crowded

When there are more shorboards than longboards on a break. I'm scared of sitting further out than the shortboards. When it is overhead and there's only 1-2 other longboards. After take off, I have to be very careful of not running over the shortboards as they all sit very closely together and there is very little space between them. Therefore I move further down the shoulder which makes it harder to catch the wave and I have to wait for the bigger sets to come in.
The other longboards that sit at the peak are really good surfers and they seem to be the regular and knows everyone around the break.
What should I do in this situation? Take the risk and go sit further out with the longboards? Or move to a different break?
I also have another problem where when it is overhead and the wave is gnarly. If I paddle for the wave, I can't back out if another person manage to take off in the deeper section. As it is way too steep, I'll have to drop in on them and do a bottom turn and go over the wave. Most people here seems okay and they say it's not a problem that I did not block them. However I kinda feel like this is probably wrong? On smaller 3-4ft waves I have no problem of checking to see if they have made the drop and can always back out the wave.