Unless someone changes the law you have as much right to be on that road as "the tailgater".
My only opinion is that tailgaters, whether in a car or golf cart are vile people. Vile too strong? Hmmm.... nah I am ok with that.
Install a nice camera on the back of your cart. The sign on mine will read in small print:
If you can read this, smile, you are on Alan's camera!
The only other thing I would say is never return aggressive behavior to an aggressive driver. Although, it is not easy, these folks are not stable IMO and it is not worth the risk.
PS. Actually, I guess I better heed my own words and not attach that sign....