I was with someone that didn't care how slow they were, I said we should pick it up a bit when you hit double par, the response was "I pay the same amenity fee as the folks behind me"........
I think anyone can play from where they wish, and if they hold you up tell the ambassador the issue, usually works.
But then again what's the rush