1st burst of cold air is usually mid October, but not always.

We've been here 15 years. We both decided a few years ago that the last 2 weeks of October and the 1st 2 weeks of November are the best weather we get all year. Warm enough to swim but cool enough to do most other outdoor activities. Crowds have not begun to gather yet.