Having spent quite a bit of time in St. Augustine myself, I would second Sable99's comments.
If you want a really intimate and exceptional gourmet meal, you might want to take a look at La Pentola.
My best suggestion however, is to go through the Lightner Museum first...it really is quite spectacular.
Lightner Museum in St. Augustine, Florida | Cut glass, Victorian art glass, costumes, furnishings, mechanical musical instruments from the Gilded Age. St. Augusine, Florida. Open daily (closed Christmas)
PS. Don't bother with the Ghost Tour...as we found it largely underwhelming.