I live in TV full time but my brother did what you are suggesting, He bought and rents it out. He never has a problem with finding renters, He has many returns and has had to turn people away. I think he covers his costs for the year with just the seasonal rent.
He also has the added advantage of a cheap handyman to fix minor problems!