A bit of a story:
Some OH friends of ours followed their dream a number of years ago and moved to south FL. Their grown kids didn't really come into play as far as thinking of staying in OH and not moving went. Their single son was living nearby in OH but was living the single life. Their married daughter had one infant child at that point and was living in DC. FL to DC wasn't too bad of a trip to visit versus being in OH. So off to south FL our friends went.
Things changed: Single son became married son and they were going to be starting a family soon. Married daughter has another baby.......and moves back to central OH. Our friends? After living in FL for 4 years, the pull of family caused them to want to move back to OH to be near them. The key for them was they wanted to be a very integral part of their grandchildren's (now numbering 4!) lives while they were growing up - that was extremely important to them. They miss what they had in FL but are comfortable they make the right decision (for THEM) in moving back to OH. They've been back in OH for about 9 years or so.......and as the grandkids are getting older, they're thinking of starting to want to spend their winters in FL!
Bottom line: Ya gotta do what YOU feel is the right thing to do. You're the only person who can truly answer that question.
Bill