Roger, you've broken Brock's Rule: Avoid false dichotomies! When given two bad options, choose neither.
If the older generation's need for retirement income means millions of houseless young families, clearly something must change.
I advocate for universal basic income as a means of covering your living costs and a decommodification of all residential real estate because of the long-term havoc.
(That said, as for your personal situation, there's a strong chance that within the framework for which many of us are advocating, your purpose-built vacation houses would be zoned commercial.)