This is the option I was going to throw out. If you have a place to put your stuff, you could buy and camper and rent a spot in a local RV park until you found your property and worked out the details.
Also, you can find single wides for under $50k new. Not sure what the lead times are on them, these days. Might be an option if you found a piece of land, vs buying a camper.