I've started to do this 4 different times. Each time there was something going on that reminded me that it's nice to go home and leave "work" behind.
I quoted above, because nearly everyone who has started their own business, spent WAY more time getting it running and started than they EVER did working FOR someone.
If you pursue this, just know you will NOT be spending more time with the family for the first few years. In fact it will be MUCH worse because that will be your main focus.
Same, started my own business, did really well, life threw some curve balls my way (REALLY hard to get a mortgage with a P&L sheet and a tax return). I have picked up being self employed and employed a couple of different times, each has the pros and cons. I would say the best advice I could give is this.
1. Get a part time job that can cover the majority of your bills, and use the extra hours to lay the ground work for whatever you want to do (Get your EIN, open a business banking account, establish an LLC, get insurance quotes). Start small, like sign in the yard small, with a few customers.....if it takes off, you are established and can determine when the best time to cut the part time job loose is.
2. Buy an established business (this comes with some risk obviously), but stepping into something that is established, setup, has a customer base, goodwill, etc etc will save you some of those sleepless years mentioned earlier. In an ideal world, buy a company that you can work at for a while so you can figure out what works and what doesn't (on somebody else dime).
As other have said, the grass is always greener, you will have flexibility in your day, but you will work more hours in the week is how I would explain it. Also, depending on the type of person you are, you will never actually take a vacation again....phone rings on the beach....you will answer it, because it is money out of your pocket if you don't. There is no "paid vacation" anymore, there is just time you are willing to step away and not make money.
I used to burn the candle at both ends for the first couple of months of the year to make sure I have the majority of my operating costs covered, often I didn't draw a paycheck until March sometime...but I am not a fan of credit and risk.