I really hate working for other people. It's almost always boring, tedious things that I really don't care about. Making something else your primary job, and doing development on the side, would probably make you much happier.
My friend, after a string of really crappy dev jobs, quit, moved to Austin, and is now working as a barista at a coffee shop right across the street. He isn't making a lot of money, but he is going to a ton of meetups, playing a lot of video games, and generally having a great time. A lot of his stress is gone now that he isn't doing something he hates for 40+ hours a week.
If you want to build your portfolio (and make some money) the local business route is a pretty solid way to go. Lot's of small companies still don't have websites, and you can make decent money throwing up a few WordPress sites. They won't cost you a lot of time, or them a lot of money, so they should be willing to take a chance on you. You may have to physically make some rounds, but a nice walk around town isn't so bad.
I have no idea what your expenses are, but if it's like most people, you'll probably have to cut back some. Throwing in a lower-stress, part-time job would help as well. Then you should have enough time for web development and side projects.
Last time I did this, I saved up a lot of money, quit my job, and worked for 6 months on my own projects. It was awesome. I only finished a couple of things, none of which made any serious money, but I had a great time. Freelancing helped me last a little longer than I would have if I just used my savings.
Next year (end of March, almost here!), I'll be leaving for good. Moving to the country, starting a farm (that seems to be a lot more common than I thought, based on this thread), and being a part-time (ha!) farmer and part-time devloper. I love developing, but I'm not happy working in the tech industry.
Good luck, and I hope you find something that makes you happy.