Yeah, tell me about it. My other hobby is sports cars... Thankfully a 75,000 mile Miata has allowed me to partake in the hobby AND not spend too much. But somehow I doubt there is such a thing as "inexpensive" when it comes to airplanes.
You never know though. I always wanted to sail (another expensive pastime) and I was able to find a free community boating program near where I work. So stranger things have happened...
We're a lot alike... I'm into cars and SCUBA, but decided to put both on the back burner for awhile... I currently drive a '96 Geo Tracker that I've had for 5 years now (175K plus miles), but at one time I was messing around with another budget "exotic": a '76 Fiat 124 Sport Spider. Finally decided to stop pouring money into it, but it was fun while it lasted. Almost as much fun tinkering with that little honey as it was driving it.
As for the SCUBA, I still don't have my card (took a resort course years ago but didn't finish), but every time I visit friends in Florida I "get wet" at least once with a rented rig and a certified buddy.
So little time (and money); so many cool things to do... sigh.