At age 30, I decided to switch careers and started flight training full time. I felt like the "old guy" in school with most of my peers in in their early to mid 20s. If I had to start over today (and I'm younger than you) I personally wouldn't do it.
Do you have a good career now / make decent money? Have you done any flight training at all? At least get your private pilot and maybe instrument rating on your own time before you decide to commit to an aviation career.
You mentioned you were in the military. Do you have GI Bill money to cover training? If you are thinking about taking out a loan, I would strongly reconsider. The last thing you want to be worrying about is how to pay back Aunt Sallie Mae when you are approaching retirement.
Rich wife, house paid for? Go for it!