EMKFlyer:
I've been in a similar situation to yours. My advice is, stay in the Air Force if you love it. For me, I got to a point where the USAF was driving me crazy, so I left and went civilian.
A military friend of mine was in your exact situation. He was out of the cockpit for several years, but had a lot of time. CAL didn't want to hire him because of his recency issue. But when they found out that he took an ATP checkride the month before, they hired him.
You can always go rent a plane with an instructor and get some recency. Having a couple of thousand heavy military hours is priceless. They will be looking for guys like you.