Grad school is a possiblilty, just not in your near future.
You need to take the time to decide which path you want your future flow through.
If it's Grad school sooner than later, heading off to pilot training will only bring you heartache. And skipping pilot training will burn the bridges you've worked for to get a pilot slot. A feat that isn't easy to do in this day and age.
OTS is just the tip of the training you have in store for you.
After OTS, you are off to a year of pilot training, followed by another 4 to 12 months of specialized training.....followed by a period of consolidation training at your unit to get you to operational status (and build the habit patterns that will save you for the rest of your flying career).
If you head directly to grad school, min running your participation at your unit, you will only **** off the people that you will be flying with for an extended period of time (could be a 10-20 yr grudge for some folks)
If you really, truly, want to fly and have been working towards that goal. Then I would highly recommend you continue on that path. Get into your unit and take a class or two of requisites/continuing education towards your Grad school goals and revisit grad school in about 5 years. While that seems a long ways away, 5 years will go by fast.
School will always be there and always be a possibility.