The Buffer days will be given back, but the VAC days will come out of your VAC bank!
Example: I had VAC last month and knocked out 7 R days (did not extend VAC) with VAC and hit 2 R days with buffer. The buffer days were moved to earlier in the month!