Originally Posted by
Photon
it's strange, when I see gouge I think of someone plucking another persons eyes out. Guess it's because I'm not a native English speaker

That's the dictionary definition, yes.
I'm not sure how it came to mean "inside info" but it did start in the navy. Maybe it was a military acronym that was phonetically similar to "gouge"?