Pretty much just the old folks who've lost there hearing already will fly without headsets. Besides the headset will make it significantly easier for you to communicate with your flight instructor and Air Traffic Control.
When choosing a starter headset, you should start looking in the $300-350 price range. Anything much cheaper than that won't be comfortable, and you'd likely throwing money out the window during a flight lesson due to the fatigue a cheaper headset will cause.