On the airbus fleet at DL, virtually everyone loses the headset right at 18,000 feet and puts it back on right at 18,000 feet on the way down on all but the shortest flights. The oldest 320s are louder, but that's not wind noise, it's the recirc fans.
And thats how I maintain total unobstructed cohesiveness.