Switch. The instructor is as important to your training as any other part and if you honestly don't feel you can learn effectively from this guy then find a different instructor. Its your money and your training, so if it isn't working out and you feel you have given it an honest chance then tell him that you don't think you are a good fit for his teaching style and are going to find another instructor.
As an instructor I know my students are paying good money and come to learn something new each flight so I do whatever I can to facilitate that learning. Yelling and adding stress, is, IMO, not needed.