No it wouldn’t be that difficult.
Aviation does not require excellent English, it requires proficiency.
Besides you’ll learn it in leaps and bounds once you start your training.
In your case I’d recommend you do your training in the US and do a European conversion afterwards should you consider it necessary.