No you dont have to fly with a DE. An instructor can do both a BFR and an IPC for someone regardless of how long they have been away from flying.