I'm afraid you're seriously underestimating the driving time between EWR and Albany. I'm in Albany right now, and it took me two hours from Harriman NY! It's an additional hour from EWR to Harriman with good traffic flow, which is hardly the situation in summer. I think you're looking at a 3.5-4.0 hour commute.