I wouldn't worry too much about crime, as long as you stay in the sterile area. My biggest QOL concern would be the constant announcements on the PA, and the TSA and the Port Authority hustling you.
Seriously, Eastern Penn. sucks if you're single. You will able to find an apartment with a roomate in Jersey City or Hoboken for under a grand. Roommates.com works great, and so does Craigslist.