That could be an emergency. How am I supposed to enjoy the view and drink my coffee if I have to actually fly the plane???

In all seriousness though, without knowing the situation an AP malfunction could be an emergency. It isn't responding to inputs from the crew, strong and erratic flight control movements, or won't disconnect are a few examples.