I start worrying about fatigue when I start scrweing up the little things. Call sign on the radio, readbacks on checklists, generally feeling spaced out etc. It doesn't matter how many hours I have been on duty or how many hours of sleep I got. Fatigue is a function of how you personally feel and not a metric of hours of sleep vs hours on duty.