Yes, exactly!

But only at a level where the government itself creates the money. So at a local or state level the budgets do have to be balanced. Also, households need to balance their budgets (or should balance them).