If scheduling thinks there is enough staffing, they will drop it. Will it look bad? Nope, as long as you are fine with out the pay. The real issue is getting scheduling to allow you to drop it. Do what you gotta do. Worse that can do is deny it.