The 1% risk of it all falling apart is significantly worse than the 99% chance it all works out fine. Either go with him on days off, or wait until hes older and can fend for himself if it all falls apart.