You can be a “tourist” in JP for up to 180 days per year visa free, so once you subtract your working days, it’s probably not an issue to spend your days off there. If you have a really efficient work schedule you might end up needing to take an international vacation once in a while to keep it legal.