First off, as ong as there is legit training involved there is no serious harm in flying dual.
But eventually you need to fly the nest so to speak. You need to evaluate whether this issue is simply a comfort zone thing, or due to some real deficiency in experience, skill, or confidence.
If it's just comfort zone, you need to break out.
If it's something else, you need to figure out what and address it. You cfi is probably a good person to discuss this with.
But if you have real concerns about safety, don't go solo until you get it sorted out.