I can understand the frustration, slower than desired progress. Factor in how long it will take to get your ‘sea legs’ back after a switch.
With 1.5 years to go, the end of the tunnel should almost be visible. Yes, you really should get that 4-yr degree, even if it’s in aviation science or basket-weaving.
Can you speed things up? Many flight colleges offer flight training about year round? Any options at the local FBO?
Back in the day I went through in 3.5 years, another finished the 4-yr program in 3 years, both non-aviation.
There should be some tweaks available. Switching isn’t out of the question, though there will be time lost with the transition. Without specifics it’s hard to do more than generalize.