Is it healthier just to end the relationship?

Trust your instinct. If you feel that you are better off without him, then, as you say, at this early stage, not too much harm has been done. If he does not make you feel fantastic 99% of the time, I say this relationship is not good for you. It may be hard, but think of it this way: why bring tears and sorrow into your life by accepting his anger? All the best