Hello superstar.
That's a very sad tale.
Is it possible that he really was telling her to back off, because he realised that he had come close to losing you?
I should get some relationship counselling, if it's available. You both need to be sure of what you are doing ~ for both of your sakes and that of the little girl.
Good luck!