You are too young to waste your life with someone who doesn't want to be with you. Life is too short. Three years in and he tells you he made a mistake by marrying you?? What is he going to do at 10 years, 15, 20?? It is frankly cruel.
Get your life in order and make a plan. You have a child to raise. If you are not financially independent, start working on a plan to get there. Start building a support network. Make plans.