My suggestion is to get counseling (not with a pastor unless they are okay with the divorce thing)......pastors have an agenda..... a secular counselor does not.
I mention this, because I went to a pastor (baptist) and it nearly destroyed my life; even after 10 years I suffer because of what he did.
See an attorney (first visit usually free) and get into counseling; protect yurself and your daughter.
You are too young to waste your life with someone who doesn't want to be with you. Life is too short. Three years in and he tells you he made a mistake by marrying you?? What is he going to do at 10 years, 15, 20?? It is frankly cruel.
Get your life in order and make a plan. You have a child to raise. If you are not financially independent, start working on a plan to get there. Start building a support network. Make plans.