You deserve to have your boundaries respected. It sounds like he’s been inching further and further towards a life he wants but you are miserable in. Try to look forward to how much better a life without him will be. A life where you can so “no” and be heard.