I went through the same thing for over a year, he basically lived with another woman & came home only to do laundry & I still couldn't get him out because, as you say, there was no physical (plenty of mental) abuse.
Our divorce is finally final & he is gone! Yeah! Happy day! One day he will HAVE to leave. Good luck!