If you could rent the house across the street then maybe, but the domestic violence claims would also have me concenred. I would never assume he has the leverage becasue he has the house, the childrens cusotdy will most likely be 50/50 if you are both normal and have equally capable attorneys.