No, you’re right - he should be the one to move out. Unless he’s willing to try marriage counseling or something, show him where the door is. That tiny piece that wants him to regret his decision is probably based on your past with him and not the jerk he’s being right now.