No problem Julie,
I would say you trust him completely not to cross the line with this woman OR you are quite detached from him.
Maybe you could write him a letter, that way you know for a fact you have his undivided attention at least for the duration of reading it with no interuptions or protestations.
Good luck with the counselling.

Thanks Abby,
I think I will write him a letter. Hopefully then he'll understand what I am trying to say.