Hello, I am sorry this is happening to you. I know exactly what it feels like to be betrayed as I lived in a deceitful marriage for 29 years. Always wondering why some things never added up. Came to the realization after too many years that it wasn't that I wasn't being tolerant enough, that it was him. He was a narcissistic, homosexual jerk.
As far as your situation is concerned. I would try marriage counseling and if he works really hard at gaining your trust again then, forgive and move forward. But, if this is just a can of worms that you just opened. I wouldn't waste my time, energy and health on someone who broke your trust.