couple of ways to think about it:
“When you hold resentment toward another, you are bound to that person or condition by an emotional link that is stronger than steel. Forgiveness is the only way to dissolve that link and get free.” -Catherine Ponder

OR

“To forgive is to set a prisoner free and discover that the prisoner was you.” -Lewis B. Smedes

And of course

“Always forgive your enemies - nothing annoys them so much.” - Oscar Wilde

So sure, you can forgive him! But then let go. And go away for awhile if you can! Why not? If it's a short place to a local hotel or across the seas, you deserve a break to reconnect with yourself and your self-worth. He doesn't deserve to own your heart. Put it back together and hold it close, it is your essence, don't let him take that.