NTA you did your time he did the crime
If adultery was a crime 75% of the population would be in jail , men and women , don’t be ridiculous, it’s life , not the best but but it’s been like this in all recorded history