SOLVED:Desperate to remember this historical romance

I've been trying to remember which book this is and it's making me crazy. All I can remember is that I think it was an arranged marriage/marriage of convenience. The husband only comes to the wife's bed at night and is always silent, and eventually she discovers it's because he thinks she's pretending he's someone else the whole time. A former love or lover? I think that she had either had a lover or something else and had been forced to marry him/ he offered marriage to save her good name.I think they had a conversation at some point where she said she'd always be thinking of her lover and never him during sex. I remember crying during the scene where she realizes that he's been trying to be so quiet and only coming to her in the dark because he thinks she's imagining him to be someone else and he wants to make it easier for her. Possibly a scarred/disfigured hero. Please help! Thanks!