Well, technically he could just get his comfort from Jeyne and leave her and her family there (I'm speaking of book version now), going back to his army. The Freys wouldn't need to know anything, he can still marry the Frey girl of his choice and everyone is happy.
However, because of his honor, he now was bound to marry Jeyne, which he did, which pissed off the Freys.
The show version doesn't show that, it's just kinda like "oh there's that amputator-girl from Volantis named Talisa, she's also cute, let's marry each other".
(I think it's alright to compare the book and the show as all these events have already happened in the show too)