Their relationship started with an affair that ended two marriages. Now they wonder if there’s enough trust there to build something stable together.