Most likely they would be quietly upset. They might crack a joke about my other lover buying my affection. Humor is often their nervous twitch.

A while later, if it still bothered them, the might mention it to me if they felt it needed to be discussed - but I bet not.