Yes, I'm afraid this is a fairly common male fantasy...maybe he's just feeling you out to see how you'd react to it. But if you're not comfortable with his fantasy, your "no" should be enough for him...if he keeps up the pressure, you might try turning the tables...ask him how he'd feel if you wanted to see him with another guy...there's an outside chance that might backfire, but most guys would back up in a hurry at the merest suggestion

__________________
Plug me into somethin'

If the theory does not conform to the facts, then the facts must be discarded.

No good deed ever goes unpunished

Never argue with an idiot. He'll drag you down to his level, & beat you with experience.