The key words there are "puts up with".
The fact you fantasize about men and the girlfriend doesn't really approve means you're going to paint yourself into a corner with this relationship.
Unless you have a real taste for masochism and can afford a nasty divorce, run...do not walk..for the enarest exit!!