I wear diapers 24/7 and have never had any issues. I change from my street clothes to gym clothes in the locker room and also shower and rediaper afterwards. I have gotten a few stares, but never any comments. After I shower and dry off, a grab a diaper from my locker and put it on in a stall. Then I simply change back into my work clothes and go about my business.
I think that the key is if your attitude is "No big deal" than no one will bother you. I've also found that most guys who do see the diapers don't want to know and just ignore. If you're up for the challenge, I say go for it, just try to be somewhat "discrete" (at least as much as possible).