He was just deeply in the closet. The second he's in drag, he lets it all out. Notice he doesn't have any love interest, just Osgood. He easily gets swept away after dancing the night away with him and had to force himself to revert to acting in a socially acceptable way.