I feel like if your wearing lifts your letting the world know your height bothers you, I mean you have "Confidence"and then you have a" Confidence Man" and I feel it's the latter.
Dont be fraudulent, own your look, only time I might say otherwise is like your wedding photos or photos on the wall or something, even then