That's an unlikely scenario.
Let's remember that attraction and seduction is based on looks, money, status, and personality.
Here's what can happen:
Looks: If looks go downhill, then a man could run into seduction problems. Weight gain and losing muscularity would be a common cause of this. Disability and disfigurement could cause issues as well.
Money: Losing money on bad investments and losing a job are ways to have money issues. Unemployment is a common way for a man who is a decent seducer to lose the ability to seduce women. Despite the fact that Roosh wrote the best guide to getting laid while unemployed (see below), it is actually quite difficult for most men to get laid while unemployed. Unemployed men in extended relationships are also commonly dumped by girlfriends or wives during unemployment.
Older men (35+) are judged more on money both by single women near their own age and by women 10+ years younger.
Status: Losing status through a lack of employment or taking a subpar quality job after a layoff can result in status loss.
Personality: This is the least likely to change but could be problematic if a trauma like weight gain, disfigurement, or extended unemployment happens. Having charisma is something that is less likely to change.