I'm pretty much all gray. I know several guys here who claim they are more successful "spitting game" since coloring their hair. But I think colored hair on guys looks fake.
Honestly, I have never noticed any difference at all in the way women have treated me since I've gone gray. I know that seems counterintuitive to a guy, but women aren't as attracted to youth clues like men are. Men desire young, fertile women. If anything, women seem to place more value on me now than ever, even younger ones.
I've asked a lot of women if I should color my hair, and most say they like it the way it is. Some point to some guy who colors his and say how lousy it looks. Some are vehemently opposed. I know they say don't listen to what women say, but I haven't found a good reason to color it yet. The gray doesn't seem to be hurting me any.
Personally, I'd rather have my old dark brown hair back, but no one else seems to care. For the OP, who is just starting to go gray, women love the salt and pepper, that shouldn't be a problem.