Getting along with Directors but not MDs?

I've done some reflecting on my career so far, and have made an interesting observation. I think so far (2 years in IBD, now at an UMM PE fund), I've done relatively well through strong relationships with other associates, VPs, and even a few directors who have invested in me and my development. I believe I've built great relationships with them along the way, but for some reason have never really gotten close with any MDs.

I realize that maybe now it doesn't matter as much, but it's a skill I should develop to advance my career in the short-medium term and I've noticed many others I work with who are exceptionally good at this, which has rewarded them handsomely (for example, getting powerful letters of recommendation for business school, expanding their rolodex)

This is been a clear theme in almost all stages of my career. A few examples:

• Summer Analyst program: Got an offer largely because the associates and VPs got along great with me, had virtually no relationship with the MD. Had a one-on-one call when I turned down the return offer which was cordial (went to another bank).
• IBD analyst: Had a few great relationships at the senior VP/junior director level, but many of them left. No strong relationships with any of the MDs (for example, nobody at the MD level who I would call and ask for advice, got one 'wish you well' e-mail when I left). Not in touch with any of them.
• PE recruiting: Got an offer from the second shop I interviewed at, because the first shop (respected UMM shop), I had rave reviews from everybody except for 2 senior partners, one of who founded the firm literally vetoed me off behavioral interviews (a senior associate I really got along with passed on the feedback, who said my technicals and behaviorals were among the best they had seen and they felt great until the 2 senior partners stepped in)
• Current PE shop: Good reviews to date, but the people who write them are VPs and Directors. Have a few great relationships at the director level, but I can't shake the feeling that I don't get along well with many of the MDs (for example, at a dinner and one made a few sarcastic remarks toward me during it, jokes at my expense, etc.).

I wonder if any of you have dealt with anything similar. I'm noticing enough of a trend that I feel like I should ask myself if there's anything I should be doing differently, and why people with 5-10 years of experience seem to like me, but people with 20+ years of experience don't.