Prejudice at IB Interview

So I had an in-house interview at a BB a short while ago and need help analyzing a situation:

I interviewed with four bankers, and I thought I did well with all of interviewers except one prejudice banker *ugh*. He was an associate and gave me the most awkward interview session. He asked me a series of tech and fit questions which I answered. While answering one of the fit questions about why banking?? He randomly throws out a question and asks me if I was an angry person or if I was aggressive ( I thought he was trying to gauge response or whatever…) ..completely unexpected and almost had me disoriented, but I smiled and told him I was a very nice person etc.. He then proceeded to ask me what I liked doing etc.. At the end of the interview, he gave me some advice going forward with my remaining interviews. I asked for his b-card and he politely refused saying he didn’t like receiving thank you notes (He was sincere, and I thought nothing of it) We shook hands and I proceeded to my remaining interviews.

After all the interviews, I ran into problem banker on my way out of the building so I thanked him again for blah blah. He asked where I was from and I told him my story.. He then said he thought so, because he noticed my accent, and that he had worked with an analyst in the past who had a similar accent, and is from the same place. He said the analyst was an angry and aggressive person, and didn’t work well with him- the analyst did not last a year.. I grinded my teeth and told him I was sorry but laughed it off. He went on the defensive and said he was not stereotyping or being prejudiced.. I told him I understood and that it happens (I should have given him the lecture of life! Ugh*) He ended up giving me his email, and told me I was fine, that I should not worry about anything. He was probably from Southern Europe or Latin America…. I’m blk btw. Is this a big deal? I really don’t care anymore, but I would like to know your thoughts.. Thanks!