A Little Worried

Hi...I am new to posting on the forum but I have been reading a lot of posts. I want to explain my situation and let the elder monkeys tell me what they think.

I was an investment banking analyst with a small bank, not a boutique, think William Blair, Morgan Keegan, etc. I left after a year for a multitude of reasons such as my team just sucked they were not trying to get business, there was no flow of information, and people did not give a fuck about the person below them or even above them. This coupled with the fact that I would spend 80-90 hours a week sitting at my cube doing pitches that my boss would never close.

After I left I did not want to go back to banking, I guess I was scarred. I actually joined a F100 company and work in their financial analyst department doing internal metrics. I picked this job for several reasons such as good pay $60,000 plus a $20,000 end of year for working 5-days a week and getting every other Friday off. Also, to be next to my girlfriend and college roommates, never a good reason but it was one of them.

I have been at this firm going onto my second year, the last year of my contract, and I have fulfilled a lot of goals of mine. I started a small non-profit and I also am going to take my CFA III next summer. The problem is I yearn for the investment world and I want to get into a HF or PE even. I have invested my own money with success, which no one cares about. However, what are my chances? I am only 25 and I have a BS in Finance from a small liberal arts school. I received a 740 on my GMAT so I guess an option is going to B-School, however, I will have my CFA and I do not want to waste my time. Will the fact that I was in IBD and left hurt me, especially since I left for non HF/PE/IBD? Any advice?