Breaking into IB / ‘High Finance’ for a sophomore

Hello all, I am currently the equivalent of a sophomore in college. I am interested in high finance specifically Investment Banking as a career, for the options it will provide me later in life. 
I go to what would generally be considered a semi-target college, and for my first 1.5 years of College I did not work particularly hard and achieved average grades. Think the equivalent of a 3.2-3.4 GPA. However in my most recent semester I have achieved the equivalent of a 3.8-4.0 GPA. My concern is how competitive I will be in breaking into high finance from my current position assuming I continue to perform at a strong level academically. I have done a somewhat related unpaid internship in a field akin to consulting and have done decent networking, however I am concerned as to the impact of my uncompetitive academic performance in my early days at college. People I have talked to who work or have worked in IB and PE, have said that provided I continue to maintain a strong GPA and network etc. correctly I will still be competitive. However I would appreciate any unbiased insight into whether my ability to break into IB has been dramatically impacted by this, and if it is still an option for me. Much appreciated.

Apologies if I have posted this in the wrong place or made any other errors this is my first time posting on this website.