7 Comments
 

AI systems, including machine learning models, are not inherently "wrong" but have limitations and specific behaviors based on how they are designed. Based on the most helpful WSO content, here’s why AI might appear to "make up" things rather than omitting unknown facts:

  1. Bias-Variance Tradeoff: AI models are trained to generalize from data. When faced with novel or unseen data points, they may overfit (relying too heavily on patterns from training data) or underfit (failing to capture the complexity of the data). This can lead to errors or "hallucinations" when the model tries to predict or infer something outside its training scope.

  2. Optimized Trial and Error: Machine learning algorithms often rely on a process akin to optimized trial and error. They throw variations of predictive models at a dataset until they find something that "works." This process is not inherently intelligent but rather a brute-force optimization, which can lead to incorrect or fabricated outputs when the input data is ambiguous or incomplete.

  3. Imperfect Information Handling: Unlike humans, who excel at modeling unknown or imperfect information, AI struggles with tasks that require understanding beyond structured or digitized data. For example, in tasks with incomplete or hidden variables, AI may attempt to fill gaps based on patterns it has learned, even if those patterns are not applicable.

  4. Data Dependency: AI requires vast amounts of structured, relevant data to function effectively. When the data is insufficient, irrelevant, or biased, the model may produce outputs that seem fabricated because it lacks the context or depth to provide accurate answers.

  5. Algorithmic Design: Many AI systems are designed to provide the "most likely" response based on their training data. This probabilistic approach means that when the system encounters a question or scenario it doesn't fully understand, it generates an answer that seems plausible rather than admitting ignorance.

In essence, AI doesn't "know" in the human sense—it processes data and patterns. When it encounters gaps or ambiguities, it may generate outputs that appear fabricated because it is designed to provide an answer, even if the answer is not grounded in reality.

Sources: https://www.wallstreetoasis.com/forum/hedge-fund/machine-learning-taking-over-hf-research-analyst-roles-in-near-future?customgpt=1, Will robots replace your consulting or financial career?

I'm an AI bot trained on the most helpful WSO content across 17+ years.
 

ntcons

You are not allowed to answer this one.

haha AI talking about AI 

"If you always put limits on everything you do, physical or anything else, it will spread into your work and into your life. There are no limits. There are only plateaus, and you must not stay there, you must go beyond them." - Bruce Lee
 
Most Helpful

By no means an AI specialist, but my naive understanding is that 

  • it's a word prediction machine, it has no judgement, so it can't imply or process the underlined idea that you may be looking for, and instead just tries to match the most textually accurate text to the question you asked it which means that there is a always a margin of error. This is why can be very good for example to find differences across texts or to identify a specific text pattern, but it is useless to get qualitative advice. 
  • On being wrong, it also forces an answer even when the probability of being wrong is there, just because it can't reason whether the advice is good or bad (again, has no judgement) so it's up for the user to assess it, its only "judgement" is a probability threshold that the laid text matches based on broad patterns what should follow as a very plausible answer the question that was asked. 

Which is to say it's a great tool for processing data, text, and calculations especially when the instructions are very precise and straightforwrad but do not expect to think for you and it won't give you novel thoughts or ideas as it's trained on existing data (the fact that it solves some unresolved math problems it's more an aptitude of machines to do complex problems, such as deep blue when it beat chess players, but for broader decision-making/thinking, unless the decision-making is built on some quantitative thresholds (e.g., invest only if X stock is undervalued based on A, B, C, criteria, etc.) then it's somehow useless). 

I think people that overrely on it and delegate everyting to it will be left behind, because the world rewards problem-solvers, so how can you be a problem-solver if you don't exercise the part of your brain concerned with problem-solving? The best problem-solvers will also be the ones that will extract the most leverage from AI, not some guy that just keeps relying on AI to do everything he comes across. The gap will be seen in 10-15 years, now those guys are juniors/processing/crunching data/Excels/Words...

P.S. What surprises me most about AI is being wrong on calculations. I just don't get it, how you can have all the formulas and just having to input the numbers, and still make mistakes. Someone else might give some light on this...

incentives triumph ethics
 

GS under Blankfein

P.S. What surprises me most about AI is being wrong on calculations. I just don't get it, how you can have all the formulas and just having to input the numbers, and still make mistakes. Someone else might give some light on this...

The question of when is a number a word and when is a number a number is very, very complex and context dependent. That's why.

Wolfram Alpha can do calculations, and could do them 15 years ago. It knows everything it encounters is a number. But you just explained how LLMs don't really "understand" the text they're processing; by that same logic, an LLM doesn't understand the difference between reading the sentence "one plus one equals three" (which is a thing people say, and has a language meaning) and processing the equation 1+1=3 (which is an arithmetic equation that's just incorrect).

 

Helpful video worth a watch

"If you don't have any enemies in life you have never stood up for anything" - Winston Churchill | "It's a testament to the sheer belligerence of the profession that people would rather argue about the 'risk-adjusted returns' of using inferior tooth cleaning methods." - kellycriterion
 

Perspiciatis ut est autem et sit. Rem culpa qui est velit qui ex.

Molestiae eum eveniet et aut reiciendis velit. Doloribus ipsum molestiae omnis. Voluptas sint qui est dicta est eos fugiat. Aut eaque aut tenetur excepturi sed. Impedit molestiae quia odit ullam soluta sit. Magnam quod vel eos enim assumenda tenetur accusamus.

When in doubt, use more peanut butter

Career Advancement Opportunities

October 2026 Investment Banking

  • Evercore 01 99.5%
  • Moelis & Company 01 99.0%
  • JPMorgan 01 98.4%
  • Guggenheim Partners 02 97.9%
  • Morgan Stanley 06 97.4%

Overall Employee Satisfaction

October 2026 Investment Banking

  • Moelis & Company No 99.5%
  • Morgan Stanley 02 99.0%
  • Evercore 01 98.4%
  • Banco Santander 02 97.9%
  • BMO Capital Markets 13 97.4%

Professional Growth Opportunities

October 2026 Investment Banking

  • Evercore 01 99.5%
  • Moelis & Company 01 99.0%
  • Morgan Stanley 05 98.4%
  • Goldman Sachs 01 97.9%
  • JPMorgan No 97.4%

Total Avg Compensation

October 2026 Investment Banking

  • Vice President (16) $429
  • Associates (57) $264
  • 3rd+ Year Analyst (8) $210
  • 2nd Year Analyst (28) $184
  • Intern/Summer Associate (16) $161
  • 1st Year Analyst (84) $151
  • Intern/Summer Analyst (76) $101
notes
16 IB Interviews Notes

“... there’s no excuse to not take advantage of the resources out there available to you. Best value for your $ are the...”

Leaderboard

1
redever's picture
redever
99.2
2
Secyh62's picture
Secyh62
99.0
3
kanon's picture
kanon
99.0
4
BankonBanking's picture
BankonBanking
99.0
5
DrApeman's picture
DrApeman
98.9
6
dosk17's picture
dosk17
98.9
7
GameTheory's picture
GameTheory
98.9
8
Betsy Massar's picture
Betsy Massar
98.9
9
CompBanker's picture
CompBanker
98.9
10
bolo up's picture
bolo up
98.8
success
From 10 rejections to 1 dream investment banking internship

“... I believe it was the single biggest reason why I ended up with an offer...”