Machine Learning for Hedge Funds

Is there much interest in the recent developments in neural networks (deep, recurrent or reinforcement) at funds? Or are other method generally favored for financial time series prediction?

 
Best Response
EastOrWest:

Is there much interest in the recent developments in neural networks (deep, recurrent or reinforcement) at funds? Or are other method generally favored for financial time series prediction?

I've worked at several quant funds, including one that everyone would agree is in the top 5. I'm sure somebody somewhere is doing something with machine learning, but it just doesn't seem to be very widespread among the serious money makers. Neural networks will always find a solution to whatever training data set you give them and you can't ever describe it in words to see if there's any kind of pattern vs just random noise. I've never met a "just 100% trust the machine" trader in my life -- even the ones who most rely on algos still demand a human-understandable description of what the algo is looking for rather than just blindly trusting a black box.

Ideally, a neural net would help you find a historical correlation that you didn't know existed -- but the problem with neural nets is they always find a solution to any arbitrary set of training data you give it, and they don't give you any intuitive insight into why the pattern might exist, so it doesn't seem very fruitful.

 

Yes, but you can test the model's performance just like any human created algorithm. Just because a machine created it doesn't make it any more or less valid--although your typical trader might view it with more suspicion.

In fact, there are always going to be people who don't trust machines, just like there are people who still insist records or tube amps have better sound. Heck, I even heard there are people in Pennsylvania who still use a horse and buggy to get to work.

The real question is do modern machine learning algorithms, when supplied with the appropriate data, yield predictions that produce a positive return? If so, which ones? If none do yet, then I see a business opportunity (but I doubt that's the case).

 

From my experience, more value comes from providing the modeling procedure with interesting inputs than in using increasingly complicated modeling procedures. That's not to say that there isn't value in using something like neural nets, but the incremental benefit is often marginal relative to the additional complexity they add.

The other thing is that with financial data the signal to noise ratio is typically a lot lower than in more traditional applications of modern machine learning, such as in image recognition. So the problem is inherently more difficult and you can't just easily throw tons of data at it since financial data is non-stationary at any time-scale you might look at it.

Recently there was an interesting WSJ article on Two Sigma's approach to quantitative investing. I do not work there, so I do not know precisely what they're doing, but I imagine that even though they're using computers to crunch tons of data, the actual statistical methodology behind it would not be very complex.

 

I've seen job postings for exactly these types of positions before, so I'm sure there's some interest. I have also heard from many that this is part of the system RenTec uses. Take that for what it's worth.

"When you stop striving for perfection, you might as well be dead."
 

Do you study Machine Learning? Would be interested to know how widely is it used/ how valuable is it on the street since I can pick it as my fourth year course option.

Observe. Learn. Share.
 

Dolores nesciunt dolores eum maxime et repellat. Rem consequatur consequuntur reprehenderit. Aliquid facere suscipit qui voluptate voluptas. Nulla voluptates sed consequatur illo.

Odio architecto porro placeat earum ducimus. Praesentium quia dolor molestias dolorum ipsam libero sit sint. Aut quod perspiciatis voluptatem. Quam nulla distinctio itaque eius.

Rerum eos modi sequi. Rerum in ratione voluptatibus dolorum fuga quibusdam expedita. Rerum maiores dolor sit sint cumque aspernatur enim accusamus.

Career Advancement Opportunities

April 2024 Hedge Fund

  • Point72 98.9%
  • D.E. Shaw 97.9%
  • Citadel Investment Group 96.8%
  • Magnetar Capital 95.8%
  • AQR Capital Management 94.7%

Overall Employee Satisfaction

April 2024 Hedge Fund

  • Magnetar Capital 98.9%
  • D.E. Shaw 97.8%
  • Blackstone Group 96.8%
  • Two Sigma Investments 95.7%
  • Citadel Investment Group 94.6%

Professional Growth Opportunities

April 2024 Hedge Fund

  • AQR Capital Management 99.0%
  • Point72 97.9%
  • D.E. Shaw 96.9%
  • Magnetar Capital 95.8%
  • Citadel Investment Group 94.8%

Total Avg Compensation

April 2024 Hedge Fund

  • Portfolio Manager (9) $1,648
  • Vice President (23) $474
  • Director/MD (12) $423
  • NA (6) $322
  • 3rd+ Year Associate (24) $287
  • Manager (4) $282
  • Engineer/Quant (71) $274
  • 2nd Year Associate (30) $251
  • 1st Year Associate (73) $190
  • Analysts (225) $179
  • Intern/Summer Associate (22) $131
  • Junior Trader (5) $102
  • Intern/Summer Analyst (250) $85
notes
16 IB Interviews Notes

“... there’s no excuse to not take advantage of the resources out there available to you. Best value for your $ are the...”

Leaderboard

1
redever's picture
redever
99.2
2
Betsy Massar's picture
Betsy Massar
99.0
3
BankonBanking's picture
BankonBanking
99.0
4
Secyh62's picture
Secyh62
99.0
5
CompBanker's picture
CompBanker
98.9
6
kanon's picture
kanon
98.9
7
dosk17's picture
dosk17
98.9
8
GameTheory's picture
GameTheory
98.9
9
Linda Abraham's picture
Linda Abraham
98.8
10
Jamoldo's picture
Jamoldo
98.8
success
From 10 rejections to 1 dream investment banking internship

“... I believe it was the single biggest reason why I ended up with an offer...”