Error Measurement and "Cost of Forecast Error" for Predictive Models

Hello,

I'm currently working on multivariate regression using Artificial Neural Networks to forecast the price of VIX. My problem is that I'm an undergraduate Math student and not a trader so I don't know which cost function I should be minimizing.

I usually default to RMSE for regression problems, but I understand there are a number of other metrics used in statistics for error measurement of forecasts. (eg. Mean square error (MSE): Sum of the squared errors Root mean square error (RMSE): Square root of the MSE Mean percent error (MPE): Average of the percent errors Mean absolute error (MAE): Average of the absolute errors Mean absolute percent error (MAPE): Average of the APE Weighted mean absolute percent error (WMAPE): Weighted average of the APE) source: goo.gl/nyYaAy

I will eventually be summarizing my findings in a paper and hope to submit the results to the SIAM Journal on Financial Mathematics (SIFIN) for publication.

I found a paper which published a number of different error metrics in a nice table (ie. goo.gl/3ZWpst) but in terms of training the neural network, the optimizer needs a single objective to minimize.

As a trader, if you were going to include a forecasting model such as an ANN in your trading strategy, which error measurement would you be most interested in seeing minimized? Would this answer change if you were trading FOREX vs. Options vs. Stocks?

Thank you for any guidance you can provide!

0 Comments

Career Advancement Opportunities

June 2026 Investment Banking

  • Evercore 01 99.4%
  • Moelis & Company 01 98.8%
  • JPMorgan 01 98.2%
  • Guggenheim Partners 01 97.7%
  • Morgan Stanley 07 97.1%

Overall Employee Satisfaction

June 2026 Investment Banking

  • Moelis & Company No 99.4%
  • Morgan Stanley 01 98.8%
  • Evercore 01 98.2%
  • BMO Capital Markets 12 97.6%
  • Banco Santander 01 97.1%

Professional Growth Opportunities

June 2026 Investment Banking

  • Moelis & Company No 99.4%
  • Evercore No 98.8%
  • Morgan Stanley 05 98.2%
  • JPMorgan No 97.7%
  • BMO Capital Markets 12 97.1%

Total Avg Compensation

June 2026 Investment Banking

  • Vice President (14) $434
  • Associates (43) $259
  • 3rd+ Year Analyst (8) $210
  • 2nd Year Analyst (22) $179
  • Intern/Summer Associate (13) $156
  • 1st Year Analyst (75) $151
  • Intern/Summer Analyst (66) $101
notes
16 IB Interviews Notes

“... there’s no excuse to not take advantage of the resources out there available to you. Best value for your $ are the...”

Leaderboard

1
redever's picture
redever
99.2
2
Secyh62's picture
Secyh62
99.0
3
BankonBanking's picture
BankonBanking
99.0
4
kanon's picture
kanon
99.0
5
DrApeman's picture
DrApeman
98.9
6
dosk17's picture
dosk17
98.9
7
CompBanker's picture
CompBanker
98.9
8
GameTheory's picture
GameTheory
98.9
9
Betsy Massar's picture
Betsy Massar
98.9
10
numi's picture
numi
98.8
success
From 10 rejections to 1 dream investment banking internship

“... I believe it was the single biggest reason why I ended up with an offer...”