11-05-2023 · Insight

Machine learning in finance: Why and how?

With the rise in popularity of machine learning (ML), it’s no surprise that investment practitioners are attracted to this potential industry game changer.

That’s why this new research report by Robeco is an important contribution to the conversation. It provides detailed analysis of the huge upside of this technological advancement, but also expresses a much-needed note of caution for the finance and investment industry.

    Authors

  • Mike Chen - Head of Next Gen Research

    Mike Chen

    Head of Next Gen Research

  • Weili Zhou - Head of Quant Investing & Research, Deputy CIO

    Weili Zhou

    Head of Quant Investing & Research, Deputy CIO

So, why ML in investing?

The answer is simple: the promise of higher risk-adjusted returns. In general, industry practitioners have found that ML-derived alpha models outperform more traditional, linear models in predicting cross-sectional equity returns.

In this report, the authors explore the interaction between ML and other known quantitative techniques. They examine non-linear effects which are a key factor behind the superior performance of ML. The interaction effect between accounting red flags and equity returns is an interesting illustration of this.

Another notable feature of ML algorithms is their so called ‘knowledge discovery’ abilities. Given that they’re designed to look for relationships, an ML algorithm can decipher the link between inputs and outputs without specifying a hypothesis.

Investor beware…

It’s worth mentioning that financial markets differ from other areas of modern life where ML has made tremendous strides. Financial markets’ inherent complexity throws up notable challenges. For instance, the Robeco research highlights the low signal-to-noise ratio of financial data. This means for a given security, any one metric is generally not a huge determinant of how that security will perform.

Another challenge relates to amount of data, a significant driver of an ML algorithm’s power. While it may feel like there is a vast amount of data in finance, it’s actually relatively small compared with other areas where ML has thrived.

Finally, financial markets are adaptive. This means they ‘learn’ over time, enabling investors to change their approach as required. However, because ML tends to perform well with static systems, this throws up potential difficulties.

Overcoming challenges in application

Due to the short sample data history, overfitting and spurious correlations can occur. While common techniques to overcome this may not work as well in finance, human intuition and economic domain knowledge can help significantly. In the full Robeco paper, you’ll see the authors’ illustration of this using the SHapley Additive exPlanation (SHAP) value.

Robeco suggests that ML investors build a robust data and code infrastructure to tackle potential replicability challenges. This would include a robust system for code version control and documentation of all tested iterations and hypotheses.

Quant investors will be familiar with lookahead bias and the more general problem of data leakage. This phenomenon occurs when data used in the training set contains information that can be used to infer the prediction, information that would otherwise not be available to the ML model in live production. The report outlines various techniques to counteract this potential pitfall.

Machine learning models can be difficult to understand and explain, especially via performance attribution. The full Robeco report offers the fundamental approach to recent explainable machine learning work, including helpful diagrams.

As technology advances, so do the opportunities for quantitative investors. By incorporating more data and leveraging advanced modelling techniques, we can develop deeper insights and enhance decision-making.

Sample ML applications in finance

The Robeco report analyses practical applications of ML to financial investing. It takes a comprehensive dive into each area of study:

  1. Predicting cross-sectional stock returns
    The ML algorithms used here compare the relative, rather than absolute, returns of securities to predict whether a security’s price will rise or fall. The report delves into five consistent results that practitioner and academic studies have found, starting with the outperformance of ML algorithm prediction versus the traditional linear approach.

  2. Predicting stock crashes
    This application differs slightly in focusing on the worst-performing stocks only, offering potential benefits for conservative strategies which can then exclude securities most likely to crash. The performance of this ML algorithm is shown to be greater than that of traditional approaches, with notable implications for stock selection when looking on a sectoral basis.

  3. Predicting fundamental variables
    Company fundamentals have a major influence on stock price and performance. Fundamentals, being more stable, may be easier to predict than stock returns. ML models give more accurate earnings forecasts. One key conclusion is that ensemble models, traditional or machine learned, were more accurate than individual models alone.

  4. Natural Language Processing (NLP) in multiple languages
    In general, a global portfolio may invest in 20-30 different countries, while a typical investor may understand only two or three languages, if that. NLP can be used to overcome this barrier. Taking Chinese as an example, NLP can be used to detect investment terms in both standard Chinese and slang. This can aid understanding of foreign language investment blogs for instance.


Where do we go from here?

With the recent hype around GPT, it’s certainly an opportune moment for investors to look more widely at the use of machine learning in finance. Given that financial markets have unique characteristics, the authors outline why the use of ML is not necessarily a one-way bet for investors. The applications discussed here represent only a subset of ML’s potential, and the future looks set to bring more interest and innovation for this powerful set of tools.

Click here to download the full report


Let's keep the conversation going

Keep track of fast-moving events in sustainable and quantitative investing, trends and credits with our newsletters.

Stay updated
Robeco

Robeco aims to enable its clients to achieve their financial and sustainability goals by providing superior investment returns and solutions.

Important information This disclaimer applies to any documents and the verbal or written comments of any person in presentations or webinars on this website and taken together is referred to herein as the “Information”. The services to which the Information relate are NOT FOR RETAIL CLIENTS - The information contained in the Website is solely intended for professional investors, defined as investors which (1) qualify as professional clients within the meaning of the Markets in Financial Instruments Directive (MiFID), (2) have requested to be treated as professional clients within the meaning of the MiFID or (3) are authorized to receive such information under any other applicable laws and must not be relied or acted upon by any other persons. This Information does not constitute an offer to sell, or a solicitation of an offer to buy, any financial product, and may not be relied upon in connection with the purchase or sale of any financial product. You are cautioned against using this Information as the basis for making a decision to purchase any financial product. To the extent that you rely on the Information in connection with any investment decision, you do so at your own risk. The Information does not purport to be complete on any topic addressed. The Information may contain data or analysis prepared by third parties and no representation or warranty about the accuracy of such data or analysis is provided.
In all cases where historical performance is presented, please note that past performance is not a reliable indicator of future results and should not be relied upon as the basis for making an investment decision. Investors may not get back the amount originally invested. Neither Robeco Institutional Asset Management B.V. nor any of its affiliates guarantees the performance or the future returns of any investments. If the currency in which the past performance is displayed differs from the currency of the country in which you reside, then you should be aware that due to exchange rate fluctuations the performance shown may increase or decrease if converted into your local currency. Robeco Institutional Asset Management B.V. (“Robeco”) expressly prohibits any redistribution of the Information without the prior written consent of Robeco. The Information is not intended for distribution to, or use by, any person or entity in any jurisdiction or country where such distribution or use is contrary to law, rule or regulation. Certain information contained in the Information includes calculations or figures that have been prepared internally and have not been audited or verified by a third party. Use of different methods for preparing, calculating or presenting information may lead to different results. Robeco Institutional Asset Management UK Limited (“RIAM UK”) is authorised and regulated by the Financial Conduct Authority. RIAM UK, 30 Fenchurch Street, Part Level 8, London EC3M 3BD (FCA Reference No:1007814). The company is registered in England and Wales under Ref No. 15362605.

In all cases where historical performance is presented, please note that past performance is not a reliable indicator of future results and should not be relied upon as the basis for making an investment decision. Investors may not get back the amount originally invested. Neither Robeco Institutional Asset Management B.V. nor any of its affiliates guarantees the performance or the future returns of any investments. If the currency in which the past performance is displayed differs from the currency of the country in which you reside, then you should be aware that due to exchange rate fluctuations the performance shown may increase or decrease if converted into your local currency. Robeco Institutional Asset Management B.V. (“Robeco”) expressly prohibits any redistribution of the Information without the prior written consent of Robeco. The Information is not intended for distribution to, or use by, any person or entity in any jurisdiction or country where such distribution or use is contrary to law, rule or regulation. Certain information contained in the Information includes calculations or figures that have been prepared internally and have not been audited or verified by a third party. Use of different methods for preparing, calculating or presenting information may lead to different results. Robeco Institutional Asset Management B.V. is authorised as a manager of UCITS and AIFs by the Netherlands Authority for the Financial Markets and subject to limited regulation in the UK by the Financial Conduct Authority. Details about the extent of our regulation by the Financial Conduct Authority are available from us on request.