02-23-2022 · Insight

Indices insights: Do ESG ratings align with the values of large investors?

This is the first article of a new series, Indices insights, in which we focus on some of the flaws of ESG ratings. Compared to the UN SDGs, the use of ESG ratings has some shortfalls. Indeed, it’s possible for firms that typically appear on asset owners’ exclusion lists to have decent ESG ratings.

    Authors

  • Joop Huij - PhD, Head of Sustainable Index Solutions

    Joop Huij

    PhD, Head of Sustainable Index Solutions

  • Simon Lansdorp - PhD, Portfolio Manager Sustainable Index Solutions

    Simon Lansdorp

    PhD, Portfolio Manager Sustainable Index Solutions

  • Jan Anton van Zanten - SDG Strategist

    Jan Anton van Zanten

    SDG Strategist

Many investors either incorporate sustainability considerations in their portfolios or plan to do so in the future. One of the key motivating factors for this adoption is that it enables investors to align with positive impact, i.e., by allocating capital to companies that are sustainable and which benefit society, while avoiding investments in those that inflict significant harm on it. To achieve this, investors often rely on readily available ESG ratings.

It is, however, important to assess whether these ESG scores appropriately measure societal impact. In our analysis, we scrutinized the ESG ratings of companies that are explicitly earmarked by large institutional asset owners as being bad for society. Surprisingly, we found a weak relationship between the firms that are on exclusion lists and their respective ESG ratings. By contrast, there was a much stronger alignment when we used a measure based on the United Nations Sustainable Development Goals (SDGs).

For example, Figure 1 shows that more than half of the tobacco producers that are excluded from the portfolios of large asset owners receive an average ESG rating or are even considered ESG leaders by MSCI. Similarly, more than half of these companies are assessed as having neutral or even low ESG risk according to Sustainalytics. By contrast, all of these firms receive the lowest Robeco SDG score of -3, in line with the harmful products they produce. Similarly, we find that stocks that are avoided for other reasons that are deemed important by large asset owners have SDG scores that are seemingly more aligned with the negative impact they inflict on society.

Figure 1 | Scores of companies on exclusion lists, using different sustainability measures

Figure 1 | Scores of companies on exclusion lists, using different sustainability measures

Source: Robeco, MSCI, Sustainalytics.

Subscribe - Indices Insights

Receive an update as soon as a new article is available with insights about sustainability, factors or markets.

Subscribe Read more about Robeco Indices


Data and methodology

For our analysis, we started by collecting exclusion lists. Many institutional investors keep a record of the companies they exclude from their investable universes for regulatory or values-based reasons. Large asset owners often publish ESG policies and sometimes their exclusion lists on their websites. Thus, we were able to download the exclusion lists for some the largest sovereign wealth funds and pension funds globally, as well as their criteria for omitting companies.1

For example, the Norges Bank shares a list of firms that are excluded or under observation for the Government Pension Fund Global. It also provides guidelines which contextualize the reasons why certain businesses are not included in their investable universe, such as precluding investments in companies that produce tobacco-related products given their adverse impact on health.2

We then combined the exclusion lists of the various asset owners and categorized the list of companies according to five commonly used exclusion criteria. Since data coverage is relatively low for micro-cap stocks, we restricted our universe to the constituents of the MSCI ACWI Investable Market Index. In total, we analyzed 293 firms. These were based on the five exclusion criteria: tobacco producers; coal miners and/or coal-based energy producers; controversial weapons manufacturers; companies at fault for significant environmental damage; firms responsible for severe violations of human and/or labor rights.

For each of the stocks that met these exclusion criteria, we analyzed their sustainability scores by referring to three data providers, namely the Robeco SDG scores based on our proprietary SDG framework, MSCI ESG ratings, and Sustainalytics ESG risk ratings. Note that these three data providers use different approaches for their scoring methodologies and that their sustainability scores are not directly comparable.

That said, the sustainability scores clearly differentiate between firms that have a negative, neutral or positive impact on society (Robeco SDG scores); companies that are deemed to be ESG laggards, average in terms of ESG, or ESG leaders (MSCI ESG rating); or businesses that have high, neutral, or low ESG risks (Sustainalytics ESG risk rating).

For instance, the Robeco SDG scores and MSCI ESG ratings apply a categorical scale, ranging from -3 to +3, and from CCC to AAA respectively. The Sustainalytics ESG risk ratings assign a quantitative risk score that is used to place a company in one of five risk categories, ranging from severe to negligible. This is summarized in Table 1.

do-esg-ratings-align-with-the-values-of-large-institutional-asset-owners-fig2.jpg

Source: Robeco, MSCI, Sustainalytics.

Conclusion

Based on our analysis, we conclude that ESG ratings may not effectively capture the impact companies have on society, which is a key consideration for large institutional asset owners. An SDG-based approach takes into account how companies impact the SDGs. In our view, such an approach can enable investors to align their portfolios with positive impact, by avoiding investing in firms that contribute negatively to the SDGs.

Background to sustainability metrics

In defining sustainability, investors have a multitude of dimensions and metrics they could consider. For example:

  • Values-based exclusions

  • ESG integration

  • Impact investing

ESG scores typically put more focus on the operations of a business, whereas SDG scores also incorporate the impact that the business’ products and/or services have on society.

We see client sustainability objectives increasingly moving towards avoiding controversial businesses (values-based exclusions) and including those that provide sustainable solutions (impact investing). In the first few articles of our Indices Insights series, we will empirically show how the different sustainability metrics (negative screening/exclusions, ESG, SDG) relate to these increasingly impact-oriented client sustainability objectives.


1 We observe that large asset owners in Northern Europe and the Pacific region, in particular, are more likely to disclose their exclusion lists compared to other regions.
2 See: https://www.nbim.no/en/the-fund/responsible-investment/exclusion-of-companies/

Indices Insights

Let's keep the conversation going

Keep track of fast-moving events in sustainable and quantitative investing, trends and credits with our newsletters.

Don’t miss out
Robeco

Robeco aims to enable its clients to achieve their financial and sustainability goals by providing superior investment returns and solutions.

Important information
The Robeco Capital Growth Funds have not been registered under the United States Investment Company Act of 1940, as amended, nor or the United States Securities Act of 1933, as amended. None of the shares may be offered or sold, directly or indirectly in the United States or to any U.S. Person (within the meaning of Regulation S promulgated under the Securities Act of 1933, as amended (the “Securities Act”)). Furthermore, Robeco Institutional Asset Management B.V. (Robeco) does not provide investment advisory services, or hold itself out as providing investment advisory services, in the United States or to any U.S. Person (within the meaning of Regulation S promulgated under the Securities Act).
This website is intended for use only by non-U.S. Persons outside of the United States (within the meaning of Regulation S promulgated under the Securities Act who are professional investors, or professional fiduciaries representing such non-U.S. Person investors. By clicking “I Agree” on our website disclaimer and accessing the information on this website, including any subdomain thereof, you are certifying and agreeing to the following: (i) you have read, understood and agree to this disclaimer, (ii) you have informed yourself of any applicable legal restrictions and represent that by accessing the information contained on this website, you are not in violation of, and will not be causing Robeco or any of its affiliated entities or issuers to violate, any applicable laws and, as a result, you are legally authorized to access such information on behalf of yourself and any underlying investment advisory client, (iii) you understand and acknowledge that certain information presented herein relates to securities that have not been registered under the Securities Act, and may be offered or sold only outside the United States and only to, or for the account or benefit of, non-U.S. Persons (within the meaning of Regulation S under the Securities Act), (iv) you are, or are a discretionary investment adviser representing, a non-U.S. Person (within the meaning of Regulation S under the Securities Act) located outside of the United States and (v) you are, or are a discretionary investment adviser representing, a professional non-retail investor.


Access to this website has been limited so that it shall not constitute directed selling efforts (as defined in Regulation S under the Securities Act) in the United States and so that it shall not be deemed to constitute Robeco holding itself out generally to the public in the U.S. as an investment adviser. Nothing contained herein constitutes an offer to sell securities or solicitation of an offer to purchase any securities in any jurisdiction. We reserve the right to deny access to any visitor, including, but not limited to, those visitors with IP addresses residing in the United States. This website has been carefully prepared by Robeco. The information contained in this publication is based upon sources of information believed to be reliable. Robeco is not answerable for the accuracy or completeness of the facts, opinions, expectations and results referred to therein. Whilst every care has been taken in the preparation of this website, we do not accept any responsibility for damage of any kind resulting from incorrect or incomplete information. This website is subject to change without notice. The value of the investments may fluctuate. Past performance is no guarantee of future results. If the currency in which the past performance is displayed differs from the currency of the country in which you reside, then you should be aware that due to exchange rate fluctuations the performance shown may increase or decrease if converted into your local currency. For investment professional use only. Not for use by the general public.