09-09-2022 · Insight

Measuring sustainability performance: comparing an SDG score with ESG ratings

Investors are seeking more powerful tools to measure how sustainable companies are. In this article we compare Robeco's SDG score with traditional ESG ratings and explain why it can help investors create sustainable investing strategies that pursue positive impacts and avoid negative effects.

    Authors

  • Jan Anton van Zanten - SDG Strategist

    Jan Anton van Zanten

    SDG Strategist

  • Joop Huij - PhD, Head of Sustainable Index Solutions

    Joop Huij

    PhD, Head of Sustainable Index Solutions

Sustainable investing is hot. Estimates suggest that sustainably invested assets grew 55% from 2016 to 2020, reaching 36% of total assets under management1. More than two-thirds of the USD 35.3 trillion that is invested sustainably involves ESG-integration. However, despite their prominence, the ESG ratings that are used to create such strategies are under fire.

For example, tobacco companies, and mining giants can get top-notch ESG ratings. This suggests ESG ratings fail to thoroughly capture companies’ environmental and social impacts. There is also a lack of correlation between ESG ratings from different providers, creating ‘aggregate confusion’ over what it is that ESG ratings measure. Such critiques led Bloomberg to identify an “ESG mirage” and the Economist dubbed ESG to be “three letters that won’t save the planet”.

Faced with serious disagreement over how to best measure which companies are sustainable, how might investors identify those companies that contribute to a better world and exclude those that have a negative impact?

Introducing an SDG score and comparing it to ESG ratings

In our new working paper, we contend that the Sustainable Development Goals (SDGs) are an important blueprint for sustainable investors. Academics posit that sustainable investing is ‘a generic term for investments that seek to contribute toward sustainable development’. The 17 SDGs with their 169 underlying targets thereby identify what specific sustainable development objectives investors ought to pursue. The fact that the SDGs were adopted by all United Nations member states ensures that they are globally valid.

From this point of departure, we introduce the Robeco SDG score, which has been used for many years in our investment strategies, as a novel metric of sustainability performance. This score measures to what extent companies positively or negatively contribute to the SDGs. The score ranges from -3, indicating that a company has high negative impacts, to +3, signaling that the company makes high positive contributions.

This presents an interesting question: how might we test which metric – the SDG score or an ESG rating – best captures companies’ sustainability impacts? And does this SDG score offer something new relative to established ESG ratings?

In our paper we test whether the SDG score and four prominent ESG ratings align with: (i) investors’ revealed sustainability preferences; (ii) sustainable investing regulation; and (iii) climate science.

Sustainable Investing Open Access Initiative

A collaborative effort to promote and encourage research and ideas and offer insight in our SDG scores and country sustainability rankings.

Learn more

Do sustainability metrics align with investors’ revealed sustainability preferences?

Our first test looks at whether the SDG score and ESG ratings agree with the observed sustainable investing behavior of actual investors.

First, we assess if these metrics can identify companies that investors believe have negative impacts by comparing the SDG scores and ESG ratings of companies that are excluded by asset owners. With exclusion lists, asset owners avoid investing in companies with severe negative impact, such as those violating human rights, digging up thermal coal, or producing tobacco. We expect a useful sustainability metric to assign poor scores to companies on such exclusion lists.

Second, we assess if these metrics can pinpoint companies that investors believe to have positive impact by comparing the SDG and ESG performance of companies invested in by mainstream sustainable thematic funds. We look at three sectors: sustainable energy; water; and healthcare where useful sustainability metrics should assign good scores.

For this first test, we find that nearly all companies on asset owners’ exclusion lists get negative SDG scores while companies in sustainable thematic funds receive positive SDG scores. Notwithstanding some differences among providers, ESG ratings for excluded and sustainable thematic companies are comparable to the broader benchmark. Hence, the SDG score aligns with investors’ revealed sustainability preferences. ESG ratings do not.

How do companies and countries score on sustainability?

Explore the contributions companies make to the Sustainable Development Goals and how countries rank on ESG criteria.

Find out more

Do sustainability metrics align with sustainable investing regulation?

Our second test determines if the SDG score and ESG ratings comply with the EU Taxonomy. Again, we look at both negative and positive impact.

First, the EU Taxonomy stipulates what types of corporate behavior violate the ‘do-no-significant-harm’ (DNSH) principle. We expect companies that cause significant environmental harm, and thus violate this principle, to get poor sustainability scores. Second, the EU Taxonomy sets technical screening criteria that define which types of corporate activities provide solutions for promoting environmental sustainability. We expect companies that generate most of their revenues from such activities to achieve good sustainability scores.

Using Sustainalytics EU Taxonomy data, we find that the SDG score for all companies that violate the DNSH principle is negative. In turn, the SDG score for companies that have over 66% of revenues from EU Taxonomy-aligned activities is typically very positive. In contrast, ESG ratings for both types of companies tend not to differ that much from the benchmark. Thus, the SDG score is in line with this specific sustainable investing regulation, while ESG ratings tend not to be.

Do sustainability metrics align with climate science?

Our final test is based on climate science. We posit that the majority companies with extremely high greenhouse gas emissions should get poor sustainability ratings.

We assess this by looking at combined scope 1 and 2 emissions, and scope 3 emissions. Looking at the top-100 GHG emitters, we find that most get a negative SDG score, while ESG ratings for these companies are generally comparable to the benchmark’s scores. This shows that the SDG score aligns with climate science. ESG ratings do not.

Conclusion: an SDG score and ESG ratings can complement one another but should never be confused

On all three tests, the SDG score proved its validity while the four traditional ESG ratings either failed the tests, or only partially captured companies’ impacts. These findings demonstrate that ESG ratings should not be understood as measuring companies’ contributions to sustainable development. We therefore caution against using concepts like ESG, sustainability, and impact interchangeably.

A practical implication is that sustainable investment strategies that solely integrate ESG ratings are likely to continue to invest in companies responsible for negative impacts, while missing investments in companies that make positive contributions. This implies investors could fall short of meeting their – and their clients’ – sustainability objectives. This is not to say that ESG ratings are useless. These tend to gauge the financial risk that companies face from sustainability issues. They could therefore complement an SDG score, in order to support financial performance, while targeting positive impact on the SDGs.

To read the full research report find it here: Corporate Sustainability Performance: Introducing an SDG Score and Testing Its Validity Relative to ESG Ratings by Jan Anton van Zanten, Joop Huij - SSRN

Footnote

1 GSIA. (2021). Global Sustainable Investment Review. Retrieved 8 July 2022 from: http://www.gsi-alliance.org/wp-content/uploads/2021/08/GSIR-20201.pdf


Stay informed on our latest insights with monthly mail updates

Receive our Robeco newsletter and be the first to read the latest insights and build the greenest portfolio.

Stay updated

Let's keep the conversation going

Keep track of fast-moving events in sustainable and quantitative investing, trends and credits with our newsletters.

Stay updated
Robeco

Robeco aims to enable its clients to achieve their financial and sustainability goals by providing superior investment returns and solutions.

Important information
The Robeco Capital Growth Funds have not been registered under the United States Investment Company Act of 1940, as amended, nor or the United States Securities Act of 1933, as amended. None of the shares may be offered or sold, directly or indirectly in the United States or to any U.S. Person (within the meaning of Regulation S promulgated under the Securities Act of 1933, as amended (the “Securities Act”)). Furthermore, Robeco Institutional Asset Management B.V. (Robeco) does not provide investment advisory services, or hold itself out as providing investment advisory services, in the United States or to any U.S. Person (within the meaning of Regulation S promulgated under the Securities Act).
This website is intended for use only by non-U.S. Persons outside of the United States (within the meaning of Regulation S promulgated under the Securities Act who are professional investors, or professional fiduciaries representing such non-U.S. Person investors. By clicking “I Agree” on our website disclaimer and accessing the information on this website, including any subdomain thereof, you are certifying and agreeing to the following: (i) you have read, understood and agree to this disclaimer, (ii) you have informed yourself of any applicable legal restrictions and represent that by accessing the information contained on this website, you are not in violation of, and will not be causing Robeco or any of its affiliated entities or issuers to violate, any applicable laws and, as a result, you are legally authorized to access such information on behalf of yourself and any underlying investment advisory client, (iii) you understand and acknowledge that certain information presented herein relates to securities that have not been registered under the Securities Act, and may be offered or sold only outside the United States and only to, or for the account or benefit of, non-U.S. Persons (within the meaning of Regulation S under the Securities Act), (iv) you are, or are a discretionary investment adviser representing, a non-U.S. Person (within the meaning of Regulation S under the Securities Act) located outside of the United States and (v) you are, or are a discretionary investment adviser representing, a professional non-retail investor.


Access to this website has been limited so that it shall not constitute directed selling efforts (as defined in Regulation S under the Securities Act) in the United States and so that it shall not be deemed to constitute Robeco holding itself out generally to the public in the U.S. as an investment adviser. Nothing contained herein constitutes an offer to sell securities or solicitation of an offer to purchase any securities in any jurisdiction. We reserve the right to deny access to any visitor, including, but not limited to, those visitors with IP addresses residing in the United States. This website has been carefully prepared by Robeco. The information contained in this publication is based upon sources of information believed to be reliable. Robeco is not answerable for the accuracy or completeness of the facts, opinions, expectations and results referred to therein. Whilst every care has been taken in the preparation of this website, we do not accept any responsibility for damage of any kind resulting from incorrect or incomplete information. This website is subject to change without notice. The value of the investments may fluctuate. Past performance is no guarantee of future results. If the currency in which the past performance is displayed differs from the currency of the country in which you reside, then you should be aware that due to exchange rate fluctuations the performance shown may increase or decrease if converted into your local currency. For investment professional use only. Not for use by the general public.