360° Coverage : The Ultimate Pointlessness of Benchmarks

10 Updates
The Ultimate Pointlessness of Benchmarks
Photo Credit: Forbes Business

The Ultimate Pointlessness of Benchmarks

Apr 3 2014, 10:40pm CDT | by

As an investment advisor, my performance is benchmarked to infinity and beyond.  My beloved clients can log on and view all their holdings (including even those I don’t manage) sorted into seven...

Filed under: news

 
 
 

17 weeks ago

The Ultimate Pointlessness of Benchmarks

Apr 3 2014, 10:40pm CDT | by

As an investment advisor, my performance is benchmarked to infinity and beyond.  My beloved clients can log on and view all their holdings (including even those I don’t manage) sorted into seven categories and fifteen sub-categories.  Each of these categories and sub-categories is assigned a benchmark that lets clients track me like a bloodhound.

My clients can see these results every morning over their Cheerios if they are so inclined — for any particular security, or category or sub-category, or for their accounts as a whole.  In case they missed it, I also write them quarterly letters summarizing all of the above.

This whole process — which I set up — is a little bit nutty.  I’m not sure what the point of all this benchmarking is, or what clients are supposed to do with all this data.  It metacommunicates that paying attention to performance vs. benchmarks is important.  But is it?

No, it’s not.

For example, my US Small/Value Equity category is matched against the Total US Stock Market.   The benchmarks are usually represented by funds clients could buy on their own without conjuring up a factor-based strategy like I do.  This decision is arbitrary.  I could also benchmark small/value stocks against a small/value stock index.  But what if my stocks are smaller or more valuey than the benchmark index?  Is it still a fair benchmark?   If I pursue this logic to its extreme, I end up benchmarking everything to itself.

Consider: Tesla has been on fire lately.  Should it be benchmarked to a broad stock index?  Or, to a group of automotive stocks?  Or, should it be benchmarked to technology stocks or momentum stocks?  Perhaps it should be benchmarked against electric car companies like BYD.  In the end, there’s no company exactly like Tesla.  But the more we benchmark it to itself, the more the benchmark disappears like a charmed quark and we are left with nothing.

At a macro level, financial theory suggests that we all should be benchmarked against the global market index: the portfolio of all assets in the world weighted by their market prices.  Assuming that we could calculate this (it’s a big spreadsheet), there are still problems, because we can only use the assets that are readily investable.  What about all the residential real estate on here on Spaceship Earth?  Or the value of the minerals under the soil?  Or our human capital?  Whether we take out a microscope or a telescope, the whole process seems more rather than less arbitrary the closer/farther we look.

How little we know

Academics are still debating whether Warren Buffett, the greatest genius investor of all time, is really any good, because he could be just a statistical outlier.  Maybe all those Chairman’s letters are bunk, the delusions of a fellow with a series of good spins at the roulette wheel who came to believe his philosophy was possessed of super-powers.

Here’s my point, and you aren’t going to like it:  If statisticians still can’t decide whether Warren Buffett is skillful or just a lucky duck after sixty years, how are we going to be able to tell whether that confident-looking guy managing our money for the last five years is any good?

The answer is, we can’t.  We will go to our graves not knowing whether he was Einstein or an empty suit.  And so, for that matter, will he.

Looking at performance is an exercise in futility, made worse because it misleads us into believing that we are doing some kind of meaningful due diligence.  At most we will be able to conclude that he seems to be lucky or unlucky, so far.  But that’s not what we thought we were deciding, now, is it?  If he’s only lucky, that is a problem, because luck can run out, especially when we need it the most.  Whereas skill, if it is skill, might presume to endure and he could lead us like Mark Trail through some dark night of the stock market’s soul.

But then — what is the investment committee to do?  As Cliff Asness points out, these groups often review 3-to-5 year track records to size up the cut of a manager’s jib.  As Cliff might say, this is not only wrong, it’s backwards.  If anything, after 3-to-5 years, however dubious a strategy the manager has been following, it is likely to regress to the mean.  The mighty will be brought low; the meek will inherit the earth.  This is why investment consultants notoriously destroy value to the tune of about 1% a year (or maybe they’re just unlucky?).

Why?  Why?

Why, then, do I go through the expense and bother of benchmarking?

Back in the day, I used to get brokerage statements with zero mention of benchmark performance./>/>

As time passed, I started to get statements using a bogus index, like a Dow Jones Industrial Average that didn’t include reinvested dividends.  Then, this turned into too much information: I received statements with a dozen indexes cited: S&P 500, MSCI EFAE Index, Barclay’s Bond Aggregate, the LIBOR rate, all over the map of Benchmarkistan — only with no way of weighting or relating these to the performance of my account.  They might as well have sent me a copy of the Wall Street Journal.

Surprise: all these were bald attempts to obfuscate poor (expensive) performance.  I knew I didn’t want to be like these guys.  My hope is that if clients know all the data is available, that paradoxically they wouldn’t worry too much about it or obsess over every last detail.  Because in the end, I suspect that the system I set up is more of a distraction than an aid.

The alternative?

What is the investor to do?

1) Be the benchmark.  Simply index everything and forget the rest.  We still need to choose the right index funds and allocate our money among them.  These choices will be highly consequential, for good or evil.  When markets are down, if we have chosen wisely, we can console ourselves with the sentiment that most other investors are doing worse.

2) Invest by strategy.  Some strategies have demonstrated long-term historical and cross-validated outperformance.  They are underpinned by economic intuition, perhaps paying a premium for our assuming an economic risk or psychological discomfort.  Value investing strategizes that buying companies when they are beaten down or cheap by conventional metrics leads to better long-term returns than buying companies that are expensive and glamorous.  This doesn’t work every day or quarter or year or every five years, but over the long term we expect it to work out in our favor.  As with indexing, price matters and execution matters.  When markets are down, we console ourselves with the thought that in the long run we have a good chance to beat the index.

If we invest by strategy, it behooves us to understand what we are doing well enough to ride out the meaningful differences between our returns and the market benchmarks.  In practice, we will only care when we underperform, but that will also be the most expensive time to change course.  Whether we decide to become the benchmark or follow some strategy, comparing our performance to a benchmark is irrelevant or, at worst, potentially dangerous.  If we have trailed the market by several percentage points a year for the past few years, does this mean our well-considered strategy should now be abandoned?  No, that would b e a mistake.  Our time would be better spent understanding our strategies and focusing on certainties like expenses, taxes, and its overall suitability to our purposes.  But that takes work.

 
Update
10

7 weeks ago

RM47mil KWSG contributions still unclaimed

Jun 9 2014 7:54am CDT | Source: Business Times Malaysia

KUALA LUMPUR: About RM47 million of contributions in the Teachers Provident Fund (KWSG) still remain unclaimed, the Dewan Raky ...
Source: Business Times Malaysia   Full article at: Business Times Malaysia
 

 
Update
9

7 weeks ago

Gold shop lost almost RM1mil

Jun 9 2014 3:50am CDT | Source: Business Times Malaysia

KANGAR: A gold shop owner lost almost RM1 million after after the safe on in his shop was broken into b ...
Source: Business Times Malaysia   Full article at: Business Times Malaysia
 

 
Update
8

7 weeks ago

Motion to debate MAS losses in Dewan Rakyat rejected

Jun 9 2014 3:39am CDT | Source: Business Times Malaysia

KUALA LUMPUR: AN emergency motion to debate the losses incurred by Malaysia Airlines last year, amounting to RM1.2 billion was reje ...
Source: Business Times Malaysia   Full article at: Business Times Malaysia
 

 
Update
7

7 weeks ago

MH370 Tragedy: Hisham: RM27.6 mil spent on 1st phase of SAR

Jun 9 2014 2:11am CDT | Source: Business Times Malaysia

KUALA LUMPUR: Malaysia spent some RM27.6 million in its first phase of the search operations for missing Malaysia Airline flight MH370, said Acting Transport Minister, Datuk Seri ...
Source: Business Times Malaysia   Full article at: Business Times Malaysia
 

 
Update
6

7 weeks ago

9.1m litres of diesel seized in a month

Jun 8 2014 1:11am CDT | Source: Business Times Malaysia

PUTRAJAYA: The Domestic Trade, Cooperatives, and Consumerism ministry has seized some 9.1 million litres of diesel and property worth RM58 million since mounting ‘Operasi Diesel Selatan’ in the southern state ...
Source: Business Times Malaysia   Full article at: Business Times Malaysia
 

 
Update
5

8 weeks ago

Girl, 9, awarded RM2.78m compensation for medical negligence

Jun 6 2014 4:56am CDT | Source: Business Times Malaysia

KUALA LUMPUR: A nine-year-old girl who suffered brain damage during her birth at a government hospital was awarded over RM2.78 mi ...
Source: Business Times Malaysia   Full article at: Business Times Malaysia
 

 
Update
4

8 weeks ago

Malaysia's total trade in April up 12pc

Jun 5 2014 11:52pm CDT | Source: Business Times Malaysia

KUALA LUMPUR: Malaysia's total trade in April 2014 rose by 12 per cent from a year ago to RM123.86 billion due to growing trading activities, International Trade and Industry Minister Datuk Seri Mustapa M ...
Source: Business Times Malaysia   Full article at: Business Times Malaysia
 

 
Update
3

8 weeks ago

Works Ministry to spend RM20m for upgrading works at 50 accident black spots

Jun 4 2014 11:35pm CDT | Source: Business Times Malaysia

JOHOR BARU: The Works Ministry will implement upgrading works at 50 accident prone locations in the country that have been identified this year involving an allocation of RM20 mill ...
Source: Business Times Malaysia   Full article at: Business Times Malaysia
 

 
Update
2

8 weeks ago

Najib launches loan scheme for Ramadan traders

Jun 4 2014 10:24pm CDT | Source: Business Times Malaysia

PUTRAJAYA: Prime Minister Datuk Seri Najib Razak today launches RM45 million Ramadan Ba ...
Source: Business Times Malaysia   Full article at: Business Times Malaysia
 

 
Update
1

8 weeks ago

Residents bring up objection against Kidex to Suhakam

Jun 4 2014 4:49am CDT | Source: Business Times Malaysia

PETALING JAYA: A group of 20 Petaling Jaya residents held a meeting with the Human Rights Commission of Malaysia (Suhakam) over their objection against the proposed RM2.2 billion Kinrara Damansara S ...
Source: Business Times Malaysia   Full article at: Business Times Malaysia
 

 

Don't miss ...

 

<a href="/latest_stories/all/all/30" rel="author">Forbes</a>
Forbes is among the most trusted resources for the world's business and investment leaders, providing them the uncompromising commentary, concise analysis, relevant tools and real-time reporting they need to succeed at work, profit from investing and have fun with the rewards of winning.

 

blog comments powered by Disqus

Latest stories

Delegates to be screened for Ebola at US-Africa summit
Washington, Aug 2 (IANS) US President Barack Obama has ordered compulsory screening of all the African delegates arriving in Washington for a summit for Ebola virus symptoms.
 
 
Man builds spaceship in his kid's bedroom!
New York, Aug 2 (IANS) Have you ever thought of building a spacecraft for your kid? Learn from this man who gifted his four-year-old son a NASA spaceship simulator - right in his bedroom!
 
 
WTO fails to reach trade facilitation agreement
Geneva, Aug 2 (IANS) Negotiations at the World Trade Organisation(WTO) has failed to agree on the implementation of the trade facilitation agreement as the deadline of July 31 passed.
 
 
Liberia reports new Ebola cases
Lagos, Aug 1 (IANS) The Liberian government has reported new Ebola cases as of July 28.
 
 
 

Latest from the Network

Heavy rain claims five lives in Karachi
Islamabad, Aug 2 (IANS) At least five people were killed Saturday in separate incidents in Karachi as heavy rains hit the city. A man in Metroville died as a wall collapsed on him, Dawn online reported. A woman and...
Read more on Politics Balla
 
UN continues to seek truce in Gaza
United Nations, Aug 2 (IANS) The UN continues to seek a halt to the Gaza violence despite the breakdown of a 72-hour humanitarian ceasefire. "The ceasefire seems to have lasted for maybe 90 minutes this morning, a...
Read more on Politics Balla
 
Delegates to be screened for Ebola at US-Africa summit
Washington, Aug 2 (IANS) US President Barack Obama has ordered compulsory screening of all the African delegates arriving in Washington for a summit for Ebola virus symptoms. The issue of Ebola "is something that we...
Read more on Business Balla
 
Man builds spaceship in his kid's bedroom!
New York, Aug 2 (IANS) Have you ever thought of building a spacecraft for your kid? Learn from this man who gifted his four-year-old son a NASA spaceship simulator - right in his bedroom! The spaceship has controls,...
Read more on Apple Balla
 
Pakistan summons Afghan envoy over border attacks
Islamabad, Aug 2 (IANS) Pakistan has summoned Afghanistan's charge d'affaires over another cross-border attack by terrorists, officials said. Pakistan's foreign ministry said a soldier was killed during "a sniper...
Read more on Politics Balla
 
Apple Prepared To Layoff 200 Beats Employees
The $3 billion Beats acquisition by Apple was certainly one of the most high profile purchases that the company has ever made. There have been over 25 other acquisitions in the past year, but nothing that matched this...
Read more on Apple Balla
 
Man Steals $300,000+ From Apple
Complex cyber attacks have become more and more common as years go by, but there is still a group of people who are having success with much more low-tech scams. That was the case with a man who recently obtained over $...
Read more on Apple Balla
 
Apple Launches Content Delivery Network
Apple is responsible for delivering a great deal of data to consumers, although they have traditionally relied on third party groups to handle the process. According to Frost & Sullivan, Apple has already worked out...
Read more on Apple Balla
 
Dunga denies Brazil blacklist
Rio de Janeiro, Aug 2 (IANS) Brazil coach Dunga has denied suggestions that striker Fred and goalkeeper Julio Cesar have been placed on a blacklist after the team's ignominious World Cup exit last month. Speaking...
Read more on Sport Balla
 
Lampard set for Manchester City loan
Washington, Aug 2 (IANS) Former Premier League side Chelsea star Frank Lampard will play for Manchester City under a loan deal from his new Major League Soccer Team New York City FC, media reports said. Lampard, who...
Read more on Sport Balla