360° Coverage : The Ultimate Pointlessness of Benchmarks

2 Updates
The Ultimate Pointlessness of Benchmarks
Photo Credit: Forbes Business

The Ultimate Pointlessness of Benchmarks

Apr 3 2014, 10:40pm CDT | by

As an investment advisor, my performance is benchmarked to infinity and beyond.  My beloved clients can log on and view all their holdings (including even those I don’t manage) sorted into seven...

Filed under: news

 
 
 

28 weeks ago

The Ultimate Pointlessness of Benchmarks

Apr 3 2014, 10:40pm CDT | by

As an investment advisor, my performance is benchmarked to infinity and beyond.  My beloved clients can log on and view all their holdings (including even those I don’t manage) sorted into seven categories and fifteen sub-categories.  Each of these categories and sub-categories is assigned a benchmark that lets clients track me like a bloodhound.

My clients can see these results every morning over their Cheerios if they are so inclined — for any particular security, or category or sub-category, or for their accounts as a whole.  In case they missed it, I also write them quarterly letters summarizing all of the above.

This whole process — which I set up — is a little bit nutty.  I’m not sure what the point of all this benchmarking is, or what clients are supposed to do with all this data.  It metacommunicates that paying attention to performance vs. benchmarks is important.  But is it?

No, it’s not.

For example, my US Small/Value Equity category is matched against the Total US Stock Market.   The benchmarks are usually represented by funds clients could buy on their own without conjuring up a factor-based strategy like I do.  This decision is arbitrary.  I could also benchmark small/value stocks against a small/value stock index.  But what if my stocks are smaller or more valuey than the benchmark index?  Is it still a fair benchmark?   If I pursue this logic to its extreme, I end up benchmarking everything to itself.

Consider: Tesla has been on fire lately.  Should it be benchmarked to a broad stock index?  Or, to a group of automotive stocks?  Or, should it be benchmarked to technology stocks or momentum stocks?  Perhaps it should be benchmarked against electric car companies like BYD.  In the end, there’s no company exactly like Tesla.  But the more we benchmark it to itself, the more the benchmark disappears like a charmed quark and we are left with nothing.

At a macro level, financial theory suggests that we all should be benchmarked against the global market index: the portfolio of all assets in the world weighted by their market prices.  Assuming that we could calculate this (it’s a big spreadsheet), there are still problems, because we can only use the assets that are readily investable.  What about all the residential real estate on here on Spaceship Earth?  Or the value of the minerals under the soil?  Or our human capital?  Whether we take out a microscope or a telescope, the whole process seems more rather than less arbitrary the closer/farther we look.

How little we know

Academics are still debating whether Warren Buffett, the greatest genius investor of all time, is really any good, because he could be just a statistical outlier.  Maybe all those Chairman’s letters are bunk, the delusions of a fellow with a series of good spins at the roulette wheel who came to believe his philosophy was possessed of super-powers.

Here’s my point, and you aren’t going to like it:  If statisticians still can’t decide whether Warren Buffett is skillful or just a lucky duck after sixty years, how are we going to be able to tell whether that confident-looking guy managing our money for the last five years is any good?

The answer is, we can’t.  We will go to our graves not knowing whether he was Einstein or an empty suit.  And so, for that matter, will he.

Looking at performance is an exercise in futility, made worse because it misleads us into believing that we are doing some kind of meaningful due diligence.  At most we will be able to conclude that he seems to be lucky or unlucky, so far.  But that’s not what we thought we were deciding, now, is it?  If he’s only lucky, that is a problem, because luck can run out, especially when we need it the most.  Whereas skill, if it is skill, might presume to endure and he could lead us like Mark Trail through some dark night of the stock market’s soul.

But then — what is the investment committee to do?  As Cliff Asness points out, these groups often review 3-to-5 year track records to size up the cut of a manager’s jib.  As Cliff might say, this is not only wrong, it’s backwards.  If anything, after 3-to-5 years, however dubious a strategy the manager has been following, it is likely to regress to the mean.  The mighty will be brought low; the meek will inherit the earth.  This is why investment consultants notoriously destroy value to the tune of about 1% a year (or maybe they’re just unlucky?).

Why?  Why?

Why, then, do I go through the expense and bother of benchmarking?

Back in the day, I used to get brokerage statements with zero mention of benchmark performance./>/>

As time passed, I started to get statements using a bogus index, like a Dow Jones Industrial Average that didn’t include reinvested dividends.  Then, this turned into too much information: I received statements with a dozen indexes cited: S&P 500, MSCI EFAE Index, Barclay’s Bond Aggregate, the LIBOR rate, all over the map of Benchmarkistan — only with no way of weighting or relating these to the performance of my account.  They might as well have sent me a copy of the Wall Street Journal.

Surprise: all these were bald attempts to obfuscate poor (expensive) performance.  I knew I didn’t want to be like these guys.  My hope is that if clients know all the data is available, that paradoxically they wouldn’t worry too much about it or obsess over every last detail.  Because in the end, I suspect that the system I set up is more of a distraction than an aid.

The alternative?

What is the investor to do?

1) Be the benchmark.  Simply index everything and forget the rest.  We still need to choose the right index funds and allocate our money among them.  These choices will be highly consequential, for good or evil.  When markets are down, if we have chosen wisely, we can console ourselves with the sentiment that most other investors are doing worse.

2) Invest by strategy.  Some strategies have demonstrated long-term historical and cross-validated outperformance.  They are underpinned by economic intuition, perhaps paying a premium for our assuming an economic risk or psychological discomfort.  Value investing strategizes that buying companies when they are beaten down or cheap by conventional metrics leads to better long-term returns than buying companies that are expensive and glamorous.  This doesn’t work every day or quarter or year or every five years, but over the long term we expect it to work out in our favor.  As with indexing, price matters and execution matters.  When markets are down, we console ourselves with the thought that in the long run we have a good chance to beat the index.

If we invest by strategy, it behooves us to understand what we are doing well enough to ride out the meaningful differences between our returns and the market benchmarks.  In practice, we will only care when we underperform, but that will also be the most expensive time to change course.  Whether we decide to become the benchmark or follow some strategy, comparing our performance to a benchmark is irrelevant or, at worst, potentially dangerous.  If we have trailed the market by several percentage points a year for the past few years, does this mean our well-considered strategy should now be abandoned?  No, that would b e a mistake.  Our time would be better spent understanding our strategies and focusing on certainties like expenses, taxes, and its overall suitability to our purposes.  But that takes work.

 
Update
2

7 weeks ago

Khazanah throws MAS RM6b lifeline

Aug 29 2014 5:01pm CDT | Source: Business Times Singapore

August 30, 2014 1:15 AMKHAZANAH Nasional will inject RM6 billion (SS$2.4 billion) over three years to resuscitate loss-making Malaysia Airlines (MAS) under a recovery plan that includes even an Act of Parliament. Other key moves are migrating its operations, assets and liabilities to a new company (NewCo) and slashing the workforce of 20,000 ...
Source: Business Times Singapore   Full article at: Business Times Singapore
 

 
Update
1

7 weeks ago

MAS posts loss of RM307m for Q2

Aug 28 2014 5:00pm CDT | Source: Business Times Singapore

August 29, 2014 1:13 AMMALAYSIA Airlines (MAS) registered a loss of RM307 million (S$122 million) for the second quarter to end-June, but warned of worse to come in the second half when the "full financial impact of the double tragedies ...
Source: Business Times Singapore   Full article at: Business Times Singapore
 

 

Don't miss ...

 

<a href="/latest_stories/all/all/30" rel="author">Forbes</a>
Forbes is among the most trusted resources for the world's business and investment leaders, providing them the uncompromising commentary, concise analysis, relevant tools and real-time reporting they need to succeed at work, profit from investing and have fun with the rewards of winning.

 

blog comments powered by Disqus

Latest stories

Paralysed man walks again after pioneering cell therapy
London, Oct 21 (IANS/EFE) A paralysed man has been able to walk again after therapy that involved transplanting cells from his nasal cavity into his spinal cord, the BBC reported Tuesday.
 
 
Non-smokers face major health risks in smoking homes
London, Oct 21 (IANS) Living with smokers is as bad as living in smoke-free homes in heavily polluted cities such as Beijing or London, researchers said.
 
 
Finally Nepal, India sign power trade agreement
Kathmandu, Oct 21 (IANS) Nepal and India here Tuesday formally signed a landmark power trade agreement (PTA), allowing exchange of electricity, which is expected to open up new vistas of cooperation in the hydropower sector between the two energy-starved nations.
 
 
Depressed people, too, believe in brighter future
Toronto, Oct 21 (IANS) Like most adults, even depressed people believe in a brighter future, but for them this optimistic belief may not lead to better outcomes, found a research.
 
 
 

Latest from the Network

1,074 new dengue cases in Chinese province
Beijing, Oct 18 (IANS) China's Guangdong province has reported 1,047 new cases of dengue fever, health authorities said Saturday. Six people have already died in Guangdong -- five in Guangzhou and one in adjacent...
Read more on Business Balla
 
Blake Lively 'always' wanted to be mum
Blake Lively has ''always'' wanted to be a mother. The 27-year-old actress is expecting her first child with husband Ryan Reynolds and she admits she's been dreaming of this moment since she was a youngster. Speaking...
Read more on Celebrity Balla
 
Kris Jenner 'torn apart' by Bruce's new relationship
Kris Jenner feels ''torn apart and angry'' that Bruce Jenner is dating her former assistant. The 58-year-old matriarch split from the 64-year-old Olympic gold medalist last October following 22-years of marriage but is...
Read more on Celebrity Balla
 
Cheryl Fernandez-Versini won't move to France
Cheryl Fernandez-Versini doesn't want to move to her husband's home country of France. The 'X Factor' judge, 31, who comes from Newcastle, is adamant she won't be relocating any time soon to suit her new spouse Jean-...
Read more on Celebrity Balla
 
Lance Bass sets wedding date
Lance Bass has set a date for his wedding. The former *NSYNC singer and his partner Michael Turchin, who have been dating for two-and-a-half years, are to tie the knot on December 20, 2014, a representative for the...
Read more on Celebrity Balla
 
Nepal avalanche toll reaches 39
Kathmandu, Oct 18 (IANS) At least 39 climbers died while hiking on a key Nepali route after it was hit by a major snowstorm and avalanches earlier this week, BBC reported Saturday citing officials. Over 350 stranded...
Read more on Politics Balla
 
Jake Gyllenhaal says society is complicit in 'nightcrawling'
Jake Gyllenhaal says almost everybody in society ought to relate to his new movie 'Nightcrawlers'. The eagerly-awaited film concerns those people who monitor police scanners and then race to crime scenes to film eye-...
Read more on Movie Balla
 
India eves look for first win in AFC U-16 qualifiers
Dhaka, Oct 18 (IANS) India will hope to register their first win of the 2015 Asian Football Confederation (AFC) Under-16 Women's Championship qualifiers when they take on hosts Bangladesh in a crucial encounter at the...
Read more on Sport Balla
 
Moyes mulling return to management
London, Oct 18 (IANS) Former Manchester United manager David Moyes said that he is ready to revive his managerial career six months after being sacked by the 'Red Devils'. "I am ready to return. I have enjoyed the...
Read more on Sport Balla
 
Ebola fears loom over Ghana hosting AFCON
Accra (Ghana), Oct 18 (IANS) The Ghana Medical Association (GMA) cautioned the government Saturday against hosting the 2015 African Cup of Nations (AFCON), despite a request by the Confederation of African Football (...
Read more on Sport Balla