Point Lookout: a free weekly publication of Chaco Canyon Consulting
Volume 19, Issue 39;   September 25, 2019: Planning Disappointments

Planning Disappointments

by

When we plan projects, we make estimates of total costs and expected delivery dates. Often these estimates are so wrong — in the wrong direction — that we might as well be planning disappointments. Why is this?
The Leonard P. Zakim Bunker Hill Bridge

One of the many problems contributing to cost overruns in the highway project known as Boston's "Big Dig" was a sequence of delays in determining the design of the Charles River Crossing. Once this decision-making overran its schedule, very serious problems developed later in the project, in both management and engineering and construction. As in the private sector, the early focus of scrutiny has been on the engineering and construction rather than on management, in part because we measure them more carefully. Pictured is the Leonard P. Zakim Bunker Hill Bridge in a later construction phase, as it emerges from the Thomas P. "Tip" O'Neill Jr. Tunnel to cross the Charles River. This particular crossing is very near the one referred to as "two if by sea," in the poem, "The Midnight Ride of Paul Revere," by Longfellow (1860). Photo courtesy Massachusetts Turnpike Authority.

When people estimate how long a piece of work will take — or how much it will cost — their estimates are fairly reliable if they've done lots of similar work before. But if the work is unfamiliar, or if there are significant unknowns associated with the work, estimates of cost and schedule tend to be far less accurate, even when all we asked for was a "rough estimate." And the inaccuracies are almost always of a certain kind: final costs tend to exceed estimates, and deliveries are often late.

Why does this happen?

Last time, I explored three important contributors to this pattern — the planning fallacy, self-serving bias, and organizational politics. But in addition to these sources of systematic errors, there are two conceptual errors that are a bit mathematical in nature. One is a general misunderstanding of the term "rough estimate," and the second is a misconception about the shape of probability distributions of costs and schedules for unfamiliar projects.

Misunderstanding the term "rough estimate"
Rough estimates can be useful if we understand the true meaning of "rough." Technically, a rough estimate is an estimate that has a relatively wide margin of error. Every estimated value has a band of values that corresponds to, say, 95% confidence, and a mean or average that corresponds to a point within that band. If the width of the 95% confidence band is W, and the mean is M, then there is a ratio R equal to W/M. The "rougher" the estimate is, the greater is R.
To be safe, users of rough estimates need to use the value at the top end of the band for estimated values in which larger is worse, or the value at the low end of the band for estimated values in which smaller is worse. Too often, people just use M. They can be forgiven, of course, when the estimator provides M alone, without reference to a 95% confidence band.
There are clear reasons for this. In my experience, many consumers of estimates — the decision-makers, as they're often called — are uncomfortable with any estimate that includes an uncertainty band. I've actually heard reports about decision-makers' responses to estimates of the form, say, 8.7 million +/- 1.5 million, that go like this: "Don't give me this +/- stuff! If you don't know how much it will cost, just admit it! Now give me an estimate! Exactly what will this cost?"
In fairness, Rough estimates can be useful
if we understand the true
meaning of "rough"
many estimators lack sufficient information needed to compute a 95% confidence band. Others aren't sure how to calculate it. Others are intimidated by decision-makers who reject the "+/- stuff," and still others aren't intimidated, but just don't want to fight with resistant decision-makers. Whatever the case, estimates without 95% confidence bands are common, and because the estimates lack these bands, overruns are defined as "less favorable than the so-called estimate," which makes overruns very likely.
The shape of probability distributions of costs and schedules
Another source of estimation error is our human intuition about the shape of the probability distributions of costs and schedules. We tend to think of these distributions as fairly symmetrical around some average, or mean. And we also like to believe that the mean of, say, the cost distribution, is fairly close to the most likely value of that distribution.
We base this intuition on our experience with familiar efforts. And as it happens, for familiar efforts, our experience is a useful guide. That is, the distribution of cost or schedule outcomes for familiar efforts is fairly symmetric around some average value.
But for unfamiliar efforts, our intuition is misleading — sometimes grossly misleading. And this comes about for reasons that are easy to understand intellectually, but difficult to incorporate into our intuition.
With unfamiliar efforts, or efforts that are subject to significant unknowns, the probability distributions for costs and schedules aren't symmetric about their means. In fact, they're wildly asymmetric. While there are some pretty hard limits on how quickly or cheaply things can happen, there are no analogous limits on how slowly or expensively things can happen. For example, no matter how hard you try, you probably cannot get to the conference room in the other building in less than 45 seconds — even if you run. But without trying to dawdle, it can sometimes take you 20 minutes to get there, even though it's only a five-minute walk, depending on the weather, who you run into on the way over, and whether or not you have to go back to pick up something you forgot.
For unfamiliar projects, or projects subject to significant unknowns, the probability distributions for costs and schedules tend to have long "tails" corresponding to unanticipated costs and delays. These tails cause the distributions to have average values that can be much greater than their most likely values. And that's what throws off our intuitions. When we estimate, we tend to estimate the most likely value. And when the average value is much greater than the most likely value, our estimates tend to fall crazily short. The situation is even worse when we stack one task or project after another in a long train, because the uncertainty bands stack up.

Next time you make or receive an estimate without a 95% confidence band, ask yourself, "What are the lowest and highest values that wouldn't shock me totally senseless beyond all reason?" That should give you some idea of what 95% confidence means. Go to top Top  Next issue: Start Anywhere  Next Issue

How to Spot a Troubled Project Before the Trouble StartsProjects never go quite as planned. We expect that, but we don't expect disaster. How can we get better at spotting disaster when there's still time to prevent it? How to Spot a Troubled Project Before the Trouble Starts is filled with tips for executives, senior managers, managers of project managers, and sponsors of projects in project-oriented organizations. It helps readers learn the subtle cues that indicate that a project is at risk for wreckage in time to do something about it. It's an ebook, but it's about 15% larger than "Who Moved My Cheese?" Just . Order Now! .

Your comments are welcome

Would you like to see your comments posted here? rbrenmhXARWRMUvVyOdHlner@ChacxgDmtwOKrxnripPCoCanyon.comSend me your comments by email, or by Web form.

About Point Lookout

Thank you for reading this article. I hope you enjoyed it and found it useful, and that you'll consider recommending it to a friend.

Point Lookout is a free weekly email newsletter. Browse the archive of past issues. Subscribe for free.

Support Point Lookout by joining the Friends of Point Lookout, as an individual or as an organization.

Do you face a complex interpersonal situation? Send it in, anonymously if you like, and I'll give you my two cents.

Related articles

More articles on Project Management:

FootprintsStatus Risk and Risk Status
One often-neglected project risk is the risk of inaccurately reported status. That shouldn't be surprising, because we often fail to report the status of the project's risks, as well. What can we do to better manage status risk and risk status?
The Marx brothers: Chico, Harpo, Groucho and ZeppoTINOs: Teams in Name Only
Perhaps the most significant difference between face-to-face teams and virtual or distributed teams is their potential to develop from workgroups into true teams — an area in which virtual or distributed teams are at a decided disadvantage. Often, virtual and distributed teams are teams in name only.
Illustrating the concept of local maximumFalse Summits: II
When climbers encounter "false summits," hope of an early end to the climb comes to an end. The psychological effects can threaten the morale and even the safety of the climbing party. So it is in project work.
The U.S. F-35 Lightning II joint strike fighter lifts off for its first training sortie March 6, 2012, at Eglin Air Force Base, FloridaWishful Thinking and Perception: II
Continuing our exploration of causes of wishful thinking and what we can do about it, here's Part II of a little catalog of ways our preferences and wishes affect our perceptions.
Firefighter lighting grass using a drip torchHow to Get Out of Firefighting Mode: I
When new problems pop up one after the other, we describe our response as "firefighting." We move from fire to fire, putting out flames. How can we end the madness?

See also Project Management and Personal, Team, and Organizational Effectiveness for more related articles.

Forthcoming issues of Point Lookout

The Bay of Pigs, CubaComing September 30: Seven More Planning Pitfalls: II
Planning teams, like all teams, are susceptible to several patterns of interaction that can lead to counter-productive results. Three of these most relevant to planners are False Consensus, Groupthink, and Shared Information Bias. Available here and by RSS on September 30.
Assembling an IKEA chairAnd on October 7: Seven More Planning Pitfalls: III
Planning teams, like all teams, are vulnerable to several patterns of interaction that can lead to counter-productive results. Two of these relevant to planners are a cognitive bias called the IKEA Effect, and a systemic bias against realistic estimates of cost and schedule. Available here and by RSS on October 7.

Coaching services

I offer email and telephone coaching at both corporate and individual rates. Contact Rick for details at rbrenmhXARWRMUvVyOdHlner@ChacxgDmtwOKrxnripPCoCanyon.com or (650) 787-6475, or toll-free in the continental US at (866) 378-5470.

Get the ebook!

Past issues of Point Lookout are available in six ebooks:

Reprinting this article

Are you a writer, editor or publisher on deadline? Are you looking for an article that will get people talking and get compliments flying your way? You can have 500 words in your inbox in one hour. License any article from this Web site. More info

Public seminars

The Power Affect: How We Express Our Personal Power

Many The Power Affect: How We Express Personal Powerpeople who possess real organizational power have a characteristic demeanor. It's the way they project their presence. I call this the power affect. Some people — call them power pretenders — adopt the power affect well before they attain significant organizational power. Unfortunately for their colleagues, and for their organizations, power pretenders can attain organizational power out of proportion to their merit or abilities. Understanding the power affect is therefore important for anyone who aims to attain power, or anyone who works with power pretenders. Read more about this program.

Bullet Points: Mastery or Madness?

DecisBullet Point Madnession-makers in modern organizations commonly demand briefings in the form of bullet points or a series of series of bullet points. But this form of presentation has limited value for complex decisions. We need something more. We actually need to think. Briefers who combine the bullet-point format with a variety of persuasion techniques can mislead decision-makers, guiding them into making poor decisions. Read more about this program.

Follow Rick

Send email or subscribe to one of my newsletters Follow me at LinkedIn Follow me at Twitter, or share a tweet Subscribe to RSS feeds Subscribe to RSS feeds
The message of Point Lookout is unique. Help get the message out. Please donate to help keep Point Lookout available for free to everyone.
Technical Debt for Policymakers BlogMy blog, Technical Debt for Policymakers, offers resources, insights, and conversations of interest to policymakers who are concerned with managing technical debt within their organizations. Get the millstone of technical debt off the neck of your organization!
Go For It: Sometimes It's Easier If You RunBad boss, long commute, troubling ethical questions, hateful colleague? Learn what we can do when we love the work but not the job.
303 Tips for Virtual and Global TeamsLearn how to make your virtual global team sing.
101 Tips for Managing ChangeAre you managing a change effort that faces rampant cynicism, passive non-cooperation, or maybe even outright revolt?
101 Tips for Effective MeetingsLearn how to make meetings more productive — and more rare.
Exchange your "personal trade secrets" — the tips, tricks and techniques that make you an ace — with other aces, anonymously. Visit the Library of Personal Trade Secrets.
If your teams don't yet consistently achieve state-of-the-art teamwork, check out this catalog. Help is just a few clicks/taps away!
Ebooks, booklets and tip books on project management, conflict, writing email, effective meetings and more.