Although many believe that "You get what you measure," metrics-based management systems sometimes produce disappointing results. In this Part II, we look at the effects of employee behavior.
etrics-based management holds that "You get what you measure," but the assertion is actually even stronger. Many also believe that if you aren't measuring it, you won't get it. That's why it's reasonable to investigate possible causes of disappointing performance of metrics-based management. Here's part two of a collection of reasons why metrics-based management systems can disappoint. This part emphasizes employee behavior. See Part I and Part III, for more.
The Western Electric Plant at Hawthorne, Illinois. This plant was the site of a series of experiments that purportedly demonstrated observer effects, in which the act of observation affects the system being observed. The Hawthorne experiments remain controversial, but subsequent evidence of the importance of observer effects in general is more widely accepted. Photo courtesy The Eastland Memorial Society.
People aren't bolts of cloth
When we measure a length of cloth, the cloth hardly ever tries to influence the result. But employees, consciously or not, do try to make measurements "come out right." For instance, if employees fear the consequences of departing from management's expectations, they're more likely to provide data that's consistent with their estimate of management expectations.
But this effect can be even more confounding. Employees sometimes guess wrong about what management is measuring. Their biased reports then "spin" the data in a direction consistent with their interpretations of what management is measuring, rather than spinning it with respect to what management is actually measuring. Thus, even if we figure out how to correct for "spin," we might not be correcting for the right spin.
People and organizations adapt
When we measure a length of cloth, the cloth hardly ever tries to influence the result
Whether or not you believe that measurement works, it works best at first, because repeated measurements of the same attributes have decreasing impact. Soon, the measurement becomes routine, and employees adapt their actions and responses to enable a more comfortable, familiar stance.
For instance, when we first start tracking "show-stopper defects," we find people working hard to fix them. But after a few cycles, people develop ways of reclassifying defects to appear less severe, or they create escape clauses, or the organization develops an "appeal procedure" for obtaining waivers. The effect of the metric soon diminishes, often after a surprisingly short useful life.
Measurements of different attributes can interact
When people notice that we're measuring two different attributes, they might try to make them both "come out right," and this sometimes leads them to contradictions. For instance, to achieve long-term goals, we might have to take actions that jeopardize short-term goals, or vice versa. Thus, the act of measuring one attribute can affect the measurement of another.
Moreover, it isn't necessary that we actually make two measurements. All that's required for contamination of the data is a belief among some employees that measurement of a second attribute might take place. Perhaps we measured it in the past, or perhaps other organizations measure it, or the "literature" suggests measuring it. Even if you announce that it won't be measured, there are those who will remain skeptical, and who assume that it will happen, "just to be safe."
Just as employees make choices that can reduce the effectiveness of measurements, so can management. We'll examine that issue in a future issue. TopNext Issue
Are your projects always (or almost always) late and over budget? Are your project teams plagued by turnover, burnout, and high defect rates? Turn your culture around. Read 52 Tips for Leaders of Project-Oriented Organizations, filled with tips and techniques for organizational leaders. Order Now!
If your boss is a micromanager, your life can be a seemingly endless misery of humiliation and frustration. Changing your boss is one possible solution, but it's unlikely to succeed. What you can do is change the way you experience the micromanagement.
Not long ago, Mastodons roamed North America in large numbers. Cousins to the elephant, they thrived in the cool, sub-glacial climate. But the climate warmed, and human hunters arrived. The Mastodon couldn't adapt, and now it's extinct. Change is now coming to your profession. Can you adapt?
If you like to browse in bookstores, you probably know the thrill of new ideas and new perspectives. When I find a book worth reading, I want to own it, and that's how it gets to my shelf. Here are some tips to help you read more of what you really want to read.
When we notice similarities between events, or possible patterns of events, we often attribute meaning to them beyond what we can prove. Sometimes we guess right, and sometimes not. How can we improve our guesses?
Team-building is one of the most common forms of team "training." If only it were the most effective, we'd be in a lot better shape than we are. How can we get more out of the effort we spend building teams?
I offer email and telephone coaching at both corporate and individual rates.
Contact me for details at rbrenner@ChacoCanyon.com
or (617) 491-6289, or toll-free in the continental US at (866) 378-5470.
Get the e-book!
Past issues of Point Lookout are available in four e-books:
Are you a writer, editor or publisher on deadline?
Are you looking for an article that will get people talking and get compliments flying your way? You can have 500 words in your inbox in one hour. License any article from this Web site. More info
Public seminars
Managing Virtual Teams for Real Results
Managing global or dispersed teams is challenging — miscommunications, misunderstandings, and interpersonal conflict all thrive in the typical environment of the distributed team. And they're even more common in global teams, because of time-zone offsets and language and cultural differences. We'll inventory the challenges distributed and global teams face, and provide tools for anticipating and addressing them. The focus of this program is practical — attendees will learn concrete techniques for preventing and dealing with the problems that accompany global and distributed teams. Read more about this program. Here are some upcoming dates for this program:
Organizational Politics for People Who Hate Politics
Have you ever felt powerless to implement an important new idea? Have you ever been "blind-sided" at a meeting? Have you ever lost two good employees because you could find no way to keep them from attacking each other? These are some of the issues of organizational politics. Many of us have become enmeshed in them from time to time, but we've also known some people who seem to be able to engage and prosper. How is that done? We'll inventory the challenges of organizational politics, and provide tools for anticipating and addressing them. The focus of this program is practical — attendees learn concrete techniques for dealing with the problems that arise in workplace politics, while keeping their integrity intact. Read more about this program. Here are some upcoming dates for this program:
What do you do when your team can't make critical decisions? Or worse, when they make a decision, what do you do when they open it up again next week? Making good decisions and facilitating group decisions are both critical skills for project managers. In this revealing and interactive program, I demonstrate a model of decision-making that captures the internal conflicts we all feel when we make difficult decisions. With a better understanding of how we resolve conflicting priorities, we not only become more skilled at making decisions, but we learn how to make decisions that "stick." Read more about this program. Here's an upcoming date for this program:
The Politics of Meetings for People Who Hate Politics
There's a lot more to running an effective meeting than having the right room, the right equipment, and the right people. With meetings, the whole really is more than the sum of its parts. How the parts interact with each other and with external elements is as important as the parts themselves. And those interactions are the essence of politics for meetings. This program explores techniques for leading meetings that are based on understanding political interactions, and using that knowledge effectively to meet organizational goals. Read more about this program. Here's an upcoming date for this program:
Person-to-Person Communication for Project Managers
When we talk, listen, send or read emails, read or write memos, or when we leave or listen to voice mail messages, we're communicating person-to-person. And whenever we communicate person-to-person, we risk being misunderstood, offending others, feeling hurt, and being confused. There are so many ways for things to go wrong that we could never learn how to fix all the problems. A more effective approach avoids problems altogether, or at least minimizes their occurrence. In this very interactive program you'll learn a model of inter-personal communications that can help you stay out of the ditch. In those moments of intense involvement, when we're most likely to slip, you'll have a new tool to use to keep things constructive. Read more about this program. Here are some upcoming dates for this program:
Ever wonder if there isn't a better way to travel? Travel is essential, but the hassles of travel aren't. Read 202 Tips for Business Travel to learn how to convert business travel from a time-wasting hassle to a breeze. Revised and updated for 2008 with 101 new tips! Check it out!
Are you doing work you love? Are you less in love with the job? Bad boss, long commute, troubling ethical questions, hateful colleague? Read Go For It! Sometimes It's Easier If You Run to learn what we can do when we love the work but not the job. It helps you get moving again!
The key to managing virtual or global teams is creating a sense of team despite the obstacles of separation. Read my tips booklet, 303 Tips for Virtual and Global Teams, to learn how to make your virtual global team sing. Newly revised and updated for 2008 with 101 new tips! Check it out!
Are you managing a change effort that faces rampant cynicism, passive non-cooperation, or maybe even outright revolt? Read 101 Tips for Managing Change to learn how to plan and execute your change efforts to inspire real, passionate support. Check it out!
A Tip a Day arrives by email each business day. It's 20 to 30 words at most, and gives you a new perspective on the hassles and rewards of work life. Most tips also contain links to related articles. Free!
Do you ever wonder if all these meetings are really necessary? (They aren't) Or whether there isn't some better way to get this work done? (There is) Read 101 Tips for Effective Meetings to learn how to make meetings more productive — and more rare. Check it out!
Exchange your "personal trade secrets" — the tips, tricks and techniques that make you an ace — with other aces, anonymously. Visit the Library of Personal Trade Secrets.
etrics-based management holds that "You get what you measure," but the assertion is actually even stronger. Many also believe that if you aren't measuring it, you won't get it. That's why it's reasonable to investigate possible causes of disappointing performance of metrics-based management. Here's part two of a collection of reasons why metrics-based management systems can disappoint. This part emphasizes employee behavior. See Part I and Part III, for more.
Top 
Next IssueAre your projects always (or almost always) late and over budget? Are your project teams plagued by turnover, burnout, and high defect rates? Turn your culture around. Read 52 Tips for Leaders of Project-Oriented Organizations, filled with tips and techniques for organizational leaders. Order Now!
When Your Boss Is a Micromanager
Learn from the Mastodon
Smart Bookshelves
Coincidences Do Happen
Team-Building Travails
Download to
Ever wonder if there isn't a better way to travel? Travel is essential, but the hassles of travel aren't. Read 202 Tips for Business Travel to learn how to convert business travel from a time-wasting hassle to a breeze. Revised and updated for 2008 with 101 new tips! Check it out!
add value to your Web sites quickly and easily. Pick up the HTML to link to this article in a choice of formats.
Are you doing work you love? Are you less in love with the job? Bad boss, long commute, troubling ethical questions, hateful colleague? Read Go For It! Sometimes It's Easier If You Run to learn what we can do when we love the work but not the job. It helps you get moving again!
The key to managing virtual or global teams is creating a sense of team despite the obstacles of separation. Read my tips booklet, 303 Tips for Virtual and Global Teams, to learn how to make your virtual global team sing. Newly revised and updated for 2008 with 101 new tips! Check it out!
Are you managing a change effort that faces rampant cynicism, passive non-cooperation, or maybe even outright revolt? Read 101 Tips for Managing Change to learn how to plan and execute your change efforts to inspire real, passionate support. Check it out!
A Tip a Day arrives by email each business day. It's 20 to 30 words at most, and gives you a new perspective on the hassles and rewards of work life. Most tips also contain links to related articles. Free!
Do you ever wonder if all these meetings are really necessary? (They aren't) Or whether there isn't some better way to get this work done? (There is) Read 101 Tips for Effective Meetings to learn how to make meetings more productive — and more rare. Check it out!
