To manage well, we need to know where we are, where we would like to be, and what we need to do to get there. Measurement can help us achieve our goals, by telling us where we are and how much progress we're making. But some things aren't measurable, and some measurement methods yield misleading results. How can we use measurement effectively?
any organizations measure attributes of populations and processes in the hope of guiding the organization towards stated goals. But some of these measurements yield misleading data, for a variety of reasons. For instance, we sometimes use surveys that require respondents to supply their subjective judgments.
The Palermo Stone, as it was before it was fragmented. It's probably the earliest historical text from ancient Egypt, recording, among other things, measurements of the Nile flood over a five-year period. Photo courtesy Museo Archeologico Regionale, Palermo.
An example of subjective judgment: "Rate your subordinate's ability to work with others on a scale from 1 to 5." Such attributes cannot actually be measured. If you try to measure them, by means of, say, surveys — even anonymous surveys — you actually measure the rating that people enter on the form. That rating might or might not reflect what you think you're measuring.
Some measurements do work. Here are some properties of useful measurements.
Actionable
The organization must have in mind some adjustment of operations that it would make in response to the results. If you don't use the results of the measurement, why are you measuring it at all?
Boolean, numeric, or member of a defined list
The answer to the question "What is the observed value of this metric?" must be true or false; a number; or an element of a defined list. For instance, did we complete the project on time? If we were late, how late were we?
Objective
Determining the observed value of the measurement shouldn't involve subjective judgment. For example, the number of malware incidents per month, or the number of timecard hours or hours "badged in" per employee per month.
Untraceable
The people who provide the data, or whose activities the data describes, should be confident that the data they enter cannot be traced to them personally. This enhances (but does not ensure) the honesty of submissions, especially when the submitted data conveys bad news.
Out of awareness
If you don't use the results of the measurement, why are you measuring it at all?The people whose activity is being measured should be unaware that a measurement is taking place. This limits the impact of the so-called Hawthorne Effect. See "Getting Around Hawthorne," Point Lookout for October 2, 2002, for more.
Measured
The measurement process itself should be measured, to determine its quality. Measures that are helpful include traceability checks, the probability of the data actually being used, and multiple data collections to evaluate precision.
Fraud resistant
Sometimes people attempt to achieve desired measurement results by means of fraud. They conceal, misrepresent, spin, or do whatever is necessary to get the results they want or the results they believe the measurer wants. Plan enforcement actions in advance of the data collection, and establish organizational policy regarding measurement fraud.
How many of the measurements you now make meet these criteria? Most important, how many measurements do you actually use? If you eliminate those you never use, you might find resources that you can use to improve the rest. TopNext Issue
Are your projects always (or almost always) late and over budget? Are your project teams plagued by turnover, burnout, and high defect rates? Turn your culture around. Read 52 Tips for Leaders of Project-Oriented Organizations, filled with tips and techniques for organizational leaders. Order Now!
You probably commute to work. On a good day, you spend anywhere from ten minutes to an hour or two — each way — commuting. What kind of experience are you having? Taking control of this part of your life can make a real difference.
When an important item remains on our To-Do list for a long time, it's possible that we've found ways to avoid facing it. Some of the ways we do this are so clever that we may be unaware of them. Here's a collection of techniques we use to avoid engaging difficult problems.
Not long ago, Mastodons roamed North America in large numbers. Cousins to the elephant, they thrived in the cool, sub-glacial climate. But the climate warmed, and human hunters arrived. The Mastodon couldn't adapt, and now it's extinct. Change is now coming to your profession. Can you adapt?
When the phone rings, do you drop whatever you're doing to answer it? Do you interrupt face-to-face conversations with live people to respond to the jerk of your cellular leash? Listen to seemingly endless queues of voicemail messages? Here are some reminders of the choices we sometimes forget we have.
Here's part two of a list of films and videos about project teams that weren't necessarily meant to be about project teams. Most are available to borrow from the public library, and all are great fun.
I offer email and telephone coaching at both corporate and individual rates.
Contact me for details at rbrenner@ChacoCanyon.com
or (617) 491-6289, or toll-free in the continental US at (866) 378-5470.
Get the e-book!
Past issues of Point Lookout are available in four e-books:
Are you a writer, editor or publisher on deadline?
Are you looking for an article that will get people talking and get compliments flying your way? You can have 500 words in your inbox in one hour. License any article from this Web site. More info
Public seminars
Managing Virtual Teams for Real Results
Managing global or dispersed teams is challenging — miscommunications, misunderstandings, and interpersonal conflict all thrive in the typical environment of the distributed team. And they're even more common in global teams, because of time-zone offsets and language and cultural differences. We'll inventory the challenges distributed and global teams face, and provide tools for anticipating and addressing them. The focus of this program is practical — attendees will learn concrete techniques for preventing and dealing with the problems that accompany global and distributed teams. Read more about this program. Here are some upcoming dates for this program:
Organizational Politics for People Who Hate Politics
Have you ever felt powerless to implement an important new idea? Have you ever been "blind-sided" at a meeting? Have you ever lost two good employees because you could find no way to keep them from attacking each other? These are some of the issues of organizational politics. Many of us have become enmeshed in them from time to time, but we've also known some people who seem to be able to engage and prosper. How is that done? We'll inventory the challenges of organizational politics, and provide tools for anticipating and addressing them. The focus of this program is practical — attendees learn concrete techniques for dealing with the problems that arise in workplace politics, while keeping their integrity intact. Read more about this program. Here are some upcoming dates for this program:
What do you do when your team can't make critical decisions? Or worse, when they make a decision, what do you do when they open it up again next week? Making good decisions and facilitating group decisions are both critical skills for project managers. In this revealing and interactive program, I demonstrate a model of decision-making that captures the internal conflicts we all feel when we make difficult decisions. With a better understanding of how we resolve conflicting priorities, we not only become more skilled at making decisions, but we learn how to make decisions that "stick." Read more about this program. Here's an upcoming date for this program:
The Politics of Meetings for People Who Hate Politics
There's a lot more to running an effective meeting than having the right room, the right equipment, and the right people. With meetings, the whole really is more than the sum of its parts. How the parts interact with each other and with external elements is as important as the parts themselves. And those interactions are the essence of politics for meetings. This program explores techniques for leading meetings that are based on understanding political interactions, and using that knowledge effectively to meet organizational goals. Read more about this program. Here's an upcoming date for this program:
Person-to-Person Communication for Project Managers
When we talk, listen, send or read emails, read or write memos, or when we leave or listen to voice mail messages, we're communicating person-to-person. And whenever we communicate person-to-person, we risk being misunderstood, offending others, feeling hurt, and being confused. There are so many ways for things to go wrong that we could never learn how to fix all the problems. A more effective approach avoids problems altogether, or at least minimizes their occurrence. In this very interactive program you'll learn a model of inter-personal communications that can help you stay out of the ditch. In those moments of intense involvement, when we're most likely to slip, you'll have a new tool to use to keep things constructive. Read more about this program. Here are some upcoming dates for this program:
Ever wonder if there isn't a better way to travel? Travel is essential, but the hassles of travel aren't. Read 202 Tips for Business Travel to learn how to convert business travel from a time-wasting hassle to a breeze. Revised and updated for 2008 with 101 new tips! Check it out!
Are you doing work you love? Are you less in love with the job? Bad boss, long commute, troubling ethical questions, hateful colleague? Read Go For It! Sometimes It's Easier If You Run to learn what we can do when we love the work but not the job. It helps you get moving again!
The key to managing virtual or global teams is creating a sense of team despite the obstacles of separation. Read my tips booklet, 303 Tips for Virtual and Global Teams, to learn how to make your virtual global team sing. Newly revised and updated for 2008 with 101 new tips! Check it out!
Are you managing a change effort that faces rampant cynicism, passive non-cooperation, or maybe even outright revolt? Read 101 Tips for Managing Change to learn how to plan and execute your change efforts to inspire real, passionate support. Check it out!
A Tip a Day arrives by email each business day. It's 20 to 30 words at most, and gives you a new perspective on the hassles and rewards of work life. Most tips also contain links to related articles. Free!
Do you ever wonder if all these meetings are really necessary? (They aren't) Or whether there isn't some better way to get this work done? (There is) Read 101 Tips for Effective Meetings to learn how to make meetings more productive — and more rare. Check it out!
Exchange your "personal trade secrets" — the tips, tricks and techniques that make you an ace — with other aces, anonymously. Visit the Library of Personal Trade Secrets.
any organizations measure attributes of populations and processes in the hope of guiding the organization towards stated goals. But some of these measurements yield misleading data, for a variety of reasons. For instance, we sometimes use surveys that require respondents to supply their subjective judgments.
Top 
Next IssueAre your projects always (or almost always) late and over budget? Are your project teams plagued by turnover, burnout, and high defect rates? Turn your culture around. Read 52 Tips for Leaders of Project-Oriented Organizations, filled with tips and techniques for organizational leaders. Order Now!
Enjoy Your Commute
How We Avoid Making Decisions
Learn from the Mastodon
At the Sound of the Tone, Hang Up
Films Not About Project Teams: Part II
Download to
Ever wonder if there isn't a better way to travel? Travel is essential, but the hassles of travel aren't. Read 202 Tips for Business Travel to learn how to convert business travel from a time-wasting hassle to a breeze. Revised and updated for 2008 with 101 new tips! Check it out!
add value to your Web sites quickly and easily. Pick up the HTML to link to this article in a choice of formats.
Are you doing work you love? Are you less in love with the job? Bad boss, long commute, troubling ethical questions, hateful colleague? Read Go For It! Sometimes It's Easier If You Run to learn what we can do when we love the work but not the job. It helps you get moving again!
The key to managing virtual or global teams is creating a sense of team despite the obstacles of separation. Read my tips booklet, 303 Tips for Virtual and Global Teams, to learn how to make your virtual global team sing. Newly revised and updated for 2008 with 101 new tips! Check it out!
Are you managing a change effort that faces rampant cynicism, passive non-cooperation, or maybe even outright revolt? Read 101 Tips for Managing Change to learn how to plan and execute your change efforts to inspire real, passionate support. Check it out!
A Tip a Day arrives by email each business day. It's 20 to 30 words at most, and gives you a new perspective on the hassles and rewards of work life. Most tips also contain links to related articles. Free!
Do you ever wonder if all these meetings are really necessary? (They aren't) Or whether there isn't some better way to get this work done? (There is) Read 101 Tips for Effective Meetings to learn how to make meetings more productive — and more rare. Check it out!
