Defect Streams and Their Sources

In many kinds of knowledge work the quality of the output is important enough that we require the people who perform the work to meet specified quality standards. When they don't, we intervene to take corrective action. That corrective action often requires changes to the way the work is performed, with the hope that the changes will lead to improved output quality. Sometimes this approach works well. But at other times, even though the changes seemed to bring about the desired improvement at the pilot scale, the results of the full-scale intervention are disappointing.

This post explores a plausible explanation of disappointing results of some interventions intended to address defects in knowledge work. That explanation depends on a model of how defects arise based on the idea of defect streams and their sources.

For concreteness, consider the case of an organization engaged in deploying a software security platform. That platform will support a large number of applications that an even larger number of people use in the course of their daily work. To ensure that users can do their work in a secure environment, it's important that the deployment meet strict security criteria — for the platform itself and for each application.

Defect streams

The people performing the work are required to follow complex procedures to ensure that each software application can be used safely. Although the procedures are similar in large part, they differ in detail depending on the type of software being installed, and on the particular product and release of that product. If the person performing the work executes it incorrectly, the evidence of the error might not appear immediately. Often, the error is discovered by the Quality Assurance team, which reports the error in a weekly defect report. We can regard these errors as comprising a defect stream.

Defect sources

Streams Those who devise procedure changes
to reduce the incidence of defects
must provide the resources necessary
to adopt their recommendationshave sources. We usually assume that the sources of the errors lie somewhere within the organization that is executing the deployment. Although it's common to assert that the cause of the errors is shoddy work by the people who last touched the defective work product, their behavior might not actually be the root cause.

Three possible candidate root causes are below:

Unfunded mandated effort

Announcing a procedure or procedure change is an important step in taking corrective actions. But unless the people who execute the procedure have access to the resources and time required to learn a procedure, or to learn about the latest changes, they cannot afford to acquire the knowledge they need to execute the altered procedure correctly.

Those who design interventions intended to reduce the volume of the defect stream must provide the resources necessary to adopt the changes they are recommending. Absent those necessary resources, the people who execute the procedures in question will scrounge equivalent resources from someplace else. The result, often, is formation of new defect sources that feed the old defect streams, or which create new defect streams.

Misallocating the cost of procedure competence

The cost of procedure competence is the cost of training the people who execute the procedure, plus the cost of ensuring their continued competence after training is complete. We usually allocate that cost to the business unit in which those people perform their work. But in many cases, that allocation is erroneous. And it might even be the root cause of the defects.

For example, consider a cumbersome and overly complicated procedure. In an extreme case, the procedure can be so gratuitously complex that nobody can apply it correctly with regularity. Defects are inevitable. Should not the cost of these defects be charged to the poor design of the procedure? Said differently, should not the cost of the training required to prevent defects be charged to the poor design of the procedure?

That is, the cost of procedure competence ought not to be borne solely by the business units responsible for executing the procedure. Some of the costs might be due to procedure design. Allocating some costs to the unit responsible for the procedure design helps to ensure that procedures are designed with learning costs and execution costs in mind.

Frequent changes in procedures

Those who execute the procedures need to understand the procedures to avoid making errors. If changes are frequent, they need to monitor the status of procedures so that they'll be aware of changes that can affect their work. That monitoring activity competes with other responsibilities for their attention.

The cost of a procedure change should include more than the cost of designing the change. Training and retraining are real costs. The unit that makes the change must provide resources to the units that must execute the change.

Although these observations are expressed in terms of defects in work product, they apply equally to compliance with policies. To see how, consider policies to correspond to procedures in the discussion above, and deviations from policy to be defects.  Top    Next Issue

Projects never go quite as planned. We expect that, but we don't expect disaster. How can we get better at spotting disaster when there's still time to prevent it? How to Spot a Troubled Project Before the Trouble Starts is filled with tips for executives, senior managers, managers of project managers, and sponsors of projects in project-oriented organizations. It helps readers learn the subtle cues that indicate that a project is at risk for wreckage in time to do something about it. It's an ebook, but it's about 15% larger than "Who Moved My Cheese?" Just . Order Now! .

Your comments are welcome

About Point Lookout

Thank you for reading this article. I hope you enjoyed it and found it useful, and that you'll consider recommending it to a friend.

This article in its entirety was written by a human being. No machine intelligence was involved in any way.

Point Lookout is a free weekly email newsletter. Browse the archive of past issues. Subscribe for free.

Support Point Lookout by joining the Friends of Point Lookout, as an individual or as an organization.

Do you face a complex interpersonal situation? Send it in, anonymously if you like, and I'll give you my two cents.

Related articles

More articles on Project Management:

Are You Changing Tactics or Moving the Goal Posts?

When we make a mid-course correction in a project, we're usually responding to a newly uncovered difficulty that requires a change in tactics. Sometimes, we can't resist the temptation to change the goals of the project at the same time. And that can be a big mistake.

The True Costs of Cost-Cutting

The metaphor "trimming the fat" rests on the belief that some parts of the organization are expendable, and we can remove them with little impact on the remainder. Ah, if only things actually worked that way...

Planning Disappointments

When we plan projects, we make estimates of total costs and expected delivery dates. Often these estimates are so wrong — in the wrong direction — that we might as well be planning disappointments. Why is this?

Seven More Planning Pitfalls: I

Planners and members of planning teams are susceptible to patterns of thinking that lead to unworkable plans. But planning teams also suffer vulnerabilities. Two of these are Group Polarization and Trips to Abilene.

Anticipating Absence: Passings

In times more normal than ours, co-workers who pass on tend to do so one at a time. Disease or accidents rarely strike many co-workers in the same week, month, or year. There are exceptions — 9/11 was one such. This pandemic is another.

See also Project Management and Project Management for more related articles.

Forthcoming issues of Point Lookout

Coming April 2: Mitigating the Trauma of Being Laid Off

Trauma is an emotional response to horrible events — accidents, crimes, disasters, physical abuse, emotional abuse, gross injustices — and layoffs. Layoff trauma is real. Employers know how to execute layoffs with compassion, but some act out of cruelty. Know how to defend yourself. Available here and by RSS on April 2.

And on April 9: Defining Workplace Bullying

When we set out to control the incidence of workplace bullying, problem number one is defining bullying behavior. We know much more about bullying in children than we do about adult bullying, and more about adult bullying than we know about workplace bullying. Available here and by RSS on April 9.

Coaching services

I offer email and telephone coaching at both corporate and individual rates. Contact Rick for details at rbrentSgXnAlNVWlhxNIJner@ChacAtZoEYrrmofzZnjPoCanyon.com or (650) 787-6475, or toll-free in the continental US at (866) 378-5470.

Get the ebook!

Past issues of Point Lookout are available in six ebooks:

• Get 2001-2 in Geese Don't Land on Twigs (PDF, )
• Get 2003-4 in Why Dogs Wag (PDF, )
• Get 2005-6 in Loopy Things We Do (PDF, )
• Get 2007-8 in Things We Believe That Maybe Aren't So True (PDF, )
• Get 2009-10 in The Questions Not Asked (PDF, )
• Get all of the first twelve years (2001-2012) in The Collected Issues of Point Lookout (PDF, )

Are you a writer, editor or publisher on deadline? Are you looking for an article that will get people talking and get compliments flying your way? You can have 500-1000 words in your inbox in one hour. License any article from this Web site. More info