Project Practitioners > Closing a Project: Ask the Right Questions

Closing a Project: Ask the Right Questions

By Alan Zucker

 Asking the right questions takes as much skill as giving the right answers.” Robert Half

It is generally accepted that a conducting lessons learned meeting or a project post-implementation review at the end of a project or phase is a best practice.at the close of a project or phase. However most reviews are ineffective because they do not collect actionable information. 

A well-executed project or phase closeout will yield:

  • A constructive post-implementation review that produces actionable lessons learned.
  • Lessons learned that could be communicated as ‘universal truths' that are readily applied to future projects. For example, a project team may have experienced issues negotiating pricing with a vendor; the universal truth might be ‘use Procurement to negotiate pricing because they can leverage volume discounts across the firm.’
  • Institutionalized learning where the universal truths are actively communicated and applied across the organization. In other words, ensuring that the lessons and universal truths become part of the organizational DNA.

This article focuses on facilitating the closing process meeting and identifying the lessons learned. Future articles will discuss distilling the lessons and institutionalizing them.

The primary challenge to a post-mortem process is eliciting meaningful and constructive information from the project team. I have frequently observed:

  • Meetings that devolve into the intricacies of that particular project.
  • Jumping to solutions before the issues has been clearly defined. 
  • Finger pointing and blame shifting.

I have found that by proactively facilitating the project review meeting, it is possible to collect actionable information and leave the participants feeling good about the process. The two methods that I frequently use are: the Crawford Slip process, and a directed questioning technique.

Crawford Slip

The Crawford Slip process is a commonly used and effective brainstorming technique. I use it to collect requirements, develop mission statements, and collect feedback on projects. The technique is designed to quickly elicit and prioritize a large amount of information from a group.

This is how I adopt the Crawford Slip technique to a project post-mortem:

  1. When the team comes to the meeting, I tell them that most of the meeting will be conducted in silence.
  2. I give each participant several Post-It Notes® and ask them to list their thoughts about the project, with one idea on each Post-It. In general, I ask for feedback as a neutral, open-ended question.
  3. When everyone has stopped listing their thoughts, I then go around the room and ask each person to share one of their ideas out loud, and then post it on the wall. At this point, the notes are posted randomly on the wall. We go around the room until all of the notes are posted.
  4. I then ask the participants to go to the wall and begin organizing the ideas into lists, which is also done silently.
  5. Once all of the notes are organized into like columns, I read all of the notes in the list and ask the team to label the column.
  6. After all of the columns have been labeled, we step back and discuss the major themes that have emerged. These themes are the feedback or lessons learned from the project.

  Project Closeout

I use the Crawford Slip technique in many settings. By conducting most of the process in silence, all participants have the opportunity to express their thoughts in a non-threatening environment. The facilitator can easily control the flow of the meeting and avoid most of the common meeting dynamic issues.

In an hour-long meeting with 10 participants, this technique can generate 50-75 ideas that can be categorized into 5-10 categories. These categories can form the basis of the universal truths or be the starting point for a subsequent deep-dive meeting. 

Directed Questioning

The directed questioning technique is most effective when reviewing a troubled project. In this technique, the facilitator asks focused and directed questions to the team. Posing the questions in a binary (yes/no) format is one way to avoid distractions or ‘red herring’ conversations.

For example, I was the external facilitator for a post-implementation review for a project that experienced a software defect shortly after it was deployed into production. The review was critical because the team had started another project that was already experiencing challenges.

When the meeting began the team started describing the technical source of the defect and the planned solution. An existing downstream data feed was accidentally changed and a key field was deleted. I quickly redirected the conversation away from the solution--which was well understood--and refocused the team to the central point: 'what went wrong and why?'

I began asking a series of focused and directed questions to pinpoint the root cause of the problem:

"Was there a requirement to change the data feed?" No. The primary scope of the project was improving system performance. 

“Did the analysis/design document include the change?” Yes. The development team documented the change to the feed; but the impact was not understood. A design review was held, but no concerns were raised.

“Was the missing data element identified during testing?” Yes; but the tester failed to raise this as a defect.

“Was there a thorough review of the test results and open issues prior to the Go decision?” No. The approvers were not aware of the defect when they made the Go decision.

By driving the discussion, we were able to uncover a breakdown in basic project controls. For the subsequent project, we added additional oversight to ensure the standard processes and controls were followed. 

The primary goal of the closing meeting is to gather actionable information. Of course, it's best if the team also leaves the meeting feeling good about the process. A well-facilitated review session can achieve both of these goals. I have found both the Crawford Slip and directed questioning techniques to be effective for achieving these dual goals.

Image Courtesy of Creative Constructs.  Sticky Note Ninjitus (http://www.creative-constructs.com/sticky-note-ninjitsu/

© 2014 Alan Zucker



Comments
Not all comments are posted. Posted comments are subject to editing for clarity and length.

Great reminder on the power of Crawford Slip. On a related 'note', I recently came across a Post-It notes app that looks like you can take a picture of post-its and then rearrange them electronically. Has anyone used this tool in conjunction with Crawford Slip?


Was it an actual 3M app, John, or something from a third party? It's a fascinating idea (and might help me organize my desk -- har!)


so how does a group silently agree on what post it ideas go together. I think with my colleagues this would end in a scrum.


I'm curious about the "silent organization" as well. I've used and seen versions of this approach before, but not with the organization task done silently. While I might be worried about an all-out scrum, I'd expect some awkwardness at least, if brief interchanges couldn't be used to reconcile where to put something.

When I've experienced it with people getting to do such brief consultations if needed to make a placement decision, it seemed to go fine.

But i'm very curious to hear more about the reason for staying silent during this part, what issues Alan has seen arise, and how to handle.


So, let me clarify a little. The organization is performed in 'essential silence'. There is always a little chatter, but no conversation about where cards should be placed.

It is ok for someone to move a card from column A to B; then someone to move the card to column C. I have never seen a tug-of-war where two people keep moving a card back and forth.

You would be surprised how well this works.

I like the technique because it is so efficient. A large group of people can get to a primally close answer very quickly. Discussions can then be used to drill down where needed.

If you generate 50 cards and have just 1 minute of conversation about each one, you have essentially spent an hour organizing the cards. With the silent organization technique, you can organize the cards in about 15 minutes.

Try it and let me know how it works for you.


Post a comment




(Not displayed with comment.)









©Copyright 2000-2017 Emprend, Inc. All Rights Reserved.
About us   Site Map   View current sponsorship opportunities (PDF)
Contact us for more information or e-mail info@projectconnections.com
Terms of Service and Privacy Policy



Stay Connected
Get our latest content delivered to your inbox, every other week. New case studies, articles, templates, online courses, and more. Check out our Newsletter Archive for past issues. Sign Up Now

Follow Us!
Linked In Facebook Twitter RSS Feeds


Got a Question?
Drop us an email or call us toll free:
888-722-5235
7am-5pm Pacific
Monday - Friday
We'd love to talk to you.

Learn more about ProjectConnections and who writes our content. Want to learn more? Compare our membership levels.