Please click here if you cannot view this e-news.
And You Thought You Knew Kirkpatrick - By Jim Kirkpatrick, PhD

I have known my father Don Kirkpatrick my whole life.  He is 85 years old now, and still going strong with the four levels.  He is one of the most consistent and predictable people I know.  I can count on him to lead an audience with his Green Bay Packer song.  I can count on him telling the story of how I saved him from the game warden when he didn’t have his fishing license. And I can count on him introducing his audience to “a new modern marvel – the overhead projector.”

But just when I think I know exactly what he will do and say in a given situation, he surprises me.  About a week ago, we were both addressing a large group of participants in Omaha, Nebraska.  During his talk, he began talking about Change Management, and detailed very current principles of gaining acceptance during times of change.    Again, I had never heard him talk about them before.

I am sure that the same has happened to you – just when you think you know someone, they surprise you and say or do something entirely out of character (at least your understanding about their character).

Here is a fact about the four levels that perhaps you have not considered before: 

While Kirkpatrick’s Level 4 is aptly called “results”, results occur and should be dealt with at all four of the levels.

Results come in many different forms.  For Level 1, there are results in the form of reactions; Level 2, there are pure learning results; for Level 3, the results take the form of the degree to which participants apply what they learn; Level 4 results are the more typical business and human resource results such as sales numbers, cost savings, and retention of top talent.  The basic premise here is that these results should be purposefully gathered, analyzed, and actually used to improve the business partnership process at any point along the learning and performance continuum.  

Perhaps the best way to close this article is with a real life example.  Following is a best practice from our colleagues at 7-eleven, that detail some of the results and their use at each of the four levels.

7-Eleven Practitioner Practices

Field Consultant Certification Training (FCCT) is one of 7-Eleven’s most important initiatives.  The program, which has been running since February 2007, is designed to prepare business consultants to effectively produce results for the organization.  In each of the three distinct training phases (Table 1), the company’s focal team members gather for a week at the corporate headquarters in Dallas, TX to learn about leadership skills, the core processes involved in doing their job correctly and efficiently, and the analytical skills necessary to help the business consultants produce tangible results to the bottom line. 

As with all graduation programs, the emphasis is that the end truly is the beginning, not only with new ways of going to business but also with the intensive certification process designed to ensure the training business consultants received is applied and verified back on the job. 

Results of this program at all four Kirkpatrick Levels are tracked diligently, monitored monthly by senior leadership to ensure the significant cost associated with the program is producing adequate results.

Table 1. Summary of Field Consultant Certification Training metrics

Evaluation Level Reaction
Metric Definition Daily Course Evaluation - Participants
Who Tracks? Facilitator Team
Who Receives?
1. Facilitator Team
2. Learning Management
Purpose of Metric
1. Help facilitators understand participant response to pace, course materials, topics, facilities, accommodations, transportation, and food for immediate (next day) solution.
2. Help Learning Mgmt team verify facilitator performance and monitor participant satisfaction.
Evaluation Level Learning
Metric Definition Step 2: Knowledge Verification
Who Tracks? Online Assessment Tool, Facilitator Team
Who Receives?
1. Learners
2. Managers
Purpose of Metric
1. Participants are encouraged to take the evaluation before beginning module study, review results, and then focus learning on knowledge gaps before retaking the assessment at a later date.
2. Supervisors and managers receive individual reports from learners on assessment progress as well as a weekly summary of updates for each of their direct reports. 
Evaluation Level Behavior
Metric Definition Step 3: Business Plan
Who Tracks? Supervisors / Managers, Facilitator Team
Who Receives?
1. Learners
2. Supervisors
Purpose of Metric
1.

Learners are provided valuable feedback from a variety of sources (division vice president, merchandising, their supervisor, human resources, training, and others) on their performance on a major component of their job (business planning). 

2.

Supervisors use the Business Plan opportunity in a variety of ways.  First, they use the opportunity to verify current performance and coach learners for better, more improved performance. 

Evaluation Level Results
Metric Definition Store Sales results 6 months after certification
Who Tracks? Financial Planning, Training Team
Who Receives? Senior Leadership, Financial Planning
Purpose of Metric
1.

Sales are tracked to make sure that certification impacts sales…those who are certified have higher sales increases than those who are not.  Senior leadership uses these results to verify that the program is working (as does the learning team). 

2. Financial Planning uses this information to help justify the cost to the organization/senior leadership. 

I wish you well as you, like me, will find new ways of applying the four levels of evaluation.  Feel free to check into our services and products at SMR-USA that can help you do this more effectively.

Best regards,
Jim Kirkpatrick, PhD
VP Global Training and Consulting
SMR USA, Inc.


 
Click here to download HRDPower.net brochure
 
Join SMR USA Public Sessions!
 
Download SMR USA Brochure