Return on Expectations – the Ultimate Demonstration of Training Value
We have recently unveiled the current, true, comprehensive Kirkpatrick Model that was created 50 years ago by Donald Kirkpatrick. I believe that “Return on Expectations” or ROE is the most meaningful way to demonstrate the value of training (and reinforcement) efforts to the business. Proclaiming ROE as THE measure of training value is a bold statement, considering that the most popular and recognized way to demonstrate value is ROI, or “Return on Investment”.
As you might guess, the “expectations” we are referring to in ROE are those of our internal and external business partners – the people we are in business to support. I was addressing an ASTD Chapter in Fort Worth, Texas and a learning professional described his job as “supporting the needs of corporate business.” I know when we hear words along those lines that the person gets it. I strongly urge you to consider the notion that training follows, serves, and supports the work of our business partners, and training is not an end in and of itself.
I often suggest that we no longer have a free pass when it comes to value. For years, we as training professionals have been seen as having inherent value to our organizations just because we are learning and development professionals. Now, however, we now find ourselves in the position of having to demonstrate our value just like everybody else. And that is where ROE comes in.
I believe so strongly that The End is the Beginning that we made it one of the Five SMR/Kirkpatrick Foundational Principles. What I mean by this is that before we put together and deliver a training program based on the request of our business stakeholders, we need to find out what they are expecting to see as a result of the efforts. We want to find out “what success will look like” in the eyes of our business leaders so we can better focus our training, reinforcement, and evaluation to meet those expectations. Thus, if we are clear about specific success outcomes, we are already well on the path to delivering return on our stakeholders’ expectations.
At times ROE looks just like return on investment. It can, in fact, include a formal ROI calculation if that is what the business stakeholders expect. The difference is that ROE is not limited to ROI. ROE may at times be measured in simpler terms. For example, an agreed-upon increase in sales, or decrease in scrap. Or it could also encompass intangibles like better employee morale and loyalty. The great thing about ROE is that the stakeholder is in control of determining what is important to them, and you as a training professional have the ability to determine with their agreement the best ways to measure the results. ROE is stated in language that is understood by the business stakeholders, and everyone within the organization that has a stake in the training impact.
As mentioned earlier, the terms of ROE are stated before a project even begins. So ROE is a positive measure that pulls an organization together in the quest to define and achieve the target. In contrast, ROI tends to be measured after the fact, as a defensive measure where a training professional or organization is attempting to isolate the impact of their efforts to justify their existence. I hope you can see the difference. ROE is a collaborative agreement that unites an organization in working towards a common goal. ROI is a summative measurement that separates business units by attempting to isolate the efforts of each.
Even though ROE may include measurements that are not as scientific and formulaic as ROI, do not be misled to think that ROE is “soft”. On the contrary, it is a strong measurement that can include all of the metrics that typically make up ROI (if the stakeholders want to see that type of evidence), and more that ROI is not able to measure. Examples of typical “expectations” converted into success outcomes are:
| Revenue from new customers. | |
| Increased operations efficiencies with decreased training costs. | |
| Reduced turn-around times. | |
| Increased retention of top talent. |
There is certainly a financial component in each of these examples. And there is also a long list of “other” benefits that may be measured numerically or not. Typically it doesn’t make sense to attempt to isolate these measurements because they were accomplished as a team. When an organization sets their targets collaboratively up front and works towards them in lockstep, the entire team may take credit for the success.
We are currently working with an agency in Abu Dhabi, part of the United Arab Emirates. On a recent trip, my connecting flight was delayed and I had to divert from my final destination of Abu Dhabi to Dubai. No problem; just an hour-long cab ride. When I climbed into my airport cab, I asked the driver, “Do you know where the Emirates Plaza Hotel in Abu Dhabi is?” “Oh, surely”, he said, and off we went. When we entered the city of Abu Dhabi, he asked me, “Do you know where the hotel is?” “No, I thought, you said you did.” “No”, I said, “I only knew where the city is.” Silence. Then, as we were riding, my driver honked and flashed his lights at a local taxi until the guy pulled over. My driver got out and entered into a discussion in Arabic with the other driver. He got back in, and away we went. For the next hour, he pulled over at least six more taxis, each time getting out and discussing and pointing with the driver. Finally, we got to my hotel.
Metaphors are constantly hitting me in the face, and this ‘exciting’ taxi trip was no exception. It showed me what happens when someone is unfamiliar with the desired end. It is the same in training. Unless we clearly identify and negotiate what the indicators of success will be in the eyes of our business partners, we will be guessing and hoping, just like my cab driver.
We encourage you to not only work with the notion of ROE, but the entire SMR/Kirkpatrick approach. We believe you, like many others, will create a strong, working bond with your business partners that will lead to a higher degree of mutual respect and positive, measurable bottom line results.
SMR USA's Public Session, 2009
|
This 2-day program has been officially sanctioned by the International Society for Process Improvement (ISPI) and is worth 12 ISPI credits toward re-certification.

Please click here for more details on SMR USA's Public Sessions.



