The Training Measurement Book offers managers, executives, and training and human resource professionals a method for measuring their investments in a way that provides information that is both actionable, credible, and meaningful to corporate leaders. Using the methods outlined in this important resource, you can free yourself from traditional, often cumbersome measurement models and put in place pragmatic, useful, and easy-to-implement approaches for measuring training activities.
The Training Measurement Book offers managers, executives, and training and human resource professionals a method for measuring their investments in a way that provides information that is both actionable, credible, and meaningful to corporate leaders. Using the methods outlined in this important resource, you can free yourself from traditional, often cumbersome measurement models and put in place pragmatic, useful, and easy-to-implement approaches for measuring training activities.
Introduction 1The Challenge of Training Measurement 1Need for New Measurement Models 3Structure of This Book 6Methodology for This Research 9A Personal Comment 10General Principles of Training Measurement 13Measurement Should Deliver Actionable Information 13A Measurement Program Should Not Be Designed to Cost-Justify Training 20Measure Training as a Support Function 22A Measurement Program Must Meet the Needs of Multiple Audiences 26Measurement Should Be a Process, Not a Project 27The LMS Is a Foundation for Measurement 31Dedicate Resources 33Start Simply and Evolve Over Time 34The Pros and Cons of Using ROI 37ROI Analysis Assumes That Training Is Treated as an Investment 38In-Depth ROI Measurements Are Often Difficult to Believe 42In Concept, the ROI of Training Should Be Extraordinarily High 44It is Very Difficult to Correlate Outcomes Specifically to Training 46How Do You Make ROI Actionable? 48Use of "Potential ROI" During Performance Consulting 48"Performance-Driven"Versus "Talent-Driven" Training 50Don't Let ROI Become "Return on Insecurity" 53Limitations of the Kirkpatrick Model 57The Kirkpatrick Levels Are Not a Complete Model 58The Model Incorrectly Positions the Levels as a Hierarchy 62The Kirkpatrick Model Ignores the Role of Training as a Service-Delivery Function 63Kirkpatrick Misses Other Operational Measures 66One Alternative: The Six-Sigma Approach to Measurement 68Another Alternative: The Success Case Method 68The Impact Measurement Framework 71The Business Impact Model 73The Impact Measurement Framework 87Summary of the Framework 103Program versus Organizational Measures 103How to Use the Measurement Framework 106Summary of the Measurement Models 106Implementation: The Seven-Step Training Measurement Process 109The Seven-Step Program Measurement Process 109Best Practices in Implementation 123How to Start 129Measurement of Business Impact 139Simplifying the Problem 140Use Line-of-Business-Specific Measures 141Integrate with Performance Management Processes 148Measurement of Alignment 153Caterpillar's Planning and Budgeting Process 154CNA Insurance Training Investment Model 156How Do You Measure Alignment? 157Attainment: Measurement of Customer Satisfaction 163The Six Sigma Approach 163How Do You Operationalize the Measurement of Customer Satisfaction? 166Measurement Tools and Technologies 169The Role of the LMS 169Training Analytics and Advanced Reporting 172The Knowledge Advisors Solution 174CLO Dashboard by Zeroed-In Technologies 175The Journey Forward: Focus on What Matters 179Case Study A: Randstad Measures Onboarding 185Randstad Overview 185The Business Problem 186The Solution 187Results 191Lessons Learned 196Next Steps 196Case Study B: HP Develops an Integrated Measurement Process 199HP Measurement Goals 199HP Systematic Approach 200Designed to Deliver Actionable Information 202HP Solution: Standard Evaluation and Indicators 203Lessons Learned 206Research: The State of Training Measurement Today 209What Do Training Organizations Consider Important? 209What Do Training Organizations Actually Measure? 211Budgets for Training Measurement 212The Importance of a Business Plan 214How Do Organizations Measure Alignment? 215The Role of Performance Consulting 217Satisfaction with LMS Systems 218Is Enough Being Spent on Training Measurement? 219Demographics from the Survey 220Examples of Learning Measurements 223Caterpillar University ROI Analyses 223DAU: Business-Focused Approach 223Cisco Sales Training 226Microsoft Learning 226Sprint University 229Specific Learning Measures 233Training Analytics Specifications 235Introduction 235Business Measures 235Dimensions 239Hierarchy and Aggregation 242Computational Flexibility 242Security and Roles 243Dashboards 244Alerts and Report Subscriptions 244Extract, Transform, and Load 245General 246Creating Demonstration Scripts 246Index 249About the Author 259