Module Title |
Module Objectives |
Module 1: How
To Create Reactionnaires That Measure Overall Training Success |
- assess the strengths and weaknesses
of corporate reactionnaires; and,
- edit
corporate reactionnaires to include appropriate assessment guidelines.
|
Module
2: Basic Statistics Related To Training Evaluations
|
- define five statistical terms
(correlation, mean, standard deviation, t-test and statistical
significance); and,
- provide
an example of how each of the five terms can be used in training
evaluations.
|
Module
3: Validity And Reliability Issues
Related To Training Evaluations
|
- name, define and illustrate 5 types
of validity; and,
- name,
define and illustrate 4 types of reliability.
|
Module
4: Creating Reliable Attitudinal Instruments
|
- define an attitudinal object;
- generate
an item pool;
- create
a draft attitudinal instrument;
- select
a scoring format;
- collect
data on the draft attitudinal instrument;
- load
data into a statistical software package;
- complete
an item analysis; and,
- refine
an attitudinal instrument based upon the item analysis results.
|
Module
5: Test Construction: Creating
Multiple Choice Exams
|
- examine the objective and determine
the level of performance needed based on Bloom's Taxonomy;
- decide
which testing format is best for your exam questions;
- create
a content valid multiple choice exam; and,
- employ
sixteen guidelines for creating effective multiple-choice exams.
|
Module
6: The Basics Of Measuring
On-The-Job Behavior
|
- describe how on-the-job behavior is
viewed from both the traditional and new training evaluation models;
- name three types of data collection
methods used to measure on-the-job behavior;
- list
the benefits and limitations of the three data collection methods;
- apply
the information from modules two and three (i.e., basic statistics and
reliability/validity) to measure on-the-job behavior;
- define
intra and inter rater reliability; and,
- calculate
intra and inter rater reliability.
|
Module
7: Return On Investment
|
- create a list of costs and benefits;
- develop
criteria;
- determine
a dollar value for all data;
- determine
if the data fits the criteria;
- calculate
the total costs and the total benefits;
- calculate
a cost-benefit ration; and,
- calculate
return on investment.
|
Module
8: The New Training Evaluation
Model: Creating Evaluation Instruments To Predict
Behavior Transfer
|
- name the five tiers of the new
training evaluation model;
- explain
the benefit of using the new model's instruments;
- create
a reactionnaire with a built-in self-efficacy instrument;
- explain
how the self-efficacy section of a reactionnaire aids evaluators in
gathering more information than a traditional reactionnaire;
- create
an attitudinal instrument;
- create
a subjective norms instrument;
- create
a self-efficacy instrument;
- create
an external control instrument;
- create
a behavioral intentions instrument;
- create
an actual behavior instrument;
- prove
content validity;
- explain
what is a multiple regression analysis;
- prove
predictive validity;
- support
internal consistency reliability;
- support
test-re-test reliability; and,
- analyze
training effectiveness via pre and post training results.
|