Evaluation Definition

In the ADDIE model, evaluation is a systemic process that determines the quality and effectiveness of the instructional design as well as the final product. Evaluation is an ongoing activity conducted at each phase of the ADDIE model. Evaluation consists of two parts: formative and summative. Formative evaluation is part of each proceeding phase and determines effectiveness and quality of each stage. Summative evaluation consists of tests for criterion-related referenced items and provides opportunity for feedback from the users and assesses learner outcomes.

Formative Evaluation
Formative evaluation involves gathering information during the early stages of the design process with the focus on finding out whether efforts are unfolding as planned, uncovering any obstacles, barriers or unexpected opportunities hat may have emerged, and identify mid-project adjustments and corrections which can help insure the success of the project. The feedback gathered during formative evaluation is designed to fine-tune the implementation of the program, gather reaction and identify what is not working.

Six Stages of Formative Evaluation

1. Evaluation Goal Specification

   Specify the goals of the stakeholders for which the evaluation is performed

2. Preparation

   Arrange necessary personnel and measurement instruments

3. Data Collection

   Hire and train data collectors

   Elicit feedback from target audience and experts

4. Data Analysis

   Tabulate statistical data

5. Revision

   Modify product to improve effectiveness and efficiency based on data collected above the stakeholder goals

6. Recycling

   Retest product, move to summative evaluation and dissemination after removing weaknesses

Summative Evaluation
Summative Evaluation is the process of collecting data following implementation of the project in order to determine its effectiveness and satisfies the instructional objectives. The summative evaluation is instructionally congruent, allows for complete analysis, and provides feedback. Summative evaluation may measure knowledge transfer, learner outcomes, cost factors, and learner attitude.