WP 5.1 Implementation of modified Kirkpatrick model of ADDIE
The last element in the ADDIE course system is evaluation of course (see fig. 5.1) which consists of steps: Analysis, Design, Development, Implementation, and Evaluation. The most important problem related to the teaching is:
- HOW EFFECTIVE IS LEARNING PROCESS?
- ARE ASSUMED AIMS REALIZED?
In the typical training procedure system (data of Ernst &Young) 55% of European companies uses the simple procedures of evaluation of learning by questionnaires procedure of trained person. The CELGAS system will apply D. Kirpatrick model (1975) of effectiveness of learning based upon four levels: Students Reactions, Learning Results, Behaviour in the Workplace, Business Results. The Kirkpatrick scheme is modified by introducing evaluation of content of courses by two kind of expert: internal and external (in relation to the project). The proposed QUALITY EVALUATION will be done in the six (instead of four) steps. The description of each level of course valuation is presented in the table 5.1. The presented scheme should be extended by accreditation process (e.g. with European Association for Distance Learning (EADL)).
Fig. 5.1 Recurrence model of ADDIE e-learning scheme
Tab. 5.1 The evaluation scheme (Kirkpatrick model) of ADDIE e-learning system
| Level | Level name | Level description |
| 0.A | Internal quality content course check | Content quality course reviewed by internal experts of content of material and tool utilized in the teaching procedure. |
| 0.B | External quality content course check | Content quality course reviewed by external - independent -experts after preparing the material of course and after finishing fist test courses, by review of table of contents, task, description of education materials and tools, etc. |
| I | Student's Reaction | Evaluation of course content by trained person (Student's Reaction) based upon questionnaire. The questionnaire should include cross-section questions related to the adequateness of course assumptions, degree and value of interaction of exercises, transfer of knowledge and technology, etc |
| II | Learning Results | Evaluation of course content by adequately prepared and analyzed test system. On the basis of test suites - start tests/final test - it is possible evaluation of increase of competitive, knowledge, skills related to present training. The analysis of large number of system tests may acquire date to estimate of weakness points of course. |
| III | Behaviour in the Workplace | Evaluation behaviour of trained person in the workplace after 3-6 month after finishing the course. The evaluation grade is possible using prepared "critical - course" specified elements of behaviour of trained person. |
| IV | Business Results | Evaluation of quality of course based upon specific business data related to quality of work of trained person (effectiveness of work index) |
