Job Knowledge Test Design: A Cognitively-Oriented Approach. Institute Report No. 241.Reportar como inadecuado

Job Knowledge Test Design: A Cognitively-Oriented Approach. Institute Report No. 241. - Descarga este documento en PDF. Documentación en PDF para descargar gratis. Disponible también para leer online.

Selected cognitive science methods were used to modify existing test development procedures so that the modified procedures could in turn be used to improve the usefulness of job knowledge tests as a proxy for hands-on performance. A plan-goal graph representation was used to capture the knowledge content and goal structure of the task of using a map, protractor, and compass for purposes of land navigation. Diagnosticity ratings were obtained from task experts to identify those content categories and procedures that would best discriminate among levels of examinee performance and specify the relative proportion of test questions to select. A probability-based inference network was used to score examinee responses and model a more complex pattern of relationships between knowledge and performance. A 100-question knowledge test was developed and used to test the land navigation skills of 358 Marines. Five hands-on proficiency tests (designed to evaluate planning, location, distance, direction, and movement skills) and a work sample performance test were also administered to the Marines. The 0.58 correlation between the job knowledge and hands-on tests and 0.42 correlation between the job knowledge and performance tests were interpreted as evidence supporting the utility of cognitive methods for improving job knowledge tests. (Contains 81 references.) (MN)

Descriptors: Adult Education, Cognitive Measurement, Cognitive Tests, Job Performance, Knowledge Level, Military Personnel, Test Construction, Vocational Education

Autor: DuBois, David; And Others


Documentos relacionados