European Academy of Teachers in General Practice edition:Spring meeting 2007 location:Zagreb, Kroatia date:20-25 May 2007
In Flanders the Departments of General Practice in dfferent universities worked together to organise a common final assessment procedure. This takes place at the end of the vocational training period in General Practice and takes the form of a certification eam. This assessment procedure is built out of four different components: a well-designed written knowledge test, a structure oral exam, a large scale OSCE type exam and a structure report from the trainers. A pass-fail standard is defined for each separate module using appropriate procedures. A final pass-fail decision is based on a combination of the socres obtained from the different modules. This presentation discusses the different approaches that can be used to combine the different component socres. From a pure reliabilty perspective the reliability analysis of composite scores can be computed using a multivariate reliability analysis. The discussion is illustrated with data collected form the final assessment procedure in 1997-2005. The impact of using different approaches and computation methods is simulated and discussed. The choice for a specific combination method should be inspired be the psychometric characteristics of the assesment tools but the final decision is made on empirical basis.