Proposal view
Proposal Type: Individual Paper 
Domain: Assessment and Evaluation 
SIG: Assessment and Evaluation 
Type Submitted Paper 
Equipment PC and projector
Paper Details
Title Student Conceptions of Feedback: A study of New Zealand secondary students within the Conceptions of Assessment and Feedback project.
Abstract

This study investigates New Zealand secondary students’ conceptions of feedback, as part of a larger study of teacher and student conceptions of assessment and feedback, and their impact on learning outcomes.


We conducted five student focus groups, and sought student beliefs and understandings around three key aspects of assessment and feedback – definition, purpose and personal impact/response. The students felt that feedback was the critical link between assessment and learning, and that it did not stand distinct from either. In addition, they were clear about what counted as feedback, and what did not. The nature of the feedback they received also impacted on their views of the assessment, especially whether the assessment could be considered as irrelevant.


The data from the focus groups was used to develop 55 items for a conceptions of feedback instrument (CoF-I), which was piloted with 256 students. Exploratory and confirmatory factor analysis of data from the pilot study revealed the presence of six different components: feedback comes from teachers; feedback motivates me; feedback provides information; feedback is about standards; qualities of good feedback; and, help seeking. In addition, Samejima’s Graded Response model was used to select items with optimal measurement characteristics for a second administration with a larger sample.


In a second survey, the 47-item CoF-II was administered to over 800 students from a nationally representative sample of New Zealand schools. A further 250 students completed the questionnaire and also provided standardised measures of curriculum based learning in either reading or mathematics (viz., asTTle - Assessment Tools for Teaching and Learning). This paper will also report on the results of the yet-to-be analysed data obtained in this national study.

Summary
Aims

The aim of this study was to explore student conceptions of feedback as part of a larger project investigating teacher and student conceptions of assessment and feedback, and their impact on learning outcomes. Specifically, we sought to develop and test an instrument to measure and model student conceptions of feedback that would have wide applicability in high school classrooms.

 

New Zealand has undergone major re-structuring of the senior high school qualifications system in the past decade with consequential changes in the way in which assessment is conducted in high schools, and feedback provided to improve student learning. Teachers are seeking new tools that identify student conceptions (and their implications for learning), and also provide them with ways to address those conceptions that are unproductive for learning.

 

Conceptions play an important role in the way in which student and teachers behave, interact and respond to their shared environment (Elen & Lowyck, 1999; Vermetten, Vermunt & Lodewijks, 2002; Könings, Brand-Gruwel, & van Merriënboer, 2005). Feedback is regarded as a critical element in the teaching and learning cycle for improving student learning outcomes (Crooks, 1988; Hattie, 2003), and has assumed great importance with the increasing trend to formative assessment brought about through the influence of the Assessment Reform Group (Black and Wiliam 1998; Assessment Reform Group, 1999, 2002) among others. There is a body of research on teacher and student preferences for feedback (e.g., Brandl, 1995; Dwyer, 1993; Leki, 1991; Pajares & Graham, 1998) but little exists that conceptualises the definition and purpose of feedback from a student perspective.

 

Methodology

Five student focus groups were conducted with 41 students from Years 9 and 10 in four urban high schools, across a range of socio-economic status suburbs. These focus groups explored both assessment and feedback covering three key dimensions – definition, purpose, and personal impact/response.

 

From the analysis of the focus group transcripts, a bank of 55 items was developed to capture student conceptions of feedback (CoF-I). Students also selected from a list of 16 feedback types (derived from student comments) those that they associated with the term “feedback”. The questionnaire (together with two other instruments - conceptions of assessment CoA, and conceptions of learning CoL) was piloted with 256 students. The data were analysed, poor items eliminated or amended, and a revised version of the questionnaire (CoF-II) administered to a nationally representative sample of over 800 secondary students. A further 250 students completed all the three instruments, and also provided standardised measures of curriculum based learning in reading or mathematics (viz., asTTle scores – Assessment Tools for Teaching and Learning).

 

Results and Discussion

Analysis of the focus group data indicated that students saw feedback as a link between assessment and learning – assessment leads to feedback which leads to further learning. Feedback was an essential lubricant between assessment and further learning, provided it told them what and how to improve. Assessments were regarded as irrelevant in the absence of a mark or grade.

 

The pilot study data indicated the existence of six conceptions of feedback (feedback comes from teachers; feedback motivates me; feedback provides information; feedback is about standards; qualities of good feedback; and, help seeking). The fit of the model was marginally acceptable (chi2 = 1139.54 ; df = 587 ; p = .000 ; TLI = .783 ; CFI = .798 ; RMSEA = .067), and a larger sample was sought to provide more robust analysis of the structure. Analysis of the data from a nationally representative sample of over 800 secondary students will be reported in this paper providing for the first time a model of secondary student conceptions of feedback. Furthermore, the CoF-II responses of a further 250 students together with standardised measures of their learning will enable us to use structural equation modelling to determine the effect of differing conceptions on student learning outcomes.

 

Educational Significance

This initial research is the first to investigate New Zealand student conceptions of feedback, through a qualitative study, then through a national survey. In addition, it reports on the development of an instrument that New Zealand classroom teachers can use to gain a student perspective on this critical element of their work, and the effect of differing conceptions of feedback on student learning.
Keywords Formative evaluation
Secondary education
Student perceptions
Appendices
Authors
Name Surname Institution Country e-mail EARLI Number Presenting
S Earl Irving The University of Auckland New Zealand e.irving@auckland.ac.nz   *  
Elizabeth R. Peterson The University of Auckland New Zealand e.peterson@auckland.ac.nz    
Gavin TL Brown The University of Auckland New Zealand gt.brown@auckland.ac.nz    
Visit NQcontent
© European Association for Research on Learning and Instruction, 2012 All rights reserved.