| Proposal Type: | Symposium |
|---|---|
| Domain: | Learning and Cognitive Science |
| SIG: | Conceptual Change |
| Type | Submitted Symposium |
| Title | Exploring the Nature of the Refutation Text Effect in Conceptual Change |
| Abstract | Classroom learning typically involves the restructuring of existing knowledge (Mason & Gava, 2005). One instructional tool that has been found to be effective with enriching the potentials of learning is refutational texts. Refutational texts are designed to activate students’ prior knowledge by directly stating misconceptions about a topic, refuting those misconceptions, then presenting the scientific explanation as a plausible alternative (Hynd, 2003). Indeed, a meta-analysis conducted by Guzzetti, Snyder, Glass, and Gamas (1993) found that refutational texts are more effective than expository texts in promoting conceptual change. Researchers have offered possible explanations for the refutational text effect, such as the design of the text itself-- misconceptions are elicited then refuted (Chinn & Brewer, 1993; Hynd, 2003). A second view is that refutational texts include persuasive messages (Dole & Sinatra, 1998; Hynd, 2003). What is missing from these studies is an examination of how and why the refutation text effect occurs. Several international scholars were invited to report empirical research or make a theoretical contribution to exploring the nature of the refutation text effect. In the first presentation, Irini Skopeliti and Stella Vosniadou ( |
| Equipment |
PC and projector |
| Keywords | Cognitive processes/development Conceptual change Reading |
| Chair list | |||||
|---|---|---|---|---|---|
| Name | Surname | Institution | Country | EARLI Number | |
| Suzanne H. | Broughton | University of Nevada, Las Vegas | United States | suzanne.broughton@unlv.edu | |
| Organiser list | |||||
|---|---|---|---|---|---|
| Name | Surname | Institution | Country | EARLI Number | |
| Mirjamaija | Mikkila-Erdmann | University of Turku | Finland | mirmik@utu.fi | |
| Gale M. | Sinatra | University of Nevada, Las Vegas | United States | sinatra@unlv.nevada.edu | |
| Discussant list | |||||
|---|---|---|---|---|---|
| Name | Surname | Institution | Country | EARLI Number | |
| Clark | Chinn | Rutgers University | United States | cchinn@rci.rutgers.edu | |
| Erno | Lehtinen | University of Turku | Finland | erno.lehtinen@utu.fi | |
| Paper Details |
|---|
| Title | The Influence of Refutational & Categorical Information on Children’s Scientific Understanding |
|---|---|
| Abstract | The purpose of the present research was to investigate the influence of refutational text and of categorical information on changing young children’s earth concept. The term ‘categorical information’ is used to refer to information about the category to which the concept ‘earth’ should belong (e.g., earth is a solar object vs. a physical object). We hypothesized that refutational texts would have a greater effect on children’s text comprehension than the non-refutational texts and that the texts giving information about the categorization of the earth as a solar object, would have a greater effect on children’s responses than the non-categorical texts. Eighty-four 3rd graders were randomly assigned to one of the four above mentioned text types. An open-ended questionnaire about the earth was used as pre and post-test. The results showed main effects for both refutational and categorical text types. The refutational text with categorical information improved children’s responses more than all the other conditions. The results indicate that the effects of refutational texts can be improved by paying more attention to the selection of the right kind of information to refute. It also supports previous findings that the shift from categorizing the earth as a solar object and not as a physical object may be a prerequisite for a full understanding of the scientific model of the earth as a rotating sphere revolving around the sun. |
| Summary | Studies of text comprehension have shown that students understand scientific information better when they read a refutational text than when they read a non-refutational one (eg. Diakidoy, Kendeou, & Ioannides, 2002; Guzzetti, Williams, Skeels, & Wu, 1997). In the present study, we compared refutational with non-refutational texts predicting that the refutational text would be more effective in facilitating children’s understanding of the scientific information about the earth than the non-refutational ones. Refutational text studies do not usually manipulate the kind of scientific information given to children. In the present study, we wanted to investigate the effects of two different kinds of scientific information: Categorical information and non-categorical information about the earth. Categorical information is the kind of information which explicitly conveys that the earth is a “solar” and not a “physical” object, having the characteristics of other solar objects, such as planets, namely that they are round, rotating and revolving around the sun. The non-categorical text provided specific explanations about how something that looks flat can be round but did not indicate anything about the earth being a solar object. More specifically, the children were told that the earth may appear flat but that it is not, and that it is actually a very large round ball and that only looks flat because we live on it and we see its surface from very close. We hypothesized that categorical information would be more effective in promoting conceptual change both in the case of the refutational and in the non-refutational texts. This is the case because categorical information carries a great deal of implicit beliefs and presuppositions that can constrain new learning.For example, when children categorize the earth as a physical object they apply to it all the characteristics of the physical objects, such as stability and up-down gravity. These presuppositions constrain children’s understanding of the earth as a rotating and revolving sphere with people living on it, at the outside, without falling. Method Participants were 84 3rd grade students. Four different texts were constructed [(1) Refutational – Categorical, (2) Non-Refutational – Categorical, (3) Refutational – Non-Categorical, (4) Non-refutational – Non-Categorical]. Each child was given individually one of the texts to read for about half an hour. Then the experimenter read the text aloud to the whole classroom and responded to children’s clarification questions. A questionnaire consisting of 14 open-ended questions was used as a pre-test and a post-test. Half of the questions derived explicitly from the texts, while the remaining were inferential. Results Children’s responses were subjected to a two-way mixed ANOVA [refutational information: 2 (refutational – non-refutational) * categorical information: 2 (categorical – non-categorical * pre-post test]. The analysis of variance showed main effects for pre-post test [F(1,80)=26,287, p<.001], showing that all texts improved children’s responses in the post-test. The same analysis showed main effects for categorical information in favor of the categorical texts [F(1,80)=10,131, p<.005]. No main effects were found for the refutational information. The analysis did not show statistically significant interactions for text type (refutational*categorical) for all the questions, since all texts improved children’s responses in the post test. The questions were divided in explicit and inferential and we found statistically significant interactions for the explicit questions [F(1,80)=5,318,p<.05] but not for the inferential. A mixed ANOVA [refutational information: 2 (refutational – non-refutational) * pre-post test] comparing the effects of refutational information in Non-Categorical Texts only, did not show main effects. However, the same analysis in Categorical Texts showed main effects for Refutational Text for all the questions [F(1,26)=5,029, p<.05], and for the explicit questions [F(1,26)=6,219, p<.05] but not for the inferential questions. The mixed ANOVA [categorical information: 2 (categorical – non-categorical) * pre-post test] which compared the effects of the two refutational type texts in children’s responses showed main effects for text type in favor of the Refutational-Categorical Text for all the questions [F(1,53)=13,596, p<.001], for explicit [F(1,53)=11,583, p<.001] and for new questions [F(1,53)=5,950, p<.05]. Discussion The results of the present study showed that the use of refutational texts in relation to the specific information given through it can be an effective mean of promoting conceptual change in science. However, the categorical information seemed to have a greater effect on children’s responses than the refutational information, since the analyses of variance showed statistically significant effects only for the texts that included categorical information. The Refutational – Categorical Text was more effective than all the other texts, in improving children’s responses. This effect agrees with previous studies showing that the shift from categorizing the earth as a physical object to categorizing it as a solar object may be a prerequisite for understanding the scientific model of the earth (Vosniadou & Skopeliti, 2005) and supports our hypothesis that categorical information would be more effective in promoting conceptual change both in refutational and in non-refutational texts, because categorical information carries a great deal of implicit beliefs that can guide new learning. References Diakidoy, I.-A.N., Kendeou P., Ioannides C. (2003). Reading about energy: The effects of text structure in science learning and conceptual change.Contemporary Educational Psychology, 28(3), 335-356. Guzzetti, B.J., Williams, W.O., Skeels, S.A., & Wu, S.M. (1997). Influence of text structure on learning counterintuitive physics concepts. Journal of Research in Science Teaching, 34, 701-719. Vosniadou, S. & Skopeliti, I. (2005). Developmental Shifts in Children’s Categorization of the Earth, In B. G. Bara, L. Barsalou, & M. Bucciarelli (Eds.) Proceedings of the XXVII Annual Conference of the Cognitive Science Society, pp. 2325-2330. |
| Keywords | Cognitive processes/development Conceptual change Reading |
| Appendices | |
| Authors | ||||||
|---|---|---|---|---|---|---|
| Name | Surname | Institution | Country | EARLI Number | Presenting | |
| Irini | Skopeliti | University of Athens | Greece | eskopel@phs.uoa.gr | * | |
| Stella | Vosniadou | University of Athens | Greece | svosniad@phs.uoa.gr | ||
| Title | Refutational Text, Epistemic Beliefs and Interest: The Interplay of Instructional and Individual Characteristics in the Process of Conceptual Change |
|---|---|
| Abstract | This presentation is aimed at discussing the findings from two studies focused on the interplay of instructional and individual variables to extend our understanding of the complex dynamics underlying the process of knowledge restructuring. Specifically, we examine the role of refutational text in relation to learner epistemic beliefs and interest to try to shed light on why and how the effect of this type of text occurs. The first study involved 110 8th graders and the topic was natural selection and animal evolution, while the second involved 94 5th graders studying the topic of light and vision. In both studies epistemic beliefs were measured by means of self-reported questionnaires, and students were assigned to two reading conditions. In one condition they read a refutational text, while participants in the other read a traditional text. Within each reading condition students had more or less advanced beliefs about the nature of scientific knowledge. In the second study they also had high or low topic interest. As hypothesized, in the first study greater conceptual change was produced by students who read the refutational text and believed more in complex and uncertain knowledge. In the second study, students who attained the highest scores at both the immediate and delayed post-test were those who read the refutational text and had high topic interest as well as more constructivist beliefs about scientific knowledge. Furthermore, in the first study greater metaconceptual awareness of the change in their conceptions was expressed by students who read the refutational text and those who were more sophisticated in their epistemic thinking. Theoretical and educational implications will be drawn. |
| Summary | Aim. Recent research has highlighted the intricacy of the process of conceptual change and the delicate interactions of the multiple factors that shape it (Murphy & Mason, 2006; Sinatra & Mason, in press). This presentation is aimed at discussing the findings of two studies on the interplay of instructional and individual variables to extend our understanding of the complex dynamics underlying the process of knowledge restructuring. Specifically, we examined the role of refutational texts in relation to learner epistemic beliefs and interest to try to shed light on why and how this type of effect of text occurs. Theoretical framework. Most of the new knowledge students learn in school comes from text reading, especially when abstract concepts are acquired. Therefore, the texts presented to students are an essential factor in conceptual change learning. A particular type of text, the refutational, has been investigated by researchers interested in knowledge restructuring. These texts directly state students’ alternative conceptions about a topic, refute them, and present scientific conceptions as viable alternatives (Alvermann & Hynd, 1989; Hynd, 2003). It has been documented that refutational texts are more effective than traditional expository texts (Diakidoy, Kendeou, & Ioannides, 2003; Guzzetti, Snyder, Glass, & Gamas, 1993; Hynd, 2003; Mikkilä-Erdman, 2002) in producing conceptual change, as they elicit dissatisfaction with the reader’s current conceptions, explain the scientific concept clearly, make it credible, unambiguous, and in multiple forms (Chinn, 1993; Chinn & Malhotra, 2004). In order to understand better what is behind the effectiveness of refutational text, we examined it in relation to two learner characteristics. Following the warming trend (Sinatra, 2005), inspired by Pintrich, Marx, and Boyle’s (1993) seminal article, as learner characteristics we took into consideration two motivational factors considered as possible resources for conceptual change: epistemic beliefs and interest. Regarding epistemic beliefs (Hofer & Pintrich, 1997), it has been documented that only more constructivist representations, that is, beliefs in complex, hypothetical, and evolving knowledge promote students’ recognition that what they already know does not match a new conception (Mason, 1993). It has also been revealed that interest has an energizing role in cognitive processing, as it stimulates attention arousal, positive emotional reactions, effort, and willingness to persist in the task. High interest therefore sustains deep cognitive processing (Alexander & Murphy, 1998; Flowerday, Schraw, & Stevens, 2004; Hidi, 1990, 2001; Schiefele, 1991), which is beneficial to knowledge restructuring. Method. The first study involved 110 8th graders and the topic was natural selection and animal evolution, while the second involved 94 5th graders studying the topic of light and vision. In both studies epistemic beliefs were measured by means of self-reported questionnaires, as well as students being assigned to two reading conditions. In one condition they read a refutational text, while participants in the other read a traditional text. Within each reading condition students had more or less advanced beliefs about the nature of scientific knowledge. In the second study they also had high or low topic interest. In both studies repeated measures ANCOVAs were performed (reading comprehension skill was considered as covariate). Results. Overall, as hypothesized, the main findings from pre- to immediate and delayed post-tests show that the process of knowledge restructuring is affected by several interactions between the variables examined. In the first study, greater conceptual change was produced by students who had read the refutational text and believed more in complex and uncertain knowledge [F (2, 104) = 5.72, p = .01]. In the second study students who attained the highest scores at both the immediate and delayed post-test were those who had read the refutational text and had high topic interest as well as more constructivist beliefs about scientific knowledge [F(2, 84) = 4.43, p <. 05]. An interesting outcome of the first study was that students who read the refutational text [(F 1, 105) = 8.89, p < .01] and students who were more sophisticated in their epistemic thinking [(F 1, 105) = 5.58, p < .05] showed greater metaconceptual awareness of the change in their conceptions. Furthermore, findings from a qualitative analysis of students’ text processing activities confirmed that reading refutational text was a greater stimulus for students’ reflections about the need and reasons for change. Finally, in both studies refutational text facilitated students’ understanding of new concepts even when participant characteristics were not supportive (less advanced epistemic beliefs or low topic interest). Theoretical and educational significance. The studies highlight that refutational texts are powerful in promoting an understanding of complex scientific knowledge, especially in interaction with certain learner characteristics. Their positive effects may be explained in terms of the creation or refinement of metacognitive awareness of one’s conceptions, and deeper text processing stimulated by a comparison between readers’ preconceptions and the new knowledge. From the educational point of view, the findings lead to the consideration that adequate space should be given to texts that explicitly demonstrate the limitations of alternative conceptions and the fruitfulness of intelligible and credible ones. Refutational text should be considered not only as a source of scientific knowledge but also as a tool for promoting the refinement of students’ metacognitive awareness, which is a crucial factor for the activation and support of a conceptual change process |
| Keywords | Cognitive processes/development Conceptual change Reading |
| Appendices | |
| Authors | ||||||
|---|---|---|---|---|---|---|
| Name | Surname | Institution | Country | EARLI Number | Presenting | |
| Lucia | Mason | University of Padova | Italy | lucia.mason@unipd.it | * | |
| Title | Attention Allocation, Background Knowledge and the Refutation Text Effect |
|---|---|
| Abstract | This study examined the influence of the selective attention strategy (SAS) on reading refutational text. According to the SAS, readers learn important information because they allocate extra attention to certain text elements. Attention allocation may be an indicator of the level of engagement the reader has with the information to be learned and may account for the power of refutational text in promoting conceptual change. Undergraduate college students (N=48) were assigned to read either a refutational or a non-refutational text. Both texts introduce the same topic (seasonal change). Individual participants’ reading times were tracked and recorded sentence-by-sentence in order to examine the effects of the SAS on the processing of refutational text and promoting conceptual change. A one-way ANCOVA was conducted to compare reading times between the refutation text group and the non-refutation text group. Reading rate and comprehension were used as the covariate. The results show a significant difference in time spent reading the refutational paragraph [F(2,45) = 4.86, p<.05] over the non-refutation version. Specifically, the significant difference was due to the refutational segment of the text [F(2,45) = 4.47, p<.05]. More interestingly, the results indicate that readers spent less time processing the refutational text. Both text types showed learning effects with participants in both groups scoring higher on the seasons concept inventory at both the post-test and delayed post-test. These findings illustrate that the refutation effect may be due to the “schema slot” notion that refutational material may be easier to read because it serves as an advance organizer, activates background knowledge, and provides clear, concrete, compelling examples for the reader. A second study to be completed and included in this presentation will extend Study I by interviewing participants after reading the text passages. |
| Summary | A rich body of literature shows that the most effective intervention strategies for promoting conceptual change include a combination of activating students’ background knowledge, reading a refutational text, and participating in supplemental scientific investigation activities. These instructional strategies are effective because they promote “high engagement” according to the view proposed by Dole and Sinatra (1998). According to Dole and Sinatra, high engagement results when learners are afforded the opportunity to examine their own ideas in comparison and in contrast to the information they are learning. Refutational text promotes high engagement, and a weighing of the issues and arguments by presenting information that may conflict with the reader’s prior knowledge, directly refuting the prior conception, and presenting the formal scientific explanation as the alternative. This approach has been shown to be very effective (Guzzetti, Snyder, Glass, & Gamas 1993). Despite its success in promoting conceptual change (see for example, Mason & Boscolo, 2004) the nature of the refutational text effect is not well understood. Researchers have begun to explore possible process explanations for the refutation text effect (Anto, Penttinen, Mikkila-Erdmann, Salonen, 2006). One such explanation is that the refutational text effect may be due to attention allocation. In other words, readers may devote greater attention to the refutational text segments because they are highly salient (Reynolds, 1992). Salient information is text elements that are either important or explicit. Alternatively, readers may pay more attention to the refutational text statement because the initial sentence stating the commonly held misconception activates prior knowledge, which sets up an expectation that their prior knowledge is going to be confirmed. The refutational statement then disconfirms the expectation, drawing their attention due to the contradiction. In contrast, it is also possible that readers may in fact pay less, rather than more attention to the refutational text segments. Refutational text segments are written in a manner that conveys the information in a clear, concrete and easy to process manner. Thus, readers devote less attentional resourses to these text elements. These alternatives were explored in a series of two studies. The first study examined the influence of the selective attention strategy (SAS) on reading a refutational text on the seasons. According to the SAS, readers learn important information because they allocate extra attention to certain elements in the text. Therefore, the SAS would predict that the refutation text elements should results in greater learning than non-refutational text formats. Undergraduate college students were assigned to read either a refutational or a non-refutational text. Both texts introduced the same topic (seasonal change) but the refutational text elicits and directly challenges the students’ misconceptions of the phenomena. Individual participant’s reading times were tracked and recorded sentence-by-sentence in order to examine the effects of the SAS on the processing of refutational text and promoting conceptual change. A one-way ANCOVA was conducted to compare reading times between the refutation text group and the non-refutation text group. The results show a significant difference in time spent reading the refutational paragraph [F(2,45) = 4.86, p<.05]. More interestingly, the significant difference was due to the refutational segment of the text [F(2,45) = 4.47, p<.05]. These results indicate that readers spent less time processing the refutational text. Both text types showed learning effects with participants in both groups scoring higher on the seasons concept inventory at both the post-test and delayed post-test. These findings illustrate that the refutation effect may be due to the “schema slot” notion that refutational material may be easier to read because it serves as an advance organizer, activates background knowledge, and provides clear, concrete, compelling examples for the reader. A second study, which will be completed and included in this presentation will more fully explore the influence of background knowledge on attentional allocation to the refutational text segments. In this study, participants will read either the refutional or non-refutational texts as in Study I. In addition, they will be interviewed to explore more fully the nature of the influence of background knowledge and attention allocation contributing to the refutation text effect. References Anto, E., Pentinnen, M., Mikkila-Erdmann, M., Salonen, P. (2006). Individual conceptual change processes during learning from science text: A multimethod online approach. Paper presented at the meeting of the European Association for Research on Lerning and Instruction, Special Interest Group, Conceptual Change, Stockholm, Sweden. Dole, J. A., & Sinatra, G. M. (1998). Reconceptualizing change in the cognitive construction of knowledge. Educational Psychologist, 33(3), 109-128. Guzetti, B. J., Snyder, T. E., Glass, G. V., & Gamas, W. S. (1993). Meta-analysis of instructional interventions from reading education and science education to promote conceptual change in science. Reading Research Quarterly, 28, 116-161. Mason, L., & Boscolo, P. (2004). Role of epistemological understanding and interest in interpreting a controversy and in topic-specific belief change. Contemporary Educational Psychology, 29, 103-128. Reynolds, R. E. (1992). Selective attention and prose learning: Theoretical and empirical research. Educational Psychology Review, 4(4), 1-48. |
| Keywords | Cognitive processes/development Conceptual change Reading |
| Appendices | |
| Authors | ||||||
|---|---|---|---|---|---|---|
| Name | Surname | Institution | Country | EARLI Number | Presenting | |
| Suzanne H. | Broughton | University of Nevada, Las Vegas | United States | suzanne.broughton@unlv.edu | * | |
| Gale M. | Sinatra | University of Nevada, Las Vegas | United States | sinatra@unlv.nevada.edu | ||
| Ralph E. | Reynolds | University of Nevada, Las Vegas | United States | ralph.reynolds@unlv.edu | ||
| Title | Tracing the process of conceptual change in reading science text | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Abstract | Keywords: cognitive conflict, conceptual change, eye tracking, text comprehension |
|||||||||||||||
| Summary | Tracing the process of conceptual change in reading science text According to the Construction-Integration -model (Kintsch & van Dijk 1983; Kintsch 1988) the reader forms a text base and a situation model in a continuous cycle while reading. These are constructed through propositions activated by the text. The propositions are interpreted through the reader's knowledge base (i.e. prior knowledge). It is likely that cognitive conflict, the collision of naive and scientific conceptions, can be experienced in different levels of comprehension. Based on the CI -model, cognitive conflict on a propositional level can be placed in the comparison of a newly formed, naively interpreted proposition and the text base, through which the situation model will be formed. Kintsch and van Dijk (1983) suggest that if the reader encounters difficulties while comparing a new proposition to earlier ones, he might have to return to earlier text to support his working memory. This kind of text processing can be examined extremely accurately with the methodology offered by eye movement research (e.g. Hyönä et al. 2003) (table 1).
Table 1. Measuring cognitive difficulties in reading process. Method Thirty 6th graders participated in this study. Written pre- and delayed post-tests were used and conducted in classrooms (table 2). Tests consisted of fact finding and so-called generative questions (see Vosniadou 1994). Performance on generative questions was used here to describe the reader's level of conceptual change. In the laboratory setting the participants read either a refutational or an explanatory text concerning photosynthesis. Texts were otherwise identical, but refutational text included metaconceptual text units which pointed out the possible differences between the misconceptions of the reader and the scientific model (see Mikkilä-Erdmann 2001).
Table 2. The design. Study 2 Gilabert, R., Martinez, G. & Vidal-Abarca, E. (2005). Some good texts are always better: Text revision to foster inferences of readers with high and low prior background knowledge. Learning and Instruction, 15, 45-68. Hyönä, J., Lorch, R.F. Jr & Rinck, M. (2003). Eye movement measures to study global text processing. In J. Hyönä, R. Radach & H. Deubel (Eds.), The mind’s eye: Cognitive and applied aspects of eye movement research (pp. 313-334). Kintsch, W. (1988). The role of knowledge in discourse comprehension: A construction-integration model. Psychological Review, 95, 163-182. Limón, M. & Mason, L. (Eds.; 2002). Reconsidering conceptual change. Issues in theory and practise. Mikkilä-Erdmann, M. (2001). Improving conceptual change concerning photosynthesis through text design. Learning and Instruction, 11, 241-257. Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124, No. 3, 372-422. van Dijk, T. & Kintsch, W. (1983). Strategies of discourse comprehension. Vosniadou, S. (1994). Capturing and modelling the process of conceptual change. Learning and Instruction, 4, 45-69. |
|||||||||||||||
| Keywords | Conceptual change Research methodology Text comprehension |
|||||||||||||||
| Appendices | Graph 1.JPG | |||||||||||||||
| Authors | ||||||
|---|---|---|---|---|---|---|
| Name | Surname | Institution | Country | EARLI Number | Presenting | |
| Mirjamaija | Mikkila-Erdmann | University of Turku | Finland | mirmik@utu.fi | * | |
| Erkki | Anto | University of Turku | Finland | emanto@utu.fi | ||
| Marjaana | Penttinen | University of Turku | Finland | mapent@utu.fi | ||

