The Graphic Organizers Bibliography contains a wide variety of articles highlighting not only the different types of graphic organizers but the versatility and importance of graphic organizers in different educational settings. The articles chosen represent topics ranging from concept mapping protocols in medical school to mind mapping activities in elementary school science settings. For the novice reader, the articles by Joseph Novak, the researcher credited with the modern day development of concept mapping, provide a thorough introduction to the development of concept mapping. For more diverse interests, the studies reviewed by individual members of our group demonstrate the impressive range of graphic organizers: Bera & Robinson (2008) pair graphic organizers with text summaries in an attempt to increase knowledge retention; Gonzalez et al. (2008) use a concept mapping strategy paired with a mediation protocol to enhance meaningful learning; Carlson, Chandler, & Sweller (2003) studied how graphic organizers may reduce cognitive load. In general, this bibliography spans am impressive range of topics and contains some of the most prominent names doing research in the area of graphic organizers today.
graphic organizer bibliography download
Saturday, May 2, 2009
Implications
The Mautone and Mayer (2007) study suggests the potential to use structural and concrete graphic organizers to promote students’ comprehension of scientific graphs. Structural organizers should help students to understand how variables are related. In addition, there is the possibility that repeated use of concrete graphic organizers may promote causal understanding and integration of new knowledge into existing schemata. Theoretical implications suggest that signaling graphic organizers that focus on structure may help students to better understand relations in graphs. Structural graphic organizers can help students to better understand more complex relations between variables, such as curvilinear relationships.
The Ozmen (2009) study suggests the potential to use laboratory activities and concept mapping together to modify alternative conceptions that tend to be stable and resistant to correction by traditional teaching methods. Theoretical implications of this article involve possible synergistic effects between concept mapping and laboratory activities (and possibly other forms of experiential learning, group work, and project-based learning).
The Chiou, C. (2008) study indicates that concept mapping can be an effective meta-cognitive strategy to enhance meaningful learning in accounting and other related business courses. In domains that stress the incremental acquisition of knowledge (in particular math and science), concept mapping might be an effective instructional and summative tool by allowing corrective feedback during the course of instruction
The Gonzalez, H., Palencia, A., Umana, L., Galindo, L., Villafrade M,L., (2008)study suggests that concept mapping, combined with a mediated learning experience, can be an effective meta-cognitive strategy to enhance meaningful learning in a medical school setting.
One of the implications the Bahr, S & Dasereau,D. (2005) study includes using both BiK and monolingual knowledge maps in all kinds of academic settings in order to promote a shift toward a more beneficial top-down processing strategy among the learners.
The Bera and Robinson (2004) study suggests that future GO research further explore relations and interdependence between encoding efficiency and encoding distinctiveness, the two factors that can produce the efficient and effective comprehension of main ideas.
Practical implication for this study are likely to include the incorporation of Bera and Robinson efforts which call on educators to capitalize on students’ active involvement in the learning process into everyday in-class instruction and may lead to more content-appropriate handouts and displays in schools in all levels.
The Gardill and Jitendra(1999) study suggests that direct instruction in the use of story maps can lead to gains in comprehension with middle school students with learning disabilities. The number of instruction and practice sessions needed before mastery was achieved was up to 23, so repeated practice would be needed to effectively make use of this instructional strategy.
The Abi-El-Mona study lends support to the efficacy of using mind maps to support student learning in the domain of science instruction for middle school students. Furthermore, the gains were not mediated by students’ prior achievement.The results from the study contradict the theory of iconography’s connection with mind-mapping proposed by Buzan.
The Ozmen (2009) study suggests the potential to use laboratory activities and concept mapping together to modify alternative conceptions that tend to be stable and resistant to correction by traditional teaching methods. Theoretical implications of this article involve possible synergistic effects between concept mapping and laboratory activities (and possibly other forms of experiential learning, group work, and project-based learning).
The Chiou, C. (2008) study indicates that concept mapping can be an effective meta-cognitive strategy to enhance meaningful learning in accounting and other related business courses. In domains that stress the incremental acquisition of knowledge (in particular math and science), concept mapping might be an effective instructional and summative tool by allowing corrective feedback during the course of instruction
The Gonzalez, H., Palencia, A., Umana, L., Galindo, L., Villafrade M,L., (2008)study suggests that concept mapping, combined with a mediated learning experience, can be an effective meta-cognitive strategy to enhance meaningful learning in a medical school setting.
One of the implications the Bahr, S & Dasereau,D. (2005) study includes using both BiK and monolingual knowledge maps in all kinds of academic settings in order to promote a shift toward a more beneficial top-down processing strategy among the learners.
The Bera and Robinson (2004) study suggests that future GO research further explore relations and interdependence between encoding efficiency and encoding distinctiveness, the two factors that can produce the efficient and effective comprehension of main ideas.
Practical implication for this study are likely to include the incorporation of Bera and Robinson efforts which call on educators to capitalize on students’ active involvement in the learning process into everyday in-class instruction and may lead to more content-appropriate handouts and displays in schools in all levels.
The Gardill and Jitendra(1999) study suggests that direct instruction in the use of story maps can lead to gains in comprehension with middle school students with learning disabilities. The number of instruction and practice sessions needed before mastery was achieved was up to 23, so repeated practice would be needed to effectively make use of this instructional strategy.
The Abi-El-Mona study lends support to the efficacy of using mind maps to support student learning in the domain of science instruction for middle school students. Furthermore, the gains were not mediated by students’ prior achievement.The results from the study contradict the theory of iconography’s connection with mind-mapping proposed by Buzan.
Selection
These research articles selected and reviewed by the contributors of the Graphic Organizer Blog represents both a broad and a holistic overview of this particular segment of cognition research. With the aim to give the readers sufficient information and insight into the world of graphic organizers (GOs), we chose articles that examined the use of GOs in both hard and social science settings. As the titles of the articles are good indicator of the setting were the studies were performed, a decision was made to omit specific references hereafter.
We decided to highlight research that not only measured the effects of various types of GOs but also performed comparative analysis with other instructional methods currently in use in a typical classroom.
We also included research that either aimed to replicate or to confirm previous studies on GOs, something that is, in our opinion, not done with enough frequency in educational research.
Finally, we felt strongly about the need to show the versatility and diversity GOs can provide in terms of statement generation, mediated learning, and scaffolding for experts and learners alike in any instructional settings.
In our opinion, GOs offer enormous possibilities to improve human learning throughout the life stages by influencing instruction. We invite the reader to read additional articles from our bibliography to witness the amazing range of fields such as special education, science classrooms, medical schools, cancer patient advocacy and foreign language training where GO has been making a difference.
We decided to highlight research that not only measured the effects of various types of GOs but also performed comparative analysis with other instructional methods currently in use in a typical classroom.
We also included research that either aimed to replicate or to confirm previous studies on GOs, something that is, in our opinion, not done with enough frequency in educational research.
Finally, we felt strongly about the need to show the versatility and diversity GOs can provide in terms of statement generation, mediated learning, and scaffolding for experts and learners alike in any instructional settings.
In our opinion, GOs offer enormous possibilities to improve human learning throughout the life stages by influencing instruction. We invite the reader to read additional articles from our bibliography to witness the amazing range of fields such as special education, science classrooms, medical schools, cancer patient advocacy and foreign language training where GO has been making a difference.
Gardill, M. C., & Jitendra, A. K. (1999)
Gardill, M. C., & Jitendra, A. K. (1999). Advanced Story Map Instruction: Effects on the Reading Comprehension of Students with Learning Disabilities. Journal of Special Education, 33(1), 2-17,28.
Problem, Purpose and Research Questions:
The study being reviewed is entitled Advanced Story Map Instruction: Effects on the Reading Comprehension of Students with Learning Disabilities (Gardill & Jitendra, 1999). This study is a replication of work that was done with similarly disabled students (Gurrney et al. 1990). However, the researchers endeavored to improve on the research design and add an additional phase where generalization of the treatment was assessed.
Methods
The multiple baseline study design used assessments prior to the intervention, post measures, a time lapse and then a maintenance measure to see if gains in story comprehension continued after direct instruction and practice in story map construction was discontinued.
The study participants consisted of five males and one female. All students were Caucasian. One student also had a documented neurological disability. Pseudonyms were used throughout the study to relate details about each student’s performance throughout the study.
The researchers provided a table which included participant’s demographic and test data which included: age, grade, years in special education, performance on the full scale IQ assessment (WISC-R), and two subscale scores on the Woodcock Reading Mastery Test-Word Identification and Passage Comprehension.
The study researchers limited the participants to students who did not have severe reading delays so that reading ability would not be a confounding variable. The reading level criteria set up were that students had to score at least the fourth grade level on the word identification subtest of the Woodcock Reading Mastery Test – Revised (WRMT-Revised). In addition, to prove that they had difficulties with comprehension they had to have been so identified by their special education teacher as well as scoring at least two grades below their grade level on the reading comprehension subtest of the WRMT-Revised.
For the dependent variable, the researchers developed two comprehension quiz instruments. The first one focused on correctly identifying story grammar elements. These questions closely correlated with story map elements that the students complete with the story map form. The second, basal assessment instrument contained comprehension questions that combined literal and inferential questions. All questions required a production response of more than one word or phrase. Acceptable answers to these questions were developed so a scoring rubric was developed. Students also completed a basal story map with no teacher intervention except for “do your best.”
Students were given instruction on completing story map forms in a separate room in dyads, not in their classrooms. Teacher scripts were developed to control for some aspects of teacher interaction effects. The direct instruction sessions taught story map completion which included ascertaining the main idea, conflict and attempts at resolution. Students were first given sessions of direct instruction, then guided practice, and finally independent practice using a story map form that was developed by the researchers as a more advanced version of simple story maps. The intervention period for the dyads lasted from 14- to 20- weeks. The total time for the intervention phase lasted 21 to 27 hours (M=23.6 hr).
The story map form contained questions that were posted in a vertical portrait style format with horizontal lines provided for writing the answers to the following prompts: Student name, date, Story (Title), Name the problems or conflict. Identify the main characters and describe them. Where does the story take place? Tell how the characters try to solve the problem. Is there an added twist or complication in the story? Tell how the problem is or is not solved. What is the theme of the story? What is the author trying to say?
After students received instruction in story map completion, they participated in practice sessions until they reached the criteria for mastery- 80% on two out of three story grammar tests. A maintenance assessment of reading and comprehension questions was performed using another reading text after two weeks.
A verbal assessment of comprehension was incorporated into the study as well. It was in the form of story retelling where a teacher read a story to the student and then asked the student to retell the story in their own words. The rationale was put forward that students with learning disabilities often have problems expressing themselves via writing, so may not show their full subject knowledge through this means of communication. A rubric was set up to assess their verbal retelling of the text. Assessments were made before and after the direct instruction of story maps had completed. Each student was assessed separately, and retelling was audio taped and transcribed for later analysis.
Results
The study authors provided bar graphs showing pre, post, and maintenance scores for each student in the study.
The students also completed a student questionnaire in the form of a customer satisfaction survey. They were asked how they rated the story map procedure and whether or not they would advocate its use with their peers.
At baseline, the mean scores for story grammar quiz (story map completion) and basal comprehension were 30% and 39% respectively. During the teacher modeling phase, scores rose to a mean of 51% (range = 37% - 59%). For the independent phase, an average increase of 55% (range 40% - 67%) was made compared to baseline for the story grammar quizzes. A mean increase of 24% (range 5%- 26%) was made on the basal comprehension tests. For the generalization phase, the story grammar quiz mean score was 86% correct - an improvement of 56% over baseline. Whereas a mean increase of 16% was noted for the basal comprehension. In the maintenance phase, a mean increase over baseline of 19% (range 6% - 38%) was made on the story grammar quiz. A mean gain of 19% was also made on the basal comprehension test. With the exception of two students, literal and inferential comprehension scores rose for all other students.
For the oral retells, mean scores for the six students were not reported. Instead results were broken down by student. In comparing the number of words, the number of words increased for only two students. When analyzing the audio for story grammar elements, it was found that 5 of the 6 students showed increases in the number of story elements mentioned.
For the student questionnaire about the effectiveness of using story maps, the majority of the students chose the category often to describe how often they would use the technique (mean = 3 corresponding to “quite strongly”).
Discussion and Implications
The study researchers stated that using story maps helped students develop a framework to organize and remember story elements which in turn would help them develop greater comprehension. They point out that the mean performance of all six students improved from the baseline condition in basal comprehension. They noted the one female student’s performance decreasing after initial gains, though overall higher than baseline. She was also the student who was identified as having a neurological disorder. The researchers hypothesized that she became fatigued over the course of the many sessions.
The researchers listed some limitations that they saw in their study. First, they mentioned the small group of students in the study limits generalization. They listed the fact that intervention was provided in pairs where more individualized instruction could take place. Thirdly, they mentioned that students were given the intervention outside the classroom in a self contained environment, and suggested that studies performed in an inclusive environment are needed.
Critique
The two major problems with this study were two possible confounding variables the dyad instruction, which of course meant a much smaller teacher to student ratio, and the second being quiet environment with the concomitant lack of noise and distractions. These two variables could have accounted for comprehension gain and competed with the effectiveness of the independent variable under study – direct instruction in story map completion and all the sub-skills necessary for that independent skill.
Also, it would have been better if the results section listed quiz scores or z scores instead of improvement over baseline. The improvement over baseline, gave a “rosier” picture of gains made than would z scores. However the researchers did provide a plot graph for each student showing data points at each stage of the study for both story grammar quizzes and baseline comprehension tests. This graphic was useful in interpreting the results dispassionately.
Problem, Purpose and Research Questions:
The study being reviewed is entitled Advanced Story Map Instruction: Effects on the Reading Comprehension of Students with Learning Disabilities (Gardill & Jitendra, 1999). This study is a replication of work that was done with similarly disabled students (Gurrney et al. 1990). However, the researchers endeavored to improve on the research design and add an additional phase where generalization of the treatment was assessed.
Methods
The multiple baseline study design used assessments prior to the intervention, post measures, a time lapse and then a maintenance measure to see if gains in story comprehension continued after direct instruction and practice in story map construction was discontinued.
The study participants consisted of five males and one female. All students were Caucasian. One student also had a documented neurological disability. Pseudonyms were used throughout the study to relate details about each student’s performance throughout the study.
The researchers provided a table which included participant’s demographic and test data which included: age, grade, years in special education, performance on the full scale IQ assessment (WISC-R), and two subscale scores on the Woodcock Reading Mastery Test-Word Identification and Passage Comprehension.
The study researchers limited the participants to students who did not have severe reading delays so that reading ability would not be a confounding variable. The reading level criteria set up were that students had to score at least the fourth grade level on the word identification subtest of the Woodcock Reading Mastery Test – Revised (WRMT-Revised). In addition, to prove that they had difficulties with comprehension they had to have been so identified by their special education teacher as well as scoring at least two grades below their grade level on the reading comprehension subtest of the WRMT-Revised.
For the dependent variable, the researchers developed two comprehension quiz instruments. The first one focused on correctly identifying story grammar elements. These questions closely correlated with story map elements that the students complete with the story map form. The second, basal assessment instrument contained comprehension questions that combined literal and inferential questions. All questions required a production response of more than one word or phrase. Acceptable answers to these questions were developed so a scoring rubric was developed. Students also completed a basal story map with no teacher intervention except for “do your best.”
Students were given instruction on completing story map forms in a separate room in dyads, not in their classrooms. Teacher scripts were developed to control for some aspects of teacher interaction effects. The direct instruction sessions taught story map completion which included ascertaining the main idea, conflict and attempts at resolution. Students were first given sessions of direct instruction, then guided practice, and finally independent practice using a story map form that was developed by the researchers as a more advanced version of simple story maps. The intervention period for the dyads lasted from 14- to 20- weeks. The total time for the intervention phase lasted 21 to 27 hours (M=23.6 hr).
The story map form contained questions that were posted in a vertical portrait style format with horizontal lines provided for writing the answers to the following prompts: Student name, date, Story (Title), Name the problems or conflict. Identify the main characters and describe them. Where does the story take place? Tell how the characters try to solve the problem. Is there an added twist or complication in the story? Tell how the problem is or is not solved. What is the theme of the story? What is the author trying to say?
After students received instruction in story map completion, they participated in practice sessions until they reached the criteria for mastery- 80% on two out of three story grammar tests. A maintenance assessment of reading and comprehension questions was performed using another reading text after two weeks.
A verbal assessment of comprehension was incorporated into the study as well. It was in the form of story retelling where a teacher read a story to the student and then asked the student to retell the story in their own words. The rationale was put forward that students with learning disabilities often have problems expressing themselves via writing, so may not show their full subject knowledge through this means of communication. A rubric was set up to assess their verbal retelling of the text. Assessments were made before and after the direct instruction of story maps had completed. Each student was assessed separately, and retelling was audio taped and transcribed for later analysis.
Results
The study authors provided bar graphs showing pre, post, and maintenance scores for each student in the study.
The students also completed a student questionnaire in the form of a customer satisfaction survey. They were asked how they rated the story map procedure and whether or not they would advocate its use with their peers.
At baseline, the mean scores for story grammar quiz (story map completion) and basal comprehension were 30% and 39% respectively. During the teacher modeling phase, scores rose to a mean of 51% (range = 37% - 59%). For the independent phase, an average increase of 55% (range 40% - 67%) was made compared to baseline for the story grammar quizzes. A mean increase of 24% (range 5%- 26%) was made on the basal comprehension tests. For the generalization phase, the story grammar quiz mean score was 86% correct - an improvement of 56% over baseline. Whereas a mean increase of 16% was noted for the basal comprehension. In the maintenance phase, a mean increase over baseline of 19% (range 6% - 38%) was made on the story grammar quiz. A mean gain of 19% was also made on the basal comprehension test. With the exception of two students, literal and inferential comprehension scores rose for all other students.
For the oral retells, mean scores for the six students were not reported. Instead results were broken down by student. In comparing the number of words, the number of words increased for only two students. When analyzing the audio for story grammar elements, it was found that 5 of the 6 students showed increases in the number of story elements mentioned.
For the student questionnaire about the effectiveness of using story maps, the majority of the students chose the category often to describe how often they would use the technique (mean = 3 corresponding to “quite strongly”).
Discussion and Implications
The study researchers stated that using story maps helped students develop a framework to organize and remember story elements which in turn would help them develop greater comprehension. They point out that the mean performance of all six students improved from the baseline condition in basal comprehension. They noted the one female student’s performance decreasing after initial gains, though overall higher than baseline. She was also the student who was identified as having a neurological disorder. The researchers hypothesized that she became fatigued over the course of the many sessions.
The researchers listed some limitations that they saw in their study. First, they mentioned the small group of students in the study limits generalization. They listed the fact that intervention was provided in pairs where more individualized instruction could take place. Thirdly, they mentioned that students were given the intervention outside the classroom in a self contained environment, and suggested that studies performed in an inclusive environment are needed.
Critique
The two major problems with this study were two possible confounding variables the dyad instruction, which of course meant a much smaller teacher to student ratio, and the second being quiet environment with the concomitant lack of noise and distractions. These two variables could have accounted for comprehension gain and competed with the effectiveness of the independent variable under study – direct instruction in story map completion and all the sub-skills necessary for that independent skill.
Also, it would have been better if the results section listed quiz scores or z scores instead of improvement over baseline. The improvement over baseline, gave a “rosier” picture of gains made than would z scores. However the researchers did provide a plot graph for each student showing data points at each stage of the study for both story grammar quizzes and baseline comprehension tests. This graphic was useful in interpreting the results dispassionately.
Abi-El-Mona, I., & Adb-El-Khalick, F. (2008)
Abi-El-Mona, I., & Adb-El-Khalick, F. (2008). The Influence of Mind Mapping on Eighth Graders' Science Achievement. [Feature]. School Science and Mathematics, 108(7), 298-312.
Purpose, Problem and Research Questions
The problem was not directly stated in the article, however, it can be inferred. The integration of science concepts including reasoning and clear concept understanding can be improved in science instruction. To this end, the purpose of this study was to ascertain the effectiveness of students generating their own mind maps after a lecture and seeing if it increased their concept knowledge. Students with different initial achievement levels were used to see if the effectiveness was differentiated by different levels of prior knowledge or achievement.
Mind maps were defined as different from concept maps in that although they both share many attributes , ie both are graphic organizers with a web-like structure and conceptual links in a non-linear fashion, mind maps inspire more personal connections, are not necessarily hierarchical, use color and drawings or icons, and sometimes add a legend.
Methods
The study design was a 2x3 factorial study with post test only. The independent variable was the use of mind mapping in a classroom setting. There were two levels: use and non-use. The second factor was a moderator variable. It was prior academic achievement in science with three levels (high, medium, and low). The dependent variable was post instruction achievement.
The population for the study was a private middle school in a Middle Eastern country. All classes were taught in English. The study participants were 62 eighth grade students placed in four intact classrooms. The teacher/instructor for the both the control group and the intervention group was the same (one of the researchers). The instructional method during the lecture portion remained constant as well. Two class sections were randomly assigned to each experimental condition.
For the intervention group, mind mapping instruction took place over the period of one month. The control group was instructed in a note summarization procedure so that time of intervention for both conditions would be kept constant. During the intervention phase the classrooms either spent the last 10 minutes forming mind maps or doing note summarization .
Post instruction achievement was performed using a test instrument developed by both researchers. The test items were 30 multiple choice questions, which targeted NAEP science standards. These same standards were used in the curriculum development for the lecture part of the course. Domains fell across two categories- conceptual understanding and practical reasoning. The test item pool was examined by four secondary science teachers to ensure validity of the instrument. Some items were changed, added, or deleted based on the feedback that was collected.
Results
Two multivariate analyses of variance (MANOVA) were performed on the test results, with the factors under consideration, use/non use of the mind maps, and the three levels or prior science achievement. Another MANOVA was conducted with two categories of achievement –conceptual understanding and practical reasoning. When results were significant , a univariate analysis followed the MANOVA.
In addition a rubric was developed by the two researchers to analyze the mind maps that the students had created. Items such as number of links, the map geography, the use of colors, the use of drawings, the use of icons, presence of a central theme, and links to major concepts.
Mind maps were also analyzed in a historical fashion. Mind maps created at the beginning of the semester were compared to mind maps created later,
The test using the 3 levels of prior achievement, - (PSA) was statiscally significant for T (p>.05). In addition. Students scored higher on both conceptual understanding test items and practical reasoning items(M-exp = 72.9, M – comp=57.53, p <001) .
Discussion
The researchers listed one limitation of the study. That this is only one study and needs to be replicated in other settings. The researcher spent time going into the differences in design of mind maps, comparing maps high scoring, medium scoring and lower scoring students. High scoring students individualized their maps, used color, seldom used icons (contradicting another mind map researcher) and had few but correct links to other major topics.
Implications
The main implication is that creating mind maps to consolidate and organize knowledge may be a useful tool for students to enhance their learning. More research should be done in this promising endeavor, especially because it helps to personalize information for the learner in meaningful ways,and in turn, raising student achievement.
Critique
This article, despite the statistical complexities, was very well organized and presented. Ideas were clear, even though few diagrams were used. The only exception is the Vee maps.
Effect strength was not computed for the significant statistics. This would have been helpful for interpretation of the results importance to other researchers
In terms of ethical issues, the researchers don't indicate how securely they kept the testing materials nor the mind maps that they collected at the end of each session. Also, since the authors ascertained that mind maps were beneficial to student learning, they should have offered some way to offer that treatment/method of instruction to the students who missed out - the control group. Since each mind mapping exercise occurred directly after instruction, either the instruction would need to be repeated which is unlikely, or from that point on, all students would be given assignments with mind mapping after instruction.
Purpose, Problem and Research Questions
The problem was not directly stated in the article, however, it can be inferred. The integration of science concepts including reasoning and clear concept understanding can be improved in science instruction. To this end, the purpose of this study was to ascertain the effectiveness of students generating their own mind maps after a lecture and seeing if it increased their concept knowledge. Students with different initial achievement levels were used to see if the effectiveness was differentiated by different levels of prior knowledge or achievement.
Mind maps were defined as different from concept maps in that although they both share many attributes , ie both are graphic organizers with a web-like structure and conceptual links in a non-linear fashion, mind maps inspire more personal connections, are not necessarily hierarchical, use color and drawings or icons, and sometimes add a legend.
Methods
The study design was a 2x3 factorial study with post test only. The independent variable was the use of mind mapping in a classroom setting. There were two levels: use and non-use. The second factor was a moderator variable. It was prior academic achievement in science with three levels (high, medium, and low). The dependent variable was post instruction achievement.
The population for the study was a private middle school in a Middle Eastern country. All classes were taught in English. The study participants were 62 eighth grade students placed in four intact classrooms. The teacher/instructor for the both the control group and the intervention group was the same (one of the researchers). The instructional method during the lecture portion remained constant as well. Two class sections were randomly assigned to each experimental condition.
For the intervention group, mind mapping instruction took place over the period of one month. The control group was instructed in a note summarization procedure so that time of intervention for both conditions would be kept constant. During the intervention phase the classrooms either spent the last 10 minutes forming mind maps or doing note summarization .
Post instruction achievement was performed using a test instrument developed by both researchers. The test items were 30 multiple choice questions, which targeted NAEP science standards. These same standards were used in the curriculum development for the lecture part of the course. Domains fell across two categories- conceptual understanding and practical reasoning. The test item pool was examined by four secondary science teachers to ensure validity of the instrument. Some items were changed, added, or deleted based on the feedback that was collected.
Results
Two multivariate analyses of variance (MANOVA) were performed on the test results, with the factors under consideration, use/non use of the mind maps, and the three levels or prior science achievement. Another MANOVA was conducted with two categories of achievement –conceptual understanding and practical reasoning. When results were significant , a univariate analysis followed the MANOVA.
In addition a rubric was developed by the two researchers to analyze the mind maps that the students had created. Items such as number of links, the map geography, the use of colors, the use of drawings, the use of icons, presence of a central theme, and links to major concepts.
Mind maps were also analyzed in a historical fashion. Mind maps created at the beginning of the semester were compared to mind maps created later,
The test using the 3 levels of prior achievement, - (PSA) was statiscally significant for T (p>.05). In addition. Students scored higher on both conceptual understanding test items and practical reasoning items(M-exp = 72.9, M – comp=57.53, p <001) .
Discussion
The researchers listed one limitation of the study. That this is only one study and needs to be replicated in other settings. The researcher spent time going into the differences in design of mind maps, comparing maps high scoring, medium scoring and lower scoring students. High scoring students individualized their maps, used color, seldom used icons (contradicting another mind map researcher) and had few but correct links to other major topics.
Implications
The main implication is that creating mind maps to consolidate and organize knowledge may be a useful tool for students to enhance their learning. More research should be done in this promising endeavor, especially because it helps to personalize information for the learner in meaningful ways,and in turn, raising student achievement.
Critique
This article, despite the statistical complexities, was very well organized and presented. Ideas were clear, even though few diagrams were used. The only exception is the Vee maps.
Effect strength was not computed for the significant statistics. This would have been helpful for interpretation of the results importance to other researchers
In terms of ethical issues, the researchers don't indicate how securely they kept the testing materials nor the mind maps that they collected at the end of each session. Also, since the authors ascertained that mind maps were beneficial to student learning, they should have offered some way to offer that treatment/method of instruction to the students who missed out - the control group. Since each mind mapping exercise occurred directly after instruction, either the instruction would need to be repeated which is unlikely, or from that point on, all students would be given assignments with mind mapping after instruction.
Gonzalez et al. (2008)
Gonzalez, H., Palencia, A., Umana, L., Galindo, L., Villafrade M, L., (2008) Mediated learning experience and concept maps: A pedagogical tool for achieving meaningful learning in medical physiology students. Adv Physiol Educ. 32, 312-316.
Purpose/Problem
The research problem addressed in this experimental study is whether a concept mapping methodology, combined with a mediated learning experience, increases meaningful learning in students attending a cardiovascular module of a medical physiology course. Gonzalez, Palencia, Umana, Galindo and Villafrade define meaningful learning as 1) students being able to predict or explain the responses of the physiological system when stressed, and 2) students being able to solve quantitative problems related to the physiological system. Gonzalez et al. define mediated learning as the interaction between the learner and a mediator where the mediator is primarily concerned with how the learner approaches problem solving. Specifically, Gonzalez et al. utilized the model of mediation described by R. Feurstein. In this model, the mediator involves herself in the student learning process not as a traditional teacher, but as a type of learning coach. Gonzalez et al. describe four qualities that must be present in the mediator-student learner interaction: 1) intentionality, where the mediator concentrates on helping the learner understand how he or she is using their cognitive faculties; 2) reciprocity, where the mediator and the learner consider one another as being co-equals in the learning process; 3) mediation of meaning, where the mediator interprets for the learner the significance of what the learner has accomplished; 4) transcendence, where the mediator helps the learner apply the lessons learned to new situations.
This study is noteworthy because the use of concept mapping, combined with a meditated learning experience, could prove to be a powerful pedagogical tool in a medical physiology class as well as other medical school courses. Gonzalez et al. ground their study by citing well-established research establishing the efficacy of concept mapping to promote meaningful learning as well as research describing the effectiveness of the mediated learning experience. The researchers note that the literature points out the need for more effective pedagogical models to help medical students select, integrate, and transfer new learning, and therefore, reach a meaningful learning threshold.
Methods
The participants in this study were 121 medical students in their third semester of medical school in Columbia. At the beginning of the study, each student was assigned an index score based on: 1) their total score on a national high school graduate exam; 2) their cumulative average medical school grades from the previous two semesters, and 3) their grade obtained on a construction of a conceptual mentifact – a graphical instrument that represents thoughts and values – used to define how knowledge is organized and represented in the human mind. Depending on the index score, the students were divided into quartile groups: quartile one were students in the lowest 25 percent of the index score while quartile four were students who obtained the highest index scores or the top 25 percent. Students in quartile four were deemed the most competent in their medical studies while students in quartile one was deemed the least competent. Students in each quartile were randomly assigned to the control group or to the intervention group. In order to increase the possibility of finding significant differences between groups, Gonzalez et al. established a 2:1 ratio of intervention students to control students.
Students in the experimental group attended four 2-hour mediated sessions where mediators helped the students develop individualized approaches to studying the cardiovascular module. Students in the experimental group also received reading material from the cardiovascular module one week prior to the first session. At the beginning of each mediated session, the mediators, who were professors at the medical school, briefly discussed the information contained in the reading material. The mediators also explained concept mapping construction. After the explanations, each subgroup was given two sets of cards: one with propositions reflecting concepts; and the other with definitions of the concepts. Students in the experimental group were then asked to prepare concept maps linking propositions and definitions contained in the reading material. Mediators observed the cognitive performance of the students during the concept mapping activity and helped them to analyze and correct any difficulties that arose in organizing the concepts. The students in the experimental group then corrected their own maps.
Students in the control group also attended four 2-hour sessions conducted by the medical school professors and received the same reading material from the cardiovascular module. In explaining the reading material, the professors did not act as mediators but assumed more traditional roles as teachers. The pedagogical methods used with the control group were ones that were traditionally used at the medical school; teachers asked questions and students answered.
During each session, two researchers acted as observers and recorded the academic, cognitive, attitudinal, and behavioral performances of students in both the control and experimental groups, the mediators in the experimental group, and the professors in the control group. After completion of the four sessions of the cardiovascular module, the control and experimental groups took two exams to evaluate student learning and achievement. One exam consisted of multiple choice questions assessing the student recall of the information in the cardiovascular module. The second exam consisted of problem-solving scenarios assessing the students’ ability to transfer information learned during the module to new situations. Additionally, at the end of the cardiovascular module, both groups were given self-evaluation instruments requiring them to assess any perceived changes in their cognitive processes.
The experimental and control groups were compared using the following two variables: 1) average grades on the two post-sessions exams; and 2) the percentage of students who failed the exams (on a scale from 1.0 to 5.0, any student scoring below 3.0). Averages (means) and SDs were used for the continuous variables and percentages were used for discrete variables. Differences between the control and experimental groups were determined by a t-test (a comparison of the two means) and a Mann-Whitney test (p < 0.05).
Results
Gonzalez et al. report that mean scores from the problem-solving exam were higher in the experimental group (N = 83, M = 3.68) than the control group (N = 39, M = 2.79) achieving a statistical significance of p = 0.0013. When student performance was compared using the distribution by quartiles, the average scores on the problem-solving exam were higher for the experimental group than for the control group but the difference in scores were only statistically significant for the students in quartile one (p = 0.008). The average score on the multiple-choice exam was higher for the experimental group in all quartiles with the exception of quartile one.
Qualitative data detailing the effectiveness of mediation was gathered from the self-evaluations of students from both groups and from the researchers who acted as observers during concept mapping activity. Students in the experimental group reported that mediation during the concept mapping activity helped them develop more effective learning strategies by being made more aware of their strengths and weaknesses while organizing information. The experimental group also reported that being given a more active role in their learning was very motivating. These types of remarks were reported less frequently by the control group students.
Discussion
The main purpose of this study was to examine whether a combination of mediation and a concept mapping strategy could increase meaningful learning in medical students in a medical school setting. The results of the study showed that students in the experimental group improved their learning achievement more than the students in the control group. Gonzalez et al. note that these findings are in agreement with findings in the literature.
Gonzalez et al. also note that the statistically significant differences found between the experimental and control groups on the problem-solving exams and not on the multiple-choice exams are not unexpected. Gonzalez et al. posit that multiple-choice exams to not challenge student metacognitive abilities in the same way as problem-solving exams.
Gonzalez et al. also observe that although the experimental group globally benefitted from the implemented strategy, results were greatest in students in the lowest quartile. Gonzalez et al. speculate that the intervention may have stimulated development of cognitive processes that were previously underutilized.
Gonzalez et al. suggest that the qualitative analysis shows that the combination of mediation and concept mapping increases student motivation and stimulates students to participate more actively in their own learning.
Critique
In general, this study employs sound methodological and statistical techniques and represents a well-thought out and controlled study. The writing is clear, appropriately formal, direct, well organized, and factual. The study is well grounded in previous research and makes an important contribution to the literature. Sample size is sufficient (N = 122) to yield generalizable results.
The study could have been strengthened by inclusion of a third experimental group using mediation without the concept mapping strategy, or the concept mapping strategy without the mediation intervention. Since the experimental group showed improvement over the control group by a combination of mediation and concept mapping protocols, it is difficult to determine whether the combination of the interventions is effective or if one intervention contributed to the majority of the improved effect.
Theoretical, Methodological, and Practical Implications
This study indicates that concept mapping, combined with a mediated learning experience, can be an effective meta-cognitive strategy to enhance meaningful learning in a medical school setting. In domains that stress problem-solving and analysis, the combination of concept mapping and mediation might prove to be a powerful pedagogical tool allowing students to maximize meaningful learning. Given the unique context of combining mediation and concept mapping, this study makes an important contribution to the corpus of literature.
In addition, this study indicates that concept mapping combined with mediation encourages more efficient learning skills by allowing these medical students to reflect on their own cognitive processes and adjusting practices to maximize meaningful learning. This change in emphasis from traditional teaching methodologies to more mediated learning experiences seem to enhance meaningful learning in complex domains.
Purpose/Problem
The research problem addressed in this experimental study is whether a concept mapping methodology, combined with a mediated learning experience, increases meaningful learning in students attending a cardiovascular module of a medical physiology course. Gonzalez, Palencia, Umana, Galindo and Villafrade define meaningful learning as 1) students being able to predict or explain the responses of the physiological system when stressed, and 2) students being able to solve quantitative problems related to the physiological system. Gonzalez et al. define mediated learning as the interaction between the learner and a mediator where the mediator is primarily concerned with how the learner approaches problem solving. Specifically, Gonzalez et al. utilized the model of mediation described by R. Feurstein. In this model, the mediator involves herself in the student learning process not as a traditional teacher, but as a type of learning coach. Gonzalez et al. describe four qualities that must be present in the mediator-student learner interaction: 1) intentionality, where the mediator concentrates on helping the learner understand how he or she is using their cognitive faculties; 2) reciprocity, where the mediator and the learner consider one another as being co-equals in the learning process; 3) mediation of meaning, where the mediator interprets for the learner the significance of what the learner has accomplished; 4) transcendence, where the mediator helps the learner apply the lessons learned to new situations.
This study is noteworthy because the use of concept mapping, combined with a meditated learning experience, could prove to be a powerful pedagogical tool in a medical physiology class as well as other medical school courses. Gonzalez et al. ground their study by citing well-established research establishing the efficacy of concept mapping to promote meaningful learning as well as research describing the effectiveness of the mediated learning experience. The researchers note that the literature points out the need for more effective pedagogical models to help medical students select, integrate, and transfer new learning, and therefore, reach a meaningful learning threshold.
Methods
The participants in this study were 121 medical students in their third semester of medical school in Columbia. At the beginning of the study, each student was assigned an index score based on: 1) their total score on a national high school graduate exam; 2) their cumulative average medical school grades from the previous two semesters, and 3) their grade obtained on a construction of a conceptual mentifact – a graphical instrument that represents thoughts and values – used to define how knowledge is organized and represented in the human mind. Depending on the index score, the students were divided into quartile groups: quartile one were students in the lowest 25 percent of the index score while quartile four were students who obtained the highest index scores or the top 25 percent. Students in quartile four were deemed the most competent in their medical studies while students in quartile one was deemed the least competent. Students in each quartile were randomly assigned to the control group or to the intervention group. In order to increase the possibility of finding significant differences between groups, Gonzalez et al. established a 2:1 ratio of intervention students to control students.
Students in the experimental group attended four 2-hour mediated sessions where mediators helped the students develop individualized approaches to studying the cardiovascular module. Students in the experimental group also received reading material from the cardiovascular module one week prior to the first session. At the beginning of each mediated session, the mediators, who were professors at the medical school, briefly discussed the information contained in the reading material. The mediators also explained concept mapping construction. After the explanations, each subgroup was given two sets of cards: one with propositions reflecting concepts; and the other with definitions of the concepts. Students in the experimental group were then asked to prepare concept maps linking propositions and definitions contained in the reading material. Mediators observed the cognitive performance of the students during the concept mapping activity and helped them to analyze and correct any difficulties that arose in organizing the concepts. The students in the experimental group then corrected their own maps.
Students in the control group also attended four 2-hour sessions conducted by the medical school professors and received the same reading material from the cardiovascular module. In explaining the reading material, the professors did not act as mediators but assumed more traditional roles as teachers. The pedagogical methods used with the control group were ones that were traditionally used at the medical school; teachers asked questions and students answered.
During each session, two researchers acted as observers and recorded the academic, cognitive, attitudinal, and behavioral performances of students in both the control and experimental groups, the mediators in the experimental group, and the professors in the control group. After completion of the four sessions of the cardiovascular module, the control and experimental groups took two exams to evaluate student learning and achievement. One exam consisted of multiple choice questions assessing the student recall of the information in the cardiovascular module. The second exam consisted of problem-solving scenarios assessing the students’ ability to transfer information learned during the module to new situations. Additionally, at the end of the cardiovascular module, both groups were given self-evaluation instruments requiring them to assess any perceived changes in their cognitive processes.
The experimental and control groups were compared using the following two variables: 1) average grades on the two post-sessions exams; and 2) the percentage of students who failed the exams (on a scale from 1.0 to 5.0, any student scoring below 3.0). Averages (means) and SDs were used for the continuous variables and percentages were used for discrete variables. Differences between the control and experimental groups were determined by a t-test (a comparison of the two means) and a Mann-Whitney test (p < 0.05).
Results
Gonzalez et al. report that mean scores from the problem-solving exam were higher in the experimental group (N = 83, M = 3.68) than the control group (N = 39, M = 2.79) achieving a statistical significance of p = 0.0013. When student performance was compared using the distribution by quartiles, the average scores on the problem-solving exam were higher for the experimental group than for the control group but the difference in scores were only statistically significant for the students in quartile one (p = 0.008). The average score on the multiple-choice exam was higher for the experimental group in all quartiles with the exception of quartile one.
Qualitative data detailing the effectiveness of mediation was gathered from the self-evaluations of students from both groups and from the researchers who acted as observers during concept mapping activity. Students in the experimental group reported that mediation during the concept mapping activity helped them develop more effective learning strategies by being made more aware of their strengths and weaknesses while organizing information. The experimental group also reported that being given a more active role in their learning was very motivating. These types of remarks were reported less frequently by the control group students.
Discussion
The main purpose of this study was to examine whether a combination of mediation and a concept mapping strategy could increase meaningful learning in medical students in a medical school setting. The results of the study showed that students in the experimental group improved their learning achievement more than the students in the control group. Gonzalez et al. note that these findings are in agreement with findings in the literature.
Gonzalez et al. also note that the statistically significant differences found between the experimental and control groups on the problem-solving exams and not on the multiple-choice exams are not unexpected. Gonzalez et al. posit that multiple-choice exams to not challenge student metacognitive abilities in the same way as problem-solving exams.
Gonzalez et al. also observe that although the experimental group globally benefitted from the implemented strategy, results were greatest in students in the lowest quartile. Gonzalez et al. speculate that the intervention may have stimulated development of cognitive processes that were previously underutilized.
Gonzalez et al. suggest that the qualitative analysis shows that the combination of mediation and concept mapping increases student motivation and stimulates students to participate more actively in their own learning.
Critique
In general, this study employs sound methodological and statistical techniques and represents a well-thought out and controlled study. The writing is clear, appropriately formal, direct, well organized, and factual. The study is well grounded in previous research and makes an important contribution to the literature. Sample size is sufficient (N = 122) to yield generalizable results.
The study could have been strengthened by inclusion of a third experimental group using mediation without the concept mapping strategy, or the concept mapping strategy without the mediation intervention. Since the experimental group showed improvement over the control group by a combination of mediation and concept mapping protocols, it is difficult to determine whether the combination of the interventions is effective or if one intervention contributed to the majority of the improved effect.
Theoretical, Methodological, and Practical Implications
This study indicates that concept mapping, combined with a mediated learning experience, can be an effective meta-cognitive strategy to enhance meaningful learning in a medical school setting. In domains that stress problem-solving and analysis, the combination of concept mapping and mediation might prove to be a powerful pedagogical tool allowing students to maximize meaningful learning. Given the unique context of combining mediation and concept mapping, this study makes an important contribution to the corpus of literature.
In addition, this study indicates that concept mapping combined with mediation encourages more efficient learning skills by allowing these medical students to reflect on their own cognitive processes and adjusting practices to maximize meaningful learning. This change in emphasis from traditional teaching methodologies to more mediated learning experiences seem to enhance meaningful learning in complex domains.
Friday, May 1, 2009
Mautone and Mayer (2007)
Mautone, P. D. & Mayer, R. (2007). Cognitive aids for guiding graph comprehension. Journal of Educational Psychology, 99, 640-652.
Problem/Purpose
The researchers in this study examined how three different types of graphic organizers improved student comprehension of scientific graphs compared to students that were not exposed to graphic organizers at all. Mautone and Mayer examined the effects of signaling, concrete, and structural graphic organizers on students’ generation of causal and relational statements. Signaling organizers help students to understand the structure of graphs by using highlights, breakdowns, and other tools to convey graph structure. Concrete organizers help students to integrate graphical information through the use of images to connect variables and data in graphs to students’ existing schemata. Structural organizers help students to understand how patterns between new variables work by comparing them to similar patterns followed by other more familiar variables.
This study is of interest because it expands the understanding of how graphic organizers affect students’ comprehension and more specifically, how different kinds of graphic organizers affect different aspects of comprehension in different ways. From a theoretical perspective, this expansion provides data that may help construct a more detailed understanding of cognition. From a practical perspective, the expansion and application of graphic organizers can provide means for improving students’ comprehension of scientific graphs, especially in understanding causal and relational relationships between and among variables
Methods
Mautone and Mayer conducted three experiments.
In the first experiment, 60 students were divided into a control group and a cognitive aids group. Both groups were allowed to view self-paced PowerPoint presentations focused on four graphs derived from introductory college geography texts. The four graphs were each different in type, but all relatively complex and all depicted different aspects of common fluvial processes associated with rivers and streams and the deposits and landforms created by them. After studying the graph slide at their own pace, the control group students were prompted to write a summary of each slide for five minutes. This process was repeated for each of the four slides. The cognitive aids group in experiment one was given a modified version of the same PowerPoint presentation where the graphs were broken apart into multiple slides containing highlights, illustrations, and breakdowns that signaled the structure of the graphs. Students paged through the multiple slides for each graph at their own pace. After viewing the full graph and its preceding cognitive aids, students were then prompted to write a summary of the slide for five minutes. Student responses for both groups were scored based on the number of relational and causal statements. Separate scores were recorded for the number of relational statements and the number of causal statements. Inter-rate reliability was measured to be r=0.91 and r=0.82 and deemed to be high.
Because students in the cognitive aids group had more study time than the control group, Mautone and Mayer conducted multiple regression analyses with time and condition, finding no interaction. Analyses were also conducted using time as a covariate and no differences were found.
To separate the effects of signaling and graphic organizers, Mautone and Mayer conducted a second experiment with a 2x2 design with signaling and concrete organizers present and not present. The procedure for the second experiment was similar to experiment one except that there were four groups: control, signaling, concrete, and signaling with concrete. Scoring was done similarly to experiment one including follow-up analyses to determine that time spent studying was not a critical factor in between group differences.
Mautone and Mayer followed up with a third experiment to test the effects of structural graphic organizers that are intended to prime cognitive organizing and should increase the number of students’ relational statements and not increase the number of students’ causal statements. Again, students were divided into two groups: control and structural. The same graphs were used and the structural group viewed a self-paced PowerPoint embedded with structural cognitive aids. Student statements in the graph summaries were scored as before and time spent studying was analyzed to verify again that time was not a critical factor in the between group differences.
Results
In experiment one, Mautone and Mayer found statistically and practically significant increases in the number of causal and relational statements generated by students in the cognitive aids group. Cognitive aids group students generated an average of 5.3 relational statements (SD=2.19) while control group students generated an average of 3.6 relational statements (SD=1.99). The difference between groups was t(58)=2.96, p=0.004 and Cohen’s d was a medium-to-large 0.76. Cognitive aids group students generated an average of 1.1 causal statements (SD=0.88) while control group students generated an average of 0.4 relational statements (SD=0.62). The difference between groups was t(58)=3.55, p=0.001 and Cohen’s d was a large 0.93. Effects of time spent studying were not statistically significant.
In experiment two, Mautone and Mayer found a significant main effect of signaling graphic organizers on relational statements. Students who were in signaling groups generated an average of 5.14 relational statements (SD=1.90) while students in the other groups generated an average of 4.08 relational statements (SD=1.64). The difference between groups was F(1,98)=9.02, p=0.03 and Cohen’s d was a medium 0.60. There was no main effect for the presence of concrete graphic organizers on relational statements and there was no interaction effect between the presence of concrete and signaling graphic organizers on relational statements. Effects of time spent studying were not statistically significant.
Also in experiment two, Mautone and Mayer found a significant main effect of concrete graphic organizers on causal statements. Students who were in concrete groups generated an average of 1.02 causal statements (SD=0.96) while students in the other groups generated an average of 0.65 causal statements (SD=0.90). The difference between groups was F(1,98)=3.86, p=0.05 and Cohen’s d was a small-to-medium 0.39. There was no main effect for the presence of signaling graphic organizers on causal statements and there was no interaction effect between the presence of concrete and signaling graphic organizers on causal statements. Effects of time spent studying were not statistically significant.
In experiment three, Mautone and Mayer found statistically and practically significant increases in the number of relational statements generated by students in the structural graphic organizers group. Structural group students generated an average of 4.92 relational statements (SD=1.78) while control group students generated an average of 3.00 relational statements (SD=1.69). The difference between groups was t(45)=3.78, p<0.001 and Cohen’s d was a large 1.10. There was no significant difference between groups in the number of causal statements generated. Effects of time spent studying were not statistically significant.
Discussion
Mautone and Mayer conducted three experiments that demonstrate how different types of graphic organizers can improve students’ understanding of scientific graphs in different ways.
The differences in the three types of graphic organizers are not entirely obvious at first, but Mautone and Mayer provide clear descriptions and clarifying examples to explain the types and how they are intended to work. The signaling organizers help students to understand how variables are represented on graphs and how the different pieces of graphs are put together. Especially valuable in understanding signaling organizers is the idea of presenting partial graphs so that students can understand how fundamental parts of a graph are structured relative to each other before additional graph elements are added. Concrete organizers help students related the information on graphs to concepts and knowledge they already possess by using pictures, photographs, and diagrams to illustrate variables and their different values.
Structural organizers are perhaps the most sophisticated because they help students to understand the relationships between new variables by using other relationships the students already understand to help students understand the new relationship. Mautone and Mayer described a clever way to explain curvilinear relationships by using age and driving ability. Extremely young and old drivers have higher rates of accidents that those drivers who are closer to middle age. This structural organizer is used to then explain the curvilinear relationship between river water velocity and particle size with respect to erosion. Brilliant!
Mautone and Mayer addressed the major limitation of this study in their post-experiment analyses on the effects of time. In all three experiments, time was found to not be a statistically significant factor in between group differences.
Critique
Mautone and Mayer use clear language and provide concrete examples that are especially useful for distinguishing the three types of graphic organizers. Tables are clear, well organized and well placed within the text. The descriptions of methodology are detailed and thorough without being repetitive or redundant. Further, the follow-up analyses of time as an independent variable are thoughtful and are summarized clearly and concisely. All pertinent statistical data (means, standard deviations, effect sizes, p values and statistics) are provided clearly. The use of three experiments also provides evidence that the results are replicable, a commonly overlooked aspect of education research studies.
Theoretical, Methodological, and Practical Implications
A major practical implication of this article is the potential to use structural and concrete graphic organizers to promote students’ comprehension of scientific graphs. Structural organizers should help students to understand how variables are related. It would be interesting to conduct further studies to see if extended use of structural graphic organizers led to successful completion of far transfer tasks where new variables that have similar relationships can be understood without introduction using the graphic organizers.
As well, there is a possibility that repeated use of concrete graphic organizers may promote causal understanding and integration of new knowledge into existing schemata. Again, there may be a way that repeated use of concrete organizers could lead to far transfer ability and more generalized use of integration in novel situations without explicit use of concrete organizers. More research on these possible outcomes is needed.
Mautone and Mayer’s study extends and adds to theoretical understanding of cognition and graphic organizers by providing additional levels of detail. Signaling graphic organizers that focus on structure may help students to better understand relations in graphs and between variables. Concrete graphic organizers may help students to better understand causal relations in graphs and between variables. Structural graphic organizers can help students to better understand more complex relations between variables, such as curvilinear relationships. Graphic organizers may include both concrete and signaling design principles and thereby statistically increase students understanding of relations and integration of new knowledge as shown by increased numbers of accurate causal and relational statements. Mautone and Mayer’s work indicates that structure and integration may be independent cognitive processes.
Mautone and Mayer used a three-experiment approach with self-paced study time and timed responses. The use of replication and variation within and between the three experiments allows their method to demonstrate that their results with graphic organizers are reproducible and to examine details of graphic organizer and cognition theory through variations in the graphic organizers studied. Other research studies may benefit by following similar replication and variation strategies where multiple experiments are combined into one study. Pilot tests are commonly used in studies, but Mautone and Mayer went much further by using three full-scale experiments and not a mini-experiment as an antecedent to the main experiment.
Problem/Purpose
The researchers in this study examined how three different types of graphic organizers improved student comprehension of scientific graphs compared to students that were not exposed to graphic organizers at all. Mautone and Mayer examined the effects of signaling, concrete, and structural graphic organizers on students’ generation of causal and relational statements. Signaling organizers help students to understand the structure of graphs by using highlights, breakdowns, and other tools to convey graph structure. Concrete organizers help students to integrate graphical information through the use of images to connect variables and data in graphs to students’ existing schemata. Structural organizers help students to understand how patterns between new variables work by comparing them to similar patterns followed by other more familiar variables.
This study is of interest because it expands the understanding of how graphic organizers affect students’ comprehension and more specifically, how different kinds of graphic organizers affect different aspects of comprehension in different ways. From a theoretical perspective, this expansion provides data that may help construct a more detailed understanding of cognition. From a practical perspective, the expansion and application of graphic organizers can provide means for improving students’ comprehension of scientific graphs, especially in understanding causal and relational relationships between and among variables
Methods
Mautone and Mayer conducted three experiments.
In the first experiment, 60 students were divided into a control group and a cognitive aids group. Both groups were allowed to view self-paced PowerPoint presentations focused on four graphs derived from introductory college geography texts. The four graphs were each different in type, but all relatively complex and all depicted different aspects of common fluvial processes associated with rivers and streams and the deposits and landforms created by them. After studying the graph slide at their own pace, the control group students were prompted to write a summary of each slide for five minutes. This process was repeated for each of the four slides. The cognitive aids group in experiment one was given a modified version of the same PowerPoint presentation where the graphs were broken apart into multiple slides containing highlights, illustrations, and breakdowns that signaled the structure of the graphs. Students paged through the multiple slides for each graph at their own pace. After viewing the full graph and its preceding cognitive aids, students were then prompted to write a summary of the slide for five minutes. Student responses for both groups were scored based on the number of relational and causal statements. Separate scores were recorded for the number of relational statements and the number of causal statements. Inter-rate reliability was measured to be r=0.91 and r=0.82 and deemed to be high.
Because students in the cognitive aids group had more study time than the control group, Mautone and Mayer conducted multiple regression analyses with time and condition, finding no interaction. Analyses were also conducted using time as a covariate and no differences were found.
To separate the effects of signaling and graphic organizers, Mautone and Mayer conducted a second experiment with a 2x2 design with signaling and concrete organizers present and not present. The procedure for the second experiment was similar to experiment one except that there were four groups: control, signaling, concrete, and signaling with concrete. Scoring was done similarly to experiment one including follow-up analyses to determine that time spent studying was not a critical factor in between group differences.
Mautone and Mayer followed up with a third experiment to test the effects of structural graphic organizers that are intended to prime cognitive organizing and should increase the number of students’ relational statements and not increase the number of students’ causal statements. Again, students were divided into two groups: control and structural. The same graphs were used and the structural group viewed a self-paced PowerPoint embedded with structural cognitive aids. Student statements in the graph summaries were scored as before and time spent studying was analyzed to verify again that time was not a critical factor in the between group differences.
Results
In experiment one, Mautone and Mayer found statistically and practically significant increases in the number of causal and relational statements generated by students in the cognitive aids group. Cognitive aids group students generated an average of 5.3 relational statements (SD=2.19) while control group students generated an average of 3.6 relational statements (SD=1.99). The difference between groups was t(58)=2.96, p=0.004 and Cohen’s d was a medium-to-large 0.76. Cognitive aids group students generated an average of 1.1 causal statements (SD=0.88) while control group students generated an average of 0.4 relational statements (SD=0.62). The difference between groups was t(58)=3.55, p=0.001 and Cohen’s d was a large 0.93. Effects of time spent studying were not statistically significant.
In experiment two, Mautone and Mayer found a significant main effect of signaling graphic organizers on relational statements. Students who were in signaling groups generated an average of 5.14 relational statements (SD=1.90) while students in the other groups generated an average of 4.08 relational statements (SD=1.64). The difference between groups was F(1,98)=9.02, p=0.03 and Cohen’s d was a medium 0.60. There was no main effect for the presence of concrete graphic organizers on relational statements and there was no interaction effect between the presence of concrete and signaling graphic organizers on relational statements. Effects of time spent studying were not statistically significant.
Also in experiment two, Mautone and Mayer found a significant main effect of concrete graphic organizers on causal statements. Students who were in concrete groups generated an average of 1.02 causal statements (SD=0.96) while students in the other groups generated an average of 0.65 causal statements (SD=0.90). The difference between groups was F(1,98)=3.86, p=0.05 and Cohen’s d was a small-to-medium 0.39. There was no main effect for the presence of signaling graphic organizers on causal statements and there was no interaction effect between the presence of concrete and signaling graphic organizers on causal statements. Effects of time spent studying were not statistically significant.
In experiment three, Mautone and Mayer found statistically and practically significant increases in the number of relational statements generated by students in the structural graphic organizers group. Structural group students generated an average of 4.92 relational statements (SD=1.78) while control group students generated an average of 3.00 relational statements (SD=1.69). The difference between groups was t(45)=3.78, p<0.001 and Cohen’s d was a large 1.10. There was no significant difference between groups in the number of causal statements generated. Effects of time spent studying were not statistically significant.
Discussion
Mautone and Mayer conducted three experiments that demonstrate how different types of graphic organizers can improve students’ understanding of scientific graphs in different ways.
The differences in the three types of graphic organizers are not entirely obvious at first, but Mautone and Mayer provide clear descriptions and clarifying examples to explain the types and how they are intended to work. The signaling organizers help students to understand how variables are represented on graphs and how the different pieces of graphs are put together. Especially valuable in understanding signaling organizers is the idea of presenting partial graphs so that students can understand how fundamental parts of a graph are structured relative to each other before additional graph elements are added. Concrete organizers help students related the information on graphs to concepts and knowledge they already possess by using pictures, photographs, and diagrams to illustrate variables and their different values.
Structural organizers are perhaps the most sophisticated because they help students to understand the relationships between new variables by using other relationships the students already understand to help students understand the new relationship. Mautone and Mayer described a clever way to explain curvilinear relationships by using age and driving ability. Extremely young and old drivers have higher rates of accidents that those drivers who are closer to middle age. This structural organizer is used to then explain the curvilinear relationship between river water velocity and particle size with respect to erosion. Brilliant!
Mautone and Mayer addressed the major limitation of this study in their post-experiment analyses on the effects of time. In all three experiments, time was found to not be a statistically significant factor in between group differences.
Critique
Mautone and Mayer use clear language and provide concrete examples that are especially useful for distinguishing the three types of graphic organizers. Tables are clear, well organized and well placed within the text. The descriptions of methodology are detailed and thorough without being repetitive or redundant. Further, the follow-up analyses of time as an independent variable are thoughtful and are summarized clearly and concisely. All pertinent statistical data (means, standard deviations, effect sizes, p values and statistics) are provided clearly. The use of three experiments also provides evidence that the results are replicable, a commonly overlooked aspect of education research studies.
Theoretical, Methodological, and Practical Implications
A major practical implication of this article is the potential to use structural and concrete graphic organizers to promote students’ comprehension of scientific graphs. Structural organizers should help students to understand how variables are related. It would be interesting to conduct further studies to see if extended use of structural graphic organizers led to successful completion of far transfer tasks where new variables that have similar relationships can be understood without introduction using the graphic organizers.
As well, there is a possibility that repeated use of concrete graphic organizers may promote causal understanding and integration of new knowledge into existing schemata. Again, there may be a way that repeated use of concrete organizers could lead to far transfer ability and more generalized use of integration in novel situations without explicit use of concrete organizers. More research on these possible outcomes is needed.
Mautone and Mayer’s study extends and adds to theoretical understanding of cognition and graphic organizers by providing additional levels of detail. Signaling graphic organizers that focus on structure may help students to better understand relations in graphs and between variables. Concrete graphic organizers may help students to better understand causal relations in graphs and between variables. Structural graphic organizers can help students to better understand more complex relations between variables, such as curvilinear relationships. Graphic organizers may include both concrete and signaling design principles and thereby statistically increase students understanding of relations and integration of new knowledge as shown by increased numbers of accurate causal and relational statements. Mautone and Mayer’s work indicates that structure and integration may be independent cognitive processes.
Mautone and Mayer used a three-experiment approach with self-paced study time and timed responses. The use of replication and variation within and between the three experiments allows their method to demonstrate that their results with graphic organizers are reproducible and to examine details of graphic organizer and cognition theory through variations in the graphic organizers studied. Other research studies may benefit by following similar replication and variation strategies where multiple experiments are combined into one study. Pilot tests are commonly used in studies, but Mautone and Mayer went much further by using three full-scale experiments and not a mini-experiment as an antecedent to the main experiment.
Subscribe to:
Posts (Atom)