Mautone, P. D. & Mayer, R. (2007). Cognitive aids for guiding graph comprehension. Journal of Educational Psychology, 99, 640-652.
Problem/Purpose
The researchers in this study examined how three different types of graphic organizers improved student comprehension of scientific graphs compared to students that were not exposed to graphic organizers at all. Mautone and Mayer examined the effects of signaling, concrete, and structural graphic organizers on students’ generation of causal and relational statements. Signaling organizers help students to understand the structure of graphs by using highlights, breakdowns, and other tools to convey graph structure. Concrete organizers help students to integrate graphical information through the use of images to connect variables and data in graphs to students’ existing schemata. Structural organizers help students to understand how patterns between new variables work by comparing them to similar patterns followed by other more familiar variables.
This study is of interest because it expands the understanding of how graphic organizers affect students’ comprehension and more specifically, how different kinds of graphic organizers affect different aspects of comprehension in different ways. From a theoretical perspective, this expansion provides data that may help construct a more detailed understanding of cognition. From a practical perspective, the expansion and application of graphic organizers can provide means for improving students’ comprehension of scientific graphs, especially in understanding causal and relational relationships between and among variables
Methods
Mautone and Mayer conducted three experiments.
In the first experiment, 60 students were divided into a control group and a cognitive aids group. Both groups were allowed to view self-paced PowerPoint presentations focused on four graphs derived from introductory college geography texts. The four graphs were each different in type, but all relatively complex and all depicted different aspects of common fluvial processes associated with rivers and streams and the deposits and landforms created by them. After studying the graph slide at their own pace, the control group students were prompted to write a summary of each slide for five minutes. This process was repeated for each of the four slides. The cognitive aids group in experiment one was given a modified version of the same PowerPoint presentation where the graphs were broken apart into multiple slides containing highlights, illustrations, and breakdowns that signaled the structure of the graphs. Students paged through the multiple slides for each graph at their own pace. After viewing the full graph and its preceding cognitive aids, students were then prompted to write a summary of the slide for five minutes. Student responses for both groups were scored based on the number of relational and causal statements. Separate scores were recorded for the number of relational statements and the number of causal statements. Inter-rate reliability was measured to be r=0.91 and r=0.82 and deemed to be high.
Because students in the cognitive aids group had more study time than the control group, Mautone and Mayer conducted multiple regression analyses with time and condition, finding no interaction. Analyses were also conducted using time as a covariate and no differences were found.
To separate the effects of signaling and graphic organizers, Mautone and Mayer conducted a second experiment with a 2x2 design with signaling and concrete organizers present and not present. The procedure for the second experiment was similar to experiment one except that there were four groups: control, signaling, concrete, and signaling with concrete. Scoring was done similarly to experiment one including follow-up analyses to determine that time spent studying was not a critical factor in between group differences.
Mautone and Mayer followed up with a third experiment to test the effects of structural graphic organizers that are intended to prime cognitive organizing and should increase the number of students’ relational statements and not increase the number of students’ causal statements. Again, students were divided into two groups: control and structural. The same graphs were used and the structural group viewed a self-paced PowerPoint embedded with structural cognitive aids. Student statements in the graph summaries were scored as before and time spent studying was analyzed to verify again that time was not a critical factor in the between group differences.
Results
In experiment one, Mautone and Mayer found statistically and practically significant increases in the number of causal and relational statements generated by students in the cognitive aids group. Cognitive aids group students generated an average of 5.3 relational statements (SD=2.19) while control group students generated an average of 3.6 relational statements (SD=1.99). The difference between groups was t(58)=2.96, p=0.004 and Cohen’s d was a medium-to-large 0.76. Cognitive aids group students generated an average of 1.1 causal statements (SD=0.88) while control group students generated an average of 0.4 relational statements (SD=0.62). The difference between groups was t(58)=3.55, p=0.001 and Cohen’s d was a large 0.93. Effects of time spent studying were not statistically significant.
In experiment two, Mautone and Mayer found a significant main effect of signaling graphic organizers on relational statements. Students who were in signaling groups generated an average of 5.14 relational statements (SD=1.90) while students in the other groups generated an average of 4.08 relational statements (SD=1.64). The difference between groups was F(1,98)=9.02, p=0.03 and Cohen’s d was a medium 0.60. There was no main effect for the presence of concrete graphic organizers on relational statements and there was no interaction effect between the presence of concrete and signaling graphic organizers on relational statements. Effects of time spent studying were not statistically significant.
Also in experiment two, Mautone and Mayer found a significant main effect of concrete graphic organizers on causal statements. Students who were in concrete groups generated an average of 1.02 causal statements (SD=0.96) while students in the other groups generated an average of 0.65 causal statements (SD=0.90). The difference between groups was F(1,98)=3.86, p=0.05 and Cohen’s d was a small-to-medium 0.39. There was no main effect for the presence of signaling graphic organizers on causal statements and there was no interaction effect between the presence of concrete and signaling graphic organizers on causal statements. Effects of time spent studying were not statistically significant.
In experiment three, Mautone and Mayer found statistically and practically significant increases in the number of relational statements generated by students in the structural graphic organizers group. Structural group students generated an average of 4.92 relational statements (SD=1.78) while control group students generated an average of 3.00 relational statements (SD=1.69). The difference between groups was t(45)=3.78, p<0.001 and Cohen’s d was a large 1.10. There was no significant difference between groups in the number of causal statements generated. Effects of time spent studying were not statistically significant.
Discussion
Mautone and Mayer conducted three experiments that demonstrate how different types of graphic organizers can improve students’ understanding of scientific graphs in different ways.
The differences in the three types of graphic organizers are not entirely obvious at first, but Mautone and Mayer provide clear descriptions and clarifying examples to explain the types and how they are intended to work. The signaling organizers help students to understand how variables are represented on graphs and how the different pieces of graphs are put together. Especially valuable in understanding signaling organizers is the idea of presenting partial graphs so that students can understand how fundamental parts of a graph are structured relative to each other before additional graph elements are added. Concrete organizers help students related the information on graphs to concepts and knowledge they already possess by using pictures, photographs, and diagrams to illustrate variables and their different values.
Structural organizers are perhaps the most sophisticated because they help students to understand the relationships between new variables by using other relationships the students already understand to help students understand the new relationship. Mautone and Mayer described a clever way to explain curvilinear relationships by using age and driving ability. Extremely young and old drivers have higher rates of accidents that those drivers who are closer to middle age. This structural organizer is used to then explain the curvilinear relationship between river water velocity and particle size with respect to erosion. Brilliant!
Mautone and Mayer addressed the major limitation of this study in their post-experiment analyses on the effects of time. In all three experiments, time was found to not be a statistically significant factor in between group differences.
Critique
Mautone and Mayer use clear language and provide concrete examples that are especially useful for distinguishing the three types of graphic organizers. Tables are clear, well organized and well placed within the text. The descriptions of methodology are detailed and thorough without being repetitive or redundant. Further, the follow-up analyses of time as an independent variable are thoughtful and are summarized clearly and concisely. All pertinent statistical data (means, standard deviations, effect sizes, p values and statistics) are provided clearly. The use of three experiments also provides evidence that the results are replicable, a commonly overlooked aspect of education research studies.
Theoretical, Methodological, and Practical Implications
A major practical implication of this article is the potential to use structural and concrete graphic organizers to promote students’ comprehension of scientific graphs. Structural organizers should help students to understand how variables are related. It would be interesting to conduct further studies to see if extended use of structural graphic organizers led to successful completion of far transfer tasks where new variables that have similar relationships can be understood without introduction using the graphic organizers.
As well, there is a possibility that repeated use of concrete graphic organizers may promote causal understanding and integration of new knowledge into existing schemata. Again, there may be a way that repeated use of concrete organizers could lead to far transfer ability and more generalized use of integration in novel situations without explicit use of concrete organizers. More research on these possible outcomes is needed.
Mautone and Mayer’s study extends and adds to theoretical understanding of cognition and graphic organizers by providing additional levels of detail. Signaling graphic organizers that focus on structure may help students to better understand relations in graphs and between variables. Concrete graphic organizers may help students to better understand causal relations in graphs and between variables. Structural graphic organizers can help students to better understand more complex relations between variables, such as curvilinear relationships. Graphic organizers may include both concrete and signaling design principles and thereby statistically increase students understanding of relations and integration of new knowledge as shown by increased numbers of accurate causal and relational statements. Mautone and Mayer’s work indicates that structure and integration may be independent cognitive processes.
Mautone and Mayer used a three-experiment approach with self-paced study time and timed responses. The use of replication and variation within and between the three experiments allows their method to demonstrate that their results with graphic organizers are reproducible and to examine details of graphic organizer and cognition theory through variations in the graphic organizers studied. Other research studies may benefit by following similar replication and variation strategies where multiple experiments are combined into one study. Pilot tests are commonly used in studies, but Mautone and Mayer went much further by using three full-scale experiments and not a mini-experiment as an antecedent to the main experiment.
Showing posts with label research review. Show all posts
Showing posts with label research review. Show all posts
Friday, May 1, 2009
Wednesday, April 22, 2009
Bahr and Dasereau (2005)
Bahr, S & Dasereau, D. (2005). Bilingual knowledge maps (BiK Maps) as a presentation format: delayed recall and training effects. Journal of experimental Education, 73(2), 101-118.
Problem/Purpose
This article was selected because it represents the latest study in an almost decade long bilingual knowledge map research by the same authors. The focus of research within the bilingual language map domain is two-fold. The first is to develop new strategies that help learners of foreign language form the so-called lexical association between native and foreign language words. The second is to make semantic foreign language concepts more accessible to novice learners with highly limited vocabulary and almost nonexistent knowledge of grammar.
Previous research on monolingual as well as BiK maps suggest that BiK maps are likely to create a very positive learning context by allowing for additional tolerance for the lack of basic foreign language vocabulary and grammar and by adding both multidimensional pictorial and visio-spatial information.
The purpose of this study was to investigate two factors related to BiK map research, the presentation format, meaning the use of either BIK maps or standard word pair list, and training on how to learn using BIK maps or word-pair lists. Within these two factors, based on previous studies by the authors, the following three objectives were explored: (1) to test the prediction that when learners’ recall s is tested following a two day delay without prior immediate recall, BiK map learners will show greater recall than word-list learners (2) to asses recall strategies and the use of cues using processing inventory of vocabulary recall (PI-VOR), and (3) to asses the training effects on both BiK map and word-list trainees performance using both PI-VOR and processing inventory of behavioral intentions for textbook study (PI-BIT).
Methods
Bahr and Dansereau recruited 82 undergraduates from several psychology classes from an unknown university to participate in this study in exchange for academic credit. The participants were treated according to guidelines of the American Psychological Association and were randomly assigned to one of the four groups. The study consisted of three sessions ranging from 35 minutes to 2 hours and was conducted within a seven day period on Monday, Wednesday and Friday. In session 1 participants were randomly assigned to conditions where their previous German language knowledge, their motivations were assessed, then received either BiK map or traditional word-list training.
In session 2, both groups warmed up by using Hindi and English word-pairs and then were trained with 16 word sets of German English word-pairs with an average of 6.65 letters per foreign word reflecting tourist vocabulary. In session 3, the authors collected memory measures on both free and cued recall, conducted two additional personal inventory post-tests and ended the session with a debriefing of the participants.
Results
Bahr and Dansereau conducted four 2 X 2 multiple analyses of covariance (MANCOVA) primary analyses on four sets of dependent measures. The first set consisted of the memory measures, which included the free recall scores
FR-wp and FR-add) and cued recall scores. The second, third, and fourth sets consisted of the personal inventory (PI) factors retained from the PI-VOR, PI-BIV, and PI-BIT, respectively.
In the memory measure (Training X Presentation) format MANCOVA on the memory measures revealed a significant effect for study presentation format, F(3, 75) = 5.16, p < .002. The authors found the univariate effects on all memory measures: cued recall, F(1, 77) = 4.78, p < .031; FR-wp, F(1, 77) = 6.61, p < .012; and FR-add, F(1, 77) = 13.57, p < .001.
The adjusted means of participants who studied BiK maps were higher than those of word-list students: cued recall, 9.03 vs. 6.47, respectively; FRwp, 3.47 vs. 1.87, respectively; FR-add, 5.55 vs. 2.90, respectively ( see Table 5 below). The standardized mean differences were dCuedRecall = .497, dFR-wp = .565, and dFR-add = .826. Here the authors found that no other effects, including set effects, were significant.
In the PI-VOR. (Training X Presentation) format MANCOVA on the two PIVOR measures revealed a significant effect for presentation format, F(2, 76 ) = 7.43, p < .001, which was reflected at the univariate level as a main effect for
the Breadth Processing factor, F(1, 77) = 14.40, p < .001. Here the authors discovered that the adjusted mean score was greater for BiK-map students than for the word- list students (4.51 vs. 3.49, respectively; d = .847).
MANCOVA analysis on the two PI-BIV measures revealed a main effect for training approaching significance, F(2, 76 ) = 3.08, p < .051. At the univariate level, this effect was apparent in the Surface Processing factor, F(1, 77) = 5.20,
p < .025. Here the authors found word-list trainees indicated greater intentions than BiK map trainees to engage in this mode of processing (5.63 vs. 5.08, respectively; d = .495).
MANCOVA analysis on the PI-BIT measures revealed no significant differences. However, given the exploratory nature of the study, a univariate finding for training is reported with the Theme (Breadth) Processing factor, F(3, 75) = 4.33,
p < .040. Here the authors found that BiK map trainees indicated greater intent than word-list trainees (5.57 vs. 5.13, respectively; d = .453).
Discussion
Bahr and Dansereau state that the general results of the study are comparable with others obtained by previous foreign language acquisition researchers. This means that large standard deviations and relatively low recall scores and correlation coefficients ( in this study Cronbach’s alpha is ranging from .613 to .969) characterize it. In this respect the authors concluded that their experimental data provided support for the argument that BIK map-based learning does have significant advantage over word-list learning, in particular within short terms. However, Bahr and Dansereau also acknowledged that students’ performance in the present study was significantly lower (ranging from 10.8% to 28.8% in the BiK group and 5.8% to 20.2% in the list group) than those of students from earlier studies by the same authors in 2001.
The authors state that the difference in the students’ performance in the present study is likely due to the fact that delayed recall in previous experiments was preceded by immediate recall, which apparently caused a rehearsal effect. Although their objective in the current study was to eliminate the possibility of differential rehearsal effects, it seems that, without rehearsal, a consequent suppression of memory in general is unavoidable when testing for BiK-map effects.
The authors also discussed the possibilities of taking BiK map out of the academic realm in order test the durability of findings in realistic settings and expressed hope That future investigation into foreign language learning connectivity and multilingual memory will lead to the development of more sophisticated learning materials.
Critique
Bahr and Dansereau’s research paper, although relatively well written, is presented in a nontraditional format that can be hard to follow as both the result and discussion sections are found at the beginning of the paper. The article could have been improved by providing additional information about the location of the study and by limiting references to the authors themselves as their work has been replicated by others on numerous occasions. Other areas of weakness include the very low Cronbach’s alpha values in the processing inventory section on page 107-108 and the very low number of participants (well below the usual 300+ that is recommend for factor analysis). In spite of these critiques and in light of the experimental nature of this investigation I conclude that the Bahr and Dansereau article is both clear written and its aim is well directed.
Theoretical and practical implications
One of several theoretical implications of this study is that it highlighted the need for additional investigation to better understand the connections between of BiK maps and the foreign and the native language lexica. Although there is previous research (see page 102) that seems to support the hypothesis that a strong semantic or conceptual association exists between foreign language words and their meaning, future research should not only confirm these hypothesis’ but should test new presentation formats that would facilitate these connections in novice learners.
Practical implications of this study include using both BiK and monolingual knowledge maps in all kinds of academic settings in order to promote a shift toward a more beneficial top-down processing strategy among the learners. The use of both bi and monolingual knowledge maps in various settings also raises the possibilities that the textbook publishers would include BiK supplements in their new editions of foreign language textbooks and that BiK map creation as a subject would be added to teachers of foreign language degree course offerings.
Problem/Purpose
This article was selected because it represents the latest study in an almost decade long bilingual knowledge map research by the same authors. The focus of research within the bilingual language map domain is two-fold. The first is to develop new strategies that help learners of foreign language form the so-called lexical association between native and foreign language words. The second is to make semantic foreign language concepts more accessible to novice learners with highly limited vocabulary and almost nonexistent knowledge of grammar.
Previous research on monolingual as well as BiK maps suggest that BiK maps are likely to create a very positive learning context by allowing for additional tolerance for the lack of basic foreign language vocabulary and grammar and by adding both multidimensional pictorial and visio-spatial information.
The purpose of this study was to investigate two factors related to BiK map research, the presentation format, meaning the use of either BIK maps or standard word pair list, and training on how to learn using BIK maps or word-pair lists. Within these two factors, based on previous studies by the authors, the following three objectives were explored: (1) to test the prediction that when learners’ recall s is tested following a two day delay without prior immediate recall, BiK map learners will show greater recall than word-list learners (2) to asses recall strategies and the use of cues using processing inventory of vocabulary recall (PI-VOR), and (3) to asses the training effects on both BiK map and word-list trainees performance using both PI-VOR and processing inventory of behavioral intentions for textbook study (PI-BIT).
Methods
Bahr and Dansereau recruited 82 undergraduates from several psychology classes from an unknown university to participate in this study in exchange for academic credit. The participants were treated according to guidelines of the American Psychological Association and were randomly assigned to one of the four groups. The study consisted of three sessions ranging from 35 minutes to 2 hours and was conducted within a seven day period on Monday, Wednesday and Friday. In session 1 participants were randomly assigned to conditions where their previous German language knowledge, their motivations were assessed, then received either BiK map or traditional word-list training.
In session 2, both groups warmed up by using Hindi and English word-pairs and then were trained with 16 word sets of German English word-pairs with an average of 6.65 letters per foreign word reflecting tourist vocabulary. In session 3, the authors collected memory measures on both free and cued recall, conducted two additional personal inventory post-tests and ended the session with a debriefing of the participants.
Results
Bahr and Dansereau conducted four 2 X 2 multiple analyses of covariance (MANCOVA) primary analyses on four sets of dependent measures. The first set consisted of the memory measures, which included the free recall scores
FR-wp and FR-add) and cued recall scores. The second, third, and fourth sets consisted of the personal inventory (PI) factors retained from the PI-VOR, PI-BIV, and PI-BIT, respectively.
In the memory measure (Training X Presentation) format MANCOVA on the memory measures revealed a significant effect for study presentation format, F(3, 75) = 5.16, p < .002. The authors found the univariate effects on all memory measures: cued recall, F(1, 77) = 4.78, p < .031; FR-wp, F(1, 77) = 6.61, p < .012; and FR-add, F(1, 77) = 13.57, p < .001.
The adjusted means of participants who studied BiK maps were higher than those of word-list students: cued recall, 9.03 vs. 6.47, respectively; FRwp, 3.47 vs. 1.87, respectively; FR-add, 5.55 vs. 2.90, respectively ( see Table 5 below). The standardized mean differences were dCuedRecall = .497, dFR-wp = .565, and dFR-add = .826. Here the authors found that no other effects, including set effects, were significant.
In the PI-VOR. (Training X Presentation) format MANCOVA on the two PIVOR measures revealed a significant effect for presentation format, F(2, 76 ) = 7.43, p < .001, which was reflected at the univariate level as a main effect for
the Breadth Processing factor, F(1, 77) = 14.40, p < .001. Here the authors discovered that the adjusted mean score was greater for BiK-map students than for the word- list students (4.51 vs. 3.49, respectively; d = .847).
MANCOVA analysis on the two PI-BIV measures revealed a main effect for training approaching significance, F(2, 76 ) = 3.08, p < .051. At the univariate level, this effect was apparent in the Surface Processing factor, F(1, 77) = 5.20,
p < .025. Here the authors found word-list trainees indicated greater intentions than BiK map trainees to engage in this mode of processing (5.63 vs. 5.08, respectively; d = .495).
MANCOVA analysis on the PI-BIT measures revealed no significant differences. However, given the exploratory nature of the study, a univariate finding for training is reported with the Theme (Breadth) Processing factor, F(3, 75) = 4.33,
p < .040. Here the authors found that BiK map trainees indicated greater intent than word-list trainees (5.57 vs. 5.13, respectively; d = .453).
Discussion
Bahr and Dansereau state that the general results of the study are comparable with others obtained by previous foreign language acquisition researchers. This means that large standard deviations and relatively low recall scores and correlation coefficients ( in this study Cronbach’s alpha is ranging from .613 to .969) characterize it. In this respect the authors concluded that their experimental data provided support for the argument that BIK map-based learning does have significant advantage over word-list learning, in particular within short terms. However, Bahr and Dansereau also acknowledged that students’ performance in the present study was significantly lower (ranging from 10.8% to 28.8% in the BiK group and 5.8% to 20.2% in the list group) than those of students from earlier studies by the same authors in 2001.
The authors state that the difference in the students’ performance in the present study is likely due to the fact that delayed recall in previous experiments was preceded by immediate recall, which apparently caused a rehearsal effect. Although their objective in the current study was to eliminate the possibility of differential rehearsal effects, it seems that, without rehearsal, a consequent suppression of memory in general is unavoidable when testing for BiK-map effects.
The authors also discussed the possibilities of taking BiK map out of the academic realm in order test the durability of findings in realistic settings and expressed hope That future investigation into foreign language learning connectivity and multilingual memory will lead to the development of more sophisticated learning materials.
Critique
Bahr and Dansereau’s research paper, although relatively well written, is presented in a nontraditional format that can be hard to follow as both the result and discussion sections are found at the beginning of the paper. The article could have been improved by providing additional information about the location of the study and by limiting references to the authors themselves as their work has been replicated by others on numerous occasions. Other areas of weakness include the very low Cronbach’s alpha values in the processing inventory section on page 107-108 and the very low number of participants (well below the usual 300+ that is recommend for factor analysis). In spite of these critiques and in light of the experimental nature of this investigation I conclude that the Bahr and Dansereau article is both clear written and its aim is well directed.
Theoretical and practical implications
One of several theoretical implications of this study is that it highlighted the need for additional investigation to better understand the connections between of BiK maps and the foreign and the native language lexica. Although there is previous research (see page 102) that seems to support the hypothesis that a strong semantic or conceptual association exists between foreign language words and their meaning, future research should not only confirm these hypothesis’ but should test new presentation formats that would facilitate these connections in novice learners.
Practical implications of this study include using both BiK and monolingual knowledge maps in all kinds of academic settings in order to promote a shift toward a more beneficial top-down processing strategy among the learners. The use of both bi and monolingual knowledge maps in various settings also raises the possibilities that the textbook publishers would include BiK supplements in their new editions of foreign language textbooks and that BiK map creation as a subject would be added to teachers of foreign language degree course offerings.
Monday, April 6, 2009
Özmen et al. (2009)
Özmen, H, Gökhan, D., & Coll, R. K. (2009). A comparative study of the effects of a concept mapping enhanced laboratory experience on Turkish high school students’ understanding of acid-base chemistry. Journal of Science and Mathematics Education, 7, 1-24.
Problem/Purpose
The researchers in this study examined how the combined effect of laboratory activities and concept mapping improved student learning of acid-base chemistry relative to traditional lecture and problem set teaching methods in chemistry classes. Student learning included test measures through quantitative scales with multiple choice problems as well as student interviews to identify qualitative differences, especially alternative conceptions. The expression “alternative conceptions” refers to student conceptions that fail to align with accepted scientific models and conceptions. In addition to examining student learning, the researchers set out to measure student affect in the form of attitude toward chemistry.
This study is of interest because it expands the understanding of concept maps and laboratory activities in science teaching by examining the effects of using the two methods concurrently. By investigating more qualitative measures like alternative conceptions, the study promotes the identification and correction of incomplete or incorrect student understandings. Özmen et al. further relate that alternative conceptions are pervasive, stable, and resistant to change.
Methods
Özmen et al. conducted a quasi-experiment using one teacher, two groups, and two teaching methods. The teacher taught a unit on acids and bases in the traditional lecture-based format he had used in the past for one group. For the intervention group, he taught using concept maps and laboratory activities. The researchers provided two 45-minute training sessions on concept maps and laboratory activities for the teacher. Both groups received five 45-minute lessons per week for a total of four weeks.
For the traditional group, the teaching observed was primarily whole-group instruction consisting of teacher lectures explaining concepts with examples chosen from the textbook. The lectures were followed by teacher-driven explanations and seatwork with the teacher moving about the room, helping students to complete the seatwork.
For the intervention group, the pre-test administered to identify student alternative conceptions at the beginning of the study was used as part of the instructional design. Students were provided with instruction about alternative conceptions at the beginning of the unit. Later in the unit alternative conceptions were presented again and discussed at times when students would likely develop cognitive conflict and potentially be replace the alternative conceptions with accepted scientific conceptions.
Students in the intervention completed two laboratory activities per week (eight total). Within the intervention group, students were assigned to smaller study groups. The study groups were matched based on student pre-test performance.
Students in the intervention group also received instruction with respect to concept mapping and practice in constructing concept maps. These included partially constructed maps at the beginning, and unassisted maps later. Students prepared concept maps for seven different topics within the acid-base unit.
With both groups, the researchers used pretests and posttests. In addition to the pretest at the beginning of the unit, the researchers conducted 30-40 minute interviews with 15 students to evaluate student understanding and to identify students’ alternative conceptions. The 15 students were selected to represent a range of achievement levels based on past chemistry examination grades. The post-test used with both groups was different from the pre-test, which Özmen et al. describe as non-equivalent.
For the pretests and posttests, student understanding was measured using the Concept Achievement Test (CAT). The CAT contains 25 items, 15 of which are multiple choice and 10 of which are multiple choice with required explanations. Response choices included the scientific explanation, one common alternative conception, and three plausible distracters. Three chemistry educators validated the content of the CAT and reliability was assessed via item analysis using the Kuder-Richardson 20 statistic, which was found to be 0.81 and considered acceptable by the researchers.
Results
The researchers compared pretest scores for the two groups using an independent samples t-test (t=0.40, df=57, p=0.82), and found no statistically significant difference between the groups (p>0.05). For the posttest scores, Özmen et al. found that the intervention group had higher scores and that the difference was statistically significant (t=5.58, df=57, p<0.01). Özmen et al. did not report Cohen’s d, but the author of this review found it to be d=1.45, a rather large and noteworthy effect size.
The researchers also examined students’ alternative conceptions to determine if there were differences in stability and change of these conceptions with respect to the different instructional methods. Özmen et al. present these results in a table (Table III). For the seventeen alternative conceptions, there were larger changes for the intervention group than for the traditional group. Özmen et al. do not present any statistics to evaluate statistical significance or effect sizes for these differences.
Discussion
Özmen et al. state that their findings indicate that students in the intervention group who participated in laboratory and concept map construction activities performed better on the posttest and showed greater changes in correcting alternative conceptions with scientific explanations. Students in the traditional group improved in these ways as well, but the posttest difference between groups was statistically significant with a large effect size. Statistics and effect sizes were not calculated for the corrections of alternative conceptions.
Because Özmen et al. studied the combined effects of two treatments, it is not possible to determine if both treatments are required to accomplish the outcomes observed. The change may be due to one component, the other, or the combination of the two. As Özmen et al. state, “A simpler intervention may be equally effective.”
Some of the changes are likely due to testing of alternative conceptions in the laboratory. Özmen et al. describe having students test the conception that acids melt metals by having students treat metals with strong acids to observe the effects. The rejection of the conception from contradictory laboratory experience is expected, but this effect was not isolated and tested specifically. A similar experience was created for students in a demonstration to controvert the alternative conception that “the only way to test a sample whether it is an acid or a base is to see if it eats something away, for example metal, plastic, animal, and us.” Again, the rejection of the conception from contradictory laboratory experience is expected, but this effect was not isolated and tested specifically.
Özmen et al. state that the role of concept maps in the intervention was threefold. First the students used concept maps to defend their ideas from laboratory work. Second the students used concept maps to understand the results obtained in the laboratory. Third the concept maps allowed the teacher to identify alternative conceptions and gaps in understanding. Concept maps were used to augment understanding and processing of laboratory activities and data
Özmen et al. indicate that the literature is mixed with respect to the effect of laboratory activities alone in improving student scores on post-instruction tests and in correcting alternative conceptions. Likewise Özmen et al. indicate that the literature is mixed with respect to the effect of concept mapping alone in improving student scores on post-instruction tests and in correcting alternative conceptions. However, Özmen et al. state that a limited literature on the effect of using both strategies together is consistent with the findings of this paper. Özmen et al. additionally state the sentiment that while laboratory work may be the more critical element of the two parts of the intervention, that concept maps are crucial in helping students to integrate the laboratory work within their conceptual structure.
The limitations of this study include geographic and temporal specificity. Furthermore, the use of one teacher to teach both methods and groups does not guarantee against teacher effects. The use of two components only in combination and not in isolation does not allow for empirically based evaluations of the contributions of each component or for any synergistic effects of the components used together.
Critique
Özmen et al. use language that is understandable and jargon is avoided when possible and explained where necessary. The absence of effect size calculations for the posttest results is troubling, especially when the effect is large and worthy of inclusion. Likewise, the lack of statistical significance testing on the results of Table III for correction of students’ alternative conceptions fails to provide empirical data analysis to support the author’s contentions. Calculation and inclusion of significance tests and effect sizes for these corrections should not be difficult. Özmen et al. could also have included two treatments with only laboratory investigations included in one and concept mapping included in the other to determine component and synergy effects. This last critique can still be addressed through future studies.
Theoretical, Methodological, and Practical Implications
A major implication of this article is the potential to use laboratory activities and concept mapping together to modify alternative conceptions that tend to be stable and resistant to correction by traditional teaching methods. In addition to correcting these major misunderstandings, the significant improvement in posttest scores using the combination of concept mapping and laboratory activities in equal time is an important practical implication. This may be even more notable given that some instructional time normally devoted to content was replaced with instructional time for learning to construct and use concept maps, thereby reducing the time spent directly on content in the intervention group.
This study used a specially designed test to assess students’ use of alternative conceptions based on alternative conceptions detected at the outset of the study through student interviews. This method allowed the researchers to focus on student understanding. Future research based on this method could be improved by having more than one choice being an alternative conception and by analyzing the distracters and the alternative assessment using item response theory to ensure that the distracter and alternative conceptions are equally attractive responses.
Theoretical implications of this article involve possible synergistic effects between concept mapping and laboratory activities (and possibly other forms of experiential learning, group work, and project-based learning). As well, there is the potential for theoretical work to connect concept mapping and laboratory activities in new ways to visual and kinesthetic processing and phonological loops via the multi-sensory input of laboratory activities and the use of concept maps to connect the sensory input with phonological loops and learners’ internalized concept structures.
Problem/Purpose
The researchers in this study examined how the combined effect of laboratory activities and concept mapping improved student learning of acid-base chemistry relative to traditional lecture and problem set teaching methods in chemistry classes. Student learning included test measures through quantitative scales with multiple choice problems as well as student interviews to identify qualitative differences, especially alternative conceptions. The expression “alternative conceptions” refers to student conceptions that fail to align with accepted scientific models and conceptions. In addition to examining student learning, the researchers set out to measure student affect in the form of attitude toward chemistry.
This study is of interest because it expands the understanding of concept maps and laboratory activities in science teaching by examining the effects of using the two methods concurrently. By investigating more qualitative measures like alternative conceptions, the study promotes the identification and correction of incomplete or incorrect student understandings. Özmen et al. further relate that alternative conceptions are pervasive, stable, and resistant to change.
Methods
Özmen et al. conducted a quasi-experiment using one teacher, two groups, and two teaching methods. The teacher taught a unit on acids and bases in the traditional lecture-based format he had used in the past for one group. For the intervention group, he taught using concept maps and laboratory activities. The researchers provided two 45-minute training sessions on concept maps and laboratory activities for the teacher. Both groups received five 45-minute lessons per week for a total of four weeks.
For the traditional group, the teaching observed was primarily whole-group instruction consisting of teacher lectures explaining concepts with examples chosen from the textbook. The lectures were followed by teacher-driven explanations and seatwork with the teacher moving about the room, helping students to complete the seatwork.
For the intervention group, the pre-test administered to identify student alternative conceptions at the beginning of the study was used as part of the instructional design. Students were provided with instruction about alternative conceptions at the beginning of the unit. Later in the unit alternative conceptions were presented again and discussed at times when students would likely develop cognitive conflict and potentially be replace the alternative conceptions with accepted scientific conceptions.
Students in the intervention completed two laboratory activities per week (eight total). Within the intervention group, students were assigned to smaller study groups. The study groups were matched based on student pre-test performance.
Students in the intervention group also received instruction with respect to concept mapping and practice in constructing concept maps. These included partially constructed maps at the beginning, and unassisted maps later. Students prepared concept maps for seven different topics within the acid-base unit.
With both groups, the researchers used pretests and posttests. In addition to the pretest at the beginning of the unit, the researchers conducted 30-40 minute interviews with 15 students to evaluate student understanding and to identify students’ alternative conceptions. The 15 students were selected to represent a range of achievement levels based on past chemistry examination grades. The post-test used with both groups was different from the pre-test, which Özmen et al. describe as non-equivalent.
For the pretests and posttests, student understanding was measured using the Concept Achievement Test (CAT). The CAT contains 25 items, 15 of which are multiple choice and 10 of which are multiple choice with required explanations. Response choices included the scientific explanation, one common alternative conception, and three plausible distracters. Three chemistry educators validated the content of the CAT and reliability was assessed via item analysis using the Kuder-Richardson 20 statistic, which was found to be 0.81 and considered acceptable by the researchers.
Results
The researchers compared pretest scores for the two groups using an independent samples t-test (t=0.40, df=57, p=0.82), and found no statistically significant difference between the groups (p>0.05). For the posttest scores, Özmen et al. found that the intervention group had higher scores and that the difference was statistically significant (t=5.58, df=57, p<0.01). Özmen et al. did not report Cohen’s d, but the author of this review found it to be d=1.45, a rather large and noteworthy effect size.
The researchers also examined students’ alternative conceptions to determine if there were differences in stability and change of these conceptions with respect to the different instructional methods. Özmen et al. present these results in a table (Table III). For the seventeen alternative conceptions, there were larger changes for the intervention group than for the traditional group. Özmen et al. do not present any statistics to evaluate statistical significance or effect sizes for these differences.
Discussion
Özmen et al. state that their findings indicate that students in the intervention group who participated in laboratory and concept map construction activities performed better on the posttest and showed greater changes in correcting alternative conceptions with scientific explanations. Students in the traditional group improved in these ways as well, but the posttest difference between groups was statistically significant with a large effect size. Statistics and effect sizes were not calculated for the corrections of alternative conceptions.
Because Özmen et al. studied the combined effects of two treatments, it is not possible to determine if both treatments are required to accomplish the outcomes observed. The change may be due to one component, the other, or the combination of the two. As Özmen et al. state, “A simpler intervention may be equally effective.”
Some of the changes are likely due to testing of alternative conceptions in the laboratory. Özmen et al. describe having students test the conception that acids melt metals by having students treat metals with strong acids to observe the effects. The rejection of the conception from contradictory laboratory experience is expected, but this effect was not isolated and tested specifically. A similar experience was created for students in a demonstration to controvert the alternative conception that “the only way to test a sample whether it is an acid or a base is to see if it eats something away, for example metal, plastic, animal, and us.” Again, the rejection of the conception from contradictory laboratory experience is expected, but this effect was not isolated and tested specifically.
Özmen et al. state that the role of concept maps in the intervention was threefold. First the students used concept maps to defend their ideas from laboratory work. Second the students used concept maps to understand the results obtained in the laboratory. Third the concept maps allowed the teacher to identify alternative conceptions and gaps in understanding. Concept maps were used to augment understanding and processing of laboratory activities and data
Özmen et al. indicate that the literature is mixed with respect to the effect of laboratory activities alone in improving student scores on post-instruction tests and in correcting alternative conceptions. Likewise Özmen et al. indicate that the literature is mixed with respect to the effect of concept mapping alone in improving student scores on post-instruction tests and in correcting alternative conceptions. However, Özmen et al. state that a limited literature on the effect of using both strategies together is consistent with the findings of this paper. Özmen et al. additionally state the sentiment that while laboratory work may be the more critical element of the two parts of the intervention, that concept maps are crucial in helping students to integrate the laboratory work within their conceptual structure.
The limitations of this study include geographic and temporal specificity. Furthermore, the use of one teacher to teach both methods and groups does not guarantee against teacher effects. The use of two components only in combination and not in isolation does not allow for empirically based evaluations of the contributions of each component or for any synergistic effects of the components used together.
Critique
Özmen et al. use language that is understandable and jargon is avoided when possible and explained where necessary. The absence of effect size calculations for the posttest results is troubling, especially when the effect is large and worthy of inclusion. Likewise, the lack of statistical significance testing on the results of Table III for correction of students’ alternative conceptions fails to provide empirical data analysis to support the author’s contentions. Calculation and inclusion of significance tests and effect sizes for these corrections should not be difficult. Özmen et al. could also have included two treatments with only laboratory investigations included in one and concept mapping included in the other to determine component and synergy effects. This last critique can still be addressed through future studies.
Theoretical, Methodological, and Practical Implications
A major implication of this article is the potential to use laboratory activities and concept mapping together to modify alternative conceptions that tend to be stable and resistant to correction by traditional teaching methods. In addition to correcting these major misunderstandings, the significant improvement in posttest scores using the combination of concept mapping and laboratory activities in equal time is an important practical implication. This may be even more notable given that some instructional time normally devoted to content was replaced with instructional time for learning to construct and use concept maps, thereby reducing the time spent directly on content in the intervention group.
This study used a specially designed test to assess students’ use of alternative conceptions based on alternative conceptions detected at the outset of the study through student interviews. This method allowed the researchers to focus on student understanding. Future research based on this method could be improved by having more than one choice being an alternative conception and by analyzing the distracters and the alternative assessment using item response theory to ensure that the distracter and alternative conceptions are equally attractive responses.
Theoretical implications of this article involve possible synergistic effects between concept mapping and laboratory activities (and possibly other forms of experiential learning, group work, and project-based learning). As well, there is the potential for theoretical work to connect concept mapping and laboratory activities in new ways to visual and kinesthetic processing and phonological loops via the multi-sensory input of laboratory activities and the use of concept maps to connect the sensory input with phonological loops and learners’ internalized concept structures.
Chiou (2008)
Chiou, C. (2008). The effect of concept mapping on students’ learning achievements and interests. Innovations in Education and Teaching International. (45)4, 375-387
Purpose/Problem
The purpose of this experimental study was to examine whether concept mapping could be used to improve accounting education in an advanced accounting course in a university setting in Taiwan. The researcher of the study examined two areas of interest: whether concept mapping improved students’ learning achievement in an advanced accounting course; and the attitudes of students toward concept mapping as a learning tool. Student learning achievement was measured by accounting achievement scores in pre- and post-test instruments as well an independent CPA-level exam measuring student knowledge of the domain area. Student attitude toward concept mapping was measured pre- and post-implementation of the concept mapping intervention by a satisfaction questionnaire developed by the researcher.
This study is noteworthy because the use of concept mapping as an instructional and summative tool is contrasted with traditional teaching methodologies in a domain that examines complex mathematical concepts. In addition, the study attempts to measure the effect of student attitudes toward concept mapping both before and after implementation of the concept mapping protocol. The researcher grounded his study by citing well-established research indicating the efficacy of concept mapping as an effective tool to improve student independent learning. Further, the researcher pinpoints a lack of research in the literature in this domain area which this study fills.
Methods
The participants in this study were 124 students from two classes in advanced accounting courses and one instructor in a university setting in Taiwan. Half the students were randomly assigned as an experimental group and the remaining 62 students were assigned as a control group. One instructor taught both classes. The instructor and textbooks for both groups were identical to avoid key confounding effects on the study. None of the participants reported using concept mapping in prior classes.
Several stages were used to accomplish the purpose of the study. First, the researcher and teacher spent two months prior to the teaching of the classes discussing overall experimental design and procedures. Second, grades from a prior intermediate accounting class were combined with an accounting achievement pre-test score and evaluated in order to ensure participants had similar backgrounds in accounting. Third, the experimental group was given three hours of training on concept mapping and its rationale. The instructor then taught from the text book using teacher-generated concept maps. Students from the experimental group were asked to generate their own maps after the conclusion of a chapter. The instructor and researcher provided corrective feedback on each student map enabling the students to correct their own efforts. The students in the experimental group were able to use the modified maps as a review tool for later study. This procedure was repeated until the end of chapter six of the textbook for a total implementation period of 12 weeks. The control group was taught in a more traditional manner with the instructor giving introductory lectures and teacher-generated abstracts. Students in the control group were asked to work on individual problems to which the instructor provided corrective feedback. The identical procedure was repeated until the end of chapter six in the textbook. The implementation period was the same as the experimental group. A post-test was administered to both groups after completion of the chapters to measure learning achievement. Student attitude surveys were administered to the experimental group to measure student satisfaction of concept maps as a learning tool.
Results
T-tests were conducted to compare two factors: 1) the experimental and control groups’ scores in intermediate accounting in the two semesters preceding the study; and 2) the scores in the pre-study accounting pre-test. The differences between the two groups were not significant (t = - 0.65, p > 0.05; t = 0.89, p > 0.05) implying that both groups had similar levels of accounting knowledge and ability.
A post-test t-test was conducted to examine whether the concept mapping technique contributed to student learning achievement. Results show a significant difference (t = 2.96, p < 0.001) between the two classes. The experimental group had a mean score of 73.24 (SD = 15.314) while the control group had a mean score of 63.31 (SD = 21.561) indicating the experimental group outperformed the control group by a significant margin. A Cohen’s d was not reported.
To insure that pre-test scores did not influence the experimental effect, a one-way analysis of covariance was applied with pre-test scores as covariates and the post-test scores as dependent variables. The results attained significance (F = 8.65, p < 0.01; F = 7.99, p < 0.01) indicating that the experimental group who utilized the concept map technique had significantly higher achievement than the control group who were taught using traditional teaching methods.
The researcher also examined student responses on a 10-question Likert-style satisfaction survey to determine student attitudes toward concept mapping. Agree and Strongly Agree responses were converted into “Agree” and Disagree and Strongly Disagree responses were converted to “Disagree” statements then converted to percentages. The first four questions on the survey were designed to reveal whether concept mapping improved learning. Ninety-seven percent of the participants agreed that concept mapping aided their learning of accounting principles. Ninety-five percent of the participants agreed that concept mapping helped them to learn and think independently. Eighty-nine percent of the participants expressed the opinion that concept mapping helped them to reduce barriers to learning accounting.
The next six questions were designed to test student acceptance of concept mapping as a learning tool. Ninety-five percent of the participants indicated that concept mapping could be used as an effective teaching and learning method and easily applied to other curriculum areas. Eighty-four percent of the participants reported liking the concept mapping technique in their study of accounting. Overall, ninety percent of the participants were satisfied with using concept mapping to learn accounting. However, only fifty-eight percent of the students indicated that they “could soon adapt to concept mapping.” The researcher notes that this result indicates that probably more time is needed to train students effectively in the technique of concept mapping.
Discussion
The main purpose of this study was to examine whether concept mapping could be used to help advanced accounting students in a university setting improve learning achievement. The results of the study showed that students in the experimental group improved in their learning achievement more than the students in the control group. Chiou notes that his findings are in agreement with a number of other studies’ findings in other disciplines.
Chiou also notes that the second research area – positive student perceptions of concept mapping – also reinforced previous research. The researcher does note, however, that “nearly half the students indicated that they could not quickly adapt to the approach of concept mapping” (p. 383). While this result is reported in a number of other studies, the results from this study adds to the growing consensus that a lack of familiarity with the technique of concept mapping can be a barrier to students individually adopting concept mapping as a personal learning tool.
Chiou extends his findings to promote concept mapping as “the only approach to address both what students know and how students organize their knowledge” (p. 383) and thus “is a useful meta-learning strategy in relation to helping students ‘learn how to learn’ (p. 384). He concludes with the statement that “concept mapping is an effective meta-cognitive strategy and this study is a pioneering detailed investigation in the usefulness of concept mapping in university-level business accounting courses” (p. 385).
Critique
In general, this study employs sound methodological and statistical techniques and represents a well-thought out and controlled study. The writing is clear, appropriately formal, direct, concise, well organized, and factual. The study is well grounded in previous research and makes an important contribution to the literature. Sample size is sufficient (N = 124) to yield generalizable results. Ethical considerations seem to be at least partially addressed with student anonymity being assured in the student attitude response post-study. Confounding effects are somewhat anticipated and addressed by ensuring homogeneity of the participants’ backgrounds and abilities strengthening the validity of the experimental results. No mention is made of the students’ cultural background as a possible barrier to the generalizability of the study results.
The study could have been strengthened by a more detailed description and analysis of the Likert-style questionnaire given post-study to the experimental group. As described, Chiou grouped all affirmative responses and all negative responses into two categories and converted to percentages. The strength of these responses could have been recalibrated given a more detailed Likert response questionnaire.
Theoretical, Methodological, and Practical Implications
This study indicates that concept mapping can be an effective meta-cognitive strategy to enhance meaningful learning in accounting and other related business courses. Given the dearth of studies in this area, this study makes an important contribution to the corpus of literature. In domains that stress the incremental acquisition of knowledge (in particular math and science), concept mapping might be an effective instructional and summative tool by allowing corrective feedback during the course of instruction.
In addition, this study seems to indicate that concept mapping encourages more independent learning skills by allowing these accounting students to make their own connections between different concept areas. This change in emphasis from more traditional teaching methods seems to enhance more meaningful learning in complex domains.
Finally, concept mapping could be an effective meta-cognitive strategy in making better transitional connections between courses in a particular domain.
Purpose/Problem
The purpose of this experimental study was to examine whether concept mapping could be used to improve accounting education in an advanced accounting course in a university setting in Taiwan. The researcher of the study examined two areas of interest: whether concept mapping improved students’ learning achievement in an advanced accounting course; and the attitudes of students toward concept mapping as a learning tool. Student learning achievement was measured by accounting achievement scores in pre- and post-test instruments as well an independent CPA-level exam measuring student knowledge of the domain area. Student attitude toward concept mapping was measured pre- and post-implementation of the concept mapping intervention by a satisfaction questionnaire developed by the researcher.
This study is noteworthy because the use of concept mapping as an instructional and summative tool is contrasted with traditional teaching methodologies in a domain that examines complex mathematical concepts. In addition, the study attempts to measure the effect of student attitudes toward concept mapping both before and after implementation of the concept mapping protocol. The researcher grounded his study by citing well-established research indicating the efficacy of concept mapping as an effective tool to improve student independent learning. Further, the researcher pinpoints a lack of research in the literature in this domain area which this study fills.
Methods
The participants in this study were 124 students from two classes in advanced accounting courses and one instructor in a university setting in Taiwan. Half the students were randomly assigned as an experimental group and the remaining 62 students were assigned as a control group. One instructor taught both classes. The instructor and textbooks for both groups were identical to avoid key confounding effects on the study. None of the participants reported using concept mapping in prior classes.
Several stages were used to accomplish the purpose of the study. First, the researcher and teacher spent two months prior to the teaching of the classes discussing overall experimental design and procedures. Second, grades from a prior intermediate accounting class were combined with an accounting achievement pre-test score and evaluated in order to ensure participants had similar backgrounds in accounting. Third, the experimental group was given three hours of training on concept mapping and its rationale. The instructor then taught from the text book using teacher-generated concept maps. Students from the experimental group were asked to generate their own maps after the conclusion of a chapter. The instructor and researcher provided corrective feedback on each student map enabling the students to correct their own efforts. The students in the experimental group were able to use the modified maps as a review tool for later study. This procedure was repeated until the end of chapter six of the textbook for a total implementation period of 12 weeks. The control group was taught in a more traditional manner with the instructor giving introductory lectures and teacher-generated abstracts. Students in the control group were asked to work on individual problems to which the instructor provided corrective feedback. The identical procedure was repeated until the end of chapter six in the textbook. The implementation period was the same as the experimental group. A post-test was administered to both groups after completion of the chapters to measure learning achievement. Student attitude surveys were administered to the experimental group to measure student satisfaction of concept maps as a learning tool.
Results
T-tests were conducted to compare two factors: 1) the experimental and control groups’ scores in intermediate accounting in the two semesters preceding the study; and 2) the scores in the pre-study accounting pre-test. The differences between the two groups were not significant (t = - 0.65, p > 0.05; t = 0.89, p > 0.05) implying that both groups had similar levels of accounting knowledge and ability.
A post-test t-test was conducted to examine whether the concept mapping technique contributed to student learning achievement. Results show a significant difference (t = 2.96, p < 0.001) between the two classes. The experimental group had a mean score of 73.24 (SD = 15.314) while the control group had a mean score of 63.31 (SD = 21.561) indicating the experimental group outperformed the control group by a significant margin. A Cohen’s d was not reported.
To insure that pre-test scores did not influence the experimental effect, a one-way analysis of covariance was applied with pre-test scores as covariates and the post-test scores as dependent variables. The results attained significance (F = 8.65, p < 0.01; F = 7.99, p < 0.01) indicating that the experimental group who utilized the concept map technique had significantly higher achievement than the control group who were taught using traditional teaching methods.
The researcher also examined student responses on a 10-question Likert-style satisfaction survey to determine student attitudes toward concept mapping. Agree and Strongly Agree responses were converted into “Agree” and Disagree and Strongly Disagree responses were converted to “Disagree” statements then converted to percentages. The first four questions on the survey were designed to reveal whether concept mapping improved learning. Ninety-seven percent of the participants agreed that concept mapping aided their learning of accounting principles. Ninety-five percent of the participants agreed that concept mapping helped them to learn and think independently. Eighty-nine percent of the participants expressed the opinion that concept mapping helped them to reduce barriers to learning accounting.
The next six questions were designed to test student acceptance of concept mapping as a learning tool. Ninety-five percent of the participants indicated that concept mapping could be used as an effective teaching and learning method and easily applied to other curriculum areas. Eighty-four percent of the participants reported liking the concept mapping technique in their study of accounting. Overall, ninety percent of the participants were satisfied with using concept mapping to learn accounting. However, only fifty-eight percent of the students indicated that they “could soon adapt to concept mapping.” The researcher notes that this result indicates that probably more time is needed to train students effectively in the technique of concept mapping.
Discussion
The main purpose of this study was to examine whether concept mapping could be used to help advanced accounting students in a university setting improve learning achievement. The results of the study showed that students in the experimental group improved in their learning achievement more than the students in the control group. Chiou notes that his findings are in agreement with a number of other studies’ findings in other disciplines.
Chiou also notes that the second research area – positive student perceptions of concept mapping – also reinforced previous research. The researcher does note, however, that “nearly half the students indicated that they could not quickly adapt to the approach of concept mapping” (p. 383). While this result is reported in a number of other studies, the results from this study adds to the growing consensus that a lack of familiarity with the technique of concept mapping can be a barrier to students individually adopting concept mapping as a personal learning tool.
Chiou extends his findings to promote concept mapping as “the only approach to address both what students know and how students organize their knowledge” (p. 383) and thus “is a useful meta-learning strategy in relation to helping students ‘learn how to learn’ (p. 384). He concludes with the statement that “concept mapping is an effective meta-cognitive strategy and this study is a pioneering detailed investigation in the usefulness of concept mapping in university-level business accounting courses” (p. 385).
Critique
In general, this study employs sound methodological and statistical techniques and represents a well-thought out and controlled study. The writing is clear, appropriately formal, direct, concise, well organized, and factual. The study is well grounded in previous research and makes an important contribution to the literature. Sample size is sufficient (N = 124) to yield generalizable results. Ethical considerations seem to be at least partially addressed with student anonymity being assured in the student attitude response post-study. Confounding effects are somewhat anticipated and addressed by ensuring homogeneity of the participants’ backgrounds and abilities strengthening the validity of the experimental results. No mention is made of the students’ cultural background as a possible barrier to the generalizability of the study results.
The study could have been strengthened by a more detailed description and analysis of the Likert-style questionnaire given post-study to the experimental group. As described, Chiou grouped all affirmative responses and all negative responses into two categories and converted to percentages. The strength of these responses could have been recalibrated given a more detailed Likert response questionnaire.
Theoretical, Methodological, and Practical Implications
This study indicates that concept mapping can be an effective meta-cognitive strategy to enhance meaningful learning in accounting and other related business courses. Given the dearth of studies in this area, this study makes an important contribution to the corpus of literature. In domains that stress the incremental acquisition of knowledge (in particular math and science), concept mapping might be an effective instructional and summative tool by allowing corrective feedback during the course of instruction.
In addition, this study seems to indicate that concept mapping encourages more independent learning skills by allowing these accounting students to make their own connections between different concept areas. This change in emphasis from more traditional teaching methods seems to enhance more meaningful learning in complex domains.
Finally, concept mapping could be an effective meta-cognitive strategy in making better transitional connections between courses in a particular domain.
Subscribe to:
Posts (Atom)