首页 | 本学科首页   官方微博 | 高级检索  
相似文献
 共查询到20条相似文献,搜索用时 390 毫秒
1.
Instruction in peer assessment of complex task performance may cause high cognitive load, impairing learning. A stepwise instructional strategy aimed at reducing cognitive load was investigated by comparing it with a combined instructional strategy in an experiment with 128 secondary school students (mean age 14.0?years; 45.2% male) with the between-subjects factor instruction (stepwise, combined). In the stepwise condition, study tasks in Phase 1 were domain-specific and study tasks in Phase 2 had both domain-specific and peer assessment components. In the combined condition, these two components were present in all tasks in both phases. Final performance (i.e. speed and accuracy in domain-specific skills and peer assessment skills) showed no significant differences, but performance improved more from Phase 1 to Phase 2 in the stepwise condition than in the combined condition. The results suggest that, with complex study tasks, it might be beneficial to teach domain-specific skills before peer assessment skills.  相似文献   

2.
Giving students complex learning tasks combined with peer-assessment tasks can impose a high cognitive load. Scaffolding has proven to reduce cognitive load during learning and improve accuracy on domain-specific tasks. This study investigated whether scaffolding has a similar, positive effect on the learning of peer-assessment tasks. We hypothesised that: (1) domain-specific scaffolding improves domain-specific accuracy and reduces time on task and perceived mental effort, and (2) peer-assessment scaffolding improves peer-assessment accuracy and reduces time on task and perceived mental effort. Additionally, we explored whether there was an interaction between domain-specific and peer-assessment scaffolding. In a 2x2 experiment with the factors domain-specific scaffolding (present, absent) and peer-assessment scaffolding (present, absent), 236 secondary school students assessed the performance of fictitious peers in an electronic learning environment. We found that domain-specific accuracy indeed improved with domain-specific scaffolding, confirming our first hypothesis. Our tests of the second hypothesis, however, revealed surprising results: peer-assessment scaffolding significantly increased accuracy and mental effort during learning, it had no effect on peer-assessment accuracy at the test and led to reduced domain-specific accuracy, even when combined with domain-specific scaffolding. These results suggest that scaffolding students' peer assessment before they have mastered the task at hand can have disturbing effects on students’ ability to learn from the task.  相似文献   

3.
Number of raters is theoretically central to peer assessment reliability and validity, yet rarely studied. Further, requiring each student to assess more peers’ documents both increases the number of evaluations per document but also assessor workload, which can decline performance. Moreover, task complexity is likely a moderating factor, influencing both workload and validity. This study examined whether changing the number of required peer assessments per student / number of raters per document affected peer assessment reliability and validity for tasks at different levels of task complexity. 181 students completed and provided peer assessments for tasks at three levels of task complexity: low complexity (dictation), medium complexity (oral imitation), and high complexity (writing). Adequate validity of peer assessments was observed for all three task complexities at low reviewing loads. However, the impacts of increasing reviewing load varied by reliability vs. validity outcomes and by task complexity.  相似文献   

4.
Generic problem-solving skills have been identified as one of the key competencies valued by professional programmes, university students and their future employers. A lack of widely available and simple testing tools prevents assessment of the development of student problem-solving skills. As part of a research study, a generic problem-solving test was administered to 130 third-year science students during three consecutive years. A comparison between the scores students achieved in this test with their six academic marks obtained in this course showed no significant correlation. Lack of correlation between the problem-solving skill test scores and academic marks of students was confirmed in a larger population of students participating in a campus-wide study of generic problem-solving skills (n = 830). Problem solving and academic performance may represent two independent skill sets of students; testing problem-solving skills of students could be introduced to achieve a more comprehensive evaluation of undergraduate student progress and achievement.  相似文献   

5.
Peer assessment has been widely applied to actively engage students in learning to write. However, sometimes students resist peer assessment. This study explores reviewers’ attitudes and other underlying factors that influence students’ participation in online peer assessment. Participants were 234 Chinese undergraduates from two different academic backgrounds: engineering majors (n = 168) and English majors (n = 66). Gender, academic background and prior experience with peer assessment were all related to participation levels. Moreover, factor analyses revealed three attitudinal factors: (1) positive attitude (a general endorsement of the benefits of peer assessment), (2) interpersonal negative (concerns about the negative effects on interpersonal relationships), and (3) procedural negative (doubts about the procedural rationality of peer assessment). Among the attitudinal factors, procedural negative was negatively associated with participation, as expected. Interestingly, interpersonal negative was associated with greater participation, and positive attitude was associated with lower participation, in part because students worked hard on each review rather than doing many reviews superficially. Implications for instruction are discussed.  相似文献   

6.
This study tested the constructivist hypothesis that the acquisition of domain-specific conceptual knowledge (declarative knowledge) requires use of general procedural knowledge. More specifically, it was hypothesized that use of a general pattern of hypothetico-deductive reasoning is necessary for the acquisition of novel domain-specific concepts. To test this hypothesis 314 high school biology and chemistry students were first tested to determine whether or not they were skilled in the use of hypothetico-deductive reasoning. Based on this test, students were classified as reflective, transitional, or intuitive thinkers. All students were then presented with a series of four concept-acquisition tasks. It was predicted that reflective (hypothetico-deductive) thinkers would acquire the concepts while intuitive (empirico-inductive) thinkers would not. Transitional thinkers were expected to be partially successful. These predictions were confirmed as skill in hypothetico-deductive reasoning (developmental level), but not age, was highly correlated with performance on the concept acquisition tasks (X2 = 71.14, p < 0.00001). This result was interpreted to be supportive of the constructivist hypothesis.  相似文献   

7.
Recent research on metacognition points out the crucial role of on-line methods when endeavouring to conduct valid assessments of metacognitive skills. Presently, different on-line methods are used, however, it is still a question of research whether and how they affect students’ learning behaviour and learning outcome. Thus, the aim of this study is to quasi-experimentally analyse the effects of two on-line verbalisation methods on learning performance. By means of the thinking-aloud method, students in one experimental group (n = 24) were instructed to read and think aloud during learning. With the reflection when prompted method, students of another experimental group (n = 24) were prompted at each navigational step to reflect on the reasons why they chose specific information. Students in the control group (n = 22) learned without being instructed to verbalise. All three groups were treated identically except for the different use of verbalisation assessment methods. The students’ task was to learn the concepts and principles of operant conditioning presented in a hypermedium within 30 min. The students’ learning sessions were videotaped and learning performance was obtained immediately afterwards. Based on Ericsson and Simon’s (Protocol analysis: Verbal reports as data, MIT, Cambridge, 1993) model, no performance differences between the thinking aloud and the control group were hypothesised. However, prompting students for metacognitive reflection should affect learning performance positively, which is confirmed by the results only in tendency for transfer performance. Implications for on-line assessment methods of metacognitive skill will be discussed.  相似文献   

8.
Outcomes for methods to accelerate thinking skills involving some peer interaction have been more consistently positive than those for purely teacher‐directed or materials‐led methods. However, methods involving mainly or only peer interaction are rare. This paper describes and evaluates such a method for peer tutoring in thinking skills, which scaffolds interactive discourse based on a differentiated real book the tutorial pair has chosen to read together. This pilot study aimed to partial the impact on quality of thinking of a peer‐tutored thinking intervention from that of a peer‐tutored reading intervention, controlling for time on task and amount of peer interactivity. Experimental peer tutees were a whole class (n=28) of seven‐year‐olds; experimental tutors a whole class (n=31) of 11‐year‐olds. Comparison tutees were a whole class (n=27) of seven‐year‐olds; comparison tutors a whole class (n=30) of 11‐year‐olds. Classes/teachers within the same school were randomly assigned to conditions. In Phase 1, a paired reading intervention was implemented for six weeks for all groups. In Phase 2, the experimental classes of tutors and tutees engaged in the “paired thinking” (PT) method for 10 weeks, while the comparison group continued with paired reading. Both treatments involved one 20‐minute session weekly. Pre‐ and post‐test assessment of thinking skills and attitude to reading for all participants was conducted and post hoc subjective feedback gathered from participants. The experimental (PT) tutees showed significantly better performance in thinking skills than comparison (PR only) tutees, and some evidence of improved attitudes to reading. However, this was not true for the experimental (PT) tutors. Subjective feedback was very positive from the PT tutees and class teachers, but less positive from the PT tutors. Given the brevity and low cost in time and resources of the treatment, the finding of significant differences in measured thinking skills for the PT tutees is considered encouraging. Recommendations for refining organizational aspects of the implementation of PT and for future research are made.  相似文献   

9.
The purpose of the study was to examine whether students’ linguistic skills and task-avoidant behavior (i.e., the child-related factors) and the mean level of academic skills (reading comprehension and math) of classmates (i.e., the class-related factor) are associated with teacher judgments of children’s reading comprehension and math skills. The participants were third-grade Estonian-speaking students (n?=?656; age 9?11 years) and their classroom teachers (n?=?51). The results of the structural equation modeling path analyses indicated that teachers tend to judge students showing higher academic and linguistic skills and lower avoidance behavior as higher on the reading comprehension and math skills. In contrast, the classmates’ higher academic skill level was related to lower judgments of individual children’s reading comprehension and math skills by teachers.  相似文献   

10.
Foundation degrees (FDs) involve the fusion of academic and vocational paths in higher education (HE) qualifications; the challenge for academics and employers is the credible assessment of the student’s workplace learning. Focusing to the workplace enables participants to learn from their daily routines encountered at work. The challenge is to help them demonstrate learning from experience within the workplace, by developing their ability to think at a higher level. A vital aspect of using workplace learning in partnership with employers/sector skills councils is that the learning is valid to the role. In response, the programme development group, which was composed of academics and employers, felt that workplace tasks (WPTs) would allow students to demonstrate role development through experiential learning at work. Therefore, this article uses a pilot case study (n = 16), using a focus group methodology, to discuss the assessment of the WPTs within a FD and the students’ perception towards this form of assessment. Findings show that participants value WPTs, they motivate participants to learn and improve their self‐esteem, however, some groups need specialist skills training where workplace competence is required.  相似文献   

11.
The aim of the present study was to develop and provide psychometric evidence in support of the groupwork skills questionnaire (GSQ) for measuring task and interpersonal groupwork skills. A 46-item version of the GSQ was initially completed by 672 university students. The number of items was reduced to 15 following exploratory factor analyses, and a two-factor model consisting of task and interpersonal groupwork skills was revealed. Confirmatory factor analyses with model re-specification on new data (n = 275 students) established that the best fitting model consisted of 10 items and the same two factors (task and interpersonal). Concurrent validity of the GSQ was then determined with 145 participants by demonstrating significant relationships (p < 0.05) with attitudes towards groupwork and groupwork self-efficacy. Test–retest reliability was examined over a one-week interval. Overall, the GSQ demonstrates good validity and reliability, and has potential for both research and pedagogical application.  相似文献   

12.
In order to self-regulate, students need to honestly reflect on their learning and to take appropriate corrective action. A simple procedure to cultivate student skills in self-regulated learning, known as the Task Evaluation and Reflection Instrument for Student Self-Assessment (TERISSA) is discussed in this paper. TERISSA guides students through two evaluations of the complexity of a task: the first is undertaken just before solving the task and the second straight after completing the task. This study involved 63 undergraduate students and observed a statistically significant difference (p = 0.007) in performance between the students who did (6.1/10) and did not (4.1/10) use TERISSA during tutorials leading up to an assessment task.  相似文献   

13.
The paper focuses on the question of how to advance collaboration through the Web and support lifelong learning. First, the theoretical framework and architecture of a new web‐based tool, the ‘IQ Team’, is introduced. IQ Team is an interactive online assessment and support system to learn social skills needed in cooperative work, and belongs in an interactive online assessing and tutoring system, ‘IQ Form’, developed for the Finnish Virtual University. IQ Team has three main elements: (1) interactive self‐evaluation test banks, (2) online tutoring sets and (3) learning diaries. In the creation of IQ Team, the validation process was conducted with two samples (n = 259 and n = 275). The online students’ social skills in different groups were explored, and the feedback data from different user groups were analysed. The online students scored high values for social skills, and no differences were discerned between university, Open University and technical students. The qualitative data (n = 35) were collected in order to get users’ feedback of the tool. The qualitative data consisted of interviews, open‐ended questions and online discussions. The users of IQ Team reflected that the tool benefited them to become aware of their group work skills and developed their collaborative learning skills. IQ Team provides a powerful tool for online instruction and communication in higher education and in the Open University to promote joint‐regulated learning.  相似文献   

14.
This study investigated transfer effects of gaze‐interactive attention training to more complex social and cognitive skills in infancy. Seventy 9‐month‐olds were assigned to a training group (n = 35) or an active control group (n = 35). Before, after, and at 6‐week follow‐up both groups completed an assessment battery assessing transfer to nontrained aspects of attention control, including table top tasks assessing social attention in seminaturalistic contexts. Transfer effects were found on nontrained screen‐based tasks but importantly also on a structured observation task assessing the infants’ likelihood to respond to an adult's social‐communication cues. The results causally link basic attention skills and more complex social‐communicative skills and provide a principle for studying causal mechanisms of early development.  相似文献   

15.
Undergraduate students, and their class teachers, assessed the performance of their peers in three oral and written tasks as part of a group project. The two sets of marks awarded by peers and teachers were subsequently compared to find out whether the students were competent to assess their peers alongside their class teachers and whether this competence, or lack of it, was partly determined by the nature of the task being assessed. A number of statistical tests were run to establish the levels of agreement, the ranges, differences and relationship between peer and teacher assessments. The results have led us to conclude that the peer assessments are not sufficiently reliable to be used to supplement teacher assessments. Students’ competencies in peer assessment do not appear to be dependent on the nature of the task being assessed, but there is some evidence that practical experience of assessing a particular task type can lead to an improvement in students’ assessment skills when they assess a similar task. The paper also discusses possible improvements in peer assessment procedures based on the experiences gained.  相似文献   

16.
This study addresses the development, dissemination, and assessment of a Food Safety System Management (FSSM) curriculum offered to college‐aged, agribusiness students in Yerevan, Armenia. Prior to beginning the program, demographic data were collected and a paper‐based pretest was administered to access the food safety knowledge, behavior, and attitude of participants (n = 29). For assessment of a skill, participants’ handwashing techniques were videotaped and scored before the program commenced. Immediately after completion of the entire curriculum, a paper‐based post‐test with identical questions for food safety knowledge, behavior, and attitude was administered and handwashing skills were assessed. ANOVA with repeated measures was used to evaluate significant differences (α = 0.05) for food safety knowledge using a pretest, post‐test, and a 3‐mo follow‐up. A paired t‐test was used to evaluate handwashing skills before and after the curriculum was presented. The pretest score (44.93%, ± 2.87) for food safety knowledge (n = 29) differed significantly (P <0.0001) when compared with the post‐test score (73.21%, ± 3.28) and the 3‐mo follow‐up (n = 23) score (67.76%, ± 3.93). Participants’ (n = 9) handwashing skills prior to delivery of the FSSM curriculum differed significantly (P <0.0001), when compared to handwashing skills after completion of the curriculum. Students’ food safety attitudes and behavior assessed using a five‐point Likert scale, also improved significantly as a result of the FSSM program. The 3‐mo follow‐up survey on food safety attitude and behavior was consistent with the post‐test survey results. The information from this project may be of interest to education experts, Extension professionals, food industry personnel, or regulatory agencies, in the development and dissemination of an international food safety program.  相似文献   

17.
Lack of clarity about assessment criteria and standards is a source of anxiety for many first-year university students. The Developing Understanding of Assessment for Learning (DUAL) programme was designed as a staged approach to gradually familiarise students with expectations, and to provide opportunities for the development of the skills required to successfully complete assessment tasks. This paper investigated the students’ perceptions of the first two components of the DUAL programme, which assist first-year biology students to engage with stated assessment criteria and standards in order to develop their capacity to make judgements about scientific report exemplars, their peers’ scientific reports and ultimately their own. The study found strong evidence (96% of responses) that the marking and discussion of exemplar reports with peers and demonstrators clarified expectations of scientific report writing. A key feature of this element of DUAL was the opportunity for structured discussion about assessment criteria and standards between peers and markers (demonstrators). During these discussions, students can clarify explicit statements and develop a tacit knowledge base to enhance their ability to judge the quality of others’ work and their own. The peer review exercise (the second element of DUAL) was not rated as highly, with 65% of students finding the process helpful for improving their report. The negative reactions by a sizeable minority of students highlight the need to clearly communicate the expectations and benefits of peer review, with a focus on how the process of giving feedback to peers might benefit a student as much as receiving feedback on their own report.  相似文献   

18.
In the current research, we report on a peer feedback system for supporting student teamwork skill development during post-secondary education. The peer feedback system is part of a larger suite of assessments at ITPmetrics.com. This is a free assessment-based system that allows team members to provide round-robin ratings of each member’s effectiveness in the team on five dimensions (communication; commitment; foundation of knowledge, skills and abilities; emphasising high standards; and focus), as well as provide anonymous written feedback to supplement the numeric scores. Team members have access to a dashboard where they can complete the assessment and store assessment reports generated from their peers’ ratings. We summarise data from student learning teams suggesting that peer ratings are reliable (internally consistent, unidimensional and inter-rater correlated; n?>?85,000). Recommendations for implementation are provided with respect to pre-briefing, debriefing, and assessment schedules.  相似文献   

19.
Studies have suggested that language and executive function (EF) are strongly associated. Indeed, the two are difficult to separate, and it is particularly difficult to determine whether one skill is more dependent on the other. Deafness provides a unique opportunity to disentangle these skills because in this case, language difficulties have a sensory not cognitive basis. In this study, deaf (n = 108) and hearing (n = 125) children (age 8 years) were assessed on language and a wide range of nonverbal EF tasks. Deaf children performed significantly less well on EF tasks, even controlling for nonverbal intelligence and speed of processing. Language mediated EF skill, but the reverse pattern was not evident. Findings suggest that language is key to EF performance rather than vice versa.  相似文献   

20.
Abstract

Effective communication of science is a ubiquitous learning outcome for most science degrees, and a national threshold learning outcome for science in Australia. Evidence suggests that employers and academics are dissatisfied with the communication skills of many science graduates. Our study examines communication tasks used in summative assessment in bachelor of science (BSc) degrees. We compiled public information for all units of study from the BSc programmes at five research-intensive Australian universities. Our analysis suggests that science academics place high value on developing the ability of students to communicate, with 66% of all science units (n?=?1225) using one or more communication tasks as assessment (mean weighting 44%). However, opportunities for students to communicate in a variety of contexts are lacking. We found that communication tasks from eight majors (n?=?683) across the five universities addressed a very narrow range of contexts; an audience of scientists (including students) in the same discipline (97%), in the mode of traditional writing (79%) and for the purpose of interpreting and presenting results (66%). As such, assessment practice does not match the variety of contexts required by the Australian threshold learning outcomes or guiding statements in other countries. We identify opportunities and offer practical recommendations to help correct this mismatch.  相似文献   

设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号