共查询到20条相似文献，搜索用时 46 毫秒
1.
Andrew Emerson Wookhee Min Roger Azevedo James Lester 《British journal of educational technology : journal of the Council for Educational Technology》2023,54(1):40-57
Game-based learning environments hold significant promise for facilitating learning experiences that are both effective and engaging. To support individualised learning and support proactive scaffolding when students are struggling, game-based learning environments should be able to accurately predict student knowledge at early points in students' gameplay. Student knowledge is traditionally assessed prior to and after each student interacts with the learning environment with conventional methods, such as multiple choice content knowledge assessments. While previous student modelling approaches have leveraged machine learning to automatically infer students' knowledge, there is limited work that incorporates the fine-grained content from each question in these types of tests into student models that predict student performance at early junctures in gameplay episodes. This work investigates a predictive student modelling approach that leverages the natural language text of the post-gameplay content knowledge questions and the text of the possible answer choices for early prediction of fine-grained individual student performance in game-based learning environments. With data from a study involving 66 undergraduate students from a large public university interacting with a game-based learning environment for microbiology, Crystal Island , we investigate the accuracy and early prediction capacity of student models that use a combination of gameplay features extracted from student log files as well as distributed representations of post-test content assessment questions. The results demonstrate that by incorporating knowledge about assessment questions, early prediction models are able to outperform competing baselines that only use student game trace data with no question-related information. Furthermore, this approach achieves high generalisation, including predicting the performance of students on unseen questions.
Practitioner notes
What is already known about this topic- A distinctive characteristic of game-based learning environments is their capacity to enable fine-grained student assessment.
- Adaptive game-based learning environments offer individualisation based on specific student needs and should be able to assess student competencies using early prediction models of those competencies.
- Word embedding approaches from the field of natural language processing show great promise in the ability to encode semantic information that can be leveraged by predictive student models.
- Investigates word embeddings of assessment question content for reliable early prediction of student performance.
- Demonstrates the efficacy of distributed word embeddings of assessment questions when used by early prediction models compared to models that use either no assessment information or discrete representations of the questions.
- Demonstrates the efficacy and generalisability of word embeddings of assessment questions for predicting the performance of both new students on existing questions and existing students on new questions.
- Word embeddings of assessment questions can enhance early prediction models of student knowledge, which can drive adaptive feedback to students who interact with game-based learning environments.
- Practitioners should determine if new assessment questions will be developed for their game-based learning environment, and if so, consider using our student modelling framework that incorporates early prediction models pretrained with existing student responses to previous assessment questions and is generalisable to the new assessment questions by leveraging distributed word embedding techniques.
- Researchers should consider the most appropriate way to encode the assessment questions in ways that early prediction models are able to infer relationships between the questions and gameplay behaviour to make accurate predictions of student competencies.
2.
Kyle Gray Katharine Owens Xin Liang David Steer 《Journal of Science Education and Technology》2012,21(3):392-402
To date, research to date on personal response systems (clickers) has focused on external issues pertaining to the implementation
of this technology or broadly measured student learning gains rather than investigating differences in the responses themselves.
Multimedia learning makes use of both words and pictures, and research from cognitive psychology suggests that using both
words and illustrations improves student learning. This study analyzed student response data from 561 students taking an introductory
earth science course to determine whether including an illustration in a clicker question resulted in a higher percentage
of correct responses than questions that did not include a corresponding illustration. Questions on topics pertaining to the
solid earth were categorized as illustrated questions if they contained a picture, or graph and text-only if the question only contained text. For each type of question, we calculated the percentage of correct responses for each
student and compared the results to student ACT-reading, math, and science scores. A within-groups, repeated measures analysis
of covariance with instructor as the covariate yielded no significant differences between the percentage of correct responses
to either the text-only or the illustrated questions. Similar non-significant differences were obtained when students were
grouped into quartiles according to their ACT-reading, -math, and -science scores. These results suggest that the way in which
a conceptest question is written does not affect student responses and supports the claim that conceptest questions are a
valid formative assessment tool. 相似文献
3.
Daniel B. Wright 《Educational Measurement》2019,38(4):87-98
There is much discussion about and many policies to address achievement gaps in education among groups of students. The focus here is on a different gap and it is argued that it also should be of concern. Speed gaps are differences in how quickly different groups of students answer the questions on academic assessments. To investigate some speed gaps, response times from approximately 75,000 untimed online assessments were compared by English language learning proficiency, student gender, and ethnicity. Also examined were the relationships between response time and accuracy for these groups. The differences observed lead to recommendations for assessment accommodations and teaching strategies for taking assessments. 相似文献
4.
Can two apparently totally different secondary school subjects join forces in an attempt to enrich the learning processes of both? The authors address this question by describing an experimental lesson in which student‐teachers verbalize their preconceptions concerning a natural object (mushrooms) while in the same lesson they do a personal response activity for a poem by Sylvia Plath entitled ‘Mushrooms’. The results indicate that student teachers of different disciplines find this to be a meaningful teaching approach. It proved to be a motivating way to evoke preconceptions about a natural phenomenon by means of a poem and resulted in an enhanced awareness of mushrooms, which culminated in questions on both their growth and reproduction. Moreover, their ‘literary’ interest in the poem and the writer appeared to be stimulated. Possible applications in teaching and teacher training are discussed. 相似文献
5.
Wieslaw L. Nowinski Arumugam Thirunavuukarasuu Anand Ananthasubramaniam Beng Choon Chua Guoyu Qian Natalia G. Nowinska Yevgen Marchenko Ihar Volkau 《Anatomical sciences education》2009,2(5):244-252
Preparation of tests and student's assessment by the instructor are time consuming. We address these two tasks in neuroanatomy education by employing a digital media application with a three‐dimensional (3D), interactive, fully segmented, and labeled brain atlas. The anatomical and vascular models in the atlas are linked to Terminologia Anatomica. Because the cerebral models are fully segmented and labeled, our approach enables automatic and random atlas‐derived generation of questions to test location and naming of cerebral structures. This is done in four steps: test individualization by the instructor, test taking by the students at their convenience, automatic student assessment by the application, and communication of the individual assessment to the instructor. A computer‐based application with an interactive 3D atlas and a preliminary mobile‐based application were developed to realize this approach. The application works in two test modes: instructor and student. In the instructor mode, the instructor customizes the test by setting the scope of testing and student performance criteria, which takes a few seconds. In the student mode, the student is tested and automatically assessed. Self‐testing is also feasible at any time and pace. Our approach is automatic both with respect to test generation and student assessment. It is also objective, rapid, and customizable. We believe that this approach is novel from computer‐based, mobile‐based, and atlas‐assisted standpoints. Anat Sci Educ 2:244–252, 2009. © 2009 American Association of Anatomists. 相似文献
6.
Response accuracy and response time data can be analyzed with a joint model to measure ability and speed of working, while accounting for relationships between item and person characteristics. In this study, person‐fit statistics are proposed for joint models to detect aberrant response accuracy and/or response time patterns. The person‐fit tests take the correlation between ability and speed into account, as well as the correlation between item characteristics. They are posited as Bayesian significance tests, which have the advantage that the extremeness of a test statistic value is quantified by a posterior probability. The person‐fit tests can be computed as by‐products of a Markov chain Monte Carlo algorithm. Simulation studies were conducted in order to evaluate their performance. For all person‐fit tests, the simulation studies showed good detection rates in identifying aberrant patterns. A real data example is given to illustrate the person‐fit statistics for the evaluation of the joint model. 相似文献
7.
高职院校学生管理工作面临的挑战与对策 总被引：2，自引：0，他引：2
刁益韶 《泰州职业技术学院学报》2010,10(4):63-65
随着我国高等教育的跨越式发展,高职院校学生管理工作面临新的挑战,迫切需要以人为本,与时俱进,优化教育管理机制,加强学生教育管理队伍建设,优化育人环境,切实提高教育管理质量,以促进高职院校的健康良性发展。 相似文献
8.
Mark K. Singley 《Interactive Learning Environments》2013,21(2):102-123
In an initial experiment with a minimal version of a calculus tutor, it was determined through analyses of verbal protocol data that students were attempting to execute a fairly standard working‐backwards, means‐ends strategy to solve systems of equations, but were having difficulty maintaining the requisite goal stack. To remedy this problem, an enhancement to the interface of the tutor was designed which allowed students to post and display the subgoals required by the means‐ends strategy. As students progressed through problems, individual subgoals were boxed and shaded to indicate which subgoals were active and which had been satisfied, respectively. An experiment testing the effects of this type of goal posting showed that student problem‐solving performance improved in terms of both speed and accuracy while the goal blackboard was present. Furthermore, many of the positive effects persisted after the goal blackboard was taken away. Two explanations for the beneficial effects of goal posting are offered. The first is that the display served as external memory which maintained goal structures that would have otherwise been lost in the shuffle of problem solving. The second, perhaps more compelling explanation is that, in the process of posting goals, subjects learned something about the underlying structure of problems. 相似文献
9.
This article presents the original model of the computer adaptive testing and grade formation, based on scientifically recognized theories. The base of the model is a personalized algorithm for selection of questions depending on the accuracy of the answer to the previous question. The test is divided into three basic levels of difficulty, and the student automatically goes from one level to another according to the current level of the knowledge that he shows. Such examination creates an image to the student that the test was set up just for his level of knowledge. On the basis of responses, by applying Bayes’ theorem and the Maximum a posteriori approach, the evaluation grade is formed. In fact, based on empirical probability values, which correlate with obtaining of a certain final grade and the accuracy of answers to each question individually, model creates a score that corresponds to the current level of student’s knowledge. After each test answer, the empirical probability value is updated. That further contributes to the statistical stability of the evaluation model. Testing stops when the student answers the minimum number of questions, determined by a teacher, or, when evaluations show a clear convergence towards a single value. The research method and some results of the testing of the hypotheses as well as authors’ conclusions about CAT as a tool for evaluation of students are presented at the end of the article. 相似文献
10.
周中兴 《乌鲁木齐职业大学学报》2010,19(1):66-70
文章经过对普通话水平测试第一、二题反应效度的调查,归纳出了两题中各自存在的目标无关性错误的类型,通过统计,证实了第一题反应效度偏低,而第二题反应效度比较理想。在分析第一题目标无关性错误产生原因的基础上,提出了新的测试模式：第一题语音测试模式=（词语语境：语言的自然储存和使用单位—词语）读其中的单音节字词。 相似文献
11.
Mark G. Simkin William L. Kuechler 《Decision Sciences Journal of Innovative Education》2005,3(1):73-98
Instructors can use both “multiple‐choice” (MC) and “constructed response” (CR) questions (such as short answer, essay, or problem‐solving questions) to evaluate student understanding of course materials and principles. This article begins by discussing the advantages and concerns of using these alternate test formats and reviews the studies conducted to test the hypothesis (or perhaps better described as the hope) that MC tests, by themselves, perform an adequate job of evaluating student understanding of course materials. Despite research from educational psychology demonstrating the potential for MC tests to measure the same levels of student mastery as CR tests, recent studies in specific educational domains find imperfect relationships between these two performance measures. We suggest that a significant confound in prior experiments has been the treatment of MC questions as homogeneous entities when in fact MC questions may test widely varying levels of student understanding. The primary contribution of the article is a modified research model for CR/MC research based on knowledge‐level analyses of MC test banks and CR question sets from basic computer language programming. The analyses are based on an operationalization of Bloom's Taxonomy of Learning Goals for the domain, which is used to develop a skills‐focused taxonomy of MC questions. However, we propose that their analyses readily generalize to similar teaching domains of interest to decision sciences educators such as modeling and simulation programming. 相似文献
12.
Kathryn E. Perez Eric A. Strauss Nicholas Downey Anne Galbraith Robert Jeanne Scott Cooper 《CBE life sciences education》2010,9(2):133-140
The use of personal response systems, or clickers, is increasingly common in college classrooms. Although clickers can increase student engagement and discussion, their benefits also can be overstated. A common practice is to ask the class a question, display the responses, allow the students to discuss the question, and then collect the responses a second time. In an introductory biology course, we asked whether showing students the class responses to a question biased their second response. Some sections of the course displayed a bar graph of the student responses and others served as a control group in which discussion occurred without seeing the most common answer chosen by the class. If students saw the bar graph, they were 30% more likely to switch from a less common to the most common response. This trend was more pronounced in true/false questions (38%) than multiple-choice questions (28%). These results suggest that observing the most common response can bias a student''s second vote on a question and may be misinterpreted as an increase in performance due to student discussion alone. 相似文献
13.
Duration of response to teacher questions and statements 总被引：1，自引：0，他引：1
J.T. Dillon 《Contemporary educational psychology》1981,6(1):1-11
To examine the effectiveness of teacher questions in stimulating student participation, 26 high school discussion classes were tape-recorded and the duration of utterances timed by stopwatch. Analyses of variance performed on class mean duration of student response revealed three findings. (1) No significant difference was observed between response to questions and response to declarative statements. (2) By question type, opinion questions received significantly longer responses than factual ones, and closed longer than open; no differences were observed for six other ways of classifying questions. (3) Response to questions appeared unrelated to selected characteristics of classroom, teacher, and student. The findings offer little support to current emphases in theory and practice on the use of questions in discussion classes. The study may be situated within a body of recent research that has failed to validate traditional claims for the efficacy of teacher questions. 相似文献
14.
Richard F. Bowman 《Clearing house (Menasha, Wis.)》2013,86(4-5):174-179
Engaged questioning and focused listening are requisite tools in developing and enhancing students’ thinking skills. For educators, the ability to ask the right question at the right time is an essential instructional skill. Thought-provoking questions trigger an array of responses which reveal who learners are experientially, where learners are going instructionally, and how educators and students connect relationally. When insightful questions go unasked or unanswered, individual and collective learning is constrained for teachers and students alike. 相似文献
15.
The question of whether marking speed is related to marking accuracy is important for training examiners and planning realistic marking schedules. We explored marking speed in the context of a past examination for an international biology qualification for 14‐ to 16‐year‐olds. Forty‐two markers with differing backgrounds experimentally marked 23 diverse examination questions. All responded to questionnaires about times taken to mark two of four samples of candidate responses. We demonstrated a positive practice effect for inexperienced markers, who became significantly faster during the course of their marking whilst maintaining their accuracies; there was no clear trade‐off between speed and accuracy. The benefits of marking practice and background experience are distinct phenomena. To improve accuracy, longer term investments in education and experience are needed. 相似文献
16.
Learning to program is known to be difficult for novices. High attrition and high failure rates in foundation-level programming courses undertaken at tertiary level in Computer Science programs, are commonly reported. A common approach to evaluating novice programming ability is through a combination of formative and summative assessments, with the latter typically represented by a final examination. Preparation of such assessment is driven by instructor perceptions of student learning of programming concepts. This in turn may yield instructor perspectives of summative assessment that do not necessarily correlate with student expectations or abilities. In this article, we present results of our study around instructor perspectives of summative assessment for novice programmers. Both quantitative and qualitative data have been obtained via survey responses from programming instructors with varying teaching experience, and from novice student responses to targeted examination questions. Our findings highlight that most of the instructors believed that summative assessment is, and is meant to be, a valid measure of a student's ability to program. Most instructors further believed that Multiple-choice Questions (MCQs) provide a means of testing a low level of understanding, and a few added qualitative comments to suggest that MCQs are easy questions, and others refused to use them at all. There was no agreement around the proposition that if a question was designed to test a low level of skill, or a low level in a hierarchy of a body of knowledge, that such a question should or would be found to be easy by the student. To aid our analysis of assessment questions, we introduced four measures: Syntax Knowledge; Semantic Knowledge; Problem Solving Skill and the Level of Difficulty of the Problem. We applied these measures to selected examination questions, and have identified gaps between the instructor perspectives of what is considered to be an easy question and also in what is required to be assessed to determine whether students have achieved the goals of their course. 相似文献
17.
Christine Sälzer Ulrich Trautwein Oliver Lüdtke Margrit Stamm 《Learning and Instruction》2012,22(5):311-319
Little is known about the association of classroom characteristics with adolescent truancy. A critical question is whether high achievement standards, high workload, and fast pace protect against or increase adolescent truancy. In this study, self-reports from 3491 Swiss grade 7, grade 8 and grade 9 students in 202 classes were used to predict truancy. Multilevel modeling was used to differentiate between the student and the class levels. High achievement standards were associated with a lower truancy rate at both the student and the class level, whereas fast instructional pace was associated with more truancy at both levels. A perception of the workload as being too low was an additional predictor of high truancy at both the student and the class level. 相似文献
18.
Margareta Enghag Hans Niedderer 《International Journal of Science and Mathematics Education》2008,6(4):629-653
The theoretical framework student ownership of learning is developed both theoretically and with qualitative research. The metaphor “ownership” is related to the process towards
meaning making and understanding and is seen as relevant especially to improve physics instruction. The dimension group ownership of learning refers to the groups’ actions of choice and control of the management of the task; how the task is determined, performed
and finally reported. The other dimension, the individual student ownership of learning, refers to an individual student’s own question/idea that comes from own experiences, interests or anomalies of understanding;
an idea/question that comes back several times and leads to new insights. From literature and from our own data, we have developed
categories for group and individual student ownership of learning, which were iteratively sharpened in order to identify ownership
in the two dimensions. As a consequence, we argue for use of the framework student ownership of learning as a way to identify
an optimal level of ownership for better learning and higher motivation in physics teaching. 相似文献
19.
Amanda C. Miller Sun‐Joo Cho Jessica R. Toste James Street Laurie E. Cutting 《Learning disabilities research & practice》2014,29(1):25-35
Reading comprehension is influenced by sources of variance associated with the reader and the task. To gain insight into the complex interplay of multiple sources of influence, we employed crossed random‐effects item response models. These models allowed us to simultaneously examine the degree to which variables related to the type of passage and student characteristics influenced students’ (n = 94; mean age = 11.97 years) performance on two indicators of reading comprehension: different types of comprehension questions and passage fluency. We found that variables related to word recognition, language, and executive function were influential across various types of passages and comprehension questions and also predicted a reader's passage fluency. Further, an exploratory analysis of two‐way interaction effects was conducted. Results suggest that understanding the relative influence of passage, question, and student variables has implications for identifying struggling readers and designing interventions to address their individual needs. 相似文献
20.
Learning from and responding to students' questions: The authoritative and dialogic tension 总被引：1，自引：1，他引：0
In this study we present an analysis of classroom interactions initiated by students' wonderment questions. Our interest in such events arises from their potential to stimulate active intellectual engagement in classrooms, which can impact upon the subsequent development of the classroom discourse. In investigating this issue we shall address the following research question: How do student questions impact upon the teaching explanatory structure and modify the form of the ongoing classroom discourse, in selected science lessons? From data collected in a Brazilian secondary school we have selected three classroom episodes, with large differences in both the context in which the student's question emerges and in the communicative approach developed in response to it. The analysis, based on the framework proposed by Mortimer and Scott [Mortimer and Scott (2003). Meaning making in secondary science classrooms. Maidenhead: Open University Press], shows that questions made by students are important in providing feedback from students to the teacher, enabling adjustments to the teaching explanatory structure. These adjustments sometimes occur smoothly, at other times with major changes to the features of the classroom discourse, and elsewhere with misunderstanding and disagreement. The data also suggest the need to consider students' intentions and their active participation in the negotiation of both the content and structure of classroom discourse. © 2009 Wiley Periodicals, Inc. J Res Sci Teach 47:174–193, 2010 相似文献