共查询到20条相似文献，搜索用时 49 毫秒
1.
Contemporary educational accountability systems, including state‐level systems prescribed under No Child Left Behind as well as those envisioned under the “Race to the Top” comprehensive assessment competition, rely on school‐level summaries of student test scores. The precision of these score summaries is almost always evaluated using models that ignore the classroom‐level clustering of students within schools. This paper reports balanced and unbalanced generalizability analyses investigating the consequences of ignoring variation at the level of classrooms within schools when analyzing the reliability of such school‐level accountability measures. Results show that the reliability of school means cannot be determined accurately when classroom‐level effects are ignored. Failure to take between‐classroom variance into account biases generalizability (G) coefficient estimates downward and standard errors (SEs) upward if classroom‐level effects are regarded as fixed, and biases G‐coefficient estimates upward and SEs downward if they are regarded as random. These biases become more severe as the difference between the school‐level intraclass correlation (ICC) and the class‐level ICC increases. School‐accountability systems should be designed so that classroom (or teacher) level variation can be taken into consideration when quantifying the precision of school rankings, and statistical models for school mean score reliability should incorporate this information. 相似文献
2.
《International Journal of Educational Research》1994,21(3):267-278
This study illustrates how generalizability theory can be used to evaluate the dependability of school-level scores in situations where test forms have been matrix sampled within schools, and to estimate the minimum number of forms required to achieve acceptable levels of score reliability. Data from a statewide performance assessment in reading, writing, and language usage were analyzed in a series of generalizability studies using a person: (school x form) design that provided variance component estimates for four sources: school, form, school x form, and person: (school x form). Six separate scores were examined. The results of the generalizability studies were then used in decision studies to determine the impact on score reliability when the number of forms administered within schools was varied. Results from the decision studies indicated that score generalizability could be improved when the number of forms administered within schools was increased from one to three forms, but that gains in generalizability were small when the number of forms was increased beyond three. The implications of these results for planning large-scale performance assessments are discussed. 相似文献
3.
Vanithamani Saravanan 《Educational Research for Policy and Practice》2005,4(2-3):97-113
‘Thinking schools’ will be sites of learning for everyone declared the Singapore Prime Minister, Goh Chok and Minister of
Education Teo Chee Hean’s in 1997 also spoke on the model of’ ‘thinking schools, learning nation’. Gardner’s model was used
for the thinking school model in Singapore, in order to develop critical and creative thinking in students. This was to be
done with the use of instructional technology as an enabling tool using a diversity of approaches including integrated project
work. This paper reports on how one school went about changing approaches to teaching and learning by implementing integrated
project work as a way of integrating the content areas of the curriculum, mathematics and science through English language,
supported by the tools of instructional technology. 相似文献
4.
Emphasis on improving higher level biology education continues. A new two-step approach to the experimental phases within
an outreach gene technology lab, derived from cognitive load theory, is presented. We compared our approach using a quasi-experimental
design with the conventional one-step mode. The difference consisted of additional focused discussions combined with students
writing down their ideas (step one) prior to starting any experimental procedure (step two). We monitored students’ activities
during the experimental phases by continuously videotaping 20 work groups within each approach (N = 131). Subsequent classification of students’ activities yielded 10 categories (with well-fitting intra- and inter-observer
scores with respect to reliability). Based on the students’ individual time budgets, we evaluated students’ roles during experimentation
from their prevalent activities (by independently using two cluster analysis methods). Independently of the approach, two
common clusters emerged, which we labeled as ‘all-rounders’ and as ‘passive students’, and two clusters specific to each approach:
‘observers’ as well as ‘high-experimenters’ were identified only within the one-step approach whereas under the two-step conditions
‘managers’ and ‘scribes’ were identified. Potential changes in group-leadership style during experimentation are discussed,
and conclusions for optimizing science teaching are drawn. 相似文献
5.
MS Ruth Coulson 《Research in Science Education》1992,22(1):101-105
The attitude towards science of first year early childhood education students was explored using an instrument developed for
the purpose. The instrument comprises four Likert-type scales, biographical items and two open-ended attitude items. The four
scales, characterised as ‘confidence’, ‘enjoyment’, ‘usefulness’ and ‘appropriateness of science for young children’, were
supported by varimax factor analysis and had reliabilities from 0.83 to 0.88. Use of the combined scales as a general ‘attitude
towards science’ scale was supported by principal components analysis; reliability for the combined scale was 0.94. Comments
made in response to the open-ended items supported the validity of the scales. For the student group as a whole, mean scores
on all scales were slightly to moderately positive, with the highest mean being for the ‘science for young children’ scale.
Students who had studied at least one science subject at Year 12 level had significantly higher scores on all scales than
students who had not studied science at senior level.
Australia.Specializations: early childhood science education, biological aspects of child development, conservation biology of gulls. 相似文献
6.
H. Hultin K. Eichas L. Ferrer-Wreder R. Dimitrova M. Karlberg M.R. Galanti 《Scandinavian Journal of Educational Research》2019,63(4):534-550
Previous studies indicate that school climate is important for student health and academic achievement. This study concerns the validity and reliability of the student edition a Swedish instrument for measuring pedagogical and social school climate (PESOC). Data were collected from 5,745 students at 97 Swedish secondary schools. Multilevel confirmatory factor analyses were conducted, and multilevel composite reliability estimates, as well as correlations with school-level achievement indicators, were calculated. The results supported an 8-factor structure at the student level and 1 general factor at the school level. Factor loadings and composite reliability estimates were acceptable at both levels. The school-level factor was moderately and positively correlated with school-level academic achievement. The student PESOC is a promising instrument for studying school climate. 相似文献
7.
The purpose of this study is to identify school factors that affect students’ achievements at the secondary and tertiary levels
of education. The analysis included data of 9,894 students who studied in Auckland regional secondary schools in 2004. The
results indicate that, although student demographic characteristics are associated with students’ pathways and achievements,
schools’ demographic composition did not affect student outcomes. It was found, however, that schools’ organisational factors
do have an effect. At the university level, none of the schools’ characteristics was related to students’ achievements at
the higher end of the achievement scale (GPA ≥ 4). However, students from private or state-integrated schools were found to
be more likely to achieve low GPA (<2) than students who came from state schools. In conclusion, it is suggested that interventions
targeting at-risk populations based on demographic factors should focus on individuals or groups rather than on institutions;
while school-based interventions should identify the schools by their structure and function rather than by their demographic
characteristics.
相似文献
| Boaz ShulrufEmail: Email: |
8.
Perry den Brok Sibel Telli Jale Cakiroglu Ruurd Taconis Ceren Tekkaya 《Learning Environments Research》2010,13(3):187-204
The purposes of this study were to examine how Turkish students perceived their biology classroom environment, how their perceptions
compared to those of students in other countries, and what classroom learning environment profiles could be discerned in Turkish
high school biology classrooms. Data were gathered from 1,474 high school students in four inner city schools, in Bursa, Turkey.
A total of 11 biology teachers participated in the study with 52 of their classes. Data on students’ perceptions of their
learning environment were collected with the What Is Happening In this Class? (WIHIC) questionnaire. Results indicated that
Turkish classrooms were perceived as being low in terms of Teacher Support and high in terms of Task Orientation. Six distinct
classroom learning environment profiles were found: the ‘self-directed learning classroom’, ‘task-oriented cooperative learning
classroom’, ‘mainstream classroom’, ‘task-oriented individualised classroom’, ‘low-effective learning classroom’ and ‘high-effective
learning classroom’. The most common profile was the ‘mainstream classroom’ for which all WIHIC scales had medium–high scores. 相似文献
9.
《教育实用测度》2013,26(4):323-342
This study provides empirical evidence about the sampling variability and generalizability (reliability) of a statewide science performance assessment. Results at both individual and school levels indicate that task-sampling variability was the major source of measurement error in the performance assessment; rater-sampling variability was negligible. Adding more tasks improves the generalizability of the measurement. For the school-level assessment, the variation of performance among students within a school was larger than the variation among schools. Increasing the number of students taking a test within a school thus increases the generalizability of the assessment. Finally, the allocation of students in a matrix-sampling design is compared to a studentscrossed-with-tasks design. The former would require fewer tasks per student than the latter to build a generalizable measure of school performance. 相似文献
10.
Guemin Lee 《Journal of Educational Measurement》2002,39(2):149-164
The purpose of this study was to investigate the effects of items, passages, contents, themes, and types of passages on the reliability and standard errors of measurement for complex reading comprehension tests. Seven different generalizability theory models were used in the analyses. Results indicated that generalizability coefficients estimated using multivariate models incorporating content strata and types of passages were similar in size to reliability estimates based upon a model that did not include these factors. In contrast, incorporating passages and themes within univariate generalizability theory models produced non-negligible differences in the reliability estimates. This suggested that passages and themes be taken into account when evaluating the reliability of test scores for complex reading comprehension tests. 相似文献
11.
12.
Vasilios Grammatikopoulos Nikolaos Tsigilis Athanasios Koustelios Yannis Theodorakis 《International Review of Education/Internationale Zeitschrift für Erziehungswissenschaft/Revue internationale l'éducation》2005,40(5):427-438
The aim of this study was to develop an instrument for evaluating how an education program has been implemented. Such evaluation
can provide insight into the effectiveness of a program. Examined here was the Olympic Education Program used in Greek schools
since 2000. In it, students learn the history of the Olympic games and the importance of exercise for health along with the
principles and values of sports and volunteerism. The evaluation instrument underlying this study addressed the following
six factors: ‘facilities’, ‘administration’, ‘educational material’, ‘student–teacher relationships’, ‘educational procedures’,
and ‘training’. Results indicate that the instrument, while adequate for assessing effectiveness, should be combined with
advanced statistical methods. 相似文献
13.
The present study examines teachers’ perceptions of organizational changes in their elementary schools. These changes occurred
following the implementation of a long-term comprehensive school improvement project (CSIP). One hundred and seventy one teachers
who taught in six elementary schools located in two different school districts in Israel responded to a questionnaire both
before and after a period of 3 years during which they participated in a CSIP. The teachers, assisted by six professional
consultants, one in each school, studied cooperative learning as well as new forms of collaborative staff work. The study
addressed two primary research questions: What changes in teachers’ perceptions of their schools’ organizational culture emerged
from teachers’ participation in the project? How were the professional relationships between the schools’ supervisors and
the teachers in the two districts reflected in the teachers’ perception of school organizational changes? Results indicated
that teachers in three schools from one district recorded a significant improvement in their perceptions of their schools’
organizational culture at the end of the project, whereas the teachers from the other district indicated either no change,
or a significant decline in their evaluation of their schools’ organizational culture. A cross-validation of the teachers’
data was performed through a content analysis of 500 reports written over the course of 2 years, submitted by six external
consultants. The analysis yielded four categories: general difficulties to work with the school’s staff, problems implementing
the project, teacher resistance, and cancellations of planned meetings. The analysis provided valuable information as to why
the teachers from the two districts differed in their reactions to the project. 相似文献
14.
Previous studies in higher education have shown that the reliability of student ratings of teaching skill increases if multiple ratings by different students are aggregated. This study examines the generalizability of these findings to the context of secondary education. Also, it seeks to validate these findings by comparing reliability levels estimated by the routinely used nested design with those estimated using a more complex design. The sample consisted of 410 students from 17 classes rating 63 teachers working at eight schools across the Netherlands. Using the nested design, the study replicates findings of previous studies in higher education. The findings illustrate how the reliability level of secondary school students’ ratings increases with an increasing number of students. However, these replicated reliability levels were not validated by the more complex design which provided lower estimates. This indicates that the nested design may not provide accurate estimations of rating reliability. 相似文献
15.
Iryna Johnson 《Research in higher education》2008,49(8):776-793
Educational research has shown that individual-level background characteristics, such as parental socio-economic status and
academic ability, influence college going behavior. This study tests for the existence of aggregate-level high school effects
on college enrollment, persistence and degree attainment. It links institutional data on students enrolling within a year
after graduation from in-state high schools with state data on high schools’ performance and populations. Three high school
aggregate-level factors were found to affect enrollment and persistence. Specifically, the high schools’ percent of SAT takers
has a concave-shape effect on enrollment, retention and graduation. Additionally, students coming from schools with a higher
percent of those receiving free lunch are less likely to persist, and students coming from schools located within a 60 mile
radius are more likely to matriculate and to persist to the second year. These results suggest that aggregate-level high school
characteristics should be accounted for in enrollment management.
相似文献
| Iryna JohnsonEmail: |
16.
Chit-Kwong Kong 《Learning Environments Research》2008,11(2):111-129
It is generally believed that classroom learning experiences very much influence students’ academic development. However,
relatively little is known about whether classroom learning experiences have much effect on students’ affective and social
development. In this study, we argued for the importance of learning experiences on students’ affective and social development.
From research on Accelerated Schools Project and active learning, we conceptualised Positive Learning Experiences, Teacher
Support in Learning, and Active Learning Experiences as three components of learning experiences and developed relevant measures
to tap these learning experiences. Using research data from a large-scale student survey in Hong Kong (N = 19,477), we examined the construct validity of learning experiences and quality of school life. Confirmatory factor analysis
provided very strong support for the measures and the underlying constructs that they tap. In two-way analysis of variance,
the effects of gender and school level (secondary versus primary) on learning experiences and quality of school life were
examined. Significant gender and school-level main effects, as well as gender by school-level interaction effects, were found
for students’ ratings of their learning experiences and quality of school life. Female students gave more favourable ratings
than male students, and primary students gave more favourable ratings than secondary students. In addition, gender differences
in these ratings in secondary schools were relatively smaller than in primary schools. In subsequent multilevel modelling,
learning experiences were strong predictors of quality of school life after controlling for the effects of gender, school
level and average school achievement. These findings provide strong empirical support for the significance of classroom learning
experiences for students’ social and affective development.
相似文献
| Chit-Kwong KongEmail: |
17.
Selection of students for places at universities mainly depends on GCSE grades and predictions of A-level grades, both of
which tend to favour applicants from independent schools. We have therefore developed a new type of test that would measure
candidates’ ‘deep learning’ approach since this assesses the motivation and creative thinking that we look for in university
students. We recruited 526 applicants to Oxford University and gave them a short commentary test and a learning style questionnaire.
Specific deep learning approach questions correlated with results in the new test, and both predicted whether the candidate
subsequently obtained a place at Oxford. Furthermore high scores on one open-ended commentary question, demanding arguments
in favour of a case, produced a greater than 70% chance of obtaining a first class degree at the end of their course irrespective
of the candidates’ type of school attended or GCSE scores. Candidates from State schools scored as well as those from Independent
schools in both tests. Thus our test seemed to index candidates’ potential to succeed at a highly selective university, and
might usefully be added to current selection procedures for such universities. 相似文献
18.
This article is a response to ‘Mapping educational research and its impact on Australian schools’, Chapter 2 of The Impact
of Educational Research, in which researchers Allyson Holbrook, John Ainley, Sid Bourke, John Owen, Philip McKenzie, Sebastian
Mission and Trevor Johnson report on their Commonwealth Education Department commissioned study. They mined the Australian
Education Index and the Bibliography of Education Theses in Australia for patterns in education research in Australia over
the years 1984–1997 and compared the results with additional data obtained from university education faculties, postgraduate
students of education, school principals, system-level administrators and professional associations. 相似文献
19.
The purpose of this study is to demonstrate that performance assessment increases educational value in teachinglearning activities
using a quasi-experimental research design. In this research, the three measurement criteria of educational value are suggested
as ‘improvement & advancement,’ ‘sincerity & enthusiasm,’ and ‘individuality & wholeness.’ A pre-test was administered to
4 classes (156 students) in 7th grade. Classes were divided into an experimental group (2 classes, 79 students) and a control
group (2 classes, 77 students), according to the pre-test results. Only the experimental group was involved in the performance
assessment for 9 weeks. The results of this study show that performance assessment has a positive effect on the educational
value of teaching-learning activities in schools. 相似文献
20.
Roger J. Osborne 《Research in Science Education》1977,7(1):157-164
Conclusions It is clear that in this particular educational system teachers' and lecturers' subjective assessments of each student on
the cirteria given, were based primarily on two subjective impressions of the student; the students ‘academic ability’ and
his, or her “motivation for academic work”. A major proportion of the variance on the physics subjective scales could be explained
in terms of these two factors. However the factor scores did little to increase the prediction of success in University physics
examinations over and above prediction based on school physics examination results. There was some indication that subjective
assessments may have a potential use in predicting non-examination ‘attributes’ of importance, for example drop-outs and future
career intentions. Undoubtedly much greater reliability and validity of student scores related to objectives needs to be obtained
both via examinations and subjective assessments if future studies are to yield really useful student profiles. 相似文献