Hands-on, Practical Guidance for Educators
From math,
literacy, equity, multilingual learners, and SEL, to assessment, school counseling,
and education leadership, our books are research-based and authored by experts
on topics most relevant to what educators are facing today.
Evaluating America’s Teachers
Poor evaluation systems don’t just hurt teachers—they hurt students, too. Popham provides a clear rationale and strategies for implementing a balanced, accurate, and rigorous teacher evaluation model.
- Grade Level: PreK-12
- ISBN: 9781452260853
- Published By: Corwin
- Year: 2013
- Page Count: 200
- Publication date: May 17, 2013
Review Copies
Description
When teacher evaluations are fair, everyone wins.
Poor evaluation systems don’t just hurt teachers—they hurt students, too. That’s why America can’t afford to wait for the teacher-evaluation problem to be solved. To provide balanced, accurate, and rigorous evaluations that take into account each teacher’s particular circumstances, only one system can work: evidence-governed collegial judgment.
As states and schools scramble to find workable responses to accountability mandates, well-informed educators can make key contributions. Start here with
- A discussion of common evaluation systems, including testing, value-added models, and observations
- Analysis of federal guidelines and state responses
- Action steps teachers and school leaders can take to influence policy
- A clear rationale and strategies for implementing a teacher evaluation model based on human judgment
Evaluating America’s Teachers demonstrates that the vision is possible: effective teacher evaluations that benefit schools as a whole.
“Teachers, administrators, and policy makers rejoice! Here is a single book, from a nationally recognized scholar, that makes sense of the issues involved with the evaluation of teachers.”
—David C. Berliner, Regents’ Professor Emeritus
Arizona State University
“Once again Jim Popham has brought insight and clarity to a complex topic that only a person of his stature and expertise could provide.”
—Robert J. Marzano, CEO
Marzano Research Laboratory
“In an effective and diplomatic manner, Jim suggests concrete ways policymakers, along with local school leaders and teachers, can make sure our students are protected from summative teacher-evaluation systems that do more harm than good. No one should make policy at any level or strive to build a defensible teacher evaluation system without studying this book.”
—Rick Stiggins, Retired Executive Director
Assessment Training Institute
Key features
- Clear and specific discussion of the strengths and weaknesses of common evaluation systems such as testing, value added models, and observations.
- Cases and examples drawn from the author's experience
- Clear and engaging writing style
Author(s)
W. James Popham
Most of Dr. Popham's teaching career took place at UCLA where, for nearly 30 years, he taught courses in instructional methods for prospective teachers as well as courses in evaluation and measurement for graduate students. At UCLA he won several distinguished teaching awards. In January 2000, he was recognized by UCLA Today as one of UCLA’s top 20 professors of the 20th century. (He notes that the 20th century was a full-length century, unlike the current abbreviated one.) In 1992, he took early retirement from UCLA upon learning that emeritus professors received free parking.
Because at UCLA he was acutely aware of the perishability of professors who failed to publish, he spent his non-teaching hours affixing words to paper. The result: 30 books, 200 journal articles, 50 research reports, and 175 papers presented before research societies. Although not noted in his official vita, while at UCLA he also authored 1,426 grocery lists.
His most recent books are Classroom Assessment: What Teachers Need to Know, 6th Ed. (2010) and Assessment for Educational Leaders (2006), Allyn & Bacon; The Truth About Testing (2001), Test Better, Teach Better (2003), Transformative Assessment (2008) and Instruction that Measures Up (2009) ASCD; America’s “Failing” Schools (2005) and Mastering Assessment (2006), Routledge; and Unlearned Lessons (2009) Harvard Education Press. He encourages purchase of these books because he regards their semi-annual royalties as psychologically reassuring.
In 1978, Dr. Popham was elected to the presidency of the American Educational Research Association (AERA). He was also the founding editor of Educational Evaluation and Policy Analysis, a quarterly journal published by AERA. A Fellow of the Association, he has attended each year's AERA meeting since his first in 1958. He is inordinately compulsive.
In 1968, Dr. Popham established IOX Assessment Associates, an R&D group that formerly created statewide student achievement tests for a dozen states. He has personally passed all of those tests, largely because of his unlimited access to the tests’ answer keys.
In 2002 the National Council on Measurement in Education presented him with its Award for Career Contributions to Educational Measurement. In 2006 he was awarded a Certificate of Recognition by the National Association of Test Directors. In 2009, he was appointed to be a board member of the National Assessment Governing Board. Dr. Popham’s complete 44-page, single-spaced vita can be requested. It is really dull reading.
School Leadership Briefing Interview
Table of Contents
Preface
Acknowledgments
1. What Underlies the Tightening of Today's Teacher-Evaluation Programs?
What Uncle Sam Wants
A Federal Vision of Teacher Evaluation
What Could Go Wrong?
Chapter Implications for Three Audiences
2. Human Judgment: Needed or Not?
Human Judgment's Role
Evaluation Basics
What about the Evaluation of Teachers?
Judgment-Requisite Choices
Chapter Implications for Three Audiences
3. Defensible Teacher Evaluation
The Wonders of Whereas
Why Use a Weighted-Evidence Judgmental Approach to Teacher Evaluation?
A Weighted-Evidence Judgment Evaluative Survey
Who Are the Judges?
Chapter Implications for Three Audiences
4. Evidence from Standardized Tests
Key Testing Tenets
Why We Test
A Psychometric Blessed Trinity
Standardized Test- Two Tribes, Two Tasks
Traditional Test-Building and Its Off-Task Allure
The Origins of Traditional Educational Testing
Dealing with Effective Instruction
Ensuring Score-Spread from the Get-Go
Instructional Sensitivity as a Requisite
Returning to Validity
Evidential-Weight Guidelines
Chapter Implications for Three Audiences
5. Evidence from Classroom Assessments
Staking Out the Nature of "Classroom Assessment"
A Quest for Evidence of Student Growth
Formative and Summative Applications
Enhancing the Quality of Classroom-Assessment Evidence
Evidence of a Teacher's Instructional Ability
What's Assessed
The Traditional Psychometric Triplets
Following Test Development, Improvement, and Scoring Rules
Have Teachers Played it Straight?
Evidential-Weight Guidelines
Chapter Implications for Three Audiences
6. Evidence from Classroom Observations
What's Distinctive about Classroom Observations?
Observations Versus Ratings
Playing the Odds: Observation of Instructional Means
An Observational Reality: The Mysterious Middle Group
Getting the Most Evaluative Mileage Out of Classroom Observation Evidence
Two Widely-Used Observation Procedures
Danielson's Framework for Teaching
The Marzano Model
Evidential-Weight Guidelines
Chapter Implications for Three Audiences
7. Evidence from Ratings
Rooting Around with Ratings
Lurking Comparisons
Amalgam Judgments
Three Flavors of Bias
Administrators' Ratings
Students' Ratings
Making Ratings Righteous
The Rating Form
Rater Preparation
The Old and the New
Evidential-Weight Guidelines
Chapter Implications for Three Audiences
8. Evidence from Sundry Sources
Alternative Sources of Evidence for Evaluating Teachers
Academic Achievements
Changes in Students' Affect
Lesson Plans
Opportunity-to-Learn Student Surveys
Parental Engagement
Parent Ratings
Professional Development
Ratings by Colleagues
Student Interviews
Teacher-Made Tests
Teachers' Self-Ratings
Augmentation or Obfuscation?
Evidential-Weight Guidelines
Chapter Implications for Three Audiences
9. Mission Possible?
Weighted-Evidence Judgment of Teachers: A Reprise
What To Do- And How?
Chapter Imlpications for Three Audiences
Responding to a Subtitle
Index
Reviews
"Jim Popham provides a step-by-step analysis of the do's and don't's regarding evaluation, and leaves the reader with hope that, done properly, teacher evaluation can lead to better instruction. Evaluating America's Teachers is a must read for policy makers, district and school administrators, and classroom teachers grappling with reviewing and improving teacher evaluation."Alan Burke, Deputy Superintendent, K-12 Education
Office of Superintendent of Public Instruction, Olympia, WA
"Dr. Popham makes many true and important points in this book. Particularly noteworthy is his point that tests are not validated, inferences are. A measure that may well allow valid inferences about what a student knows may not necessarily be valid in making an inference about teacher effectiveness. I believe that many of those wishing to evaluate teacher effectiveness miss this important point."William A. Mehrens, Professor Emeritus
Michigan State University, East Lansing, MI
"Through his delightful wit and insightful use of vocabulary, Jim Popham has crafted a must read book for education policy makers, school administrators, and teachers. Throughout the book there are many "pearls of wisdom" that help steer the teacher evaluation discussion in states and local school districts. As a chief state school officer who is currently working on implementing a statewide teacher evaluation system that is required to meet the Race to the Top and ESEA waiver requirements, this book provided me with the right questions to ask prior to completion of our work. I believe this book will enable readers to turn the subtitle—Mission Possible?—from a question into a reality."Terry Holliday, Commissioner of Education
Department of Education, Frankfort, KY
"In the contentious environment where there are so many competing models for evaluating teacher quality (many of which are seriously flawed), it is refreshing (and essential) that strategies are considered that examine the full range of teacher quality (not just test scores on just reading an mathematics) to achieve a fair, valid, and comprehensive look at the quality of teachers. This book does just that and should be a "must read" for policymakers, administrators, and teachers."Barbara Plake, Professor Emeritus
University of Nebraska-Lincoln
"Popham's gift of writing and his wealth of knowledge and experience pour out of every page in this book. It recognises the inevitable—we will evaluate teachers—and shows how it can be done properly provided we remember that it is humans weighing the various sources of evidence that make judgements and not isolated instruments (observations, tests, ratings) that make these decisions. Hence, multiple methods, growth models, a clarity between formative and summative interpretations, and an emphasis on ensuring that the methods have instructional validity. The book glistens with goodness, it is sobering but optimistic, and it is fun to read."John Hattie, Director, Melbourne Education Research Institute
Melbourne Graduate School of Education, University of Melbourne, Carlton, Victoria, Australia
"Teachers, administrators, and policy makers rejoice! Here is a single book, from a nationally recognized scholar, that makes sense of the issues involved with the evaluation of teachers."David C. Berliner, Regents’ Professor Emeritus
Mary Lou Fulton Teachers College, Arizona State University, Tempe, AZ
"In an effective and diplomatic manner, Popham suggests concrete ways that policy makers, along with local school leaders and teachers, can make sure our students are protected from summative teacher evaluation systems that do more harm than good. No one should make policy at any level or strive to build a defensible teacher evaluation system without studying this book."Rick Stiggins, Retired Executive Director
Assessment Trainer Institute
"Jim Popham has taken on one of the most contentious issues in American education today, and he presents an objective, fact-based approach to creating new systems to evaluate teacher effectiveness that are both fair to teachers and helpful in improving instruction."Jack Jennings, Founder and President
Center on Education Policy
"Popham is softly critical of ineffective practice and common misperceptions but strongly proactive in his belief that this can be done—we can create teacher evaluation systems that are fair and have a positive impact on student learning. I truly feel after reading Evaluating America's Teachers: Mission Possible that this task is not only, in Popham's words a "mission possible," but it is a mission critical for America's schools."Tom Foster, Director of Research and Evaluation
Kansas Dept. of Education, Topeka, KS
"As America's educational policymakers wrestle with revamping teacher evaluation systems, decisions are likely to be made that will have real and significant consequences in classrooms—the stakes are high. Every school board member in the country needs a solidly-researched, clearly articulated guide to understanding what works and what could go wrong. Dr. Popham's Evaluating America's Teachers is that guide."Nancy J. Budd, Esq.
Hawai`i State Board of Education (SEA and LEA)
"In Evaluating America's Teachers, Jim Popham brings clarity to the critically important and divisive issue of teacher evaluation. Drawing on a deep reservoir of technical knowledge in assessment and evaluation, Dr. Popham uniquely combines expertise, perspective, and wisdom to present an authentic path forward for policymakers, administrators, and teachers to address the evaluation of teachers in ways that honor the work they do with children in classrooms. If we commit to the disciplined thought and action called for in this eminently readable book, America's teachers and children will thrive."Dawson R. Orr, Superintendent of Schools
Highland Park ISD, Dallas, Texas
"Evaluating America’s Teachers by James Popham is an enlightening description of methods utilized to evaluate teachers, with strengths and weaknesses described for each method. Federal mandates have positioned teachers on the receiving end of evaluations that are poorly understood in terms of reliability, validity, and bias. This book provides insight on teacher evaluation not only for teachers, but administrators and policy makers as well. It informs readers of the essentials involved in teacher evaluation."Hector Ibarra, Middle School Teacher
Belin Blank International Center for Gifted Education & Talent Development, Iowa City, IA
"Once again Jim Popham has brought insight and clarity to a complex topic that only a person of his stature and expertise could provide."Robert J. Marzano, CEO
Marzano Research Laboratory
"I believe the book will be a very good resource to educators. This book focuses on the hottest topic in the field of education right now and the author clearly has a great deal of experience with the subject. In addition, his use of humor makes the book an enjoyable read."Dr. Peter DeWitt, Corwin Author and Elementary School Principal
Averill Park Central School District, Albany, NY
"This book hits squarely on a topic for which district and state policy makers need current information. It is too bad this book was not out during the roll out of teacher evaluations in states everywhere. I am sure the author's wisdom could have certainly helped in selecting tests that effectively measure teacher effectiveness."John Robinson, Principal
Discovery High School, Newton, NC
"I could see using this text in a book study with my administrative team as we discuss how we can ensure effectiveness in our assessments of classroom performance. His explanation of what to look at for evidentiary source makes more sense than anything the state put out, but in the end, the state will dictate a good part of what will be used in the evaluation."Martin Hudacs, Superintendent
Solanco School, Quarryville, PA
"I see Evaluating America's Teachers: Mission Possible? as a direct attempt to address this controversial issue head on. In this book the author addresses the need for teacher accountability and addresses the hurdles and pitfalls which are often encountered in states and school districts attempts to develop a comprehensive and all encompassing fair teacher evaluation process."Carl J. Weingartner, Corwin Author and Retired Principal
Albuquerque, NM
"I find the book to be an interesting and effective guide to help a state or school district purse a teacher evaluation process that can measure the true progress of a teacher's competence and value."Carl J. Weingartner, Corwin Author and Retired Principal
Albuquerque, NM
"I like many of his proposals about the format of a quality teacher evaluation system. As a New York state high school principal, I feel our state is working to put many of these recommendations into practice."David G. Daniels, High School Principal
Susquehanna Valley Senior High School, Conklin, NY
"It is an incredible discussion of the problem. VERY in-depth and comprehensive. It really is one of the best summaries of testing I have ever read, and it makes an incredible case for improving the teacher evaluation dilemma"Joe Crawford, Corwin author and Consultant
Freeport, IL
"As states ramp up their teacher evaluation efforts, it is becoming more and more important that this is done in a way that benefits, rather than harms, students. In this important and well-argued book, Jim Popham explains why teacher evaluation absolutely has to be based on a "weighted evidence" approach, and shows what policy-makers, administrators, and teachers need to do to make this work. Everyone interested in the quality of education in the United States should read this book."Dylan Wiliam, Emeritus Professor of Educational Assessment
Institute of Education, University of London