Archive

Archive for the ‘Teacher Evaluation’ Category

2 Presentations Today

April 1, 2011 Leave a comment

Today is an inservice day for teachers. The schedule is full of good content, except for the 45 minute presentation by the insurance company (why I’m sitting in Starbucks getting my don’t-fall-asleep-you’re-near-the-front coffee). The first presentation is part of a panel about the new teacher evaluation system that we have been working on and finally adopted. The second presentation is just me and is about my K-12 common language student friendly scoring guide. More on that later.

I’m really excited!

Florida’s Teacher Merit Pay Decision…

March 20, 2011 Leave a comment

The Florida House of Representatives recently approved a modification to the way teachers are retained in their state. From the New York Times:

The legislation, which positions Florida as a leader in the teacher tenure battle, would require new teachers to work under one-year contracts beginning in July, effectively ending tenure. As of 2014, contracts would be renewed based on evaluations, half of which would be tied to how students perform on assessment tests. The evaluations could lead to raises, or dismissals if teachers perform poorly two out of three years. Tenured teachers could opt into the merit pay system, but they would face the possibility of dismissal because of unsatisfactory evaluations regardless.

I understand the allure of teacher pay or retention based on assessment tests (or partly based on those tests). That said, if you spend enough time in a classroom you will see that some students do not perform to the minimum acceptable score. This doesn’t mean that we can give up on a student or not try as hard with that kid. All students deserve our best. But here’s the deal, I can’t dunk when I play basketball.

What I mean by this is that I don’t do as well as some other people when playing basketball. In school, I didn’t do as well at math as some of my classmates. But when I played basketball, my coach didn’t give up on me and my math teachers never did either. Some kids, because of inclination, strength in different subjects, possible learning disabilities (not that kids with a disability(s) can’t pass, but a learning disability, if it is in an area that effects the subject being tested will make passing that test more difficult than a student who does not have that disability), something in their lives outside of school, a bad hair day, etc… won’t pass the test. The teacher can do everything they can, and to judge them and possibly fire them, based on a test that isn’t within their control, is very discouraging, and *gasp* unfair.

If you want to judge on performance, look at how the teacher interacts with the students, what they are doing in the classroom to teach, their knowledge of the subject they are teaching, inclination to help other staff, ability to be flexible, etc…

I can’t imagine how demoralizing this development would be to teachers in the state.

I’ve already written on this subject in another post. It’s one of my favorites so far. To get how I felt one day about test scores used in teacher evaluation, give it a look:

Judge Me With Test Scores? Want to give my student the paper to take the test?

President Obama NCLB Reform

March 14, 2011 Leave a comment

I was very interested to watch the President’s speech when I got home.  My daughter was sleepy and settled in on my chest.  We got about 10 minutes in and then I was asleep.  Ok-attempt 2.

At first I thought it was the baby pheromones that caused my drowsiness.  Turns out it was the lack of substance in the speech.  You can watch the 27 minutes if you like, but I’ll get to what I thought the meat of it was right here.

Most interesting part for me: Race to the Top costs less than 1 percent of the Federal Education budget and but has led 40 states to change their approach to education.  [Seems to me to be a sign of the desperation for funds that public schools were facing during the recession].  Ok, the most interesting part.  The Obama administration is going to open up the money and let local school districts apply. This is very interesting. We know that much of RTT is about teacher evaluation (including using test scores as part of evaluations).  It will be fascinating to see what individual districts do.

The speech itself didn’t have a lot of meat to it.  For that, you need to turn to the White House Fact Sheet released this morning.  Some selected parts:

By focusing on teacher effectiveness and driving reforms based in part on evidence of student learning and achievement, this plan will place a greater focus on helping a greater share of  teachers excel while rewarding those that are most successful in the classroom.  The President’s plan provides resources to back the development of teacher evaluation systems that use student learning and other measures to support and identify good teaching…

NCLB Status Quo: Teachers and principals don’t get credit for improving student scores.
The Obama Plan:Replace the current pass-fail school grading system with a system that rewards teachers, principals and schools for showing they’ve helped students improve and doesn’t just judge them for how students did on one test on one day.

Basically, this is saying that teacher evaluation and possibly some form of compensation “while rewarding those that are most successful in the classroom” will be tied to student test scores.  How else would you evaluate student learning?  You’re not going to ask the teacher, especially if their pay is connected to it.  Not saying that I or any teachers I know would be dishonest, but I studied game theory and that’s a situation where you’re just begging the actor to cheat.

So we’re back to the test.  During the speech the President said:

Now, I want to speak to teachers in particular here.  I’m not talking about more tests.  I’m not talking about teaching to the test.  We don’t need to know whether a student can fill out a bubble.  We do need to know whether they’re making progress.  We do need to know whether they’re not only mastering reading, math, and science, but also developing the kinds of skills, like critical thinking and creativity and collaboration that I just saw on display with the students that I met here.

Ok, so the bubble isn’t the way the president wants to evaluate students, and he wants to go beyond reading and math (yay!).  So what to replace the simple bubble test with.  By the way, in Oregon we don’t fill in a bubble, we click on it ;)

NCLB Status Quo: Rely on unsophisticated bubble tests to grade students and schools.
The Obama Plan:Support better tests.  The Obama Administration has invested $350 million to support states in their efforts to create more sophisticated assessment systems that measure problem solving and other 21st century skills and that will provide teachers will timely information to help them improve instruction.

Can someone find a link to a developed and field tested example of this?  I’m not saying it doesn’t exist, I am genuinely curious how a standardized test can be created, administered, and quickly scored for a states’ worth of children.  I see that New Mexico wants a new test, but no details yet.

How can we adequately determine a student’s problem solving without talking to the student, or reading every step they took to solve a problem (or something like that)?  Further, these problems can’t just be math, because we are going beyond math and reading to real world problems?  Remember that the tests must be administered for several years, across an entire state, and scored quickly.  And, and…it has to be cost effective.  In Oregon, to score writing samples, it takes teams of teachers all of spring break.  How are we going to afford or logistically implement real authentic assessment on a large scale?

In the end, I wasn’t expecting a lot out of the speech, but I had hoped to see some real details.  Something I could really think about.  I walked away with “We need to improve education by helping teachers do better, not just focusing on the test, and making sure all students succeed.”  This has been said for years.  Fine, but where are the new ideas?

Teacher Evaluation

August 31, 2010 Leave a comment

A post over at The Quick and the Ed got me thinking:

It’s basically an overview of a good teacher not really being recognized by the current method of evaluation and ties back to the LA Times Value Added analysis. And since “The Quick and the Ed” is on a roll today I have learned that Washington D.C.’s IMPACT evaluation uses value added data at 50% of teacher evaluation and California uses 30%. Just to pull a number out of the air, I could probably live with 15% (although my druthers would be 10%).

Although I don’t agree with using value added analysis as the primary means of teacher evaluation, and have long been repulsed by using test scores as a means of teacher evaluation (because of my belief that standardized tests are not fair to students for a variety of reasons) I agree that the LA Times story has sparked a lot of conversation about how we evaluate teachers. It is frustrating that many teacher evaluations are “meets minimum” and “Does not meet.” At the same time, it is also frustrating when the general feeling towards teachers is that as a whole they are not very good because the evaluation system is not very good.

I’m trying to get on a committee to look at teacher evaluations in my district (YES!!) and I am really looking forward to digging into the research. My district is great when it forms a committee like this. The last one I served on was about communication devices at school and the district office folks did a great job providing great literature on both ends of the spectrum. I feel a series of posts coming…

Categories: Teacher Evaluation

Finally Got Around to Reading the Article

August 21, 2010 1 comment

I had a colleague give me a copy of the January 2010 Atlantic magazine. I have had it on my desk at home for a long time because it has an article by Amanda Ripley called “What Makes a Great Teacher?” I was intrigued, but for some reason I kept only reading a the first few paragraphs. This evening, as I sat out back grilling for one of the last times this summer (mmm…BBQ in the summer) I finally took the time to read the article.

I was particularly impressed with the article because unlike many other stories I have read it doesn’t simply put Teach for America on a pedestal. My own thoughts on TFA will be saved for another post, but for now, let’s just say I don’t agree with the assertion that TFA’s methods are the epitome of modern education practice. This doesn’t mean that I think they’re not ok, just not the be all end all of education reform.

Starting in 2002, Teach for America began using student test-score progress data to put teachers into one of three categories: those who move their students one and a half or more years ahead in one year; those who achieve one to one and a half years of growth; and those who yield less than one year of gains. In the beginning, reliable data was hard to come by, and many teachers could not be put into any category. Moreover, the data could never capture the entire story of a teacher’s impact, Farr acknowledges. But in desperately failing schools, where most kids lack basic skills, the only way to bushwhack a path out of the darkness is with a good, solid measuring stick.

I think that using data is important, but I also worry about using it as the sole means of measuring teacher effectiveness so Farr (a researcher for TFA) acknowledging this point is a good thing. Unfortunately, it seems that test data, even if not used as the primary way of evaluating teachers is the part of these evaluations that people tend to focus on. Check out the furor over the LA Times Story that used value-added data (current scores used to project success) and ranked teachers. In that story, scores were what was used and that’s all.

The focus on standardized scores is unfortunate because there are so many factors outside of the teacher’s control that do impact test scores. Please note that I do not believe extraneous factors excuse the teacher from doing everything they can to help their students succeed at anything. Further, teachers should raise test scores. How do I square my belief in teacher raising test scores with my belief that those scores should not be the primary way of evaluating teachers? Probably some amount of cognitive dissonance, but primarily I believe that although test scores are very important, I know that we are not educating a nation of standardized test takers. There are so many more factors to education than the tests.

Some interesting tidbits:

Superstar teachers had four other tendencies in common: they avidly recruited students and their families into the process; they maintained focus, ensuring that everything they did contributed to student learning; they planned exhaustively and purposefully—for the next day or the year ahead—by working backward from the desired outcome; and they worked relentlessly, refusing to surrender to the combined menaces of poverty, bureaucracy, and budgetary shortfalls.

Pretty clear, but I’m glad that the data backs this up. This year I am trying to increase the recruitment of families. I’m starting with a home survey that will help me get the parents thoughts on what their children need and what has and has not worked in the past.

“Strong teachers insist that effective teaching is neither mysterious nor magical. It is neither a function of dynamic personality nor dramatic performance,” Farr writes in Teaching as Leadership, a book coming out in February from Farr and his colleagues. The model the book lays out, Farr is careful to say, is not the only path to success. But he is convinced it can improve teaching[...]

This is interesting because I think that dynamic performance is very important in the classroom. I’m not saying a teacher has to dress up as characters (ala Herbert Gower in Teachers) or jump up on desks to dive home a point (guilty) because I have had a teacher who stood at the front of the room and spoke…and the students got it. This teacher, although some people from the outside would have sen him as dull, it was his knowledge of the subject and his quirky personality (it was good though, he was super professional and most everyone responded well to this) led to a type of dynamic presentation. A dull teacher will bore the students to death. Tey have to have something that keeps the kids interested.

For years, Teach for America also selected for something called “constant learning.” As Farr and others had noticed, great teachers tended to reflect on their performance and adapt accordingly. So people who tend to be self-aware might be a good bet. “It’s a perfectly reasonable hypothesis,” Ayotte-Hoeltzel says.

But in 2003, the admissions staff looked at the data and discovered that reflectiveness did not seem to matter either. Or more accurately, trying to predict reflectiveness in the hiring process did not work.

What did predict success, interestingly, was a history of perseverance—not just an attitude, but a track record. In the interview process, Teach for America now asks applicants to talk about overcoming challenges in their lives—and ranks their perseverance based on their answers. Angela Lee Duckworth, an assistant professor of psychology at the University of Pennsylvania, and her colleagues have actually quantified the value of perseverance.

That information was particularly interesting. Teachers do need to persevere in the face of adversity, so it would make sense that a person who had shown actual persistence in the past would continue to do so.

In general, though, Teach for America’s staffers have discovered that past performance—especially the kind you can measure—is the best predictor of future performance. Recruits who have achieved big, measurable goals in college tend to do so as teachers. And the two best metrics of previous success tend to be grade-point average and “leadership achievement”—a record of running something and showing tangible results. If you not only led a tutoring program but doubled its size, that’s promising.

GPA should be very important, and I tie the latter factor here to perseverance. You have to persevere in order to succeed in something.

Overall, a very interesting article. Right now I am reading Teach Like a Champion. I was intrigued by a NYT article about the author that really got around on the blogs. It has techniques (some of them pretty standard) that the author says efective teachers in his charter schools use. I’m always looking for ways to improve my practice and before too long I’ll write a review of the book before too long.

Follow

Get every new post delivered to your Inbox.

Join 290 other followers