JEREMY Y WANG

a grad student's thoughts on mind, brain, education and science
Nov 21

My take on Diane Ravitch's message to KIPP, TFA

[REEP, KIPP and TFA Lecture Series from Jon Paul Estrada on Vimeo]

Diane Ravitch (NYU Ed Researcher) recently gave a talk at my alma mater (Rice University) at an event sponsored by the Rice Education Entrepreneurship Program (REEP), KIPP:Houston, and Teach For America. During this talk, she takes on some of the biggest issues in the reform movement - value-added assessment, Race To The Top, charter schools, and alternative certification. (For a brief review of the talk, check out Valerie Strauss's WaPo blog.) Ravitch speaks candidly and intelligently on each of these topics.

"We need to improve education, not replace it," she states, in reference to recent reform efforts that emphasize assessment, merit pay, and "free market" approaches. She also tells us that merit pay is an old idea that's been around since the 1920s, going on to cite a recent study from Vanderbilt that showed that it doesn't make a difference (using random assignment). 

She pushes KIPP and TFA to distance themselves from the charter and alternative certification movements, noting that these are not sustainable education reform solutions. I generally agree, but with a few caveats...

KIPP and the Charter School Movement

Charter schools offer a platform for us to test the effectiveness of school-level systems and provide choice for parents and students. That said, replacing all schools with charters is not the solution. As Ravitch points out, charter schools, on the whole, do not show higher student achievement than "traditional" schools, and many of them are worse. But some of them, like KIPP, do work. Baby, bathwater, etc.

To use a nerdy analogy, you can think of charter schools as the "Open API" of the school system. The platform itself is the public school system (a Pew poll a few years ago showed that about half of the US thinks that charter schools aren't public, so I make the point here). Charter schools are "apps" that work inside the system to try to make it better - again, by (a) providing options to parents and students and (b) testing new techniques that might someday be incorporated into the larger system.

So yes, KIPP should separate themselves from the "educational robber barons, dilettantes, and incompetents" that running some of our charters, but it should also embrace the fact that without a charter school movement, they wouldn't exist. Let's stop talking about charters vs. non-charters. Let's just talk about schools vs. schools.

High and Mighty TFA

Ravitch claims that if she were graduating from college today, she would be inspired to apply for TFA. But she quickly turns around to urges TFA to "please stop claiming that TFA will close the achievement gap... no one can teach for 2 or 3 years and close the achievement gap."

I agree. But my understanding of the TFA is grossly misaligned with Ravitch's. My understanding of TFA's message is not that "smart people working in tough schools for 2 or 3 years is enough." Rather, TFA's message to me (and the one posted on their website) is that you can have an immediate impact in the classroom if you work hard, your experience will help you understand the achievement gap and educational issues better, and the educational system needs to people inside and outside school walls to care and work to increase the status quo.

I've heard Tom Dooher, Education Minnesota's President, claim something similar during an MPR interview (to paraphrase, "TFA has been around for 20 years, but the achievement gap still exists"). It is entirely possible (and likely) that the public's perception of TFA is that of a bunch of Pollyannaish young people trying to save the world. If TFA does in fact believe that "their efforts are sufficient" and that "schools don't need additional resources," then I'd agree with Ravitch that showing some humility is in order.

(On a side note, I think TFA's slogan should be: "To improve American education so that we don't need Teach For America.")

But Diane, what have you done recently?

With all due respect to Ms. Ravitch, I ask, "Do we really need another Ivory Tower professor telling us what's wrong with education today and naysaying any attempt to improve it?"

While I respect her independent and intelligent thinking, I cannot recall her providing a single suggestion of a systemic solution for education. She spent an hour talking about what doesn't work in education and indicting people that are working on the hardest problems in education today.

But then again, maybe that's Ravitch's point - there is no single solution, there is no one systemic change that will make education perfect. Maybe that point has slipped past all of us, and that's why we need people like Ravitch to remind us of these things.

Jul 13

Study Finds NAEP Scores Rise When Students Are Paid - Inside School Research - Education Week

13983

« Reports Offer Good News on Adolescent Reading Front | Main

Study Finds NAEP Scores Rise When Students Are Paid

By Debra Viadero on July 13, 2010 12:00 PM --> | No Comments | No TrackBacks
-->
-->

A new study has hit on one possible way to improve 12th graders' dismal scores on the National Assessment of Educational Progress: Pay them to take the test.

Of all the grades that are regularly tested as part of the congressionally mandated NAEP program, the 12th grade results have long been the most disappointing. That has led some experts to wonder whether the problem stemmed from poor quality instruction in high schools or whether the older and more-savvy high school seniors just weren't trying as hard as the younger test-takers.

Though the testing program is considered a national barometer of student achievement, there really isn't much of an incentive, after all, for students to do well. Scores from NAEP assessments don't show up on a report card or count toward graduation requirements. Likewise, colleges never see NAEP scores when students apply for admission.

To explore what might happen if students had a little incentive to try harder, a trio of researchers focused on a sample of 2,600 students from 59 schools in seven states who were taking NAEP tests in reading. Within each school, the students were randomly assigned to one of three test-taking conditions. Under the first condition, the seniors were paid $20 at the start of the test-taking session. Another group was offered $5 in advance and $30 at the end of the session if they correctly answered two randomly chosen questions on the test. The control group received no special incentives.

The results of the experiment were posted today in the online version of Teachers College Record. The authors are Boston College's Henry Braun and Irwin Kirsch and Kentaro Yamamoto of the Educational Testing Service.

In the end, the study found, both of the monetary incentives spurred students to do better than they might have otherwise, although the second condition, in which part of the payout hinged on the students getting answers correct, proved to be the stronger incentive. Under both conditions, though, scores for both male and female students were, on average, at least 5 points higher than the scores for the no-incentive group.

Researchers said that's a sizeable and significant gain. For instance, it's one quarter of the difference between 8th graders' and 12th graders' average scores on the tests.

Students who knew they were being paid also were more likely to report, in survey questions, that they were trying hard on the tests and that it was important to them to do well.

"There is now credible evidence that NAEP may ... underestimate the reading abilities of students enrolled in 12th grade," the authors write. On the other hand, the black-white achievement gap was larger when monetary incentives were offered, according to the study.

Does that mean the U.S. Department of Education ought to start paying high school seniors to take NAEP tests?

Not according to these researchers. They say that would be prohibitively expensive. But they write that it does suggest there might be other, less costly, strategies test-givers could use to motivate students and maximize results at the 12th grade level.

If only we knew what they were...

-->

Print Print

| Email EMail entry

| AddThis

-->

Dec 22

Education Week: Scholars Test Emotion-Sensitive Tutoring Software

Media_httpwwwedweekorgmedia20091222tutor515jpg_ylrfufrscuiedgm

This might be interesting if it pans out. But the question becomes, "To what degree do students attach emotional intelligence to these characters?" Do they actually believe that the tutor knows how they feel?

Some have argued that emotional intelligence is the sine qua non for teaching; I think it is important, but probably more so for certain types of teachers than others. Some teachers use emotion to engage and encourage their students, others attempt to take emotion out of their teaching. Who's to say that one approach is better than another? No really, does anyone have any data on this?

Aug 5

Minnesota students' science test scores take big jump

Check out this website I found at startribune.com

Yay Minnesota! Home of 3M & Medtronic (among many others), we certainly have plenty of reason to emphasize STEM.

It's noted in the article that the Minnesota science assessments (MCA-II) are completely computer-based (something that the testing industry has long avoided). The test uses innovative item types to get at students' scientific reasoning and inquiry skills.

The draft test specs for the next version of the science assessment, MCA-III, have been recently released for public review, and I'm looking forward to looking at them.

Full Disclosure: My dad is a psychometrician at Pearson, who analyzes the results of the MN science assessment. He may have juked the scores to make me feel better...

Aug 4

Controlling Interests - Scores on School Testing Are Up in New York, but Criticism Continues - Series

Media_httpgraphics8nytimescomimages20090803nyregionscores60033jpg_bhowjiriaqhfiqx

NY Times article on test scores... They are up, but at what cost?

Increasing emphasis on standardized testing may be helping the bottom line, which is certainly in the interest of closing the achievement gap. However, that may be resulting in a regression to the middle. What other results is the NYC BOE looking at to measure gains?

Jun 17

Bryn Mawr adopts new testing policy promoting greater flexibility and emphasis on subject mastery | Bryn Mawr Now

Check out this website I found at news.brynmawr.edu

The continued emphasis on "depth vs. breadth" is being pushed at Bryn Mawr, where they have adopted a more flexible testing policy. Under the new policy, students can take the SAT Reasoning plus two SAT Subject Tests or the ACT, or 3 AP tests in specific areas.

By encouraging subject mastery, Bryn Mawr is making a statement that "...it isn't just about getting the answer 'right.' It is about delving deeper into the subject matter." Now we just need to make sure that these tests are of high enough quality to really allow students to demonstrate that mastery.

This is a good step towards responsible use of testing in college admissions. My opinion is that there is a large disconnect between students, parents, and admissions staff about the emphasis placed on these tests. Many college admissions teams are working on improving the situation, but it is certainly an area that can use more work.

(Thanks to angetank for sending this my way!)

Get Updates

Tags

Archive

2012 (10)
2011 (8)
2010 (33)
2009 (43)