Showing posts with label Assessment. Show all posts
Showing posts with label Assessment. Show all posts

Monday, June 29, 2015

No more CheckBrics

During my first year of teaching high school, a colleague shared with me her practice of completing every one of the assignments she gave to her social studies students before she actually assigned it to her class. By completing the assignment herself, not only could she better anticipate where students might need extra support, but she also had a better grasp on what exactly she was asking her students to know, understand, and do. This was perhaps the best advice I got my first year, that and to make sure that I ate lunch with colleagues instead of working through lunch each day. For the past thirteen years of teaching high school, I have made every effort to keep this practice. In doing so, I come into a unit or a lesson with a better understanding of what I am asking of my students and why. This same framework, suggested by Wiggins and McTighe in Understanding by Design, has greatly influenced how I think about the work that is done by students in my classroom. Busy-work has no place in my classroom.

Instead, much of the “work” of my tenth grade English classes falls into two categories - practice and performance. Students begin a unit with the summative rubrics already in hand. We need to know what we are working toward. The work of the unit is to figure out why these goals are important. We practice strategies and skills in order to work toward that summative performance. But here’s where we run into some problems. A performance assessment, especially when it is used as a summative assessment tool, is only as good as its assessment criteria. Bad rubric = worthless assessment tool and useless feedback.

What type of feedback does a student get from this?
As Peter Afflerbach points out in Understanding and Using Reading Assessment K-12, “...performance assessments provide illustrative and educative details that complement the general statements made up such single, summative assessment markers” (97). However, this is only true when those performance assessments are carefully crafted to provide relevant feedback on the skills that students are working toward. Too often I have been guilty of taking the easy way out. Instead of creating a true rubric which outlines what an exemplary versus a below basic performance of a task looks like, I have created a checkbric, a list of things the must be included in the summative task.

A checkbric is not an assessment tool. It does not provide students with a model or anchor of what the successful completion of the assignment looks like. It does not focus on skills, but rather focuses on discrete facts or items. A checkbric does not help a student self-assess their work in any sort of reflective way. Instead, a checkbric functions as a to-do list.

So, I am banning checkbrics from my classroom.

Well-developed rubrics are the backbone of performance assessments. Afflerbach writes, “Over time, our use of rubrics and work samples in the classroom contributes to students developing specific schemata for what good work looks like, strategies for progress, and a schema for the ongoing self-assessment of their progress toward performance goals” (103). It is for this reason that I firmly believe that students should have such well-developed performance rubrics at the onset of the unit. In order to understand what we are working toward, students must have a clear understanding of the end goals.

Sunday, June 28, 2015

Portfolios and Self-Assessment

Portfolio based assessments are not new. I remember researching authentic and holistic portfolio-based assessments for my final undergraduate inquiry project. Authentic and holistic. This was in the mid-nineties, when many educators were talking about holistic assessments. We discussed the whole child, whole language, holistic learning. With the backlash increasing against the proliferation of data-driven, high-stakes, multiple-choice tests, the assessment pendulum seems to be making a swing back toward more holistic, portfolio-based assessments.
As Peter Afflerbach points out in Understanding and Using Reading Assessment K-12, there are many valuable reasons for using portfolio assessments in the classroom: “The public forum provided by the portfolio process requires students to anticipate different audiences, communicate effectively with their classmates, and clearly reason about their learning based on the evidence provided in the portfolio” (83). Afflerbach sums up nicely why I use online portfolios with my tenth grade and creative writing students. My students begin our course with the construction of their online portfolio on day one, creating an opening web page that explains a self-selected metaphor for their writing process. We talk not about both the written rhetorical choices that a writer makes as well as the digital rhetorical choices that impact the viewer/reader. Throughout the semester, students post a variety of their work: multi-media research projects on their independent reading selections, benchmark literary analysis essays with reflections on their growth over time, embeded research blogs, and the text of our personal essays accompanied by video recordings of that text turned into a speech. Their final portfolio is part documentation, part a showcase of their work over time. Students self-assess their work, posting their reflections on what they have discovered and changed.

I have seen first-hand how incorporating writing portfolios can encourage more self-reflection on the part of my students. Especially given that our portfolios are online, students are constantly reflecting and reassessing how they present themselves digitally. And having created online portfolios with my students over the past few years, I now have a collection of models and mentors for my students to access as they are building their own. Afflerbach points to self-assessing as being one of the strongest reasons from employing portfolios in the classroom: “When students experience the control that accompanies self-assessment, they grow in self-esteem and agency” (90). I whole-heartedly agree. In fact, for the past two years, as a result of my students spending more time on self-assessment throughout our course, I have opened the opportunity for my classes to create their own rubric for their final online portfolio assessment.

In the last few weeks of our course, my students and I spend time reflecting on our learning experiences. What have we learned about reading? What have we learned about writing? What are the skills we have spent time developing? I ask students to think about how they know they have grown in their skills and abilities. What does evidence of learning look like? On a note card, students individually write down the skills on which they feel their final online portfolio should be assessed. Then, they meet in pairs and small groups to compare criteria. Finally, the class comes together to build our collaborative rubric for their final portfolios, and using a shared Google document, we spend about a week reflecting, revising, and rewriting the assessment criteria. Students not only collaborate to write the assessment criteria, what they are assessed on, they also decide how those points are assigned. I tell them that the final portfolio assessment must be worth 200 points, but they have to agree on how those points are assigned. As the teacher will I be assessing their portfolio for those 200 points? Will students take some of the ownership of that assessment process? Will students self-assess their entire portfolio?
Students in my Creative Writing and tenth grade English classes have been creating their final portfolio grading rubrics for the past two years. And each class is different. This past semester, my Creative Writing students wanted me to assess 50 percent of their final portfolios. I used the class-designed rubric to assign 100 points, and they used the same rubric to assess for the other 100 points. My honors English students didn’t want to split the grade. Instead, they wanted to be 100 percent responsible for assessing their final portfolio, but with the caveat that they completed their assessment through either a peer or teacher conference. My honors students wanted to talk through each of the criteria and how it applied to their portfolio as a whole.

Although each class ends up with a slightly different set of criteria, for the most part, their final rubrics end up looking quite similar. I attribute this to the consistency with which we engage in self-reflection and assessment throughout the semester. At the onset of each unit, students have the criteria and rubrics which will be used for their summative assessments. They know what they are working toward. Following each unit, as students are posting their work to their online portfolio, students are once again assessing how well they met the criteria outlined on the rubric. So by the time we get to the close of the class, students have been using the same sets of criteria throughout our course. Afflerbach states that student success with portfolio assessment can be measured when “...students are expected to grow in their ability to use the assessment strategies that are modeled and taught by their teachers” (88). I would argue that an even more powerful measure of that success comes when students are empowered to create those assessment strategies.

Here's how I manage my student portfolios.

Tuesday, June 23, 2015

Getting Testy about Testing

The most recent round of backlash to high-stakes, state-mandated testing comes as no surprise to anyone who has been paying even the smallest bit of attention to changes in educational policies over the last decade. From the onset of No Child Left Behind to state-mandated tests as a result of the recently implemented Race to the Top initiative and Common Core State Standards, our culture has been more focused on what tests have to say about what is happening in our schools. We expect more transparency. Testing has been seen as the easy window into the classroom. Not only do I see this in my own tenth grade classroom, but in the classroom of my own children.

My son started kindergarten this year. Early this past May, we attended Kindergarten Round-up, a morning set aside to meet teachers and administrators, to meet future classmates, and tour the school. At least that is what I thought it was going to be. Instead, my son and I were separated. He was taken into a separate room with four stations, asked to sound out words, arrange letters, make stories from building with bricks, and spoke with the school psychologist. In the span of circulating through four stations in 30 minutes, his reading and reasoning skills were assessed so that he could be “leveled.” Meanwhile, the other parents and I sat with a group of teachers and the school’s principal, listening to how important the kindergarten assessment would be when students took the test the following May. We were continually reassured that the elementary school routinely performed well on the state tests, which children would take every year from kindergarten through eighth grade. A state standardized test for kindergartners. The focus of this initial meeting was not on helping young learners build relationships, understand connections, or foster a love of reading and learning; instead, the overwhelming message was about the importance of testing. My six year old son was sent home with weekly homework packets filled with practice sheets in preparation for the routine DIBELS tests, popcorn words lists to memorize, and handwriting practice sheets. After the first month of school, recess was taken out of the schedule as parents were told that the time was needed to better prepare students for the tests students would be taking. Instead, recess time was replaced with time in a computer lab. My six year old son spent a portion of his time at school in front of a screen in order to prepare him to take a test.

The backlash against the proliferation of high-stakes testing should not be a surprise to anyone.

As Peter Afflerbach points out in his text Understanding and Using Reading Assessment K-12, high-stakes multiple-choices tests are not a recent addition to our educational landscape. Testing and sorting of students is a century-old practice. What has changed is the increased use of such tests in early grades despite the fact that experts in the field of reading instruction, including professional groups like the International Reading Association and the National Council of English Teachers, have all questioned the validity, reliability, and appropriateness of using such high-stakes tests to measure student ability (148). Additionally, as Afflerbach states,
High stakes assessments are used to focus responsibility for students’ failure and success on schools, which has the effect of placing the entire burden for students’ education and well-being on parents and teachers rather than the social systems that contributes to the poverty that influences students’ reading development in the first place. (150-1)
It is much more difficult to address the systemic issues that contribute to a student’s success or failure. Test results are easy to get and easy to interpret.

In the case of my own classroom, my tenth grade students recently took the Pennsylvania Keystone Literature test, a test which students must pass in order to graduate. This is a recent change, with my current group of tenth graders being the first class of students who face this new graduation requirement (fortunately, this now seems to be on the way out). As a result, our curriculum and even course offerings have changed. I have a state reading assessments workbook I was asked to use with my students which consists of short non-fiction passages and multiple-choice questions to work through. Instead of having students read full texts, we are moving more and more to passage-based reading. As research is not something assessed by state-standardized tests, teachers have dropped the more intensive project-based learning opportunities in favor of short reading assessments with multiple-choice questions aligned to our state standards and replicating those questions that students will see on the Keystone literature exam.

During the actual testing itself, the state told us that not only did we need to cover or remove any content specific posters/decor in our rooms but that we also need to remove any motivational posters. Over the last year, the state conducted a study and found that students testing in classrooms with motivational posters performing statistically better than those in rooms without. So to level the field, we needed to make our classrooms as bare as possible.

Reread that.

We have gotten to a point in our testing craze that teachers are being told to remove decorations and motivational posters from their walls to accommodate high-stakes testing.

As Afflerbach states, the negative consequences of such high-stakes assessments far outweigh the positives. Students broke down and cried during our six days of state assessments. Students began school with two hours of state tests and then went through their regular classes. A full day of classes following a grueling two hours of high stakes tests upon which their graduation is dependent. And a number of students will find out this summer that their efforts were for naught. They will be labeled “Below Basic” and rescheduled into a “Keystone Reading Class,” which students all know as the code of a remedial English class. “Labels from test results are accompanied with myriad related consequences, such as lowered expectations, differential treatment in the reading classroom, and decreased perseverance for those labeled as low-achieving readers” (160). So rather than providing support for our struggling readers, such tests do much more harm than good.

And this should come as no surprise when educational policies are made by those outside of education.

Related Posts: