Rationale: We at Eduphoria believe strongly that the classroom teacher is the most qualified professional to draw conclusions about student learning. While some students take a state test focused on academic readiness for the next school year, we believe that summative information from a student's current teacher can be powerfully informative to the student's next teacher. For state-tested subjects this can provide a meaningful extra data point; for non-tested subjects this can help inform new school year planning without having to start from zero.
We propose that teachers administer summative performance level ratings for their students at the end of the school year. There are a number of ways to do this in Aware. Below is one way that uses standard assessments.
John Fessenden of lead4ward has been working with his Accountability Connect subscribers on ways to use data collected from this type of summative evaluation practice at the start of the next school year. As John has said, data from the current-year teacher for each student can be a "gift" to the teachers next year. The instructions below can be used to generate data in Aware that coincides with these practices for reporting needs.
For more information on this, please check out the following resource:
- lead4ward Accountability Connect with John Fessenden
We advise that a district-level test author create one test and then copy it over and over for each grade level and subject that will be administering the End-of-Year Summary Ratings. These instructions detail how to set up Performance Levels and a single test item to assign rubric-style levels to each student. For more information about creating and administering tests in Aware, please visit the Aware Test Authoring section.
Also, please note that every district that uses Aware is able to set locally-determined performance level names for up to five performance levels. These instructions show the common practice of using three performance levels that mirror Texas STAAR performance levels. However, any performance level names will work in a similar way. For more information on setting district performance level names, visit this article.
- Create a new blank test and set up the General Settings as appropriate.
- Set the Performance Level Values so that 50%, 75%, and 100% are the test's cut scores. (In this image, the first two Performance Levels, defined by the district, are not being used.)
- In the Questions tab of the new test, create a single new item by clicking on the +.
- Make the item a Constructed Response item with a Scoring Range of 1-4.
- The Item Weight should remain as 1.
- This item does not need any content. However, in the section that says "Enter Scoring Guide" you may create a rubric table for teachers to help them score their students. This screenshot uses a copied image of the Grade 8 Math rubric created by lead4ward.
- In the Administration tab of the test, set the appropriate Students settings.
- You must use the "students in selected courses" option so that the 2019-2020 instructor can score each student.
- This will also make sure that the 2019-2020 instructor is associated with the test data for next school year.
- In the Administration tab of the test, set an appropriate testing window for teachers to be able to score their students.
- Activate the test.
- VERY IMPORTANT: Under the Collection Administration settings, click the button to Print Answer Documents. You will get a large pdf for every student that will be scored. You do not need to save or print this file. (Technical note: This step generates test entries in the database for each student.)
How this test works:
Teachers will use the "Enter Answers" option for administering tests in Aware to score each student one at a time.
The single Constructed Response item has a possible score range of 1-4.
- 1 = Did Not Meet Grade Level
- 2 = Approaches Grade Level
- 3 = Meets Grade Level
- 4 = Masters Grade Level
Remember that we set the Approaches performance level cut score as 50%. A student who is scored with a 2 will have a percent score of 50% and therefore earn the performance level "Approaches Grade Level."
We DO NOT recommend that teachers try to "predict" how a student might have done on the state test. For state-tested subjects, there will be data for this. The purpose of this summative evaluation is to think about each student's learning needs and how they demonstrated content and process mastery throughout the year and then rate them based on their intervention or enrichment need potential moving forward.
We DO suggest that the teacher look at available data from the majority of the school year and consider the implications for students' readiness for the next school year. To what degree might a student need sustained or casual intervention? To what degree is the student an independent learner and ready for potential enrichment tasks?