Scoring Page

  • Updated

The OSCAR Scoring page contains the Sections and Items distributed to you for scoring.  This is an example of a single Section containing three items available for scoring.

  • Section - organize the questions for scoring like 'ELA Grade 5'.
  • Item  - a response to a question from an assessment that needs scoring.

Scoring_-_Section.png

Item

Each Item displays the name of the Item, the # of 'Scores Submitted' and the amount of 'Time Spent Scoring'. Hover over the count and time for a description of the data.

Resources

ScoringResources.png

Scoring

The scoring area displays both a PracticeTraining.pngand ScoreScore.png icon. 

Practice

  • If you haven't completed Practice (when available) for an item, then clicking on Training.png takes you into a simulated scoring experience so you can practice scoring while getting feedback on your scores.
  • If you have already completed Practice, then clicking on Training.png takes you to the results so you can review the practice scoring at any time.

Score

Click theScore.png icon to start Scoring.  The scoring page is made up of the same four sections with the primary section being the response.

OSCAR_Scoring_Wireframe.png
  • gold.png - containing the item response and cannot be completely collapsed
  • green.png - either containing the resources added to the item or exemplars. Click ShowItemResources.png to expand the Item Resources if it is collapsed.  Click EXEMPLAR_SET.png to expand the Exemplar Set if it is collapsed.
  • blue.png - containing the scoring controls...where you add your notes and score in the rubric.  Click ShowScoringContros.png to expand the Scoring Controls if it is collapsed
  • purple.png - containing your personal notes.  Click ShowPersonalNote.png to expand the Personal Notes if it is collapsed 

Once a section is expanded, click the Hide.png icon to hide the section.  Both the Item Resources and Scoring Controls can be hidden after they have been expanded.  Click the Hide_notes.png icon to hide the Personal Notes section.

gold.png Item Response

Item Response is the uploaded response of the student.  This is the scorable content.  Scroll up and down through the uploaded response to ensure you see all the content.  The item may have other controls to help you view the work.  These controls will disappear unless you are actively using them.

Common controls allow zoom control +/_, rotate and inverse.  You find these controls in the top left of the response section by moving your cursor into that area.

green.png Item Resources

Resources are provided to the student that helps explain the questions and resources can be provided to aid the scorer in their task, there can be multiple Item Resources loaded.  After expanding Item Resources, the first of the resources is available...scroll down in the section to view all the pages.  

Multiple Resources

Hover in the Item Resources section to see the ResourcesOptions.png.  Click on the Resources Icon to see the list of other resources available to you.  This is a common location for rubric definitions.

green.png Exemplar Set

Multiple exemplar sets may be provided as a resource for you.  The exemplar provides an 'example' of what a response and score looks like when scored based on it's true score.  Use the exemplars to help set a solid baseline for your scores.

purple.png Personal Notes

Add personal notes that will be available to you to reference at anytime during scoring for the assessment. 

Personal_Notes.png

blue.png Scoring Controls

By default this section is expanded with the Item Response when you start scoring.  There is some optional setup for what is available for each item while scoring.

Rubric Scoring

Use the provided scoring model to score the response in the areas provided.  Be sure to use the resources as well as the scoring exemplars built into the score model.  Score each of the areas defined in the rubric.

Some of the responses you score will include hover over help on a score to help you make the best choice.  Other times the rubric definition is only included as a resource.

Scoring_with_Rubric.png

  1. Choose one of the scores on each of the traits.
  2. Press the Screen_Shot_2020-05-26_at_1.47.32_PM.png icon to complete the score and move onto the next response.
    • If the scoring isn't complete or your scoring of this item doesn't meet a calibration threshold...you will receive a message on how to continue.

NOTE 1:  If this response meets the standards for a flag...sometimes used if the response is un-scorable or causes you to be concerned for the safety of the student. Use the Screen_Shot_2020-05-26_at_1.47.19_PM.png icon to flag this response.  A supervisor will review these responses.

NOTE 2: In the event a scorer is logged out for inactivity and has selected a score(s) but has not pressed the Screen Shot 2020-05-26 at 1.47.32 PM.png icon, the scores will remain selected for subsequent login sessions. Scorers can click the Screen Shot 2020-05-26 at 1.47.32 PM.png icon to submit the scores or change the scores and then submit them.