Tim McMahonMS, RRT-NPS, RRT, LPC
All work

Selected work · 04 · Beyond the Grade

Beyond the Grade

Beyond the Grade turns one exam into two reports: a faculty report on the cohort and a Student Learning Report for each student. Each question is tagged by content area, cognitive level and NBRC domain, so each student can see where they stand and what to study next.

Input

Brightspace results and the tagged exam

Faculty

One cohort report

Students

One learning report each

After

A reflection and development plan

01 · Workflow

How a report is made

STEP 1

Tag the exam

Each question is tagged by content area, Egan chapter, course outcome, NBRC domain and task, and cognitive level.

STEP 2

Export results

The Brightspace Attempt Details export and the matching tagged exam file.

STEP 3

Review details

Course, term, assessment name, date, number of students and number of questions are shown for review before reports are generated.

STEP 4

Generate

One faculty report for the cohort, one Student Learning Report for each student and a validated data file.

02 · Student report

Student Learning Report

Each report includes the score, results for every tagged category, strengths, and a ranked list of topics to study with a practice task for each.

Priorities
Ranked by questions assessed, points missed and percentage
Where to review
The Egan chapter and course outcome for each missed topic
Practice
A specific task for each missed topic; 75 reviewed tasks for the RC 114 midterm
Not included
Other students' results, exam questions and answer choices
Page 1. Result and summary.
Priority plan. Topics, chapters and practice.
Performance by category. Content group, cognitive level, NBRC domain.
Last page. Using the report for the development plan.

03 · Faculty report

Faculty cohort report

Score distribution, then results by content area, Egan chapter, course outcome, cognitive level, clinical function and NBRC domain down to task level, with a question-level index of what the cohort missed.

Faculty use it to identify topics to reteach and questions to review.

Cohort summary. Distribution and content groups.
NBRC results. Subdomains and task level.

04 · Student reflection

Reflection and Development Plan

After each report, students complete a Reflection and Development Plan: eight questions at midterm and fifteen at the final. Written answers are reproduced word for word. Each student receives their own report, and faculty receive a report on the whole class. The final report compares midterm and final responses when both exist.

Student report. Their reflection and action plan.
Faculty report. Response coverage for the class.

05 · Semester cycle

Ten-step assessment cycle

The Student Learning Reports are steps four and eight of the cycle.

  1. 01 Student Success & Support AssessmentWeek 1
  2. 02 Instruction, learning activities and formative assessmentWeeks 1 to midterm
  3. 03 Summative assessmentMidterm
  4. 04 Student Learning ReportImmediately after midterm
  5. 05 Reflection & Development PlanAfter the report
  6. 06 Plan in action, continued instruction and formative assessmentMidterm to final
  7. 07 Summative assessmentFinal
  8. 08 Final Student Learning ReportImmediately after final
  9. 09 Reflection & Development Plan, compared with midtermAfter the final report
  10. 10 Exit ticket, instructor reflection and course improvementEnd of course

Sample reports were generated from fictional test students.

Back to project 01 Stridor