Assessment Specialist

Job Summary:

This position oversees the coordination, administration, and continuous improvement of medical student assessments and examinations, ensuring accurate, compliant, and effective evaluation of learner performance across the curriculum. The role partners closely with faculty, Course Directors, Student Affairs, and external vendors to manage examination development and delivery, NBME administration, accommodations, grading, and reporting. It conducts advanced quantitative and qualitative analyses to support accreditation, program evaluation, and strategic decision-making; manages MSPE elective components and SOAP documentation; and leads quality assurance efforts for assessment systems and processes. The position also supports faculty and staff through training, system optimization, and the implementation of assessment tools that promote curricular effectiveness and learner success.

Duties & Essential Job Functions:

1. Coordinates examination creation and verification with Course Directors and the Exam and Quiz Review Team, and orders examinations in alignment with program requirements.
2. Oversees examination administration, including room setup, serving as chief proctor, supervising proctors, and managing National Board of Medical Examiners (NBME) reporting requirements.
3. Tracks, verifies, and implements approved examination accommodations to ensure accessibility and regulatory compliance.
4. Manages and maintains the assessment calendar and examination schedules, including room reservations, exam-related technical requirements, and proctor assignments.
5. Oversees the creation and upload of student information for NBME examination rosters.
6. Serves as the primary point of contact for technical issues during examinations, collaborating with NBME to resolve issues in real time.
7. Analyzes complex quantitative and qualitative assessment and evaluation data.
8. Prepares high-level reports for senior leadership, the Office of Faculty Success, accreditation purposes, program directors, and faculty to support strategic decision-making.
9. Develops end-of-course and longitudinal analyses to evaluate learner performance, curricular effectiveness, and program outcomes over time.
10. Conducts quality assurance reviews of team deliverables and recommends corrective actions as appropriate.
11. In coordination with Student Affairs, drafts and finalizes Supplemental Offer and Acceptance Program (SOAP) letters.
12. Manages the organization and development of the elective component of the Medical Student Performance Evaluation (MSPE).
13. Creates, organizes, and maintains assessment tracking for electives and advanced inpatient courses, ensuring data accuracy, integrity, and consistency.
14. Organizes, processes, and posts grades for longitudinal and curricular courses, including follow-up with preceptors to clarify and validate student ratings and evaluation comments; posts grades and reports to the learning management system and notifies students.
15. Identifies, escalates, and reports concerning assessment or evaluation findings to leadership as appropriate.
16. Collaborates on the design, implementation, and continuous improvement of assessment and evaluation tools and processes.
17. Evaluates existing assessment systems and workflows, recommends enhancements or new solutions, and supports implementation to improve effectiveness and usability.
18. Develops and delivers training for faculty, staff, and students on the use of curricular assessment tools and online delivery technologies, and partners with leadership to identify emerging assessment needs.
19. Performs other related duties as assigned.

Required Education & Experience:

• Bachelor’s degree in healthcare, education, business, psychology, computer science or related field.
• 2 years of experience in assessment, higher education or health-related field.

Preferred Education & Experience:

• Master’s degree in healthcare, education, business, psychology, computer science or related field.
• 2 years of experience in assessment, higher education or health-related field.

Required Licensure/Certification/Specialized Training:

None

Preferred Licensure, Certification, and/or Specialized Training:

None

Knowledge, Skills & Abilities:

• Knowledge in Microsoft Office suite.
• Knowledge with using an online learning management system.
• Skill at analyzing and evaluating confidential data on an ongoing basis.
• Skill at communicating on a regular basis with all levels of administration, faculty, and staff to fulfill deadline-driven deliverables.
• Ability to maintain a vendor-based assessment and evaluation system.
• Ability to input and query data utilizing CMS/LMS applications.

Physical Requirements (With or Without Accommodations):

• Visual acuity to read information from computer screens, forms and other printed materials and information.
• Able to speak (enunciate) clearly in conversation and general communication.
• Hearing ability for verbal communication/conversation/responses via telephone, telephone systems, and face-to-face interactions.
• Manual dexterity for typing, writing, standing and reaching, flexibility, body movement for bending, crouching, walking, kneeling and prolonged sitting.
• Lifting and moving objects and equipment up to 10 lbs.

Work Environment:

• Work is indoors and sedentary and is subject to schedule changes and/or variable work hours.
• This role is an on campus, in-person position.
• There are no harmful environmental conditions present for this job.
• The noise level in this work environment is usually moderate.