coaemsp web logo  
coaemsp logo
   
 
 
Evaluation Instruments/Program Resources
Resource Assessment Terminal Competency Form  
 
Graduate and Employer Surveys   Attrition/Retention – Student Change Status form       
     
Self Study Report Instruments Patient Encounters Tracking Tools    
 
Advisory Committee Agenda and Checklist       Program Evaluation Tools    
 

Programs are required to evaluate their services in a variety of ways, obtaining input from multiple sources. One important component is the evaluation of the appropriateness and effectiveness of the program resources. The tools on this page will support the Program when it assesses its resources throughout the year.

Resource Assessment

“The Resource Assessment Matrix is a vital tool for programs and helps them get the resources it needs.” Paramedic Program Director

Assessment of program resources is to be performed at least annually (Standard III.D) using the Program Resource Survey - Students instrument and the Program Resource Survey - Program Personnel instrument as well as any other program assessment activities. Programs are to use the Resource Assessment Matrix format to define their assessment system, collate the assessment results, and develop action plans to address deficiencies.

To assist program directors with analyzing the data collected from administering student and personnel resource surveys, a RAM and PRS Data Collection was created. This spreadsheet tallies numbers from the surveys and prepares the Resource Assessment Matrix for analysis and completion. This tool is offered as a sample and an option for program directors.

DOC   Program Resource Survey – Program Personnel
DOC   Program Resource Survey – Students
XLS   RAM and PRS Data Collection
XLS   Resource Assessment Matrix
PDF   Guidelines for administration, analysis, and implementation
of the Evaluation Instruments to support the RAM
MOV   Resource Assessment & Evaluation Processes
PDF   Resource Assessment & Evaluation Processes - FAQ
PDF   Resource Assessment & Evaluation Processes - slide deck

Terminal Competency Form

CoAEMSP has developed a Terminal Competency form that programs can use to provide consistent verification of each student's accomplishment of program competencies. The form documents successful completion of didactic, laboratory, clinical, and field internship components of the curriculum as well as affective learning domain evaluations. It also includes a section for tracking the outcomes of the individual after graduation. The form provides for the signatures of both the Program Director and the Medical Director

PDF   Terminal Competency form

Graduate and Employer Surveys

For each group of graduating students, programs are required to conduct surveys of those graduates and the employers of those graduates within 6-12 months after graduation using the CoAEMSP required graduate survey and employer survey items. Programs may use the CoAEMSP survey as presented or may convert the CoAEMSP items into an electronic format. Programs may add items to a program-developed survey, but cannot delete any CoAEMSP required items.

PDF   Employer Survey
PDF   Graduate Survey

Attrition/Retention – Student Change Status form

Education programs across the country are being held more accountable for program outcomes, typically including passing rates on credentialing examinations, placement of graduates, and attrition/retention of students. Of these three outcomes, retention of students tends to be the most challenging for programs. The reasons that students leave are many and varied. The CoAEMSP has set the outcomes threshold for retention at 70%.

Programs not meeting this threshold for three years are required to submit a Standard Progress Report to the CoAEMSP Quality Improvement Committee and are asked to identify the primary reasons that students leave the course.

To assist in tracking, a Sample Student Change of Status form is available that identifies academic and non-academic reasons for attrition. This form is not required but can assist the Program in analyzing attrition and developing a plan of action.

PDF   Sample Student Change of Status Form

Self Study Report Instruments

Programs preparing a self study report for inital accreditation (ISSR) or for continuing accreditation (CSSR) must survey program personnel using the Faculty Evaluation SSR Questionnaire, and must survey students using the Student Evaluation SSR Questionnaire. The Student Evaluation Questionnaire is conducted via SurveyMonkey. The link to the Student Evaluation SSR Questionnaire is automatically provided via email to the program one year in advance and again six months before the due date of the Self Study Report. The Faculty Evaluation SSR Questionnaire results must be kept on file and made available to the site visit team; do not send paper copies to the CoAEMSP.

DOC   Faculty Evaluation SSR Questionnaire

Patient Encounters Tracking Tools

Tracking patient encounters is an essential factor for accredited Paramedic programs. Several options are available for tracking tools, from individual program developed tools to commercially developed products. Here are two (2) samples of program developed tracking tools using Microsoft© Excel:

XLS   Sample 1
XLS   Sample 1 with sample data
XLS   Sample 2

Advisory Committee Agenda and Checklist

CoAEMSP has developed an Advisory Committee Agenda and Checklist form that programs can use for their Advisory Committee meetings. The Advisory Committee must meet at least once a year and review the goals, outcomes for the classes, and make recommendations to the program. In addition, Advisory Committee meetings should include a review of minimum competency requirements, including team leads, achievement of goals, analysis of goals, action plans, and results of action, and review the annual report. Advisory Committee meetings must have minutes reflecting the attendees and meaningful discussion and actions during the meeting. The form includes of all these items.

DOC   Advisory Committee Agenda and Checklist form

Program Evaluation Tools

Evaluation includes a variety of tools, administered at specific points throughout the Program.  Guidelines for administration, analysis, and implementation are identified.  The CoAEMSP is providing samples of the tools that a program may choose to use to evaluate its courses, exams, instructors, and the program. 

Instructor Evaluations. 

  • New faculty members, adjunct/skill instructors, and content experts should be evaluated with sufficient frequency to determine student reception and identify areas that require counseling or positive feedback.
  • Program Directors should observe and evaluate experienced faculty members at least annually.
  • Evaluations should be reviewed with the individuals: document notes of the topics discussed, feedback and direction provided. These observations may become part of a professional development plan.

    Course Evaluations
  • Evaluations should be distributed and collected at the end of each term. 
  • A final course/program evaluation should be required once the capstone field internship is complete.  
  • The Program Director should review the evaluations and compile a list of positives/issues using a course summary report format.
  • The course/program evaluations should be reviewed with the appropriate instructor(s).
  • The course/program evaluations and course summary report may be reviewed with the school leaders.
  • The course/program evaluations should be reviewed with the Program Medical Director.
  • Discuss any changes/revisions to the Program resulting from the analysis of the evaluations at a staff meeting and document the discussion in faculty meeting minutes.
  • Capture any other changes/revisions in writing and retain those documents.
PDF   Course Evaluation
PDF   Exam Analysis
PDF   Instructor Observation Process
PDF   Presentation Evaluation
PDF   Program Summary Report
PDF   Skill Instructor Evaluation
 
Site Map