Use this template to plan and document your project evaluation, measuring implementation quality and outcomes. Page 1 of 11Design Your Evaluation PlanThis section is divided into two parts to help you design a comprehensive evaluation plan for your project. Part A: Background Information and Evaluation Overview Comprehensive details about the new care model, including its objectives, the target population, and the program location. Part B: Designing the Evaluation Plan Work through the following conceptual steps to build your evaluation plan: Selecting relevant evaluation domains of interest Identifying appropriate indicators and measures Establishing baselines and targets Determining data sources and data collection methods Setting timelines for the evaluation process Prioritising tasks and designating responsible parties View your results Start with one evaluation outcome and add more only if needed, up to a maximum of 8 outcomes. NextPart A: Background Information and Evaluation OverviewProject Name*Enter Project Name HereTarget Patient or Consumer Group/s*Identify the specific group or population that will benefit from the projectPrimary Objective*Briefly describe the main goal or purpose of the projectSecondary Objectives*List any additional objectives or goals the project aims to achieveProject/Evaluation Team*Provide information about the team members involved in the project, including their roles and responsibilitiesProgram Location*Specify the location(s) where the project will be implementedDate*BackNextPart B: Designing the Evaluation Plan Complete the following overview questions before defining your evaluation outcomes on the next pages. Purpose of evaluation*How will you use findings?Target audience(s)*Who and how will you share findings?Evaluation budget and/or resources*Enter HereBackNextOutcome 1Area of Interest*---Select an area of interest for the evaluation---AdoptabilityImplementabilitySustainabilityEffectivenessSafetyPatient-centrednessHealthcare provider/system experienceAccessibilityService delivery (Activity)Economic evaluationOther (Please type your answer)Other (specify)Other (Please type your answer)Evaluation Question*Define the key question(s) that the evaluation will address. Indicators / Outcome Measures Select all applicable options from the list below. Use the accordions to review example indicators and outcome measures for each area of interest. Indicators / Outcome MeasuresCommitment to adoptionEvidence of uptakeUser engagement scalesMulti-stakeholder perceptions and experiences of adoptionOther (Adoptability)Indicators / Outcome MeasuresOrganisational readiness for implementation change (ORIC)Implementation leadership scale (ILS)Implementation readiness assessment toolAssessment of organisation context (e.g. implementation climate scale (ICS))Implementation cost and resource availabilityFit into existing workflows and systemsMulti-stakeholder perceptions and experiences of implementation effectivenessOther (Implementability)Indicators / Outcome MeasuresSustainability of work practices questionnaireNormalisation measure development questionnaire (NoMAD)Program sustainability toolsOutcomes and resource allocation beyond initial stageMulti-stakeholder perceptions and experiences of sustainabilityOther (Sustainability)Indicators / Outcome MeasuresOverall well-beingEffect of symptoms or condition (e.g. Strengths and Difficulties Questionnaire)Influence of pain, assessed through pain scalesPresenteeism - being present at work or productivity while unwellAbsenteeism - being absent from work due to illness or health concernsRequirement for medications, tests and therapiesPatients' understanding of their condition and their ability to manage it (e.g. Patient Empowerment Index/score)Symptom improvement (e.g. global rate of change)Rates of resolution or recoveryImprovement in medical test results (e.g. blood pressure or glucose)Recovery times or time to a specific target or cureChanges in quality of life (e.g. Short Form 36 and 12 v2, EuroQol 5D)Locally developed or validated patient reported outcome measures (PROMs)Visits to the emergency department, hospital, or general practitionerRates of re-referral, readmission, representation, or revisionTotal referrals to other healthcare professionals or medical specialtiesChanges in patient adherence scoresOther (Effectiveness)Indicators / Outcome MeasuresDiagnostic accuracySensitivity and specificityDiagnostic yieldMissed or delayed diagnosisMisdiagnosisAppropriate escalation of careSurgical conversion ratesIncidence of errorsCompliance with guidelines, protocols, and standards of careConsistency and concordance in triage, decision-making, investigations, management, surgical necessity, and discharge planning decisionsInter-rater reliabilityAssessment of healthcare quality and appropriateness in medical care, medication management, and documentationMortalityMorbidityOccurrence of complications, adverse events, or incidentsImpact and severity of side effects or eventsClinical governanceCoordinated careCollaborationOther (Safety)Indicators / Outcome MeasuresAccessibility and convenience of careOrganisation and process from referral to dischargeAppointment durationClinician knowledge and skillsInterpersonal communication (trust, rapport, listening, and explanation skills)Cost of receiving carePerceptions of treatment outcomesSymptom improvementReassuranceTreatment and management strategiesRelational continuityInformation continuityManagement continuityAppointment attendance and retentionSatisfaction surveysRate of patients requesting second opinionLocally developed patient reported experience measures (PREMs)Other (Patient-centredness)Indicators / Outcome MeasuresPerspectives and experiences of healthcare professionalsHealthcare system expectations and experiencesAssessing impact on healthcare networksOther (Healthcare provider/system experience)Indicators / Outcome MeasuresTime to consultationTime to diagnosisTime to planned treatmentTime from diagnosis to initiation of treatmentTime to dischargeTime to referral to a specialist or additional servicesTime to access essential diagnostic tests or proceduresTime to access diagnostic test resultsNumber of patients on the waitlistReduction in the waitlistAverage waiting time for patientsPatients exceeding recommended wait timesPercentage of patients experiencing delayed carePriority level changes for patients on the waitlistTimeliness of communication with patients on the waitlistWait time for review appointmentsAccess to third next available appointmentOther (Accessibility)Indicators / Outcome MeasuresNumber of referralsNumber of patients removed from waitlistsPatients triaged to model of careProportion of patients eligible for model of careUse of telehealth and virtual consultationsNumber of patients seenOccasions of serviceDischarge ratesNumber of patients requiring escalation or expedited careOther (Service delivery)Indicators / Outcome MeasuresInputs and resource utilisationPersonnel time and costsCosts of provider visitsDiagnostic, treatment, and intervention costsDirect and indirect costsTraining costsCost minimisation (e.g. differences in salaries)Cost-effectiveness analysis (cost in relation to outcomes)Cost-benefit analysis (net benefits - benefits minus costs)Cost-utility analysis (overall measure of value e.g. quality adjusted life years)Measures of willingness to payMarginal rates of substitutionNet monetary benefits (incremental benefit x threshold - incremental cost)Incremental cost-effectiveness ratio (difference in cost divided by difference in outcomes)Lost income due to absence from workMedication expensesGeneral practitioner or specialist visit costsTravel expensesParking costsPersonal expensesOther (Economic evaluation)AdoptabilityCommitment to adoptionEvidence of uptakeUser engagement scalesMulti-stakeholder perceptions and experiences of adoptionSurveys (e.g. adaptation of Lean in healthcare questionnaire (LiHcQ))Observation, interviews, focus groups and administrative dataOther (Adoptability)ImplementabilityOrganisational readiness for implementation change (ORIC)Implementation leadership scale (ILS)Implementation readiness assessment toolAssessment of organisation context (e.g. implementation climate scale (ICS))Implementation cost and resource availabilityFit into existing workflows and systemsMulti-stakeholder perceptions and experiences of implementation effectivenessSurveys, case studies, interviews, checklists, audits, focus groups and administrative dataOther (Implementability)SustainabilitySustainability of work practices questionnaireNormalisation measure development questionnaire (NoMAD)Program sustainability toolsOutcomes and resource allocation beyond initial stageMulti-stakeholder perceptions and experiences of sustainabilitySurveys, case studies, interviews, records and policy reviewsOther (Sustainability)EffectivenessOverall well-beingEffect of symptoms or condition (e.g. Strengths and Difficulties Questionnaire)Influence of pain, assessed through pain scalesPresenteeism - being present at work or productivity while unwellAbsenteeism - being absent from work due to illness or health concernsRequirement for medications, tests and therapiesPatients' understanding of their condition and their ability to manage it (e.g. Patient Empowerment Index/score)Symptom improvement (e.g. global rate of change)Rates of resolution or recoveryImprovement in medical test results (e.g. blood pressure or glucose)Recovery times or time to a specific target or cureChanges in quality of life (e.g. Short Form 36 and 12 v2, EuroQol 5D)Locally developed or validated patient reported outcome measures (PROMs)Visits to the emergency department, hospital, or general practitionerRates of re-referral, readmission, representation, or revisionPlanned and unplannedTotal referrals to other healthcare professionals or medical specialtiesChanges in patient adherence scoresOther (Effectiveness)SafetyDiagnostic accuracySensitivity and specificityDiagnostic yieldMissed or delayed diagnosisMisdiagnosisAppropriate escalation of careSurgical conversion ratesIncidence of errorsCompliance with guidelines, protocols, and standards of careConsistency and concordance in triage, decision-making, investigations, management, surgical necessity, and discharge planning decisionsInter-rater reliabilityAssessment of healthcare quality and appropriateness in medical care, medication management, and documentationMortalityMorbidityOccurrence of complications, adverse events, or incidentsImpact and severity of side effects or eventsClinical governanceCoordinated careCollaborationOther (Safety)Patient-centrednessAccessibility and convenience of careOrganisation and process from referral to dischargeAppointment durationClinician knowledge and skillsInterpersonal communication (trust, rapport, listening, and explanation skills)Cost of receiving carePerceptions of treatment outcomesSymptom improvementReassuranceTreatment and management strategiesRelational continuityInformation continuityManagement continuityAppointment attendance and retentionSatisfaction surveysVisit satisfaction questionnaire (Modified VSQ-9)Service satisfaction scale 30 (SSS-30)Consultation satisfaction survey (CSQ)Rate of patients requesting second opinionLocally developed patient reported experience measures (PREMs)Other (Patient-centredness)Healthcare provider/system experiencePerspectives and experiences of healthcare professionalsAllied health practitionersNursingSupport teamsMedical specialistsGeneral practitionersHealthcare system expectations and experiencesHealthcare leaders, decision, and policy makersAlignment with organisational strategies and goalsAssessing impact on healthcare networksRegulatory and professional bodiesEducation and training institutionsWorkforce and developmentOther (Healthcare provider/system experience)AccessibilityTime to consultationTime to diagnosisTime to planned treatmentTime from diagnosis to initiation of treatmentTime to dischargeLength of stayEpisode of care lengthTime to referral to a specialist or additional servicesTime to access essential diagnostic tests or proceduresTime to access diagnostic test resultsNumber of patients on the waitlistReduction in the waitlistAverage waiting time for patientsPatients exceeding recommended wait timesPercentage of patients experiencing delayed carePriority level changes for patients on the waitlistTimeliness of communication with patients on the waitlistWait time for review appointmentsAccess to third next available appointmentOther (Accessibility)Service deliveryNumber of referralsNumber of patients removed from waitlistsPatients triaged to model of careProportion of patients eligible for model of careUse of telehealth and virtual consultationsNumber of patients seenOccasions of serviceDischarge ratesNumber of patients requiring escalation or expedited careOther (Service delivery)Economic evaluationInputs and resource utilisationPersonnel time and costsCosts of provider visitsPrimary care, specialists, emergency, inpatient, outpatientDiagnostic, treatment, and intervention costsDirect and indirect costsTraining costsCost minimisation (e.g. differences in salaries)Cost-effectiveness analysis (cost in relation to outcomes)Cost-benefit analysis (net benefits - benefits minus costs)Cost-utility analysis (overall measure of value e.g. quality adjusted life years)Measures of willingness to payMarginal rates of substitutionNet monetary benefits (incremental benefit x threshold - incremental cost)Incremental cost-effectiveness ratio (difference in cost divided by difference in outcomes)Lost income due to absence from workMedication expensesGeneral practitioner or specialist visit costsTravel expensesParking costsPersonal expensesOther (Economic evaluation)Baseline*Provide initial baseline data (if applicable) for each indicator or outcome measure.Target*Set targets (if applicable) for each indicator or outcome measure to monitor progress over time.Data Sources*Specify the sources from which the data will be obtained.Data Collection Method*Describe the methods for collecting the data.Timeline*Outline a timeline with key milestones and deadlines for each stage of the evaluation.Priority*Assign a priority level to this evaluation task.LowMediumHighWho is Responsible*Assign specific individuals or teams to manage this evaluation task.Add another outcome?*YesNoBackNextOutcome 2Area of Interest*---Select an area of interest for the evaluation---AdoptabilityImplementabilitySustainabilityEffectivenessSafetyPatient-centrednessHealthcare provider/system experienceAccessibilityService delivery (Activity)Economic evaluationOther (Please type your answer)Other (specify)Other (Please type your answer)Evaluation Question*Define the key question(s) that the evaluation will address. Indicators / Outcome Measures Select all applicable options from the list below. Use the accordions to review example indicators and outcome measures for each area of interest. Indicators / Outcome MeasuresCommitment to adoptionEvidence of uptakeUser engagement scalesMulti-stakeholder perceptions and experiences of adoptionOther (Adoptability)Indicators / Outcome MeasuresOrganisational readiness for implementation change (ORIC)Implementation leadership scale (ILS)Implementation readiness assessment toolAssessment of organisation context (e.g. implementation climate scale (ICS))Implementation cost and resource availabilityFit into existing workflows and systemsMulti-stakeholder perceptions and experiences of implementation effectivenessOther (Implementability)Indicators / Outcome MeasuresSustainability of work practices questionnaireNormalisation measure development questionnaire (NoMAD)Program sustainability toolsOutcomes and resource allocation beyond initial stageMulti-stakeholder perceptions and experiences of sustainabilityOther (Sustainability)Indicators / Outcome MeasuresOverall well-beingEffect of symptoms or condition (e.g. Strengths and Difficulties Questionnaire)Influence of pain, assessed through pain scalesPresenteeism - being present at work or productivity while unwellAbsenteeism - being absent from work due to illness or health concernsRequirement for medications, tests and therapiesPatients' understanding of their condition and their ability to manage it (e.g. Patient Empowerment Index/score)Symptom improvement (e.g. global rate of change)Rates of resolution or recoveryImprovement in medical test results (e.g. blood pressure or glucose)Recovery times or time to a specific target or cureChanges in quality of life (e.g. Short Form 36 and 12 v2, EuroQol 5D)Locally developed or validated patient reported outcome measures (PROMs)Visits to the emergency department, hospital, or general practitionerRates of re-referral, readmission, representation, or revisionTotal referrals to other healthcare professionals or medical specialtiesChanges in patient adherence scoresOther (Effectiveness)Indicators / Outcome MeasuresDiagnostic accuracySensitivity and specificityDiagnostic yieldMissed or delayed diagnosisMisdiagnosisAppropriate escalation of careSurgical conversion ratesIncidence of errorsCompliance with guidelines, protocols, and standards of careConsistency and concordance in triage, decision-making, investigations, management, surgical necessity, and discharge planning decisionsInter-rater reliabilityAssessment of healthcare quality and appropriateness in medical care, medication management, and documentationMortalityMorbidityOccurrence of complications, adverse events, or incidentsImpact and severity of side effects or eventsClinical governanceCoordinated careCollaborationOther (Safety)Indicators / Outcome MeasuresAccessibility and convenience of careOrganisation and process from referral to dischargeAppointment durationClinician knowledge and skillsInterpersonal communication (trust, rapport, listening, and explanation skills)Cost of receiving carePerceptions of treatment outcomesSymptom improvementReassuranceTreatment and management strategiesRelational continuityInformation continuityManagement continuityAppointment attendance and retentionSatisfaction surveysRate of patients requesting second opinionLocally developed patient reported experience measures (PREMs)Other (Patient-centredness)Indicators / Outcome MeasuresPerspectives and experiences of healthcare professionalsHealthcare system expectations and experiencesAssessing impact on healthcare networksOther (Healthcare provider/system experience)Indicators / Outcome MeasuresTime to consultationTime to diagnosisTime to planned treatmentTime from diagnosis to initiation of treatmentTime to dischargeTime to referral to a specialist or additional servicesTime to access essential diagnostic tests or proceduresTime to access diagnostic test resultsNumber of patients on the waitlistReduction in the waitlistAverage waiting time for patientsPatients exceeding recommended wait timesPercentage of patients experiencing delayed carePriority level changes for patients on the waitlistTimeliness of communication with patients on the waitlistWait time for review appointmentsAccess to third next available appointmentOther (Accessibility)Indicators / Outcome MeasuresNumber of referralsNumber of patients removed from waitlistsPatients triaged to model of careProportion of patients eligible for model of careUse of telehealth and virtual consultationsNumber of patients seenOccasions of serviceDischarge ratesNumber of patients requiring escalation or expedited careOther (Service delivery)Indicators / Outcome MeasuresInputs and resource utilisationPersonnel time and costsCosts of provider visitsDiagnostic, treatment, and intervention costsDirect and indirect costsTraining costsCost minimisation (e.g. differences in salaries)Cost-effectiveness analysis (cost in relation to outcomes)Cost-benefit analysis (net benefits - benefits minus costs)Cost-utility analysis (overall measure of value e.g. quality adjusted life years)Measures of willingness to payMarginal rates of substitutionNet monetary benefits (incremental benefit x threshold - incremental cost)Incremental cost-effectiveness ratio (difference in cost divided by difference in outcomes)Lost income due to absence from workMedication expensesGeneral practitioner or specialist visit costsTravel expensesParking costsPersonal expensesOther (Economic evaluation)AdoptabilityCommitment to adoptionEvidence of uptakeUser engagement scalesMulti-stakeholder perceptions and experiences of adoptionSurveys (e.g. adaptation of Lean in healthcare questionnaire (LiHcQ))Observation, interviews, focus groups and administrative dataOther (Adoptability)ImplementabilityOrganisational readiness for implementation change (ORIC)Implementation leadership scale (ILS)Implementation readiness assessment toolAssessment of organisation context (e.g. implementation climate scale (ICS))Implementation cost and resource availabilityFit into existing workflows and systemsMulti-stakeholder perceptions and experiences of implementation effectivenessSurveys, case studies, interviews, checklists, audits, focus groups and administrative dataOther (Implementability)SustainabilitySustainability of work practices questionnaireNormalisation measure development questionnaire (NoMAD)Program sustainability toolsOutcomes and resource allocation beyond initial stageMulti-stakeholder perceptions and experiences of sustainabilitySurveys, case studies, interviews, records and policy reviewsOther (Sustainability)EffectivenessOverall well-beingEffect of symptoms or condition (e.g. Strengths and Difficulties Questionnaire)Influence of pain, assessed through pain scalesPresenteeism - being present at work or productivity while unwellAbsenteeism - being absent from work due to illness or health concernsRequirement for medications, tests and therapiesPatients' understanding of their condition and their ability to manage it (e.g. Patient Empowerment Index/score)Symptom improvement (e.g. global rate of change)Rates of resolution or recoveryImprovement in medical test results (e.g. blood pressure or glucose)Recovery times or time to a specific target or cureChanges in quality of life (e.g. Short Form 36 and 12 v2, EuroQol 5D)Locally developed or validated patient reported outcome measures (PROMs)Visits to the emergency department, hospital, or general practitionerRates of re-referral, readmission, representation, or revisionPlanned and unplannedTotal referrals to other healthcare professionals or medical specialtiesChanges in patient adherence scoresOther (Effectiveness)SafetyDiagnostic accuracySensitivity and specificityDiagnostic yieldMissed or delayed diagnosisMisdiagnosisAppropriate escalation of careSurgical conversion ratesIncidence of errorsCompliance with guidelines, protocols, and standards of careConsistency and concordance in triage, decision-making, investigations, management, surgical necessity, and discharge planning decisionsInter-rater reliabilityAssessment of healthcare quality and appropriateness in medical care, medication management, and documentationMortalityMorbidityOccurrence of complications, adverse events, or incidentsImpact and severity of side effects or eventsClinical governanceCoordinated careCollaborationOther (Safety)Patient-centrednessAccessibility and convenience of careOrganisation and process from referral to dischargeAppointment durationClinician knowledge and skillsInterpersonal communication (trust, rapport, listening, and explanation skills)Cost of receiving carePerceptions of treatment outcomesSymptom improvementReassuranceTreatment and management strategiesRelational continuityInformation continuityManagement continuityAppointment attendance and retentionSatisfaction surveysVisit satisfaction questionnaire (Modified VSQ-9)Service satisfaction scale 30 (SSS-30)Consultation satisfaction survey (CSQ)Rate of patients requesting second opinionLocally developed patient reported experience measures (PREMs)Other (Patient-centredness)Healthcare provider/system experiencePerspectives and experiences of healthcare professionalsAllied health practitionersNursingSupport teamsMedical specialistsGeneral practitionersHealthcare system expectations and experiencesHealthcare leaders, decision, and policy makersAlignment with organisational strategies and goalsAssessing impact on healthcare networksRegulatory and professional bodiesEducation and training institutionsWorkforce and developmentOther (Healthcare provider/system experience)AccessibilityTime to consultationTime to diagnosisTime to planned treatmentTime from diagnosis to initiation of treatmentTime to dischargeLength of stayEpisode of care lengthTime to referral to a specialist or additional servicesTime to access essential diagnostic tests or proceduresTime to access diagnostic test resultsNumber of patients on the waitlistReduction in the waitlistAverage waiting time for patientsPatients exceeding recommended wait timesPercentage of patients experiencing delayed carePriority level changes for patients on the waitlistTimeliness of communication with patients on the waitlistWait time for review appointmentsAccess to third next available appointmentOther (Accessibility)Service deliveryNumber of referralsNumber of patients removed from waitlistsPatients triaged to model of careProportion of patients eligible for model of careUse of telehealth and virtual consultationsNumber of patients seenOccasions of serviceDischarge ratesNumber of patients requiring escalation or expedited careOther (Service delivery)Economic evaluationInputs and resource utilisationPersonnel time and costsCosts of provider visitsPrimary care, specialists, emergency, inpatient, outpatientDiagnostic, treatment, and intervention costsDirect and indirect costsTraining costsCost minimisation (e.g. differences in salaries)Cost-effectiveness analysis (cost in relation to outcomes)Cost-benefit analysis (net benefits - benefits minus costs)Cost-utility analysis (overall measure of value e.g. quality adjusted life years)Measures of willingness to payMarginal rates of substitutionNet monetary benefits (incremental benefit x threshold - incremental cost)Incremental cost-effectiveness ratio (difference in cost divided by difference in outcomes)Lost income due to absence from workMedication expensesGeneral practitioner or specialist visit costsTravel expensesParking costsPersonal expensesOther (Economic evaluation)Baseline*Provide initial baseline data (if applicable) for each indicator or outcome measure.Target*Set targets (if applicable) for each indicator or outcome measure to monitor progress over time.Data Sources*Specify the sources from which the data will be obtained.Data Collection Method*Describe the methods for collecting the data.Timeline*Outline a timeline with key milestones and deadlines for each stage of the evaluation.Priority*Assign a priority level to this evaluation task.LowMediumHighWho is Responsible*Assign specific individuals or teams to manage this evaluation task.Add another outcome?*YesNoBackNextOutcome 3Area of Interest*---Select an area of interest for the evaluation---AdoptabilityImplementabilitySustainabilityEffectivenessSafetyPatient-centrednessHealthcare provider/system experienceAccessibilityService delivery (Activity)Economic evaluationOther (Please type your answer)Other (specify)Other (Please type your answer)Evaluation Question*Define the key question(s) that the evaluation will address. Indicators / Outcome Measures Select all applicable options from the list below. Use the accordions to review example indicators and outcome measures for each area of interest. Indicators / Outcome MeasuresCommitment to adoptionEvidence of uptakeUser engagement scalesMulti-stakeholder perceptions and experiences of adoptionOther (Adoptability)Indicators / Outcome MeasuresOrganisational readiness for implementation change (ORIC)Implementation leadership scale (ILS)Implementation readiness assessment toolAssessment of organisation context (e.g. implementation climate scale (ICS))Implementation cost and resource availabilityFit into existing workflows and systemsMulti-stakeholder perceptions and experiences of implementation effectivenessOther (Implementability)Indicators / Outcome MeasuresSustainability of work practices questionnaireNormalisation measure development questionnaire (NoMAD)Program sustainability toolsOutcomes and resource allocation beyond initial stageMulti-stakeholder perceptions and experiences of sustainabilityOther (Sustainability)Indicators / Outcome MeasuresOverall well-beingEffect of symptoms or condition (e.g. Strengths and Difficulties Questionnaire)Influence of pain, assessed through pain scalesPresenteeism - being present at work or productivity while unwellAbsenteeism - being absent from work due to illness or health concernsRequirement for medications, tests and therapiesPatients' understanding of their condition and their ability to manage it (e.g. Patient Empowerment Index/score)Symptom improvement (e.g. global rate of change)Rates of resolution or recoveryImprovement in medical test results (e.g. blood pressure or glucose)Recovery times or time to a specific target or cureChanges in quality of life (e.g. Short Form 36 and 12 v2, EuroQol 5D)Locally developed or validated patient reported outcome measures (PROMs)Visits to the emergency department, hospital, or general practitionerRates of re-referral, readmission, representation, or revisionTotal referrals to other healthcare professionals or medical specialtiesChanges in patient adherence scoresOther (Effectiveness)Indicators / Outcome MeasuresDiagnostic accuracySensitivity and specificityDiagnostic yieldMissed or delayed diagnosisMisdiagnosisAppropriate escalation of careSurgical conversion ratesIncidence of errorsCompliance with guidelines, protocols, and standards of careConsistency and concordance in triage, decision-making, investigations, management, surgical necessity, and discharge planning decisionsInter-rater reliabilityAssessment of healthcare quality and appropriateness in medical care, medication management, and documentationMortalityMorbidityOccurrence of complications, adverse events, or incidentsImpact and severity of side effects or eventsClinical governanceCoordinated careCollaborationOther (Safety)Indicators / Outcome MeasuresAccessibility and convenience of careOrganisation and process from referral to dischargeAppointment durationClinician knowledge and skillsInterpersonal communication (trust, rapport, listening, and explanation skills)Cost of receiving carePerceptions of treatment outcomesSymptom improvementReassuranceTreatment and management strategiesRelational continuityInformation continuityManagement continuityAppointment attendance and retentionSatisfaction surveysRate of patients requesting second opinionLocally developed patient reported experience measures (PREMs)Other (Patient-centredness)Indicators / Outcome MeasuresPerspectives and experiences of healthcare professionalsHealthcare system expectations and experiencesAssessing impact on healthcare networksOther (Healthcare provider/system experience)Indicators / Outcome MeasuresTime to consultationTime to diagnosisTime to planned treatmentTime from diagnosis to initiation of treatmentTime to dischargeTime to referral to a specialist or additional servicesTime to access essential diagnostic tests or proceduresTime to access diagnostic test resultsNumber of patients on the waitlistReduction in the waitlistAverage waiting time for patientsPatients exceeding recommended wait timesPercentage of patients experiencing delayed carePriority level changes for patients on the waitlistTimeliness of communication with patients on the waitlistWait time for review appointmentsAccess to third next available appointmentOther (Accessibility)Indicators / Outcome MeasuresNumber of referralsNumber of patients removed from waitlistsPatients triaged to model of careProportion of patients eligible for model of careUse of telehealth and virtual consultationsNumber of patients seenOccasions of serviceDischarge ratesNumber of patients requiring escalation or expedited careOther (Service delivery)Indicators / Outcome MeasuresInputs and resource utilisationPersonnel time and costsCosts of provider visitsDiagnostic, treatment, and intervention costsDirect and indirect costsTraining costsCost minimisation (e.g. differences in salaries)Cost-effectiveness analysis (cost in relation to outcomes)Cost-benefit analysis (net benefits - benefits minus costs)Cost-utility analysis (overall measure of value e.g. quality adjusted life years)Measures of willingness to payMarginal rates of substitutionNet monetary benefits (incremental benefit x threshold - incremental cost)Incremental cost-effectiveness ratio (difference in cost divided by difference in outcomes)Lost income due to absence from workMedication expensesGeneral practitioner or specialist visit costsTravel expensesParking costsPersonal expensesOther (Economic evaluation)AdoptabilityCommitment to adoptionEvidence of uptakeUser engagement scalesMulti-stakeholder perceptions and experiences of adoptionSurveys (e.g. adaptation of Lean in healthcare questionnaire (LiHcQ))Observation, interviews, focus groups and administrative dataOther (Adoptability)ImplementabilityOrganisational readiness for implementation change (ORIC)Implementation leadership scale (ILS)Implementation readiness assessment toolAssessment of organisation context (e.g. implementation climate scale (ICS))Implementation cost and resource availabilityFit into existing workflows and systemsMulti-stakeholder perceptions and experiences of implementation effectivenessSurveys, case studies, interviews, checklists, audits, focus groups and administrative dataOther (Implementability)SustainabilitySustainability of work practices questionnaireNormalisation measure development questionnaire (NoMAD)Program sustainability toolsOutcomes and resource allocation beyond initial stageMulti-stakeholder perceptions and experiences of sustainabilitySurveys, case studies, interviews, records and policy reviewsOther (Sustainability)EffectivenessOverall well-beingEffect of symptoms or condition (e.g. Strengths and Difficulties Questionnaire)Influence of pain, assessed through pain scalesPresenteeism - being present at work or productivity while unwellAbsenteeism - being absent from work due to illness or health concernsRequirement for medications, tests and therapiesPatients' understanding of their condition and their ability to manage it (e.g. Patient Empowerment Index/score)Symptom improvement (e.g. global rate of change)Rates of resolution or recoveryImprovement in medical test results (e.g. blood pressure or glucose)Recovery times or time to a specific target or cureChanges in quality of life (e.g. Short Form 36 and 12 v2, EuroQol 5D)Locally developed or validated patient reported outcome measures (PROMs)Visits to the emergency department, hospital, or general practitionerRates of re-referral, readmission, representation, or revisionPlanned and unplannedTotal referrals to other healthcare professionals or medical specialtiesChanges in patient adherence scoresOther (Effectiveness)SafetyDiagnostic accuracySensitivity and specificityDiagnostic yieldMissed or delayed diagnosisMisdiagnosisAppropriate escalation of careSurgical conversion ratesIncidence of errorsCompliance with guidelines, protocols, and standards of careConsistency and concordance in triage, decision-making, investigations, management, surgical necessity, and discharge planning decisionsInter-rater reliabilityAssessment of healthcare quality and appropriateness in medical care, medication management, and documentationMortalityMorbidityOccurrence of complications, adverse events, or incidentsImpact and severity of side effects or eventsClinical governanceCoordinated careCollaborationOther (Safety)Patient-centrednessAccessibility and convenience of careOrganisation and process from referral to dischargeAppointment durationClinician knowledge and skillsInterpersonal communication (trust, rapport, listening, and explanation skills)Cost of receiving carePerceptions of treatment outcomesSymptom improvementReassuranceTreatment and management strategiesRelational continuityInformation continuityManagement continuityAppointment attendance and retentionSatisfaction surveysVisit satisfaction questionnaire (Modified VSQ-9)Service satisfaction scale 30 (SSS-30)Consultation satisfaction survey (CSQ)Rate of patients requesting second opinionLocally developed patient reported experience measures (PREMs)Other (Patient-centredness)Healthcare provider/system experiencePerspectives and experiences of healthcare professionalsAllied health practitionersNursingSupport teamsMedical specialistsGeneral practitionersHealthcare system expectations and experiencesHealthcare leaders, decision, and policy makersAlignment with organisational strategies and goalsAssessing impact on healthcare networksRegulatory and professional bodiesEducation and training institutionsWorkforce and developmentOther (Healthcare provider/system experience)AccessibilityTime to consultationTime to diagnosisTime to planned treatmentTime from diagnosis to initiation of treatmentTime to dischargeLength of stayEpisode of care lengthTime to referral to a specialist or additional servicesTime to access essential diagnostic tests or proceduresTime to access diagnostic test resultsNumber of patients on the waitlistReduction in the waitlistAverage waiting time for patientsPatients exceeding recommended wait timesPercentage of patients experiencing delayed carePriority level changes for patients on the waitlistTimeliness of communication with patients on the waitlistWait time for review appointmentsAccess to third next available appointmentOther (Accessibility)Service deliveryNumber of referralsNumber of patients removed from waitlistsPatients triaged to model of careProportion of patients eligible for model of careUse of telehealth and virtual consultationsNumber of patients seenOccasions of serviceDischarge ratesNumber of patients requiring escalation or expedited careOther (Service delivery)Economic evaluationInputs and resource utilisationPersonnel time and costsCosts of provider visitsPrimary care, specialists, emergency, inpatient, outpatientDiagnostic, treatment, and intervention costsDirect and indirect costsTraining costsCost minimisation (e.g. differences in salaries)Cost-effectiveness analysis (cost in relation to outcomes)Cost-benefit analysis (net benefits - benefits minus costs)Cost-utility analysis (overall measure of value e.g. quality adjusted life years)Measures of willingness to payMarginal rates of substitutionNet monetary benefits (incremental benefit x threshold - incremental cost)Incremental cost-effectiveness ratio (difference in cost divided by difference in outcomes)Lost income due to absence from workMedication expensesGeneral practitioner or specialist visit costsTravel expensesParking costsPersonal expensesOther (Economic evaluation)Baseline*Provide initial baseline data (if applicable) for each indicator or outcome measure.Target*Set targets (if applicable) for each indicator or outcome measure to monitor progress over time.Data Sources*Specify the sources from which the data will be obtained.Data Collection Method*Describe the methods for collecting the data.Timeline*Outline a timeline with key milestones and deadlines for each stage of the evaluation.Priority*Assign a priority level to this evaluation task.LowMediumHighWho is Responsible*Assign specific individuals or teams to manage this evaluation task.Add another outcome?*YesNoBackNextOutcome 4Area of Interest*---Select an area of interest for the evaluation---AdoptabilityImplementabilitySustainabilityEffectivenessSafetyPatient-centrednessHealthcare provider/system experienceAccessibilityService delivery (Activity)Economic evaluationOther (Please type your answer)Other (specify)Other (Please type your answer)Evaluation Question*Define the key question(s) that the evaluation will address. Indicators / Outcome Measures Select all applicable options from the list below. Use the accordions to review example indicators and outcome measures for each area of interest. Indicators / Outcome MeasuresCommitment to adoptionEvidence of uptakeUser engagement scalesMulti-stakeholder perceptions and experiences of adoptionOther (Adoptability)Indicators / Outcome MeasuresOrganisational readiness for implementation change (ORIC)Implementation leadership scale (ILS)Implementation readiness assessment toolAssessment of organisation context (e.g. implementation climate scale (ICS))Implementation cost and resource availabilityFit into existing workflows and systemsMulti-stakeholder perceptions and experiences of implementation effectivenessOther (Implementability)Indicators / Outcome MeasuresSustainability of work practices questionnaireNormalisation measure development questionnaire (NoMAD)Program sustainability toolsOutcomes and resource allocation beyond initial stageMulti-stakeholder perceptions and experiences of sustainabilityOther (Sustainability)Indicators / Outcome MeasuresOverall well-beingEffect of symptoms or condition (e.g. Strengths and Difficulties Questionnaire)Influence of pain, assessed through pain scalesPresenteeism - being present at work or productivity while unwellAbsenteeism - being absent from work due to illness or health concernsRequirement for medications, tests and therapiesPatients' understanding of their condition and their ability to manage it (e.g. Patient Empowerment Index/score)Symptom improvement (e.g. global rate of change)Rates of resolution or recoveryImprovement in medical test results (e.g. blood pressure or glucose)Recovery times or time to a specific target or cureChanges in quality of life (e.g. Short Form 36 and 12 v2, EuroQol 5D)Locally developed or validated patient reported outcome measures (PROMs)Visits to the emergency department, hospital, or general practitionerRates of re-referral, readmission, representation, or revisionTotal referrals to other healthcare professionals or medical specialtiesChanges in patient adherence scoresOther (Effectiveness)Indicators / Outcome MeasuresDiagnostic accuracySensitivity and specificityDiagnostic yieldMissed or delayed diagnosisMisdiagnosisAppropriate escalation of careSurgical conversion ratesIncidence of errorsCompliance with guidelines, protocols, and standards of careConsistency and concordance in triage, decision-making, investigations, management, surgical necessity, and discharge planning decisionsInter-rater reliabilityAssessment of healthcare quality and appropriateness in medical care, medication management, and documentationMortalityMorbidityOccurrence of complications, adverse events, or incidentsImpact and severity of side effects or eventsClinical governanceCoordinated careCollaborationOther (Safety)Indicators / Outcome MeasuresAccessibility and convenience of careOrganisation and process from referral to dischargeAppointment durationClinician knowledge and skillsInterpersonal communication (trust, rapport, listening, and explanation skills)Cost of receiving carePerceptions of treatment outcomesSymptom improvementReassuranceTreatment and management strategiesRelational continuityInformation continuityManagement continuityAppointment attendance and retentionSatisfaction surveysRate of patients requesting second opinionLocally developed patient reported experience measures (PREMs)Other (Patient-centredness)Indicators / Outcome MeasuresPerspectives and experiences of healthcare professionalsHealthcare system expectations and experiencesAssessing impact on healthcare networksOther (Healthcare provider/system experience)Indicators / Outcome MeasuresTime to consultationTime to diagnosisTime to planned treatmentTime from diagnosis to initiation of treatmentTime to dischargeTime to referral to a specialist or additional servicesTime to access essential diagnostic tests or proceduresTime to access diagnostic test resultsNumber of patients on the waitlistReduction in the waitlistAverage waiting time for patientsPatients exceeding recommended wait timesPercentage of patients experiencing delayed carePriority level changes for patients on the waitlistTimeliness of communication with patients on the waitlistWait time for review appointmentsAccess to third next available appointmentOther (Accessibility)Indicators / Outcome MeasuresNumber of referralsNumber of patients removed from waitlistsPatients triaged to model of careProportion of patients eligible for model of careUse of telehealth and virtual consultationsNumber of patients seenOccasions of serviceDischarge ratesNumber of patients requiring escalation or expedited careOther (Service delivery)Indicators / Outcome MeasuresInputs and resource utilisationPersonnel time and costsCosts of provider visitsDiagnostic, treatment, and intervention costsDirect and indirect costsTraining costsCost minimisation (e.g. differences in salaries)Cost-effectiveness analysis (cost in relation to outcomes)Cost-benefit analysis (net benefits - benefits minus costs)Cost-utility analysis (overall measure of value e.g. quality adjusted life years)Measures of willingness to payMarginal rates of substitutionNet monetary benefits (incremental benefit x threshold - incremental cost)Incremental cost-effectiveness ratio (difference in cost divided by difference in outcomes)Lost income due to absence from workMedication expensesGeneral practitioner or specialist visit costsTravel expensesParking costsPersonal expensesOther (Economic evaluation)AdoptabilityCommitment to adoptionEvidence of uptakeUser engagement scalesMulti-stakeholder perceptions and experiences of adoptionSurveys (e.g. adaptation of Lean in healthcare questionnaire (LiHcQ))Observation, interviews, focus groups and administrative dataOther (Adoptability)ImplementabilityOrganisational readiness for implementation change (ORIC)Implementation leadership scale (ILS)Implementation readiness assessment toolAssessment of organisation context (e.g. implementation climate scale (ICS))Implementation cost and resource availabilityFit into existing workflows and systemsMulti-stakeholder perceptions and experiences of implementation effectivenessSurveys, case studies, interviews, checklists, audits, focus groups and administrative dataOther (Implementability)SustainabilitySustainability of work practices questionnaireNormalisation measure development questionnaire (NoMAD)Program sustainability toolsOutcomes and resource allocation beyond initial stageMulti-stakeholder perceptions and experiences of sustainabilitySurveys, case studies, interviews, records and policy reviewsOther (Sustainability)EffectivenessOverall well-beingEffect of symptoms or condition (e.g. Strengths and Difficulties Questionnaire)Influence of pain, assessed through pain scalesPresenteeism - being present at work or productivity while unwellAbsenteeism - being absent from work due to illness or health concernsRequirement for medications, tests and therapiesPatients' understanding of their condition and their ability to manage it (e.g. Patient Empowerment Index/score)Symptom improvement (e.g. global rate of change)Rates of resolution or recoveryImprovement in medical test results (e.g. blood pressure or glucose)Recovery times or time to a specific target or cureChanges in quality of life (e.g. Short Form 36 and 12 v2, EuroQol 5D)Locally developed or validated patient reported outcome measures (PROMs)Visits to the emergency department, hospital, or general practitionerRates of re-referral, readmission, representation, or revisionPlanned and unplannedTotal referrals to other healthcare professionals or medical specialtiesChanges in patient adherence scoresOther (Effectiveness)SafetyDiagnostic accuracySensitivity and specificityDiagnostic yieldMissed or delayed diagnosisMisdiagnosisAppropriate escalation of careSurgical conversion ratesIncidence of errorsCompliance with guidelines, protocols, and standards of careConsistency and concordance in triage, decision-making, investigations, management, surgical necessity, and discharge planning decisionsInter-rater reliabilityAssessment of healthcare quality and appropriateness in medical care, medication management, and documentationMortalityMorbidityOccurrence of complications, adverse events, or incidentsImpact and severity of side effects or eventsClinical governanceCoordinated careCollaborationOther (Safety)Patient-centrednessAccessibility and convenience of careOrganisation and process from referral to dischargeAppointment durationClinician knowledge and skillsInterpersonal communication (trust, rapport, listening, and explanation skills)Cost of receiving carePerceptions of treatment outcomesSymptom improvementReassuranceTreatment and management strategiesRelational continuityInformation continuityManagement continuityAppointment attendance and retentionSatisfaction surveysVisit satisfaction questionnaire (Modified VSQ-9)Service satisfaction scale 30 (SSS-30)Consultation satisfaction survey (CSQ)Rate of patients requesting second opinionLocally developed patient reported experience measures (PREMs)Other (Patient-centredness)Healthcare provider/system experiencePerspectives and experiences of healthcare professionalsAllied health practitionersNursingSupport teamsMedical specialistsGeneral practitionersHealthcare system expectations and experiencesHealthcare leaders, decision, and policy makersAlignment with organisational strategies and goalsAssessing impact on healthcare networksRegulatory and professional bodiesEducation and training institutionsWorkforce and developmentOther (Healthcare provider/system experience)AccessibilityTime to consultationTime to diagnosisTime to planned treatmentTime from diagnosis to initiation of treatmentTime to dischargeLength of stayEpisode of care lengthTime to referral to a specialist or additional servicesTime to access essential diagnostic tests or proceduresTime to access diagnostic test resultsNumber of patients on the waitlistReduction in the waitlistAverage waiting time for patientsPatients exceeding recommended wait timesPercentage of patients experiencing delayed carePriority level changes for patients on the waitlistTimeliness of communication with patients on the waitlistWait time for review appointmentsAccess to third next available appointmentOther (Accessibility)Service deliveryNumber of referralsNumber of patients removed from waitlistsPatients triaged to model of careProportion of patients eligible for model of careUse of telehealth and virtual consultationsNumber of patients seenOccasions of serviceDischarge ratesNumber of patients requiring escalation or expedited careOther (Service delivery)Economic evaluationInputs and resource utilisationPersonnel time and costsCosts of provider visitsPrimary care, specialists, emergency, inpatient, outpatientDiagnostic, treatment, and intervention costsDirect and indirect costsTraining costsCost minimisation (e.g. differences in salaries)Cost-effectiveness analysis (cost in relation to outcomes)Cost-benefit analysis (net benefits - benefits minus costs)Cost-utility analysis (overall measure of value e.g. quality adjusted life years)Measures of willingness to payMarginal rates of substitutionNet monetary benefits (incremental benefit x threshold - incremental cost)Incremental cost-effectiveness ratio (difference in cost divided by difference in outcomes)Lost income due to absence from workMedication expensesGeneral practitioner or specialist visit costsTravel expensesParking costsPersonal expensesOther (Economic evaluation)Baseline*Provide initial baseline data (if applicable) for each indicator or outcome measure.Target*Set targets (if applicable) for each indicator or outcome measure to monitor progress over time.Data Sources*Specify the sources from which the data will be obtained.Data Collection Method*Describe the methods for collecting the data.Timeline*Outline a timeline with key milestones and deadlines for each stage of the evaluation.Priority*Assign a priority level to this evaluation task.LowMediumHighWho is Responsible*Assign specific individuals or teams to manage this evaluation task.Add another outcome?*YesNoBackNextOutcome 5Area of Interest*---Select an area of interest for the evaluation---AdoptabilityImplementabilitySustainabilityEffectivenessSafetyPatient-centrednessHealthcare provider/system experienceAccessibilityService delivery (Activity)Economic evaluationOther (Please type your answer)Other (specify)Other (Please type your answer)Evaluation Question*Define the key question(s) that the evaluation will address. Indicators / Outcome Measures Select all applicable options from the list below. Use the accordions to review example indicators and outcome measures for each area of interest. Indicators / Outcome MeasuresCommitment to adoptionEvidence of uptakeUser engagement scalesMulti-stakeholder perceptions and experiences of adoptionOther (Adoptability)Indicators / Outcome MeasuresOrganisational readiness for implementation change (ORIC)Implementation leadership scale (ILS)Implementation readiness assessment toolAssessment of organisation context (e.g. implementation climate scale (ICS))Implementation cost and resource availabilityFit into existing workflows and systemsMulti-stakeholder perceptions and experiences of implementation effectivenessOther (Implementability)Indicators / Outcome MeasuresSustainability of work practices questionnaireNormalisation measure development questionnaire (NoMAD)Program sustainability toolsOutcomes and resource allocation beyond initial stageMulti-stakeholder perceptions and experiences of sustainabilityOther (Sustainability)Indicators / Outcome MeasuresOverall well-beingEffect of symptoms or condition (e.g. Strengths and Difficulties Questionnaire)Influence of pain, assessed through pain scalesPresenteeism - being present at work or productivity while unwellAbsenteeism - being absent from work due to illness or health concernsRequirement for medications, tests and therapiesPatients' understanding of their condition and their ability to manage it (e.g. Patient Empowerment Index/score)Symptom improvement (e.g. global rate of change)Rates of resolution or recoveryImprovement in medical test results (e.g. blood pressure or glucose)Recovery times or time to a specific target or cureChanges in quality of life (e.g. Short Form 36 and 12 v2, EuroQol 5D)Locally developed or validated patient reported outcome measures (PROMs)Visits to the emergency department, hospital, or general practitionerRates of re-referral, readmission, representation, or revisionTotal referrals to other healthcare professionals or medical specialtiesChanges in patient adherence scoresOther (Effectiveness)Indicators / Outcome MeasuresDiagnostic accuracySensitivity and specificityDiagnostic yieldMissed or delayed diagnosisMisdiagnosisAppropriate escalation of careSurgical conversion ratesIncidence of errorsCompliance with guidelines, protocols, and standards of careConsistency and concordance in triage, decision-making, investigations, management, surgical necessity, and discharge planning decisionsInter-rater reliabilityAssessment of healthcare quality and appropriateness in medical care, medication management, and documentationMortalityMorbidityOccurrence of complications, adverse events, or incidentsImpact and severity of side effects or eventsClinical governanceCoordinated careCollaborationOther (Safety)Indicators / Outcome MeasuresAccessibility and convenience of careOrganisation and process from referral to dischargeAppointment durationClinician knowledge and skillsInterpersonal communication (trust, rapport, listening, and explanation skills)Cost of receiving carePerceptions of treatment outcomesSymptom improvementReassuranceTreatment and management strategiesRelational continuityInformation continuityManagement continuityAppointment attendance and retentionSatisfaction surveysRate of patients requesting second opinionLocally developed patient reported experience measures (PREMs)Other (Patient-centredness)Indicators / Outcome MeasuresPerspectives and experiences of healthcare professionalsHealthcare system expectations and experiencesAssessing impact on healthcare networksOther (Healthcare provider/system experience)Indicators / Outcome MeasuresTime to consultationTime to diagnosisTime to planned treatmentTime from diagnosis to initiation of treatmentTime to dischargeTime to referral to a specialist or additional servicesTime to access essential diagnostic tests or proceduresTime to access diagnostic test resultsNumber of patients on the waitlistReduction in the waitlistAverage waiting time for patientsPatients exceeding recommended wait timesPercentage of patients experiencing delayed carePriority level changes for patients on the waitlistTimeliness of communication with patients on the waitlistWait time for review appointmentsAccess to third next available appointmentOther (Accessibility)Indicators / Outcome MeasuresNumber of referralsNumber of patients removed from waitlistsPatients triaged to model of careProportion of patients eligible for model of careUse of telehealth and virtual consultationsNumber of patients seenOccasions of serviceDischarge ratesNumber of patients requiring escalation or expedited careOther (Service delivery)Indicators / Outcome MeasuresInputs and resource utilisationPersonnel time and costsCosts of provider visitsDiagnostic, treatment, and intervention costsDirect and indirect costsTraining costsCost minimisation (e.g. differences in salaries)Cost-effectiveness analysis (cost in relation to outcomes)Cost-benefit analysis (net benefits - benefits minus costs)Cost-utility analysis (overall measure of value e.g. quality adjusted life years)Measures of willingness to payMarginal rates of substitutionNet monetary benefits (incremental benefit x threshold - incremental cost)Incremental cost-effectiveness ratio (difference in cost divided by difference in outcomes)Lost income due to absence from workMedication expensesGeneral practitioner or specialist visit costsTravel expensesParking costsPersonal expensesOther (Economic evaluation)AdoptabilityCommitment to adoptionEvidence of uptakeUser engagement scalesMulti-stakeholder perceptions and experiences of adoptionSurveys (e.g. adaptation of Lean in healthcare questionnaire (LiHcQ))Observation, interviews, focus groups and administrative dataOther (Adoptability)ImplementabilityOrganisational readiness for implementation change (ORIC)Implementation leadership scale (ILS)Implementation readiness assessment toolAssessment of organisation context (e.g. implementation climate scale (ICS))Implementation cost and resource availabilityFit into existing workflows and systemsMulti-stakeholder perceptions and experiences of implementation effectivenessSurveys, case studies, interviews, checklists, audits, focus groups and administrative dataOther (Implementability)SustainabilitySustainability of work practices questionnaireNormalisation measure development questionnaire (NoMAD)Program sustainability toolsOutcomes and resource allocation beyond initial stageMulti-stakeholder perceptions and experiences of sustainabilitySurveys, case studies, interviews, records and policy reviewsOther (Sustainability)EffectivenessOverall well-beingEffect of symptoms or condition (e.g. Strengths and Difficulties Questionnaire)Influence of pain, assessed through pain scalesPresenteeism - being present at work or productivity while unwellAbsenteeism - being absent from work due to illness or health concernsRequirement for medications, tests and therapiesPatients' understanding of their condition and their ability to manage it (e.g. Patient Empowerment Index/score)Symptom improvement (e.g. global rate of change)Rates of resolution or recoveryImprovement in medical test results (e.g. blood pressure or glucose)Recovery times or time to a specific target or cureChanges in quality of life (e.g. Short Form 36 and 12 v2, EuroQol 5D)Locally developed or validated patient reported outcome measures (PROMs)Visits to the emergency department, hospital, or general practitionerRates of re-referral, readmission, representation, or revisionPlanned and unplannedTotal referrals to other healthcare professionals or medical specialtiesChanges in patient adherence scoresOther (Effectiveness)SafetyDiagnostic accuracySensitivity and specificityDiagnostic yieldMissed or delayed diagnosisMisdiagnosisAppropriate escalation of careSurgical conversion ratesIncidence of errorsCompliance with guidelines, protocols, and standards of careConsistency and concordance in triage, decision-making, investigations, management, surgical necessity, and discharge planning decisionsInter-rater reliabilityAssessment of healthcare quality and appropriateness in medical care, medication management, and documentationMortalityMorbidityOccurrence of complications, adverse events, or incidentsImpact and severity of side effects or eventsClinical governanceCoordinated careCollaborationOther (Safety)Patient-centrednessAccessibility and convenience of careOrganisation and process from referral to dischargeAppointment durationClinician knowledge and skillsInterpersonal communication (trust, rapport, listening, and explanation skills)Cost of receiving carePerceptions of treatment outcomesSymptom improvementReassuranceTreatment and management strategiesRelational continuityInformation continuityManagement continuityAppointment attendance and retentionSatisfaction surveysVisit satisfaction questionnaire (Modified VSQ-9)Service satisfaction scale 30 (SSS-30)Consultation satisfaction survey (CSQ)Rate of patients requesting second opinionLocally developed patient reported experience measures (PREMs)Other (Patient-centredness)Healthcare provider/system experiencePerspectives and experiences of healthcare professionalsAllied health practitionersNursingSupport teamsMedical specialistsGeneral practitionersHealthcare system expectations and experiencesHealthcare leaders, decision, and policy makersAlignment with organisational strategies and goalsAssessing impact on healthcare networksRegulatory and professional bodiesEducation and training institutionsWorkforce and developmentOther (Healthcare provider/system experience)AccessibilityTime to consultationTime to diagnosisTime to planned treatmentTime from diagnosis to initiation of treatmentTime to dischargeLength of stayEpisode of care lengthTime to referral to a specialist or additional servicesTime to access essential diagnostic tests or proceduresTime to access diagnostic test resultsNumber of patients on the waitlistReduction in the waitlistAverage waiting time for patientsPatients exceeding recommended wait timesPercentage of patients experiencing delayed carePriority level changes for patients on the waitlistTimeliness of communication with patients on the waitlistWait time for review appointmentsAccess to third next available appointmentOther (Accessibility)Service deliveryNumber of referralsNumber of patients removed from waitlistsPatients triaged to model of careProportion of patients eligible for model of careUse of telehealth and virtual consultationsNumber of patients seenOccasions of serviceDischarge ratesNumber of patients requiring escalation or expedited careOther (Service delivery)Economic evaluationInputs and resource utilisationPersonnel time and costsCosts of provider visitsPrimary care, specialists, emergency, inpatient, outpatientDiagnostic, treatment, and intervention costsDirect and indirect costsTraining costsCost minimisation (e.g. differences in salaries)Cost-effectiveness analysis (cost in relation to outcomes)Cost-benefit analysis (net benefits - benefits minus costs)Cost-utility analysis (overall measure of value e.g. quality adjusted life years)Measures of willingness to payMarginal rates of substitutionNet monetary benefits (incremental benefit x threshold - incremental cost)Incremental cost-effectiveness ratio (difference in cost divided by difference in outcomes)Lost income due to absence from workMedication expensesGeneral practitioner or specialist visit costsTravel expensesParking costsPersonal expensesOther (Economic evaluation)Baseline*Provide initial baseline data (if applicable) for each indicator or outcome measure.Target*Set targets (if applicable) for each indicator or outcome measure to monitor progress over time.Data Sources*Specify the sources from which the data will be obtained.Data Collection Method*Describe the methods for collecting the data.Timeline*Outline a timeline with key milestones and deadlines for each stage of the evaluation.Priority*Assign a priority level to this evaluation task.LowMediumHighWho is Responsible*Assign specific individuals or teams to manage this evaluation task.Add another outcome?*YesNoBackNextOutcome 6Area of Interest*---Select an area of interest for the evaluation---AdoptabilityImplementabilitySustainabilityEffectivenessSafetyPatient-centrednessHealthcare provider/system experienceAccessibilityService delivery (Activity)Economic evaluationOther (Please type your answer)Other (specify)Other (Please type your answer)Evaluation Question*Define the key question(s) that the evaluation will address. Indicators / Outcome Measures Select all applicable options from the list below. Use the accordions to review example indicators and outcome measures for each area of interest. Indicators / Outcome MeasuresCommitment to adoptionEvidence of uptakeUser engagement scalesMulti-stakeholder perceptions and experiences of adoptionOther (Adoptability)Indicators / Outcome MeasuresOrganisational readiness for implementation change (ORIC)Implementation leadership scale (ILS)Implementation readiness assessment toolAssessment of organisation context (e.g. implementation climate scale (ICS))Implementation cost and resource availabilityFit into existing workflows and systemsMulti-stakeholder perceptions and experiences of implementation effectivenessOther (Implementability)Indicators / Outcome MeasuresSustainability of work practices questionnaireNormalisation measure development questionnaire (NoMAD)Program sustainability toolsOutcomes and resource allocation beyond initial stageMulti-stakeholder perceptions and experiences of sustainabilityOther (Sustainability)Indicators / Outcome MeasuresOverall well-beingEffect of symptoms or condition (e.g. Strengths and Difficulties Questionnaire)Influence of pain, assessed through pain scalesPresenteeism - being present at work or productivity while unwellAbsenteeism - being absent from work due to illness or health concernsRequirement for medications, tests and therapiesPatients' understanding of their condition and their ability to manage it (e.g. Patient Empowerment Index/score)Symptom improvement (e.g. global rate of change)Rates of resolution or recoveryImprovement in medical test results (e.g. blood pressure or glucose)Recovery times or time to a specific target or cureChanges in quality of life (e.g. Short Form 36 and 12 v2, EuroQol 5D)Locally developed or validated patient reported outcome measures (PROMs)Visits to the emergency department, hospital, or general practitionerRates of re-referral, readmission, representation, or revisionTotal referrals to other healthcare professionals or medical specialtiesChanges in patient adherence scoresOther (Effectiveness)Indicators / Outcome MeasuresDiagnostic accuracySensitivity and specificityDiagnostic yieldMissed or delayed diagnosisMisdiagnosisAppropriate escalation of careSurgical conversion ratesIncidence of errorsCompliance with guidelines, protocols, and standards of careConsistency and concordance in triage, decision-making, investigations, management, surgical necessity, and discharge planning decisionsInter-rater reliabilityAssessment of healthcare quality and appropriateness in medical care, medication management, and documentationMortalityMorbidityOccurrence of complications, adverse events, or incidentsImpact and severity of side effects or eventsClinical governanceCoordinated careCollaborationOther (Safety)Indicators / Outcome MeasuresAccessibility and convenience of careOrganisation and process from referral to dischargeAppointment durationClinician knowledge and skillsInterpersonal communication (trust, rapport, listening, and explanation skills)Cost of receiving carePerceptions of treatment outcomesSymptom improvementReassuranceTreatment and management strategiesRelational continuityInformation continuityManagement continuityAppointment attendance and retentionSatisfaction surveysRate of patients requesting second opinionLocally developed patient reported experience measures (PREMs)Other (Patient-centredness)Indicators / Outcome MeasuresPerspectives and experiences of healthcare professionalsHealthcare system expectations and experiencesAssessing impact on healthcare networksOther (Healthcare provider/system experience)Indicators / Outcome MeasuresTime to consultationTime to diagnosisTime to planned treatmentTime from diagnosis to initiation of treatmentTime to dischargeTime to referral to a specialist or additional servicesTime to access essential diagnostic tests or proceduresTime to access diagnostic test resultsNumber of patients on the waitlistReduction in the waitlistAverage waiting time for patientsPatients exceeding recommended wait timesPercentage of patients experiencing delayed carePriority level changes for patients on the waitlistTimeliness of communication with patients on the waitlistWait time for review appointmentsAccess to third next available appointmentOther (Accessibility)Indicators / Outcome MeasuresNumber of referralsNumber of patients removed from waitlistsPatients triaged to model of careProportion of patients eligible for model of careUse of telehealth and virtual consultationsNumber of patients seenOccasions of serviceDischarge ratesNumber of patients requiring escalation or expedited careOther (Service delivery)Indicators / Outcome MeasuresInputs and resource utilisationPersonnel time and costsCosts of provider visitsDiagnostic, treatment, and intervention costsDirect and indirect costsTraining costsCost minimisation (e.g. differences in salaries)Cost-effectiveness analysis (cost in relation to outcomes)Cost-benefit analysis (net benefits - benefits minus costs)Cost-utility analysis (overall measure of value e.g. quality adjusted life years)Measures of willingness to payMarginal rates of substitutionNet monetary benefits (incremental benefit x threshold - incremental cost)Incremental cost-effectiveness ratio (difference in cost divided by difference in outcomes)Lost income due to absence from workMedication expensesGeneral practitioner or specialist visit costsTravel expensesParking costsPersonal expensesOther (Economic evaluation)AdoptabilityCommitment to adoptionEvidence of uptakeUser engagement scalesMulti-stakeholder perceptions and experiences of adoptionSurveys (e.g. adaptation of Lean in healthcare questionnaire (LiHcQ))Observation, interviews, focus groups and administrative dataOther (Adoptability)ImplementabilityOrganisational readiness for implementation change (ORIC)Implementation leadership scale (ILS)Implementation readiness assessment toolAssessment of organisation context (e.g. implementation climate scale (ICS))Implementation cost and resource availabilityFit into existing workflows and systemsMulti-stakeholder perceptions and experiences of implementation effectivenessSurveys, case studies, interviews, checklists, audits, focus groups and administrative dataOther (Implementability)SustainabilitySustainability of work practices questionnaireNormalisation measure development questionnaire (NoMAD)Program sustainability toolsOutcomes and resource allocation beyond initial stageMulti-stakeholder perceptions and experiences of sustainabilitySurveys, case studies, interviews, records and policy reviewsOther (Sustainability)EffectivenessOverall well-beingEffect of symptoms or condition (e.g. Strengths and Difficulties Questionnaire)Influence of pain, assessed through pain scalesPresenteeism - being present at work or productivity while unwellAbsenteeism - being absent from work due to illness or health concernsRequirement for medications, tests and therapiesPatients' understanding of their condition and their ability to manage it (e.g. Patient Empowerment Index/score)Symptom improvement (e.g. global rate of change)Rates of resolution or recoveryImprovement in medical test results (e.g. blood pressure or glucose)Recovery times or time to a specific target or cureChanges in quality of life (e.g. Short Form 36 and 12 v2, EuroQol 5D)Locally developed or validated patient reported outcome measures (PROMs)Visits to the emergency department, hospital, or general practitionerRates of re-referral, readmission, representation, or revisionPlanned and unplannedTotal referrals to other healthcare professionals or medical specialtiesChanges in patient adherence scoresOther (Effectiveness)SafetyDiagnostic accuracySensitivity and specificityDiagnostic yieldMissed or delayed diagnosisMisdiagnosisAppropriate escalation of careSurgical conversion ratesIncidence of errorsCompliance with guidelines, protocols, and standards of careConsistency and concordance in triage, decision-making, investigations, management, surgical necessity, and discharge planning decisionsInter-rater reliabilityAssessment of healthcare quality and appropriateness in medical care, medication management, and documentationMortalityMorbidityOccurrence of complications, adverse events, or incidentsImpact and severity of side effects or eventsClinical governanceCoordinated careCollaborationOther (Safety)Patient-centrednessAccessibility and convenience of careOrganisation and process from referral to dischargeAppointment durationClinician knowledge and skillsInterpersonal communication (trust, rapport, listening, and explanation skills)Cost of receiving carePerceptions of treatment outcomesSymptom improvementReassuranceTreatment and management strategiesRelational continuityInformation continuityManagement continuityAppointment attendance and retentionSatisfaction surveysVisit satisfaction questionnaire (Modified VSQ-9)Service satisfaction scale 30 (SSS-30)Consultation satisfaction survey (CSQ)Rate of patients requesting second opinionLocally developed patient reported experience measures (PREMs)Other (Patient-centredness)Healthcare provider/system experiencePerspectives and experiences of healthcare professionalsAllied health practitionersNursingSupport teamsMedical specialistsGeneral practitionersHealthcare system expectations and experiencesHealthcare leaders, decision, and policy makersAlignment with organisational strategies and goalsAssessing impact on healthcare networksRegulatory and professional bodiesEducation and training institutionsWorkforce and developmentOther (Healthcare provider/system experience)AccessibilityTime to consultationTime to diagnosisTime to planned treatmentTime from diagnosis to initiation of treatmentTime to dischargeLength of stayEpisode of care lengthTime to referral to a specialist or additional servicesTime to access essential diagnostic tests or proceduresTime to access diagnostic test resultsNumber of patients on the waitlistReduction in the waitlistAverage waiting time for patientsPatients exceeding recommended wait timesPercentage of patients experiencing delayed carePriority level changes for patients on the waitlistTimeliness of communication with patients on the waitlistWait time for review appointmentsAccess to third next available appointmentOther (Accessibility)Service deliveryNumber of referralsNumber of patients removed from waitlistsPatients triaged to model of careProportion of patients eligible for model of careUse of telehealth and virtual consultationsNumber of patients seenOccasions of serviceDischarge ratesNumber of patients requiring escalation or expedited careOther (Service delivery)Economic evaluationInputs and resource utilisationPersonnel time and costsCosts of provider visitsPrimary care, specialists, emergency, inpatient, outpatientDiagnostic, treatment, and intervention costsDirect and indirect costsTraining costsCost minimisation (e.g. differences in salaries)Cost-effectiveness analysis (cost in relation to outcomes)Cost-benefit analysis (net benefits - benefits minus costs)Cost-utility analysis (overall measure of value e.g. quality adjusted life years)Measures of willingness to payMarginal rates of substitutionNet monetary benefits (incremental benefit x threshold - incremental cost)Incremental cost-effectiveness ratio (difference in cost divided by difference in outcomes)Lost income due to absence from workMedication expensesGeneral practitioner or specialist visit costsTravel expensesParking costsPersonal expensesOther (Economic evaluation)Baseline*Provide initial baseline data (if applicable) for each indicator or outcome measure.Target*Set targets (if applicable) for each indicator or outcome measure to monitor progress over time.Data Sources*Specify the sources from which the data will be obtained.Data Collection Method*Describe the methods for collecting the data.Timeline*Outline a timeline with key milestones and deadlines for each stage of the evaluation.Priority*Assign a priority level to this evaluation task.LowMediumHighWho is Responsible*Assign specific individuals or teams to manage this evaluation task.Add another outcome?*YesNoBackNextOutcome 7Area of Interest*---Select an area of interest for the evaluation---AdoptabilityImplementabilitySustainabilityEffectivenessSafetyPatient-centrednessHealthcare provider/system experienceAccessibilityService delivery (Activity)Economic evaluationOther (Please type your answer)Other (specify)Other (Please type your answer)Evaluation Question*Define the key question(s) that the evaluation will address. Indicators / Outcome Measures Select all applicable options from the list below. Use the accordions to review example indicators and outcome measures for each area of interest. Indicators / Outcome MeasuresCommitment to adoptionEvidence of uptakeUser engagement scalesMulti-stakeholder perceptions and experiences of adoptionOther (Adoptability)Indicators / Outcome MeasuresOrganisational readiness for implementation change (ORIC)Implementation leadership scale (ILS)Implementation readiness assessment toolAssessment of organisation context (e.g. implementation climate scale (ICS))Implementation cost and resource availabilityFit into existing workflows and systemsMulti-stakeholder perceptions and experiences of implementation effectivenessOther (Implementability)Indicators / Outcome MeasuresSustainability of work practices questionnaireNormalisation measure development questionnaire (NoMAD)Program sustainability toolsOutcomes and resource allocation beyond initial stageMulti-stakeholder perceptions and experiences of sustainabilityOther (Sustainability)Indicators / Outcome MeasuresOverall well-beingEffect of symptoms or condition (e.g. Strengths and Difficulties Questionnaire)Influence of pain, assessed through pain scalesPresenteeism - being present at work or productivity while unwellAbsenteeism - being absent from work due to illness or health concernsRequirement for medications, tests and therapiesPatients' understanding of their condition and their ability to manage it (e.g. Patient Empowerment Index/score)Symptom improvement (e.g. global rate of change)Rates of resolution or recoveryImprovement in medical test results (e.g. blood pressure or glucose)Recovery times or time to a specific target or cureChanges in quality of life (e.g. Short Form 36 and 12 v2, EuroQol 5D)Locally developed or validated patient reported outcome measures (PROMs)Visits to the emergency department, hospital, or general practitionerRates of re-referral, readmission, representation, or revisionTotal referrals to other healthcare professionals or medical specialtiesChanges in patient adherence scoresOther (Effectiveness)Indicators / Outcome MeasuresDiagnostic accuracySensitivity and specificityDiagnostic yieldMissed or delayed diagnosisMisdiagnosisAppropriate escalation of careSurgical conversion ratesIncidence of errorsCompliance with guidelines, protocols, and standards of careConsistency and concordance in triage, decision-making, investigations, management, surgical necessity, and discharge planning decisionsInter-rater reliabilityAssessment of healthcare quality and appropriateness in medical care, medication management, and documentationMortalityMorbidityOccurrence of complications, adverse events, or incidentsImpact and severity of side effects or eventsClinical governanceCoordinated careCollaborationOther (Safety)Indicators / Outcome MeasuresAccessibility and convenience of careOrganisation and process from referral to dischargeAppointment durationClinician knowledge and skillsInterpersonal communication (trust, rapport, listening, and explanation skills)Cost of receiving carePerceptions of treatment outcomesSymptom improvementReassuranceTreatment and management strategiesRelational continuityInformation continuityManagement continuityAppointment attendance and retentionSatisfaction surveysRate of patients requesting second opinionLocally developed patient reported experience measures (PREMs)Other (Patient-centredness)Indicators / Outcome MeasuresPerspectives and experiences of healthcare professionalsHealthcare system expectations and experiencesAssessing impact on healthcare networksOther (Healthcare provider/system experience)Indicators / Outcome MeasuresTime to consultationTime to diagnosisTime to planned treatmentTime from diagnosis to initiation of treatmentTime to dischargeTime to referral to a specialist or additional servicesTime to access essential diagnostic tests or proceduresTime to access diagnostic test resultsNumber of patients on the waitlistReduction in the waitlistAverage waiting time for patientsPatients exceeding recommended wait timesPercentage of patients experiencing delayed carePriority level changes for patients on the waitlistTimeliness of communication with patients on the waitlistWait time for review appointmentsAccess to third next available appointmentOther (Accessibility)Indicators / Outcome MeasuresNumber of referralsNumber of patients removed from waitlistsPatients triaged to model of careProportion of patients eligible for model of careUse of telehealth and virtual consultationsNumber of patients seenOccasions of serviceDischarge ratesNumber of patients requiring escalation or expedited careOther (Service delivery)Indicators / Outcome MeasuresInputs and resource utilisationPersonnel time and costsCosts of provider visitsDiagnostic, treatment, and intervention costsDirect and indirect costsTraining costsCost minimisation (e.g. differences in salaries)Cost-effectiveness analysis (cost in relation to outcomes)Cost-benefit analysis (net benefits - benefits minus costs)Cost-utility analysis (overall measure of value e.g. quality adjusted life years)Measures of willingness to payMarginal rates of substitutionNet monetary benefits (incremental benefit x threshold - incremental cost)Incremental cost-effectiveness ratio (difference in cost divided by difference in outcomes)Lost income due to absence from workMedication expensesGeneral practitioner or specialist visit costsTravel expensesParking costsPersonal expensesOther (Economic evaluation)AdoptabilityCommitment to adoptionEvidence of uptakeUser engagement scalesMulti-stakeholder perceptions and experiences of adoptionSurveys (e.g. adaptation of Lean in healthcare questionnaire (LiHcQ))Observation, interviews, focus groups and administrative dataOther (Adoptability)ImplementabilityOrganisational readiness for implementation change (ORIC)Implementation leadership scale (ILS)Implementation readiness assessment toolAssessment of organisation context (e.g. implementation climate scale (ICS))Implementation cost and resource availabilityFit into existing workflows and systemsMulti-stakeholder perceptions and experiences of implementation effectivenessSurveys, case studies, interviews, checklists, audits, focus groups and administrative dataOther (Implementability)SustainabilitySustainability of work practices questionnaireNormalisation measure development questionnaire (NoMAD)Program sustainability toolsOutcomes and resource allocation beyond initial stageMulti-stakeholder perceptions and experiences of sustainabilitySurveys, case studies, interviews, records and policy reviewsOther (Sustainability)EffectivenessOverall well-beingEffect of symptoms or condition (e.g. Strengths and Difficulties Questionnaire)Influence of pain, assessed through pain scalesPresenteeism - being present at work or productivity while unwellAbsenteeism - being absent from work due to illness or health concernsRequirement for medications, tests and therapiesPatients' understanding of their condition and their ability to manage it (e.g. Patient Empowerment Index/score)Symptom improvement (e.g. global rate of change)Rates of resolution or recoveryImprovement in medical test results (e.g. blood pressure or glucose)Recovery times or time to a specific target or cureChanges in quality of life (e.g. Short Form 36 and 12 v2, EuroQol 5D)Locally developed or validated patient reported outcome measures (PROMs)Visits to the emergency department, hospital, or general practitionerRates of re-referral, readmission, representation, or revisionPlanned and unplannedTotal referrals to other healthcare professionals or medical specialtiesChanges in patient adherence scoresOther (Effectiveness)SafetyDiagnostic accuracySensitivity and specificityDiagnostic yieldMissed or delayed diagnosisMisdiagnosisAppropriate escalation of careSurgical conversion ratesIncidence of errorsCompliance with guidelines, protocols, and standards of careConsistency and concordance in triage, decision-making, investigations, management, surgical necessity, and discharge planning decisionsInter-rater reliabilityAssessment of healthcare quality and appropriateness in medical care, medication management, and documentationMortalityMorbidityOccurrence of complications, adverse events, or incidentsImpact and severity of side effects or eventsClinical governanceCoordinated careCollaborationOther (Safety)Patient-centrednessAccessibility and convenience of careOrganisation and process from referral to dischargeAppointment durationClinician knowledge and skillsInterpersonal communication (trust, rapport, listening, and explanation skills)Cost of receiving carePerceptions of treatment outcomesSymptom improvementReassuranceTreatment and management strategiesRelational continuityInformation continuityManagement continuityAppointment attendance and retentionSatisfaction surveysVisit satisfaction questionnaire (Modified VSQ-9)Service satisfaction scale 30 (SSS-30)Consultation satisfaction survey (CSQ)Rate of patients requesting second opinionLocally developed patient reported experience measures (PREMs)Other (Patient-centredness)Healthcare provider/system experiencePerspectives and experiences of healthcare professionalsAllied health practitionersNursingSupport teamsMedical specialistsGeneral practitionersHealthcare system expectations and experiencesHealthcare leaders, decision, and policy makersAlignment with organisational strategies and goalsAssessing impact on healthcare networksRegulatory and professional bodiesEducation and training institutionsWorkforce and developmentOther (Healthcare provider/system experience)AccessibilityTime to consultationTime to diagnosisTime to planned treatmentTime from diagnosis to initiation of treatmentTime to dischargeLength of stayEpisode of care lengthTime to referral to a specialist or additional servicesTime to access essential diagnostic tests or proceduresTime to access diagnostic test resultsNumber of patients on the waitlistReduction in the waitlistAverage waiting time for patientsPatients exceeding recommended wait timesPercentage of patients experiencing delayed carePriority level changes for patients on the waitlistTimeliness of communication with patients on the waitlistWait time for review appointmentsAccess to third next available appointmentOther (Accessibility)Service deliveryNumber of referralsNumber of patients removed from waitlistsPatients triaged to model of careProportion of patients eligible for model of careUse of telehealth and virtual consultationsNumber of patients seenOccasions of serviceDischarge ratesNumber of patients requiring escalation or expedited careOther (Service delivery)Economic evaluationInputs and resource utilisationPersonnel time and costsCosts of provider visitsPrimary care, specialists, emergency, inpatient, outpatientDiagnostic, treatment, and intervention costsDirect and indirect costsTraining costsCost minimisation (e.g. differences in salaries)Cost-effectiveness analysis (cost in relation to outcomes)Cost-benefit analysis (net benefits - benefits minus costs)Cost-utility analysis (overall measure of value e.g. quality adjusted life years)Measures of willingness to payMarginal rates of substitutionNet monetary benefits (incremental benefit x threshold - incremental cost)Incremental cost-effectiveness ratio (difference in cost divided by difference in outcomes)Lost income due to absence from workMedication expensesGeneral practitioner or specialist visit costsTravel expensesParking costsPersonal expensesOther (Economic evaluation)Baseline*Provide initial baseline data (if applicable) for each indicator or outcome measure.Target*Set targets (if applicable) for each indicator or outcome measure to monitor progress over time.Data Sources*Specify the sources from which the data will be obtained.Data Collection Method*Describe the methods for collecting the data.Timeline*Outline a timeline with key milestones and deadlines for each stage of the evaluation.Priority*Assign a priority level to this evaluation task.LowMediumHighWho is Responsible*Assign specific individuals or teams to manage this evaluation task.Add another outcome?*YesNoBackNextOutcome 8Area of Interest*---Select an area of interest for the evaluation---AdoptabilityImplementabilitySustainabilityEffectivenessSafetyPatient-centrednessHealthcare provider/system experienceAccessibilityService delivery (Activity)Economic evaluationOther (Please type your answer)Other (specify)Other (Please type your answer)Evaluation Question*Define the key question(s) that the evaluation will address. Indicators / Outcome Measures Select all applicable options from the list below. Use the accordions to review example indicators and outcome measures for each area of interest. Indicators / Outcome MeasuresCommitment to adoptionEvidence of uptakeUser engagement scalesMulti-stakeholder perceptions and experiences of adoptionOther (Adoptability)Indicators / Outcome MeasuresOrganisational readiness for implementation change (ORIC)Implementation leadership scale (ILS)Implementation readiness assessment toolAssessment of organisation context (e.g. implementation climate scale (ICS))Implementation cost and resource availabilityFit into existing workflows and systemsMulti-stakeholder perceptions and experiences of implementation effectivenessOther (Implementability)Indicators / Outcome MeasuresSustainability of work practices questionnaireNormalisation measure development questionnaire (NoMAD)Program sustainability toolsOutcomes and resource allocation beyond initial stageMulti-stakeholder perceptions and experiences of sustainabilityOther (Sustainability)Indicators / Outcome MeasuresOverall well-beingEffect of symptoms or condition (e.g. Strengths and Difficulties Questionnaire)Influence of pain, assessed through pain scalesPresenteeism - being present at work or productivity while unwellAbsenteeism - being absent from work due to illness or health concernsRequirement for medications, tests and therapiesPatients' understanding of their condition and their ability to manage it (e.g. Patient Empowerment Index/score)Symptom improvement (e.g. global rate of change)Rates of resolution or recoveryImprovement in medical test results (e.g. blood pressure or glucose)Recovery times or time to a specific target or cureChanges in quality of life (e.g. Short Form 36 and 12 v2, EuroQol 5D)Locally developed or validated patient reported outcome measures (PROMs)Visits to the emergency department, hospital, or general practitionerRates of re-referral, readmission, representation, or revisionTotal referrals to other healthcare professionals or medical specialtiesChanges in patient adherence scoresOther (Effectiveness)Indicators / Outcome MeasuresDiagnostic accuracySensitivity and specificityDiagnostic yieldMissed or delayed diagnosisMisdiagnosisAppropriate escalation of careSurgical conversion ratesIncidence of errorsCompliance with guidelines, protocols, and standards of careConsistency and concordance in triage, decision-making, investigations, management, surgical necessity, and discharge planning decisionsInter-rater reliabilityAssessment of healthcare quality and appropriateness in medical care, medication management, and documentationMortalityMorbidityOccurrence of complications, adverse events, or incidentsImpact and severity of side effects or eventsClinical governanceCoordinated careCollaborationOther (Safety)Indicators / Outcome MeasuresAccessibility and convenience of careOrganisation and process from referral to dischargeAppointment durationClinician knowledge and skillsInterpersonal communication (trust, rapport, listening, and explanation skills)Cost of receiving carePerceptions of treatment outcomesSymptom improvementReassuranceTreatment and management strategiesRelational continuityInformation continuityManagement continuityAppointment attendance and retentionSatisfaction surveysRate of patients requesting second opinionLocally developed patient reported experience measures (PREMs)Other (Patient-centredness)Indicators / Outcome MeasuresPerspectives and experiences of healthcare professionalsHealthcare system expectations and experiencesAssessing impact on healthcare networksOther (Healthcare provider/system experience)Indicators / Outcome MeasuresTime to consultationTime to diagnosisTime to planned treatmentTime from diagnosis to initiation of treatmentTime to dischargeTime to referral to a specialist or additional servicesTime to access essential diagnostic tests or proceduresTime to access diagnostic test resultsNumber of patients on the waitlistReduction in the waitlistAverage waiting time for patientsPatients exceeding recommended wait timesPercentage of patients experiencing delayed carePriority level changes for patients on the waitlistTimeliness of communication with patients on the waitlistWait time for review appointmentsAccess to third next available appointmentOther (Accessibility)Indicators / Outcome MeasuresNumber of referralsNumber of patients removed from waitlistsPatients triaged to model of careProportion of patients eligible for model of careUse of telehealth and virtual consultationsNumber of patients seenOccasions of serviceDischarge ratesNumber of patients requiring escalation or expedited careOther (Service delivery)Indicators / Outcome MeasuresInputs and resource utilisationPersonnel time and costsCosts of provider visitsDiagnostic, treatment, and intervention costsDirect and indirect costsTraining costsCost minimisation (e.g. differences in salaries)Cost-effectiveness analysis (cost in relation to outcomes)Cost-benefit analysis (net benefits - benefits minus costs)Cost-utility analysis (overall measure of value e.g. quality adjusted life years)Measures of willingness to payMarginal rates of substitutionNet monetary benefits (incremental benefit x threshold - incremental cost)Incremental cost-effectiveness ratio (difference in cost divided by difference in outcomes)Lost income due to absence from workMedication expensesGeneral practitioner or specialist visit costsTravel expensesParking costsPersonal expensesOther (Economic evaluation)AdoptabilityCommitment to adoptionEvidence of uptakeUser engagement scalesMulti-stakeholder perceptions and experiences of adoptionSurveys (e.g. adaptation of Lean in healthcare questionnaire (LiHcQ))Observation, interviews, focus groups and administrative dataOther (Adoptability)ImplementabilityOrganisational readiness for implementation change (ORIC)Implementation leadership scale (ILS)Implementation readiness assessment toolAssessment of organisation context (e.g. implementation climate scale (ICS))Implementation cost and resource availabilityFit into existing workflows and systemsMulti-stakeholder perceptions and experiences of implementation effectivenessSurveys, case studies, interviews, checklists, audits, focus groups and administrative dataOther (Implementability)SustainabilitySustainability of work practices questionnaireNormalisation measure development questionnaire (NoMAD)Program sustainability toolsOutcomes and resource allocation beyond initial stageMulti-stakeholder perceptions and experiences of sustainabilitySurveys, case studies, interviews, records and policy reviewsOther (Sustainability)EffectivenessOverall well-beingEffect of symptoms or condition (e.g. Strengths and Difficulties Questionnaire)Influence of pain, assessed through pain scalesPresenteeism - being present at work or productivity while unwellAbsenteeism - being absent from work due to illness or health concernsRequirement for medications, tests and therapiesPatients' understanding of their condition and their ability to manage it (e.g. Patient Empowerment Index/score)Symptom improvement (e.g. global rate of change)Rates of resolution or recoveryImprovement in medical test results (e.g. blood pressure or glucose)Recovery times or time to a specific target or cureChanges in quality of life (e.g. Short Form 36 and 12 v2, EuroQol 5D)Locally developed or validated patient reported outcome measures (PROMs)Visits to the emergency department, hospital, or general practitionerRates of re-referral, readmission, representation, or revisionPlanned and unplannedTotal referrals to other healthcare professionals or medical specialtiesChanges in patient adherence scoresOther (Effectiveness)SafetyDiagnostic accuracySensitivity and specificityDiagnostic yieldMissed or delayed diagnosisMisdiagnosisAppropriate escalation of careSurgical conversion ratesIncidence of errorsCompliance with guidelines, protocols, and standards of careConsistency and concordance in triage, decision-making, investigations, management, surgical necessity, and discharge planning decisionsInter-rater reliabilityAssessment of healthcare quality and appropriateness in medical care, medication management, and documentationMortalityMorbidityOccurrence of complications, adverse events, or incidentsImpact and severity of side effects or eventsClinical governanceCoordinated careCollaborationOther (Safety)Patient-centrednessAccessibility and convenience of careOrganisation and process from referral to dischargeAppointment durationClinician knowledge and skillsInterpersonal communication (trust, rapport, listening, and explanation skills)Cost of receiving carePerceptions of treatment outcomesSymptom improvementReassuranceTreatment and management strategiesRelational continuityInformation continuityManagement continuityAppointment attendance and retentionSatisfaction surveysVisit satisfaction questionnaire (Modified VSQ-9)Service satisfaction scale 30 (SSS-30)Consultation satisfaction survey (CSQ)Rate of patients requesting second opinionLocally developed patient reported experience measures (PREMs)Other (Patient-centredness)Healthcare provider/system experiencePerspectives and experiences of healthcare professionalsAllied health practitionersNursingSupport teamsMedical specialistsGeneral practitionersHealthcare system expectations and experiencesHealthcare leaders, decision, and policy makersAlignment with organisational strategies and goalsAssessing impact on healthcare networksRegulatory and professional bodiesEducation and training institutionsWorkforce and developmentOther (Healthcare provider/system experience)AccessibilityTime to consultationTime to diagnosisTime to planned treatmentTime from diagnosis to initiation of treatmentTime to dischargeLength of stayEpisode of care lengthTime to referral to a specialist or additional servicesTime to access essential diagnostic tests or proceduresTime to access diagnostic test resultsNumber of patients on the waitlistReduction in the waitlistAverage waiting time for patientsPatients exceeding recommended wait timesPercentage of patients experiencing delayed carePriority level changes for patients on the waitlistTimeliness of communication with patients on the waitlistWait time for review appointmentsAccess to third next available appointmentOther (Accessibility)Service deliveryNumber of referralsNumber of patients removed from waitlistsPatients triaged to model of careProportion of patients eligible for model of careUse of telehealth and virtual consultationsNumber of patients seenOccasions of serviceDischarge ratesNumber of patients requiring escalation or expedited careOther (Service delivery)Economic evaluationInputs and resource utilisationPersonnel time and costsCosts of provider visitsPrimary care, specialists, emergency, inpatient, outpatientDiagnostic, treatment, and intervention costsDirect and indirect costsTraining costsCost minimisation (e.g. differences in salaries)Cost-effectiveness analysis (cost in relation to outcomes)Cost-benefit analysis (net benefits - benefits minus costs)Cost-utility analysis (overall measure of value e.g. quality adjusted life years)Measures of willingness to payMarginal rates of substitutionNet monetary benefits (incremental benefit x threshold - incremental cost)Incremental cost-effectiveness ratio (difference in cost divided by difference in outcomes)Lost income due to absence from workMedication expensesGeneral practitioner or specialist visit costsTravel expensesParking costsPersonal expensesOther (Economic evaluation)Baseline*Provide initial baseline data (if applicable) for each indicator or outcome measure.Target*Set targets (if applicable) for each indicator or outcome measure to monitor progress over time.Data Sources*Specify the sources from which the data will be obtained.Data Collection Method*Describe the methods for collecting the data.Timeline*Outline a timeline with key milestones and deadlines for each stage of the evaluation.Priority*Assign a priority level to this evaluation task.LowMediumHighWho is Responsible*Assign specific individuals or teams to manage this evaluation task.BackPrintThis field should be left blank