The implementation phase which is being monitored and assessed within Work Package 5 lasts one year (September 2013 - September 2014). The baseline questionnaires were administered in September 2013 and the endline questionnaires will be administered in September 2014.
Additionally, self-assessment tools for the monitoring process were provided to the Healthcare Organisations (HCOs), to use them on a voluntary basis between the baseline and the endline questionnaire.
For more information about the monitoring and assessment of Work Package 5 Implementation Process please look at the following.
Baseline and Endline Questionnaires
The evaluation component focuses on the feasibility and transferability of implementing the Safe Clinical Practices (SCPs) selected in Work Package 5 (WP5) according to their description provided in the WP5 Tool Boxes. For this reason the central question is whether the practices were implemented as proposed in the tool boxes with the tools proposed and if not, why it was done differently.
Since the implementation phase which can be assessed within PaSQ lasts one year (September 2013 – September 2014), it is of further interest to assess the implementation progress made within this timeframe. To this end, baseline questionnaires were administered in September 2013 and endline questionnaires will be administered in September 2014. There will be one baseline and one endline questionnaire per Safe Clinical Practice to be implemented in Work Package 5 (i.e., 4 baseline questionnaires and 4 endline questionnaires altogether). The questionnaires will be completed online by the coordinators in the Healthcare Organisations (HCOs) for those practices which they are implementing. The coordinators will receive the necessary information from their PaSQ National Contact Points.
It is expected that the HCOs involved in this Work Package will join the project at various levels. In some of the participating countries campaigns or programmes are already underway to implement these practices. Thus, the aim of the baseline questionnaires is to assess the current level of the practice implementation as of the start of the WP5 implementation phase.
The endline questionnaires in September 2014 will be more elaborated. They will contain many of the same questions as the baseline questionnaires but will additionally incorporate more detailed questions on the practice implementation and include new questions on some further aspects.
It is important to note that the contents of the questionnaires (e.g. questions regarding the completion of implementation and process steps) are derived from the descriptions of the Safe Clinical Practices and key tools included in the WP5 Tool Boxes. The HCO coordinators should refer to these contents of the Tool Boxes for further background information when completing the questionnaires.
The following list provides an overview of the evaluation questions for which data will be collected via the baseline and endline questionnaires. Not all of the questions are compatible with all of the practices.
- Were the components of the practice implemented as described in the WP5 Tool Boxes? If not, why not and what was done differently? Which professional groups were responsible? Was the practice implemented electronically or paper-based?
- Were the implementation steps conducted as described in the WP5 Tool Boxes? If not, why not and what was done differently? Which training and communication strategies were used?
- Which implementation progress in relation to the following categories was made within one year’s time: Areas where the practice was implemented; patient groups for which the practice was implemented; implementation steps; practice components? Additionally, a measure of successful practice implementation provided at baseline and endline will be compared.
- To what extent did the HCO coordinator perceive support for the practice by the management?
- To what extent did the HCO coordinator perceive satisfaction with the practice by the involved professional groups?
- Were the WP5 Tool Boxes helpful in the implementation process? If so, which components and tools were helpful? If not, why not? Which further implementation tools did the HCOs use?
- Which activities were undertaken to ensure that patient involvement is an integral part of the practice?
- Which resources were needed for beginning the implementation? Which resources are needed to sustain?
- Which barriers and facilitators were encountered in the implementation process?
- Which impact of the practice on organizational culture, process quality and patient outcomes was perceived by the HCO coordinator? Which indicators were used in the HCO to objectively measure the impact of the practice?
- Which benefits were seen as a result of participating in the PaSQ project?
- How satisfied was the HCO coordinator altogether with the practice implementation?
After final data analysis at the end of 2014, a report summarizing the implementation experiences of the participating HCOs will be produced and disseminated.
Self-Assessment Tool for the Monitoring Process
The coordinators in the Healthcare Organisations were provided with self-assessment tools for the monitoring process in March 2014, to use them on a voluntary basis between the baseline and the endline questionnaires. There is one self-assessment tool per Safe Clinical Practice (SCP) to be implemented in Work Package 5 (i.e., 4 self-assessment tools for the monitoring process altogether). The coordinators in the HCOs received the necessary information from their PaSQ National Contact Points.
The aim of the self-assessment tools is, to help the HCOs in the ongoing implementation process through supplying a material that will let them be aware of their achievements so far regarding the SCPs. The use of the tools is voluntary for the HCOs and for their internal use only.
The contents of the self-assessment tools are derived from the baseline questionnaires which were based on the descriptions of the Safe Clinical Practices and key tools included in the WP5 Tool Boxes. The HCO coordinators should refer to these contents for further background information when using the self-assessment tools.
The tools for the monitoring process are available as fillable PDF-forms. The answers can be completed electronically. The filled forms can be saved on the computers and assigned with the dates. Responding to the questions in each tool takes approximately 10 to 15 minutes.
For the self-assessment tools for the monitoring process, click on the following links for the corresponding SCPs:
- PDF self-assessment tool PEWS
- PDF self-assessment tool MedRec
- PDF self-assessment tool Checklist
- PDF self-assessment tool HH