Departmental Evaluation Plan: Fiscal years 2023 to 2024 until 2027 to 2028

Office of the Chief Audit, Evaluation and Risk Executive

On this page

• 1. Introduction
• 2. Key accomplishments in the 2022-to-2023 fiscal year
• 3. Annual evaluation planning exercise
• Annex 1: Planned evaluation projects between fiscal years 2023 to 2024 and 2027 to 2028
• Annex 2: Programs excluded from the 2023 to 2028 Plan

1. Introduction

The Office of the Chief Audit, Evaluation and Risk Executive (OCAERE) of Public Services and Procurement Canada (PSPC) integrates 3 departmental oversight functions: internal audit, evaluation and integrated risk management.

The mission of the Evaluation Services Directorate (ESD), located in the OCAERE, consists of providing evaluation and advisory services of high quality and timeliness to facilitate decision-making, help to improve policies and programs, and ensure accountability.

This document presents the Departmental Evaluation Plan (the Plan) for PSPC for fiscal years starting in 2023 to 2024 and ending in 2027 to 2028, developed in compliance with the requirements of the Treasury Board (TB) Policy on Results (2016) and the Financial Administration Act.

Plan development

The update of the Plan was carried out at the same time as the Departmental Risk-Based Audit Plan updating, both under the supervision of the Chief Audit, Evaluation and Risk Executive. The objective was not only to promote better synergy between the 2 functions, but also to reduce, as much as possible, the burden of this exercise on the stakeholders. To achieve this, the following activities in the Plan were carried out in collaboration with Controls Services Directorate of the Finance Branch, which is considered as a new feature this year:

• planning and conducting joint consultations (approximately 17) with Departmental senior management
• aligning evaluation and audit timelines with respect to governance and joint development of presentations to selected committees
• identifying joint projects audit and evaluation

A preliminary list of evaluation projects for years 2023 to 2024 up to years 2027 to 2028 was presented to the Performance Measurement, Evaluation and Results Committee (PMERC) for senior management review and feedback. Subsequently, the Plan was shared with the Evaluation Advisory Committee (EAC) and then with the PMERC for recommendation to the Deputy Minister for approval. The Treasury Board of Canada Secretariat was also consulted in the preparation of the Plan.

Types of evaluation services

The ESD applies the flexibility provided by the Policy on Results and offers different types of evaluations to meet the information needs of senior management. Both mandatory and discretionary evaluations are most often conducted at PSPC.

Mandatory evaluations: Evaluations of programs or initiatives that must be implemented at specific times in accordance with commitments made in TB submissions. In addition, horizontal evaluations led by other departments in which PSPC is involved as well as assessments conducted in compliance with policy requirements, such as the neutral assessment of the evaluation function.

Discretionary evaluations: Evaluation of programs, internal services, policies and priorities for which the evaluation schedule is based on an analysis of risks and senior management needs and priorities.

In addition to conducting evaluations, the ESD supports supplementary activities relating to performance measurement, research, data analysis and special targeted studies intended to support the department in an effective and timely manner. The ESD also has resources dedicated to professional practices to conduct activities that strengthen the ESD. Apart from planning, reporting and liaison activities with federal institutions, the objective of the professional practices component is to develop tools to promote innovation and efficiency within the evaluation team.

Evaluation services directorate human resources

As of April 2023, the evaluation team comprised 9.2 full-time equivalent (FTE) positions.

Table 1: Number of full-time equivalents as of April 2023

Classification and Level	Number
EX-01	1
EC-07	2.2
EC-06	1
EC-05	2
EC-04	1
EC-03	2
Total number of FTEs	9.2

2. Key accomplishments in the 2022-to-2023 fiscal year

As illustrated in the table below, the ESD worked on a total of 8 evaluation projects over the course of the 2022-to-2023 fiscal year. With regards to PSPC led projects, the ESD started one project (Evaluation of the Accessible Government Built Environment Initiative) while continuing work on 2 projects carried forward from the previous year (Evaluation of PSPC’s Use of Selected Consulting Services and Review of the Space Envelope Regime). Additionally, PSPC provided support to 5 horizontal evaluations in fiscal year 2022 to 2023 at different stages of conduct.

Table 2: Evaluation projects conducted in the 2022 to 2023 fiscal year

Evaluation project	Evaluation rationale	Evaluation phase as of April 2023	Launch date	Planned Deputy Minister approval date
Evaluations at Public Services and Procurement Canada
Evaluation of PSPC’s Use of Selected Consulting Services	Discretionary evaluation	Approval	Quarter (Q) 4 2020 to 2021	Q2 2022 to 2023
Review of the Space Envelope Regime	Discretionary evaluation	Approval	Q1 2021 to 2022	Q1 2023 to 2024
Evaluation of the Accessible Government Built Environment Initiative	Mandatory evaluation	Data collection and analysis	Q2 2022 to 2023	Q3 2023 to 2024
Contribution to horizontal evaluations carried out by other Government of Canada departments
Horizontal evaluation of the Federal Leadership Towards Zero Plastic Waste in Canada Initiative led by Environment and Climate Change Canada	Mandatory evaluation	Approval	Q3 2020 to 2021	Q3 2022 to 2023
Horizontal Evaluation of the Action Plan for Official Languages led by Canadian Heritage	Mandatory evaluation	Approval	Q3 2020 to 2021	Q3 2022 to 2023
Horizontal Evaluation of the Canadian Drugs and Substances Strategy (including the Substance Use and Addictions Program, and Opioid) led by Health Canada	Mandatory evaluation	Approval	Q2 2022 to 2023	Q1 2023 to 2024
Horizontal Evaluation of the National Strategy to Combat Human Trafficking led by Public Safety Canada	Mandatory evaluation	Planning	Q4 2022 to 2023	Q1 2024 to 2025
Horizontal Evaluation of the Federal Contaminated Sites Action Plan – Phase IV led by Environment and Climate Change Canada	Mandatory evaluation	Planning	Q4 2022 to 2023	Q4 2023 to 2024

Reconciliation framework

In addition to the evaluations conducted in 2022 to 2023, the ESD completed a reconciliation framework to integrate Indigenous perspectives into its evaluations. In February 2023, ESD presented key items of the framework to the EAC. The framework was elaborated to assist PSPC evaluators in incorporating Indigenous perspectives into evaluation design and in considering Indigenous worldviews and/or capacity building at key points in the evaluation cycle. This work demonstrates the ESD’s commitment to transform the current design of evaluation practices at PSPC by focusing more and more on joint development and creative models with Indigenous partners in its evaluation projects.

3. Annual evaluation planning exercise

PSPC has prepared its 5-year plan in consideration of Treasury Board of Canada requirements as well as Treasury Board of Canada Secretariat guidance. For departmental planning purposes, the first year of the plan (fiscal year 2023 to 2024) represents the strongest commitments to the subject matter and timing of ESD projects. Subsequent years (years 2 through 5) provide a tentative projection of the mandatory and discretionary engagements that ESD anticipates to implement while recognizing that the timing and focus of evaluations may change based on future needs and stakeholder consultations.

For the 2023-to-2024 fiscal year, the ESD anticipates completing 5 carry-forward engagements (1 mandatory evaluation; 1 advisory service; and 3 mandatory horizontal evaluations) while launching 4 engagements (2 mandatory evaluations; 1 mandatory neutral assessment and 1 advisory service (2 case studies, of which 1 may have an Indigenous Engagement aspect, funded for 2023 to 2024 to support a mandatory horizontal evaluation)). Resources are not currently available for the 2023 to 2024 fiscal year to conduct discretionary evaluations.

Over the proposed 5 year period covered by this plan, a total of 28 evaluation projects are expected to be initiated and completed between fiscal year 2023 to 2024 and fiscal year 2027 to 2028. Amongst the 28 evaluation projects, PSPC will support 7 mandatory evaluations; 13 discretionary evaluations; 5 horizontal evaluations; 2 advisory service and 1 neutral assessment. Table 3: Number of evaluation projects by projected fiscal year start date presents the number of evaluation projects by type to be started each fiscal year while Table 4: Number of evaluation projects in progress by fiscal year presents the total number of evaluation projects by type which will be in progress each fiscal year.

Table 3: Number of evaluation projects by projected fiscal year start date

Evaluation project type	2023 to 2024	2024 to 2025	2025 to 2026	2026 to 2027	2027 to 2028
Mandatory evaluations (TB submission requirement)	2	4	0	0	0
Neutral assessment of the evaluation function	1	0	0	0	0
Discretionary evaluations	0	3	6	2	2
Advisory services	1	0	0	0	0
Total number of PSPC projects	4	7	6	2	2
Mandatory horizontal evaluations	0	0	0	1	1
Total number of projects	4	7	6	3	3

Table 4: Number of evaluation projects in progress by fiscal year

Evaluation project type	2023 to 2024	2024 to 2025	2025 to 2026	2026 to 2027	2027 to 2028
Mandatory evaluations (TB submission requirement)	3	6	4	0	0
Neutral assessment of the evaluation function (Policy on results requirement)	1	1	0	0	0
Discretionary evaluations	0	3	9	9	4
Advisory services	2	0	0	0	0
Total number of PSPC projects	6	10	13	9	4
Mandatory horizontal evaluations	3	1	0	1	2
Total number of projects	9	11	13	10	6

Annex 1: Planned evaluation projects between fiscal years 2023 to 2024 and 2027 to 2028 details the planned evaluation projects to be carried out by the ESD during the 5-year period identified for the Plan. The start dates identified for the evaluation projects are listed in the anticipated quarter in which evaluation plans (Terms of Reference and Framework) will be presented to the EAC for approval. End dates identified for evaluation projects indicate the quarter in which final reports and management action plans are anticipated to receive Deputy Minister approval.

Annex 2: Programs excluded from the 2023 to 2028 plan details the justifications for departmental programming not included as part of this planning exercise. 5 departmental programs (equivalent to approximately 4% of departmental expenditures) were not included in the 5-year project plan due to their low evaluation priority.

Annex 1: Planned evaluation projects between fiscal years 2023 to 2024 and 2027 to 2028

Annex 2: Programs excluded from the 2023 to 2028 plan

Payments and collection of revenues (2.92% of departmental planned program spending in 2023 to 2024)

The purpose of this program is to ensure the integrity of the Treasury for Canadians as well as to develop and maintain the Receiver General’s treasury systems. The Receiver General program was evaluated in 2015 to 2016. Consequently, the priority for evaluating this program is low, unless there is a major change in the program’s design. Modernization activities are currently underway and evaluation requirements may be reviewed as part of future annual planning exercises.

Government-wide accounting and reports (0.4% of departmental planned program spending in 2023 to 2024)

This program helps to ensure maintenance of the accounts of Canada and the Chart of Accounts at the federal administration level as well as the production of the Public Accounts of Canada, including the audited consolidated annual financial statements and the Monthly Statements of Financial Operations for the Government of Canada. The Receiver General program was evaluated in 2015 to 2016. Consequently, the priority for evaluating this program is low, unless there is a major change in the program’s design. Modernization activities are currently underway and evaluation requirements may be reviewed as part of future annual planning exercises

Government information services (0.4% of departmental planned program spending in 2023 to 2024)

This program sector supports the services providing information to Canadians and government institutions on Government of Canada programs and publications. The activities of this program have not changed much over the years and remain relatively stable. However, the evaluation requirements will be reviewed at the appropriate time, given the communication modernization project underway.

Asset disposal (0.1% of departmental planned program spending in 2023 to 2024)

The asset disposal program includes GCSurplus (GCSurplus.ca, GCMil, GCTransfer and GCRecycle) and the management of seized goods. With the last evaluation dating back to 2017 to 2018, the priority for evaluating this program is low, unless there is a major change in the program’s design. Modernization efforts are currently being proposed. We will monitor the implementation of the modernization initiative and will determine the need for an evaluation in future annual updates of the Departmental Evaluation Plan.

Canadian General Standards Board (0.04% of departmental planned program spending in 2023 to 2024)

The Canadian General Standards Board is a centre of expertise within the Government of Canada that develops and updates national standards and provides certifications for personnel, products and organizations. Since the last official evaluation dates back to 2008, the program conducted a validated self-evaluation in 2016 to 2017. The priority for evaluating this program is low, unless there is a major change in the program’s design.