Evaluation of Providing Services and Information to Canadians through Service Canada

On this page

Alternate formats

Evaluation of Providing Services and Information to Canadians through Service Canada [PDF - 1.34 MB]

Large print, braille, MP3 (audio), e-text and DAISY formats are available on demand by ordering online or calling 1 800 O-Canada (1-800-622-6232). If you use a teletypewriter (TTY), call 1-800-926-9105.

List of figures

Figure 1: Service Canada’s service tiers
Figure 2: Access to pensions Specialized Call Centres, 2014 to 2015 to 2018 to 2019
Figure 3: Number of new and returning visitors to the Canada Pension Plan Retirement Pension website, December 2015 to April 2019
Figure 4: Use of channels by client need (stage of the client journey)
Figure 5: Number of channels used by client need (stage of the journey)
Figure 6: Channel mobility by client need
Figure 7: Client satisfaction by number of contacts with Service Canada
Figure 8: Information accuracy (%), 1 800 O-Canada
Figure 9: Employee satisfaction with reference tools
Figure 10: Employee satisfaction with training
Figure 11: Digital services barriers experienced by clients as reported by employees (percent of survey respondents who reported the following barriers)

List of tables

Table 1: Outreach to Indigenous communities in 2018 to 2019
Table 2: Percentage of Employment Insurance, Old Age Security, and Canada Pension Plan mobile outreach events by target audience, April 2018 to March 2019
Table 3: First Nations reserves’ access to broadband Internet services (2011)

Executive summary

Evaluation purpose

This horizontal evaluation assesses the relevance and performance of Service Canada’s provision of general information and services (Tier 1) through 3 channels (in-person, telephone, and online) and the provision of personalized information and services (Tier 2) for the Canada Pension Plan Retirement Pension.

The evaluation focuses on the delivery of information and services for Employment Social Development Canada ’s 3 main statutory programs: Employment Insurance, Old Age Security, and the Canada Pension Plan Retirement Pension.

In particular, this evaluation assesses Service Canada’s contributions to ensuring clients’ ability to access timely services, and sufficient and accurate information through the service delivery channel that best meets their needs. It addresses key questionsFootnote 1 on the continued need for the services and information provided through the 3 channels; whether service delivery activities provide Canadians with easy, timely access to accurate information and services; and whether any barriers are encountered by different demographic groups.

Scope and methodology

The evaluation covers fiscal yearsFootnote 2 2014 to 2015 to 2018 to 2019 and provides evidence regarding results under Employment Social Development Canada’s core responsibility related to “information delivery and services for other departments”Footnote 3. This evaluation used a Gender-Based Analysis Plus lens to inform data collection and analysis, including by assessing how diverse groups of people may experience programs and initiatives differently.

Evaluation findings are based on 8 lines of evidence, as well as results from Service Canada’s Client Experience Survey (2017). Efforts were made to gather detailed and client-specific information on the Canada Pension Plan Retirement Pension. In some cases, this information provides the basis for generalizable findings relevant to client needs regarding the delivery of other programs.

Key findings and conclusions

Service Canada is meeting most client needs for access to services and general information, although challenges exist with timeliness and access to Specialized Call Centres

Most clients are able to access the services and general information they need through their preferred service delivery channel (in-person, telephone, and internet), in a timely manner, in the official language of their choice, and with a high level of client satisfaction.

For instance, results from Service Canada’s Client Experience Survey (2017) indicate high satisfaction rates with services among clients of the main statutory programs: Canada Pension Plan (87%); Old Age Security (86%); and Employment Insurance (83%).

Some exceptions include timeliness and accessibility challenges through specialized call centres. Key concerns related to access include high numbers of callers receiving High Volume MessagesFootnote 4 and being rerouted to an Interactive Voice Response system, and increased wait times and abandoned calls to Canada Pension Plan/Old Age Security Specialized Call Centres.

Movement between channels reflects that the service delivery model is functioning as designed, with many clients using multiple channels to obtain the information they are searching for. For instance, most clients reported using the in-person (44%); Web channels (39%); and telephone (10%) when seeking general information about a benefit or a program, according to the Service Canada Client Experience Survey (2017) results. The same survey found that most clients also apply for programs or benefits through the in-person (53%) or Web/mail channels (37%). The telephone (43%) and in-person (41%) channels are used more frequently than the Web channel (14%) for follow-up. Finally, clients seeking to solve problems tend to use the highest number of channels.

However, client satisfaction decreases on average as the number of times a client has to contact Service Canada increases. Some movement between channels could be resulting from clients’ inability to access required services/information at first contactFootnote 5. This was the case particularly for clients belonging to potentially vulnerable groups, who were not comfortable using the online channel, and preferred to obtain in-person assistance.

Regarding Specialized Call Centres, Report 1 of the 2019 Spring Reports of the Auditor General of Canada identified similar challenges and included recommendations for which the department will be undertaking the following actions:

Since the department has initiated efforts to address the concerns raised pertaining to Specialized Call Centers, additional recommendations are not required for this key finding.

Canadians need and expect improved information to support informed and optimal decision-making regarding complex programs such as the Canada Pension Plan Retirement Pension

General program information related to the Canada Pension Plan Retirement Pension, available through all channels, is not sufficient to support clients’ optimal decisions with respect to their Retirement Pension. For example, individuals must have personalized information such as how much they have contributed to the Canada Pension Plan over the contributory period and what their estimated benefit is in order to understand how this benefit amount might be affected by the various pension provisions including the age when they begin their pension.

However, personalized information is available through the Canada Pension Plan/Old Age Security Specialized Call Centres and “My Service Canada Account” online. In addition, only 31% of surveyed clients accessed their estimated benefits, 22% accessed their Statement of Contribution, and only 19% used the Canadian Retirement Income Calculator.

Clients were also found to lack knowledge of program details. For example, only 32% looked for information about the various pension provisions and only 3% of surveyed clients reported consulting a financial professional regarding when they should begin their benefit.

Some Canadians living in rural and remote areas as well as Indigenous people and people with lower levels of education experience barriers to accessing services and information they require

Some population groups experience greater challenges in obtaining services and information that meet their needs, as evidenced by the lower client satisfaction rates among Indigenous people and people with disabilities.

For instance, Client Experience Survey 2017 results indicate that Indigenous respondents had an overall level of satisfaction of 77% compared with 86% for non-Indigenous respondents. Results further indicate that Indigenous clients in general may face more difficulties finding and understanding the information they require, with only 64% of Indigenous clients reporting satisfaction with the ability to find information in a reasonable time compared to 79% of non-Indigenous respondents. In addition, only 73% of Indigenous respondents were satisfied that they understood the requirements of their application for a program or benefit compared to 81% of non-Indigenous clients.

Other population groupsFootnote 6 are at high risk of experiencing a range of non-digital and digital barriers. These population groups may be the least likely to know how to access the services and information needed to meet their needs. For instance, client survey and focus group results indicate that Canada Pension Plan Retirement Pension clients with lower levels of education are less likely to search for and use Government of Canada information to support informed and optimal decision-making. They are also more likely to begin their pension prior to age 65, thereby incurring a lifelong reduction in pension amount.

The literature review indicates that several population groups have a higher likelihood of experiencing digital barriers consistent with the 3 dimensions of Employment Social Development Canada's E-Vulnerability Index: Internet access (infrastructure and cost); comfortability; and competency. For example, some Indigenous people may experience challenges related to all 3 dimensions of e-vulnerability. At the national level, Internet access on all reserves is only 70% compared to 94% among other Canadian households, while access on remote reserves falls to only 57%Footnote 7.

Recommendations

  1. Explore innovative options to meeting clients’ needs for specific, personalized information about their Canada Pension Plan Retirement Pension
  2. Continue to identify and reduce barriers in accessing services and benefits amongst potentially vulnerable populations and explore inclusive approaches to providing those services

Management response and action plan

Overall management response

The Canada Pension Plan is 1 of 3 pillars of Canada’s retirement income system and a key element of the retirement security of Canadians. In fiscal year 2017 to 2018, 5.8 million individuals benefited from the Canada Pension Plan and more than 302,432 individuals applied for their Retirement Pension.

The decision of when to begin receiving the Canada Pension Plan Retirement Pension is complex. It requires clients to consider their Canada Pension Plan contributions and other sources of retirement income, their relative financial wealth, needs, general health and anticipated life expectancy. As indicated in the Canada Pension Plan Retirement Pension Survey, clients “don’t know what they don’t know”. To assist clients in making well-informed decisions about their Canada Pension Plan Retirement Pension, especially in regards to the implications of starting to collect the Retirement Pension at different ages, information and tools are available both to individuals who continue to work and those who will stop working.

The Canadian Retirement Income Calculator tool allows clients to estimate their retirement income. The calculator helps clients better understand how each level of the retirement income system will contribute to their future financial security and to provide a thorough understanding of the public pension system. Likewise, My Service Canada Account is a secured and personalized website that lets clients view their monthly estimated Canada Pension Plan benefits and apply for their Retirement Pension. In addition, through Canada.ca’s Public Pensions link, the department provides information on the Retirement Pension and other Canada Pension Plan benefits. Recently, a number of brief videos have been developed which describe the Canada Pension Plan, and the implications of starting to collect the Retirement Pension at different ages, for both individuals who continue to work and those who stop working. In addition, a letter is sent to clients at age 59 and 64 to inform them of their options. The letter includes the client’s Statement of Contributions to help them estimate their Canada Pension Plan Retirement Pension amount.

The department joined in a Government-wide multi-media advertising campaign targeting seniors, their families and stakeholders. The ad campaign raised awareness of services benefiting seniors, including the Canada Pension Plan, and directed visitors to our informative campaign page: Canada.ca/seniors. The campaign informed and engaged Canadians on how the Canada Pension Plan works to support Canadian retirees and how the program is being strengthened for future generations. As well, to help Canadians make informed decisions about their retirement, in spring 2019, the Public Affairs and Stakeholder Relations branch engaged working Canadians aged 30 to 59 on the Canada Pension Plan deferral and Canada Pension Plan enhancements through our “It’s Your Choice-Canada Pension Plan Marketing Campaign.” Using innovative communications tools, the campaign built increased awareness by generating more than 15,000 Facebook impressions, nearly 150,000 Twitter impressions, more than 40,000 LinkedIn impressions, almost 7,000 video plays and collecting close to 4,500 responses to a quiz gauging comprehension of key messaging.

Management recognizes that even with the current information, tools, and campaigns, clients face challenges in understanding the intricacies of the Canada Pension Plan to make the optimal decision as to when they should take their Retirement Pension. Through continuous improvements, the department will keep on developing and improving its information, tools and services to meet client’s needs.

Recommendation #1

Explore innovative options to meeting clients’ needs for specific, personalized information about their Canada Pension Plan Retirement Pension.

Management response

Management agrees with Recommendation #1. Given the complexity of the Canada Pension Plan Retirement Pension, the department recognizes that some clients will need more information to help them to make informed and optimal decisions by providing them with sufficient information early on. This includes helping clients increase their knowledge of the program and how it relates to their personal situation, accessing key information and tools to make the best decision possible as to when to take their pension, especially for clients with lower levels of education.

Currently, Benefits Delivery Services in cooperation with the Citizen Services Branch and Income Security and Social Development Branch continues to refine the Canada Pension Plan Retirement Pension Web pages on Canada.ca for ease of navigation, use of plain language, and organization of client-centric information. Since the evaluation period, Benefits Delivery Services has started to assess the possibility to personalize its letters to provide more detailed information on options. As presented in the management action plan table that follows, beginning in fiscal year 2019 to 2020 and moving forward in fiscal year 2020 to 2021, Benefits Delivery Services, in consultation with Income Security and Social Development, will explore innovative options to meet clients’ needs for specific, personalized information on their Canada Pension Plan Retirement Pension options.

Management action plan

1.1 Improve our communications with clients by continuing to update Canada Pension Plan Retirement Pension Web information and letters and forms. Assess the possibility to provide more client centric information in communications with clients, including outlining what options are available to clients and the potential implications of those options. This will include a review of international best practices to inform this assessment.

Completion date: March 2021

Recommendation #2

Continue to identify and reduce barriers in accessing services and benefits amongst potentially vulnerable populations and explore inclusive approaches to providing those services.

Management response

Consistent with the evaluation findings, the factors for non-participation are diverse and it is important to consider how social, personal and overlapping circumstances can exacerbate them. Thus, the quantitative and qualitative portions of the 2019 to 2020 Client Experience Survey project will explore these issues to improve our understanding and inform measures to address them. To date, we are identifying best practices in our outreach to remote and reserve communities, and pilots are underway in 6 cities.

Management action plan

2.1 Target the quantitative and qualitative components of Employment Social Development Canada’s third annual Client Experience Survey, to generate actionable insights to the barriers and challenges experienced by Service Canada clients.

Completion date: Summer/Fall 2020

2.2 Conduct targeted outreach pilots in 6 urban Indigenous communities through the Indigenous Outreach Program, to assess the effectiveness of various models in reaching vulnerable populations in urban settings.

Completion date: Winter 2020

1 Introduction

1.1 Evaluation objectives and scope

The evaluation addresses the following overarching questions:

  1. to what extent is Service Canada meeting clients’ needs by providing information and services that are accurate and easy to understand, timely, and easy to access through its 3 service delivery channels?
  2. do various population groups experience any specific barriers with regard to their use of the 3 channels?

Appendix A presents the full list of evaluation questions which were approved by the Performance Measurement and Evaluation Committee on July 13, 2016.

The evaluation takes a horizontal approach to understanding Service Canada’s contributions to client outcomesFootnote 8 by examining the provision of services and information for 3 major statutory programs (Employment Insurance, Old Age Security, and Canada Pension Plan Retirement Pension) through the 3 main service delivery channels (in-person, telephone, and Internet).

The evaluation covers fiscal years 2014 to 2015 to 2018 to 2019 and includes general information and services provided through Tier 1 services for the 3 main statutory programs. The evaluation also assesses the provision of personalized information and services for Canada Pension Plan Retirement Pension as provided through Canada Pension Plan/Old Age Security Specialized Call Centres in Tier 2. Figure 1 outlines the multi-channel, multi-tier model.

Figure 1: Service Canada’s service tiers

Figure 1

Source: Adapted from Service Canada, In-Person Operations (2017).

Figure 1: text description

An image depicting Service Canada’s Multi-Channel Service Delivery Model at the time of the evaluation reference period. From left to right, a box representing clients abuts 3 boxes representing the 3 Tier 1 service delivery channels. From top to bottom, these boxes represent Canada.ca, 1 800 O-Canada, and Service Canada Centres/Community Outreach and Liaison Service. Each box has a list of services offered to clients through the channel in question.

Canada.ca:

  • information about programs
  • links to tool and online application forms
  • video tutorials for selected programs
  • search engine

1 800 O-Canada:

  • needs assessments
  • general information about Government of Canada programs
  • teletypewriter service for the deaf and speech-impaired
  • pathfinding
  • referrals
  • promotion of self-service tools
  • mail out information packages/brochures

Service Canada Centres and Community Outreach and Liaison Services include:

  • needs assessments
  • general information about Government of Canada programs (bundling)
  • promotion of self-serve tools (Web)
  • assisted services for people with special needs
  • warm transfer to Tier 2 call centres
  • application intake and review for completeness
  • client file account maintenance
  • validation of citizenship documents
  • Social Insurance Number issuance
  • collect fees (debts)
  • claimant information sessions
  • hosting Social Security Tribunals hearings

An arrow pointing to the right shows the flow of some client inquiries from Tier 1 services to Tier 2 services. A box represents Specialized Call Centres, and lists the services provided:

  • entitlement/eligibility determination
  • authentication of applicants
  • payment issuance
  • client call backs
  • account maintenance
  • provide explanations to clients
  • escalate issues to Tier 3

Another arrow pointing to the right shows the flow of some client inquiries from Tier 2 services to Tier 3 services. The arrow points to a box with a list of Tier 3 services:

  • policy interpretation
  • liaison with policy department
  • appeals
  • decision on complex cases

A box runs below the entire image. It lists the following activities that support the 3 service tiers:

  • client segment research and analysis
  • tracking and reporting capabilities
  • proactive mail-outs
  • quality management
  • marketing
  • other support services
  • client satisfaction measurement
  • client feedback analysis

1.2 Methodology

This evaluation used multiple lines of enquiry to assess Service Canada’s contributions to clients’ ability to access timely services and sufficient and accurate information through the service delivery channel that best meets their needs. By way of examining the Canada Pension Plan Retirement Pension in detail, specific findings were used to further bolster general findings presented in this report. Some of these findings were found to be relevant to client needs regarding the delivery of other programs.

A Gender-Based Analysis Plus lens was applied to this evaluation to inform data collection and analysis, and to assess any difference in needs and barriers in the delivery of services and information across diverse groups of people. Issues related to determination of eligibility for benefits, as well as the accuracy of payments, are outside the scope of the evaluation.

8 lines of evidence, and 1 study conducted by Service Canada support the evaluation findings found in this report:

This evaluation also used evidence from Service Canada’s Client Experience Survey – a 2017 Service Canada survey of 4,000 clients of 6Footnote 10 Employment Social Development Canada programs about their experiences and satisfaction with their client journey.

Refer to Appendix B for a more detailed description of the evaluation methods used, including the 8 lines of evidence.

Refer to Appendix C for a list of the 8 corresponding technical reports (available upon request) that informed this interim report.

2 Service transformation and delivery through Service Canada

2.1 Service transformation

For nearly half a century, the Government of Canada has been working toward improving how it delivers services to the publicFootnote 11. At the same time, service delivery in the private sector has evolved rapidly through ever-advancing technologies. Clients increasingly expect the delivery of government services to keep pace – digital, easy to access, available at any time, and accompanied by timely assistanceFootnote 12,Footnote 13. Currently, there is a trend whereby Canadians are “more critical in and demanding of their interactions with government and business, putting pressure on [client] satisfaction”Footnote 14.

In a context of changing constraints and priorities on cost-efficiency, a global move towards increased use of modern digital services, and the changing expectations and demands of clients, Employment Social Development Canada has committed to transforming its service delivery approach to enhance the service experience. 1 of Employment Social Development Canada’s major undertakings over the past decade has been to improve the delivery of Employment Insurance. Noteworthy is that the evaluation of Employment Insurance Automation and ModernizationFootnote 15 and the Employment Insurance Service Quality ReviewFootnote 16 recommended the enhancement of the antiquated technology systems being used. Employment Social Development Canada’s response to these findings included new financial investments in specialized call centres and processing.

These efforts are ongoing and range from broad initiatives spanning multiple programs, such as Benefits Delivery Modernization, to more program-specific strategies, such as the Old Age Security and Canada Pension Plan Service Improvement Strategies. The Service Improvement Strategies have identified potential cost savings by way of modernizing information technology infrastructure, automation and e-services to Canadians. Information technology and e-service transformation activities are intended to address risks such as aging infrastructure, potential increased costs of delivering services, and the potential inability to meet future service demand. Implementation risks, such as service disruptions, are also possible.

Other innovative examples include outreach visits by Service Canada to all Indigenous communities in 2016 and 2017 to provide services and information on Canada Child Benefit applications. Budget 2018 provided additional funds to support outreach to all Indigenous communities, in order to increase uptake and reduce barriers related to service and information delivery that Indigenous people may face when trying to obtain benefits. As a result, over 700 Indigenous communities are engaged each year through Community Outreach and Liaison Service and visited at the request of the community.

The Employment Social Development Canada Service Strategy (2016) is the current key strategic planning document that covers all of the department’s service delivery modernization initiatives. It supports government wide service priorities and policy work on improving service delivery by aiming to modernize services in line with Canadians’ expectations through the following principles:

The department’s multi-year Service Transformation Plan (2017) outlines short, medium, and long-term opportunities and key goals including increased access, experience, timeliness and quality in service delivery. Through the use of design thinking in consultation with clients, employees, and private-sector experts, client-centric solutions have been identified under the following 5 themes:

The Service Transformation Plan aims at a future in which clients receive world class, high quality, timely services wherever they are in Canada, supported by dedicated Service Canada employees. The plan indicates that such enhanced client-centric service delivery will help Employment Social Development Canada achieve policy and program results, and ultimately build trust in government.

Solutions and improvements are underway in each service delivery channel and tier. Initiatives include website updates, new call centre systems, and re-organized outreach efforts through Community Outreach Liaison Services in a manner which improves access for clients.

Online, Canada Pension Plan and Old Age Security clients can now access more self-serve options, such as viewing account information related to benefit payments, requesting a child rearing provision, and giving consent to authorize individuals to communicate on the client's behalf. Additional transformation activities are planned or ongoing.

In addition to these transformation efforts, the department is developing the Call Centre Improvement Strategy to frame the transformation plan for Specialized Call Centres (Tier 2). This strategy is a transformation initiative that will leverage industry best practices and implement ongoing business and technology improvements to increase accessibility and enhance services to clientsFootnote 17.

Finally, Employment Social Development Canada and Service Canada have also been producing research on the client journey, client experience, and service delivery for population groups at higher risk of being vulnerable. These research activities are conducted in support of transformation initiatives and to help inform future service improvements.

Administrative documents indicate that the Service Management Committee sets strategies and priorities for service delivery across the department. Responsibilities include overseeing service transformation, ensuring alignment between policy and service delivery, making decisions related to the department’s service delivery mandate, and monitoring performance related to service delivery and service transformation. The Service Transformation Committee oversees implementation of the Service Strategy and Service Transformation Plan at the Assistant Deputy Minister level.

Although the service transformation initiatives form an important part of the context in which the evaluation is conducted, they are not themselves under evaluation in this project.

2.2 Service delivery through Service Canada

Introduced in 2005, Service Canada provides an integrated location where Canadians can access services and information for Employment Social Development Canada’s main statutory programs through in-person Points of Service, online or over the phone. Service Canada is the service delivery business line of Employment Social Development Canada and provides information about government organizations, programs, services, events and initiatives, including information on public consultation and citizen engagement activities.

Service Canada is a large, complex operation. Its channels differ in role, mandate, and activities, despite their overarching focus on clients, as illustrated in Figure 1Footnote 18.

General information and services across the channels (Tier 1)

For the 3 main statutory programs, general information and services (Tier 1) can be accessed through:

In addition, the department proactively reaches out by mail to Canadians aged 64 years and 1 month regarding their eligibility for several benefits for which they may be eligible including Canada Pension Plan Retirement Pension, Old Age Security, and Guaranteed Income Supplement.

There are some differences between the channels in the provision of general services. For example, 1 800 O-Canada is limited to providing general information and making referrals as appropriate. In-person Citizen Service Officers may also provide additional services such as assisting clients with special needs, processing account maintenance (for example, address changes), and providing a transfer to Specialized Call Centres (Tier 2). In addition, 2 Employment Insurance transactions have recently been delegated to in-person Citizen Service Officers providing increased authority as part of the First Point of Contact Resolution initiative.

Personalized information and services across the channels (Tier 2)

Tier 2 information and services are those specific to clients’ personal files for the 3 main statutory programs. Clients can access these services and information directly through Specialized Call Centres and online through the secure My Service Canada Account portal. Specialized Call Centre agents can address informational and transactional enquiries that require detailed program knowledge and access to the client’s file. Examples include decision status enquiries, administrative file maintenance such as address changes, and the adjudication of some entitlement issues at first point of contactFootnote 19. Through the My Service Canada Account, clients may interact with Service Canada regarding their specific files for purposes such as changing their account details or applying for Employment Insurance or Canada Pension Plan Retirement Pension. Clients may also use the Citizen Access Workstation Service available at in-person Service Canada Centres to access Canada.ca general information or their My Service Canada Accounts.

In October 2018, there were a total of 607 in-person points of service available to Canadians across 4 defined regions: Western/Territories Region, the Atlantic Region, the Ontario Region and the Quebec Region. Approximately 50% of the in-person points of service are full-time Service Canada Centres and 3% are part-time centres. Most of the remaining locations are Scheduled Outreach Sites (40%), which are regularly-scheduled points of service located outside Service Canada Centres, and which offer similar services provided by Citizen Service Officers who travel from their “parent office”. The final 5% of offices are Service Canada Centres – Passport Services, which are offices that exclusively offer passport servicesFootnote 20.

Finally, there are 6 Canada Pension Plan/Old Age Security Specialized Call Centres located regionally across the country: 1 in the Atlantic Region, 1 in Quebec, 2 in Ontario, and 2 in the Western/Territories Region.

3 Findings

3.1 Responsibility and alignment with federal and departmental priorities

Providing clients with services and information about Government of Canada programs is a federal responsibility that is supported by Service Canada. Service Canada meets the current government policies and aligns with government priorities. Additionally, its 3 service delivery channels are strategically aligned with Employment Social Development Canada’s priorities.

The literature reviewed emphasizes that there is more than simply a commercial relationship between a government and its citizens and notes that clients are “usually also taxpayers and citizens, that is: bearers of rights and duties in a framework of democratic community. As taxpayers and members of a civic or democratic community, citizens ‘own’ the organizations that provide public services, and have civic interests that go well beyond their own service needs”Footnote 21.

Alignment with federal priorities

Service Canada’s provision of services and information to Canadians is aligned with existing policies. The federal government is responsible for delivering a wide range of services to Canadians and effectively communicating about these services. These responsibilities are guided by the Policy on Service and the Policy on Communications and Federal Identity. The Policy on Service is rooted in the principles of client centricity, operational efficiency, and a culture of service management excellence.

According to the Policy on Communications and Federal Identity, “communications are central to the Government of Canada’s work and contribute directly to the Canadian public’s trust in government”. The Government communicates with the public in both official languages to inform Canadians of policies, programs, services and initiatives, and of Canadians’ rights and responsibilities under the law. The Government also has a responsibility to communicate with Canadians to help protect their interests and well-being, and to promote Canada as a prosperous, diverse and welcoming country.

A key expected result of this policy is that “government communications products and activities are timely, accurate, clear, objective, non-partisan, cost-effective, in both official languages, and meet the diverse information needs of the public”Footnote 22.

Current Treasury Board policies emphasize the obligation to provide services to Canadians in the language and platform of their choice. In addition, the 2013 and 2016 federal budgets confirmed the priority of the federal government to shift to electronic publishing, examine opportunities to streamline Web presence, transform service delivery, and allocate significant financial resources to renewal across multiple departments.

Alignment with departmental priorities

One of Employment Social Development Canada’s core priorities is to ensure that Canadians are able to access high-quality, timely and accurate government information and services that meet their needs. This builds on previous Employment Social Development Canada priorities to ensure that Canadians have the information necessary to make informed choices about available programs and services, and are able to access these services and information in the most accessible and convenient way. The literature notes that these service priorities support other Employment Social Development Canada responsibilities to assist Canadians in maintaining income for retirement (including through the strengthening of Canadians’ pensions), and to help Canadians receive financial support during employment transitions such as job loss, illness or maternity/parental leave.

The Employment Social Development Canada Departmental Plan 2018 to 2019 describes the approach for delivering against Government priorities as Employment Social Development Canada’s 5 core responsibilities. Of particular importance is the core responsibility “to provide information to the public on the programs of the Government of Canada and the department, and provide services on behalf of other government departments”Footnote 23. Activities undertaken by the 3 service delivery channels subject to this evaluation are key to fulfilling this responsibility. Finally, Employment Social Development Canada’s Departmental Plan 2018 to 2019 states explicitly that “service delivery is fundamental to achieving Employment Social Development Canada’s mandate and contributes to the achievement of policy results”.

3.2 Meeting demonstrable needs for services and information

There is a continued need amongst Canadians and non-Canadians for Government of Canada services and information from all channels and tiers for a number of different programs. Potential challenges with obtaining services and information persist for more complex programs and for population groups that are at higher risk of experiencing 1 or more barriers. While several initiatives are underway across channels to improve service delivery, it remains important to provide multiple service delivery options to meet everyone’s needs.

There is an ongoing need for the federal government to provide services and information through all 3 service delivery channels. In fiscal year 2018 to 2019, Service Canada received 8.4 million client visits to in-person points of service (Service Canada Centres and Scheduled Outreach) (nationally). This number includes 1,943,080 Citizen Access Workstation Service sessions occurring throughout in-person Service Canada Centres across the country. On April 1, 2019, the total monthly number of visits to Canada Pension Plan Retirement Pension webpages was 252,742. 1 800 O-Canada received approximately 1.6 million calls in fiscal year 2018 to 2019.

Clients have various needs depending on the program they wish to access and on their personal characteristics. According to the Service Canada employees surveyed for the evaluation, clients across the 3 major statutory programs ask for similar types of general information, including how and when to apply, the benefit amount, when they would receive payment, and when they would receive a response about a current or previous inquiry.

Although there is general satisfaction with needs for government services and general information being met, several population groups may experience challenges having their needs met. For example, Service Canada’s Client Experience Survey (2017) results indicate that 2 thirds of Employment Insurance clients were confident their applications would be processed in a reasonable amount of time, leaving 1 third neutral or not confident. Approximately 3 quarters of Canada Pension Plan and Old Age Security clients who participated in the same survey reported it was easy to find information about the programs, and slightly fewer found that program information was easy to understand.

Findings from the Canada Pension Plan Retirement Pension focus group study suggest that the In-Person channel continues to provide a needed service option to individuals who experience difficulties or barriers using the online channel. Across all groupsFootnote 24, most of the participants who used the In-Person channel said they chose to do so because they were not comfortable with applying online, and wanted to be able to ask questions and get assistance if they needed it. They also wanted confirmation that they were completing their applications correctly and completely.

The survey of Service Canada employees also found that some clients tell front line employees about experiencing digital barriers to accessing services and information online. For instance, 57% of respondents reported that clients often or almost always tell them they cannot find what they are looking for online, and 74% reported that clients often or almost always tell them they do not know how to use or are unfamiliar with computers. (Refer to section 3.5.)

In regards to needs varying by personal characteristics, results from Service Canada’s Client Experience Survey (2017) indicate that 77% of Indigenous respondents were satisfied with the services they receivedFootnote 25, compared to 86% of non-Indigenous respondents. These results are consistent with evidence from an evaluation of the Guaranteed Income Supplement that suggests Indigenous seniors experience a general lack of trust in government and even a fear of interacting with it. (Refer to section 3.5.)

Employment Social Development Canada’s Departmental Plan 2018 to 2019 identifies several outreach initiatives specifically intended to assist Indigenous people to access the full range of federal social benefits. These initiatives are being implemented in Indigenous communities in rural and remote communities, in the North, and through urban pilots. It is beyond the scope of this evaluation to assess the extent to which these specific initiatives meet the needs of Indigenous people.

Efforts are ongoing throughout Service Canada, and Employment Social Development Canada writ large, to find innovative ways to better meet client needs, including improved performance measurement of activities and improved use of new technology. Examples of initiatives to improve client service from 2017 include the Service Canada Client Experience Survey, the development of an E-Vulnerability Index, continued tracking of complaints and reporting monthly on performance through national scorecards, etc.

A series of improvements are planned and underway across all 3 channels as part of the Service Transformation Plan, including a range of Web initiatives, Community Outreach and Liaison Services, and a new call center system platform.

Another innovative initiative is the partnership between Service Canada and the Government of the Northwest Territories. This partnership allows employees from the Government of the Northwest Territories to provide in-person services for Service Canada, and when necessary, transfer clients to a Service Canada agent by phone. As a result, 15 northern and remote indigenous communities in the Northwest Territories now have daily access to Service Canada services. Moreover, some Government Liaison Officers in the Government of the Northwest Territories can deliver these services in the local Indigenous language or dialect.

3.3 Accessibility and timeliness of service delivery across channels

Across the In-Person, Telephone, and Internet channels, most clients are able to access services and information in a timely manner, but accessibilityFootnote 26 and timeliness vary by channel and purpose of the interaction.

In general, wait times for in-person services are met, and most Canada Pension Plan Retirement Pension clients in particular confirmed in-person wait times are reasonable. The locations, schedules, and design of in-person services are generally accessible in one form or another for most clients.

Although Service Canada has continued to make greater efforts to target service offerings for potentially vulnerable populations, a small percentage of clients across programs may not be able to obtain services and information in person as easily or regularly as most.

Many clients, including Canada Pension Plan Retirement Pension clients, express satisfaction with general telephone and Specialized Call Centre service. However, challenges were noted in regards to accessing Specialized Call Centre agents, with many clients needing to phone more than once to speak to an agent.

In regards to timeliness, in recent years, Specialized Call Centres have not always met their wait time targets. Abandoned calls have increased significantly, and clients who report having to wait longer than the service standard times to speak to a call centre agent found the wait times to be unreasonable.

Meanwhile, the availability and use of online services has expanded. Most Canada Pension Plan Retirement Pension clients who go online for information on the program are satisfied with the service, many clients continue to use paper applications.

In addition to the In-Person, Telephone, and Internet channels, Service Canada continues to contact Canada Pension Plan Retirement Pension and Old Age Security clients proactively by mail to inform them of their eligibility or enrolment for these benefits.

In-person services – accessibility

As of October 2018, the in-person service delivery channel provides a network of 607 physical locations and over 700 Community Outreach and Liaison Service sites in Indigenous communities, where clients can access Government of Canada programs and services. This network consists of 317 Service Canada Centres, 247 Scheduled Outreach sites, 32 Service Canada Centres – Passport Services, and 11 service delivery partnersFootnote 27.

For most clients, the In-Person channel is meeting expected needs for services and information. Results of a survey of Canada Pension Plan Retirement Pension clients confirm this, with 86% of the 771 respondents who visited the Service Canada Centre agreeing the staff members were helpful, and that there were enough staff available. More generally, the Client Experience Survey (2017) results are consistent, indicating a satisfaction rate of 87% among Canada Pension Plan Retirement Pension clients, and overall client satisfaction rates (across 6 programsFootnote 28) of 89% for the In-Person channel.

For most clients, in-person services are geographically accessible. The Client Experience Survey (2017) results indicate that 91% of respondents who accessed services in person strongly agreed (78%) or agreed (13%) that it was easy to get to a Service Canada office. The same survey indicates that 90% of Canada Pension Plan Retirement Pension respondents found it easy to get to a Service Canada officeFootnote 29.

Similar results were observed in the survey of Canada Pension Plan Retirement Pension clients, which indicates that 88% of these clients that visited a Service Canada Centre agreed that the office was easy to get to. When surveyed, Service Canada front line employees also agreed that location, specifically locating Service Canada Centres in major urban areas is the most effective factor for in-person service delivery (85% rated as effective or very effective) followed by providing a sufficient number of Citizen Access Workstations (83%).

At the same time, findings suggest there may still be clients for whom accessing services in person may pose certain challenges pertaining to location, scheduling, and design of the services. These individuals are often part of population groups at higher risk of being vulnerable. For example, around 1.3 million Canadians (3.5%) live more than 50 km from an in-person point of service, which can pose a challenge to reaching services which can be made worse in the winter when weather conditions worsen. More specifically, Canada Pension Plan Retirement Pension focus group participants confirmed that distance and weather may pose challenges to accessibility. However, there was also a general understanding that more regular service in remote locations may not be possible.

In 2017, select Service Canada Centres allowed staff to assist clients through video chat from anywhere in Canada. Service Canada reported that clients who used the video chat kiosks found they made for a fast visit that provided a comparable experience to speaking with staff in-personFootnote 30.

In regards to specific populations, 63% of residents living in remote areas have regular access to in-person services through Service Canada Centres and Scheduled Outreach, compared to 92% of rural residents and 99.97% of urban residents. Many residents in remote locations are also Indigenous.

Through Scheduled Outreach services, Service Canada has made attempts to reach clients who experience location-based barriers to accessing full-time, in-person services and to address seasonal, emergency, or population-specific needs for services. These are part-time, in-person services offered on a regularly-scheduled basis at the same location each time, and are intended to improve Canadians’ awareness of and access to programs and service offerings.

Canada Pension Plan Retirement Pension focus group participants suggested a number of possible improvements to scheduled outreach:

Community Outreach and Liaison Services target populations at a higher risk of being vulnerable, including Indigenous persons, individuals with lower levels of income, visible minorities, people with disabilities, the homeless, and seniors.

An analysis of Service Canada administrative data from April 2014 to May 2017 shows that 40.5% of outreach events for the 3 main statutory programs targeted 1 or a combination of population groups at higher risk of being vulnerable, with an additional 45.4% targeting workers and 14.1% targeting other population groups (youth, families near-seniors, and the general public).

More recently, Community Outreach and Liaison Services has undergone a transformation to be more responsive to serving citizens in the absence of other sustainable sources. It has been designed to remove barriers and ensure substantive equality for all vulnerable Canadians. To accomplish this, there is an increased focus on engagement with partners and communities to develop an approach based on service delivery tailored to specific needs.

From April 2018 to March 2019, Community Outreach and Liaison Services engaged all Northern, remote and on-reserve Indigenous communities and visited 669 Indigenous communities, many on more than 1 occasion. In fiscal year 2018 to 2019, there were 4,065 transactional services provided for the 3 main statutory programs (refer to Table 1).

Table 1: Outreach to Indigenous communities in fiscal year 2018 to 2019
Program Transactional Volumes
Canada Pension Plan 1,193
Canada Pension Plan Disability 189
Old Age Security 1,493
Employment Insurance 1,190
Total 4,065

Source: Employment Social Development Canada (2019), “The Evaluation of the Provision of Services and Information to Canadians: Administrative Document and File Review” technical report (internal document).

In addition to these visits, Community Outreach and Liaison Services targets vulnerable populations, including urban Indigenous, newcomers, people with disabilities and seniors. Administrative data from April 2018 to March 2019 shows that 52.7% of outreach events for the 3 main statutory programs targeted 1 or a combination of population groups at higher risk of being vulnerable (Table 2), with an additional 33.4% targeting workers and employers and 13.9% targeting other population groups.

Table 2: Percentage of Employment Insurance, Old Age Security, and Canada Pension Plan mobile outreach events by target audience, April 2018 to March 2019
Population group Percentage of outreach events that targeted the population group
Seniors 25.80%
Low-income/homeless 10.70%
Urban Indigenous people 3.80%
Newcomers/Immigrants 6.80%
People with disabilities 5.60%
Workers 22.10%
Employers 11.30%
Other (families, general public, youth, near retirees) 13.90%
Total 100%

Source: Employment Social Development Canada (2019). “The Evaluation of the Provision of Services and Information to Canadians: Administrative Document and File Review” technical report (internal document).

The accessibility of Service Canada infrastructure is another important feature to ensure that all clients can access the services. Service Canada’s Service Strategy Performance Measurement Framework lists accessibility as a measure of high-quality service. Most surveyed Service Canada front line employees (75%) agreed that providing accessible facilities and services is key to effective in-person service.

Service Canada’s efforts to improve access to services for a range of programs are ongoing. For example, in addition to the partnership with the Government of the Northwest Territories referred to in section 3.2, the Western Canada and Territories Region will implement the Remote Services Expansion and Remote Strategy that provides outreach for Government of Canada services to remote and vulnerable northern communities, according to Employment Social Development Canada’s 2018 to 2019 Departmental Plan. Through the pilot project, Government of the Northwest Territories service delivery employees provide some Service Canada services and information in up to 15 communities. Under the Service Transformation Plan, a toolkit, tools, and connectivity support are being implemented to help with outreach.

In-person services – timeliness

Analysis of administrative data from April 2014 to May 2017 indicates an upward trend in the national average wait time during this period and ranges between about 10 and 17 minutes depending on the time of the year. Wait times are highest in March and April, July and August, and December and January, which aligns with when the centres are most visited. These trends continue from June 2017 to March 2019 with the highest wait times in similar months, and the average wait time ranging between around 9 and 18 minutes.

Across all channels, employee survey results indicate that most employees (80%) rated their ability to provide clients with information quickly as very high or high (4 or 5 on the rating scale).

In-person Service Canada Centres have surpassed their service target for timeliness of service from fiscal years 2014 to 2015 to 2016 to 2017 with approximately 85% of clients served within 25 minutes at in-person Service Canada Centres. Regionally, all in-person Service Canada Centres have been able to meet the 80% target on an annual basis other than Ontario, which fell below the 80% target in fiscal years 2015 to 2016 and 2016 to 2017. Also, while the Western Region has been able to stay above the 80% target, administrative documents indicate it dropped by over 4% between fiscal years 2015 to 2016 and 2016 to 2017. Results of the survey of Canada Pension Plan Retirement Pension clients indicate that 82% of those who visited a Service Canada Centre thought the wait time to receive assistance was reasonable.

Phone service - accessibility

Clients can access services and information through the telephone using either 1 800 O-Canada (Tier 1) or program-specific Specialized Call Centres (Tier 2).

1 800 O-Canada

Looking at services across programs, results show that Canadians are able to access a 1 800 O-Canada agent with minimal level of effort. Most reach an agent on the first try and within the service standard of 18 seconds. Noteworthy, the National Performance Scorecard data indicate a downward trend in the number of calls about Canada Pension Plan and Old Age Security answered by 1 800 O-Canada from 247,225 in October 2014 to 201,067 in October 2018.

Specialized Call Centres

Evidence indicated that clients had a high satisfaction with Specialized Call Centers. While access to the Interactive Voice Response is 99.98%, there are times of the year where a high level of effort is required to reach an agent.

Survey results from Service Canada’s Client Experience Survey (2017) indicate overall client satisfaction rates of 82% among survey respondents who obtained services from Employment Insurance and Canada Pension Plan/Old Age Security Specialized Call Centres. Agents working in both types of call centres, when surveyed for the evaluation, agreed that knowledgeable staff, hours of operation, and providing services in both official languages are important factors for providing clients with effective access.

A higher level of effort may be required for Canadians to access an agent at a Canada Pension Plan/Old Age Security or Employment Insurance Specialized Call Centre. Service Canada’s Client Experience Survey (2017) shows that 45% were able to get through to a Specialized Call Centre agent in 1 call, and an additional 20% were successful in 2 calls. However, 28% needed to call 3 to 5 times, and 4% made over 5 calls before connecting with an agent.

The survey of Service Canada employees reported that clients continue to tell them they experience difficulties reaching Canada Pension Plan/Old Age Security Specialized Call Centres, with 81% of respondents hearing this comment from clients often or almost always.

Results from a survey of Canada Pension Plan Retirement Pension clients indicates that of the 12% of clients who reported using the Specialized Call Centre, 32% reported they were not able to get through to an agent on their first call, and further reported needing a median of 2 calls in order to reach an agent. However, 24% of these clients indicated that they never got through to a staff memberFootnote 31. Focus group results identify similar challenges issues with long wait times to get through to a call centre agentFootnote 32.

National Scorecard data shows a general decrease in the percentage of Canada Pension Plan and Old Age Security calls that get through to a call centre agent from 77.09% in fiscal year 2014 to 2015 to 68.2% in fiscal year 2018 to 2019 as demonstrated in Figure 2. National Performance Scorecard data further indicate a slight increasing trend in the number of Canada Pension Plan and Old Age Security calls resolved in the Interactive Voice Response (automated) system from 190,455 in October 2014, to 223,353 in October 2018. In fiscal year 2014 to 2015, no clients were blocked from accessing the Interactive Voice Response system and 905 calls were blocked in fiscal year 2015 to 2016. However, in fiscal year 2016 to 2017, 5,020 clients were blocked from accessing the Interactive Voice Response system due to higher call demand. This number fell to 3,373 clients in fiscal year 2018 to 2019.

According to Report 1 of the 2019 Spring Reports of the Auditor General of Canada, in fiscal year 2017 to 2018, a total of 4.9 million calls were made to the Canada Pension Plan/Old Age Security Specialized Call Centres in which the caller asked to speak to an agent. Of these, 49% (2.4 million) were answered by an agent. The rest of the calls were either prevented from reaching an agent (42% of cases), or the caller hung up (9% of cases)Footnote 33.

The department agreed with the Auditor General’s report’s recommendation that it will review how it manages incoming calls to improve access. The report also outlined some of the key commitments made by the department to improve the performance of the Canada Pension Plan and Old Age Security call centres. For example, on May 11, 2019, Canada Pension Plan/Old Age Security Specialized Call Centres migrated to a Hosted Call Centre solution, a modern technology to replace the outdated information technology of its call centre network, which has increased the percentage of callers able to reach an agent to 100%. The implementation of this solution includes the provision of larger call centre queues and resolves the technological limitation of the previous telephone systemFootnote 34,Footnote 35.

Challenges accessing Specialized Call Centres affect the demand on other channels. Key informants from Employment Social Development Canada noted that when the Specialized Call Centres do not have the necessary capacity to respond to demand, clients may turn to other channels for information, which they may not be able to provide. Key informants added that this has the potential to impact access to other channels, especially 1 800 O-Canada and in-person services, because of the increase in demand.

Phone service – timeliness

1 800 O-Canada

Across programs, timeliness of access to 1 800 O-Canada has been consistently high since 2014. Nearly 100% of calls to the centre are received, and approximately 80% of these calls are answered within the service standard of 18 seconds. According to employee survey data, employees working in 1 800 O-Canada are more likely than those in Canada Pension Plan/Old Age Security Specialized Call Centres to have a positive view on the effectiveness of their ability to answer calls in a timely manner.

Specialized Call Centres

The evaluation found that there has been a steady decrease in timely access to specialized call centres between fiscal years 2014 to 2015 and 2017 to 2018. National Scorecard data shows a decline in the percentage of Canada Pension Plan and Old Age Security calls answered by a Specialized Call Centre agent within the service standard of 10 minutes from 96% in March 2015 to 69.8% in March 2018, with an increase to 75.4% in fiscal year 2018 to 2019 as demonstrated in Figure 2. According to Service Canada, the decrease in calls answered within 10 minutes was the result of Canada Pension Plan/Old Age Security Specialized Call Centre agents helping with processing activities to reduce excess inventory of work. In addition, the Canada Pension Plan/Old Age Security Specialized Call Centres experience cyclical peaks in call volumesFootnote 36 which impact accessibility and timeliness. Yearly reporting in Figure 2 reflects averages across cyclical peaks and valleys.

Figure 2: Access to pensions Specialized Call Centres, fiscal years 2014 to 2015 to 2018 to 2019

Figure 2

Source: National Scorecard Data, Year to Date Results March 2015, 2016, 2017, 2018, and 2019Footnote 37.

Figure 2: text description
Fiscal year Access to Canada Pension Plan and Old Age Security agents (call) % Canada Pension Plan and Old Age Security calls answered within 10 minutes
2014 to 2015 77.00% 96.00%
2015 to 2016 53.00% 86.00%
2016 to 2017 69.00% 82.00%
2017 to 2018 58.40% 69.80%
2018 to 2019 68.27% 75.46%

Similarly, 76% of respondents in the Client Experience Survey (2017) reported having to wait more than 5 minutesFootnote 38 to speak to an agent, with 46% of clients waiting over 11 minutesFootnote 39. The majority of those that said they had to wait more than 11 minutes responded that they found these wait times to be unreasonable. This does not necessarily reflect abandoned calls,Footnote 40 which have been steadily increasing. It is important to note that over 90% of abandoned calls occur within the 10-minute threshold.

The Auditor General of Canada’s spring 2019 report indicates that 72% of calls were answered within 10 minutes, and that the average wait time was 5 minutesFootnote 41. This report further notes that respondents to a 2018 survey conducted by the Institute for Citizen-Centred Service’s indicated they expected to wait an average of 7 minutes when calling the Government of Canada. The report also highlights some of the efforts made by Employment Social Development Canada to ensure that client needs are taken into consideration. For example, a service standard review of the Canada Pension Plan and Old Age Security program service standard was recently completed in December 2018. The review included client consultations, and confirmed that established standards were relevant and consistent with client expectations. Moreover, the report also outlines further commitments made by Employment Social Development Canada to enhance its publishing of call centre service reporting, notably by increasing the frequency of reporting, and by including calls abandoned beyond the 10-minute service standard when reporting results from fiscal year 2019 to 2020 onwards.

Similarly, participants in a focus group study conducted with Canada Pension Plan Retirement Pension clients reported that wait times were very long, and they had to call back multiple times to speak to “the right person” who could not then answer their questionFootnote 42. In addition, participants reported they did not receive promised call-backsFootnote 43, nor were they able to obtain the information they needed, despite the fact they had been referred to the Specialized Call Centre by another channelFootnote 44.

General online services – accessibility

Substantial efforts have been made to increase and improve online service delivery. The creation of Canada.ca allows for program information from the 3 main statutory programs to be housed in 1 place online. A number of online tools are available to assist clients in understanding the programs and making decisions. These include the Benefits Finder Tool, the enhanced functionality of the Canada Retirement Income Calculator, and the expansion of the My Service Canada Account, which permits online applications for Canada Pension Plan Retirement Pension and Old Age Security, as well as allowing clients to link to their Canada Revenue Agency accounts. Service Canada’s Client Experience Survey (2017) found that 79% of clients were satisfied or very satisfied with the online channel.

Despite this, key informants suggest there is a need for better integration of some of the online tools (for example, the Benefits Finder Tool and the My Service Canada Account). They identified other gaps in the digital services offered including dated technology, not being user-friendly, not being well organized, and not being written in plain language. Half of the front line employees surveyed in the Service Canada employee survey indicated that clients could not locate relevant information on the Web and the Web information is not clear/sufficient/specific to their needs.

According to the Web Exit Survey of Employment Insurance clients who said they were successful applying online, or successful submitting an Employment Insurance report, 88% were very satisfied or satisfied with the amount of time it took them. Web Exit Survey results also indicate that of the clients who said they were successful in learning about or applying for the Canada Pension Plan, 79% were very satisfied or satisfied with the amount of time it took them.

Canada Pension Plan Retirement Pension online services – accessibility

A small percentage of front line employees surveyed indicated that they receive fewer client enquiries about applying for the Canada Pension Plan Retirement Pension since the application process was available online.

Figure 3 illustrates that the total number of new visitors to the Canada Pension Plan Retirement Pension webpages increased by 73% from December 2015 to March 2017. During the same period, the total number of returning visitors increased by 330%, with returning visitors outnumbering new visitors starting in June 2017Footnote 45. On April 1, 2019, the total monthly number of visits to Canada Pension Plan Retirement Pension webpages was 252,742.

Figure 3: Number of new and returning visitors to the Canada Pension Plan Retirement Pension website, December 2015 to April 2019

Figure 3

Source: Employment Social Development Canada (2018). “Providing Services and Information through Service Canada Evaluation: Web Analytics Technical Report” (deck), internal document.

Figure 3: text description
Date (month and year) Number of new visitors Number of returning visitors Notes
December 2015 29,876 112,352 n/a
January 2016 74,848 170,514 n/a
February 2016 92,964 130,945 n/a
March 2016 114,418 153,987 n/a
April 2016 99,639 130,468 n/a
May 2016 82,317 110,763 n/a
June 2016 84,542 126,495 n/a
July 2016 87,879 115,053 n/a
August 2016 85,495 115,530 n/a
September 2016 75,643 110,286 n/a
October 2016 94,077 117,119 n/a
November 2016 88,674 118,867 n/a
December 2016 49,435 62,554 n/a
January 2017 122,144 137,793 n/a
February 2017 118,385 129,651 n/a
March 2017 100,635 194,615 Announcement of Canada Pension Plan Retirement Pension Enhancements
April 2017 97,882 145,682 n/a
May 2017 102,317 125,095 n/a
June 2017 94,767 103,921 n/a
July 2017 104,660 109,155 n/a
August 2017 102,414 124,575 n/a
September 2017 89,976 117,915 n/a
October 2017 95,779 131,465 n/a
November 2017 94,864 137,482 n/a
December 2017 84,738 129,071 n/a
January 2018 125,668 198,692 n/a
February 2018 98,318 167,057 n/a
March 2018 97,869 183,639 n/a
April 2018 89,263 177,574 n/a
May 2018 72,957 142,450 n/a
June 2018 74,437 138,271 n/a
July 2018 77,063 146,770 n/a
August 2018 75,928 140,837 n/a
September 2018 70,694 126,635 n/a
October 2018 76,377 139,212 n/a
November 2018 73,566 135,761 n/a
December 2018 74,561 133,127 n/a
January 2019 133,783 233,469 Implementation of Canada Pension Plan Retirement Pension Enhancements
February 2019 97,466 177,370 n/a
March 2019 96,421 193,265 n/a
April 2019 82,882 169,860 n/a

The most visited pages included the main information pages: “Overview”, “Eligibility” and “How Much You Could Receive”. Moreover, Web analytics results indicate that between 2016 and 2017 visits to the Canadian Retirement Income Calculator, an information tool to help clients estimate benefits, outnumbered visits to the Apply page by a small amount. A possible interpretation is that visitors to the Canada Pension Plan Retirement Pension main pages are seeking information and could potentially be learning about the program.

Results of the survey of Canada Pension Plan Retirement Pension clients indicates that approximately 62% of clients surveyed accessed the website. Of these, a majority reported that information and instructions on the website were clear, easy to follow and understand. However, fewer than 40% of respondents agreed that the examples of different situations on the website helped them think about the best age to start Canada Pension Plan Retirement PensionFootnote 46. In addition, Service Canada’s Web Exit Survey results indicate that only 52% of those learning about or applying for the Canada Pension Plan find the information easy to understand.

Regarding the use of My Service Canada AccountFootnote 47, results of the survey of Canada Pension Plan Retirement Pension clients indicates that almost half of the respondents (45%) applied for their pension online through their My Service Canada AccountFootnote 48. A majority (70%) of these reported that registering for their My Service Canada Account was easy or very easy.

In the Service Canada’s Client Experience Survey (2017), 76% of Canada Pension Plan Retirement Pension respondents expressed that the My Service Canada Account was easy to use and 80% of those clients who used the online service to apply had a good overall experience with it. Focus group results are also consistent, although some participants found it problematic to request and wait for an access code.

However, slightly over half (52%) of surveyed Canada Pension Plan Retirement Pension clients did not apply online through the My Service Canada Account, primarily because the staff at a Service Canada Centre gave them an application to mail in or they chose to print and mail a paper application, they did not know how to apply online, or they did not have a computer. This is consistent with Web Exit Survey results indicating that only 48% of those who attempt to apply online are successful.

Results from the client survey and focus group study also indicate that specific groups of respondents encountered challenges in understanding information on the website, and applying online through My Service Canada Account. These include Indigenous and immigrant respondents, respondents with a disability, and respondents with lower levels of education and income. All of these groups were more likely to submit their pension application through a Service Canada Centre, preferring to seek assistance from the In-Person channel.

Key informants indicated that, although the website redesign has focused on Web content and easier to address issues, the online capacity for the Canada Pension Plan Retirement Pension is still limited as some information still must be mailed in. The standard Canada Pension Plan Retirement Pension application can be completed online through the My Service Canada Account, but specific provisions such as pension sharing, credit splitting for divorced or separated couples, and the child rearing provision may require additional documentation to be mailed in. These challenges may account for the fairly high number of unsuccessful online applicants noted previously.

Pensions-related mail-outs – accessibility

Regarding Canada Pension Plan Retirement Pension and Old Age Security in particular, Service Canada also proactively provides general information and services to clients through mail. For example, each month Service Canada reaches out to Canadians aged 64 years and 1 month to either inform them that they will receive their Old Age Security pension at age 65 (sent an Old Age Security automatic enrolment letter) or to invite them to apply for Old Age Security benefits or to apply for Canada Pension Plan Retirement Pension benefits (separate letters are sent for Old Age Security and Canada Pension Plan Retirement Pension).

Similarly, Service Canada reaches out to individuals who are collecting Old Age Security benefits but not receiving the Guaranteed Income Supplement on an annual basis. These letters invite individuals to apply for Guaranteed Income Supplement benefits as Service Canada believes that they are also potentially entitled to Guaranteed Income Supplement benefits (but requires the individual to apply for them).

These mailings are significant in scope. In fiscal year 2018 to 2019, Service Canada sent approximately 1 million letters to individuals either informing them that they will receive Old Age Security benefits automatically, inviting them to apply for either Old Age Security or Canada Pension Plan Retirement Pension benefits, or inviting them to apply for Guaranteed Income Supplement benefits.

Similarly, Service Canada provides information via mail to close to 3 million clients in July on their entitlement to Guaranteed Income Supplement benefits for the upcoming payment year (which runs from July to June of each year), informing them of any changes in their entitlement (including the amount, whether they remain entitled to benefits or not and the reasons why they may not be entitled).

3.4 Channel choice, channel mobility, and client satisfaction

Overall, the majority of clients are satisfied with the services and information they have received and are able to navigate between channels as needed, with a few critical exceptions such as some clients' inability to access the channel they are referred to, especially the Specialized Call Centres, and the Web channel.

A variety of factors are found to be associated with clients’ choice of channel and decision to move between channels, including the type of task they are trying to complete, whether they were successful in completing that task through their first point of contact, and any personal preferences for and/or barriers to using a particular channel.

Client satisfaction decreases on average with number of times a client has to contact Service Canada. Some movement between channels could be resulting from clients’ inability to access required services/information at first contact, particularly for clients belonging to potentially vulnerable groups. This inability is likely affecting some clients’ satisfaction.

Channel choice

Service Canada’s multi-channel, multi-tiered service delivery model allows clients to most effectively meet their service delivery needs by using the “right” channel.

Overall, employee survey results indicate that this model is generally working as designed, with Tier 1 front line employees indicating that they often or almost always refer clients of the main statutory programs to Canada.ca, or to the Specialized Call Centres pertinent to client needs, as they are unable to respond to client’s initial or follow-up questionsFootnote 49.

Service Canada’s Client Experience Survey (2017) results further indicate that overall satisfaction rates of clients of the main statutory programs is high:

Results of Service Canada’s Canada.ca Web Exit Survey indicate lower, but generally positive satisfaction rates among clients using website as follows:

Service Canada’s Client Experience Survey (2017) found that 25% of clients across the 6 programs covered in the survey only used self-service (Web and/or mail) and did not receive service in-person or by telephone. Results indicate that in-person remains a frequently-used channel, with 63% of clients visiting an in-person point of service at least once when needing information, applying for a benefit or program, or following up on an application.

The Client Experience Survey (2017) also indicates that clients use different channels depending on their service needs. For example, survey results indicate that clients most frequently use in-person (44%) or self-service (Web and/or mail) (39%) channels when they need to seek general information or need to apply for a program or benefit. On the other hand, in Figure 4, both the telephone (43%) and the in-person (41%) channels are used more frequently than self-service channels (Web and/or mail) (14%) for following up on an application by clients of the 6 programs. However, the telephone channel is used far less frequently to obtain information and apply for a program or benefit.

Figure 4: Use of channels by client need (stage of the client journey)

Figure 4

Source: Service Canada (2018), “Client Experience Survey 2017”, p. 76.

Figure 4: text description
Channel type Need: seeking general information (Aware) Need: applying for program or benefit (Apply) Need: following up on a submitted application (Follow-up)
High-touch (in-person) 44% 53% 41%
Self-service (web and/or mail) 39% 37% 14%
Self-service (web and/or mail) 10% 9% 43%

These results are consistent with the application process for most programs and benefits, most of which cannot be completed entirely over the phone.

Channel mobility

Many factors contribute to clients’ movement between channels, some of which indicate the proper functioning of the multi-channel, multi-tier model, while a few may indicate that clients may not be obtaining the services and information they need.

Clients most frequently used only 1 channel when they needed general information, before applying for a program or benefit. Client Experience Survey (2017) data shown in Figure 5 indicates that 53% of clients used only 1 channel when they needed general information, with the frequency of clients using 2 or more channels increasing when clients needed to apply or to follow up on an application. Results from the Client Experience Survey (2017) also suggests that clients seeking to solve problems tend to use the highest number of channels.

Figure 5: Number of channels used by client need (stage of the journey)

Figure 5

Source: Service Canada (2018), “Client Experience Survey 2017”, p. 80.

Figure 5: text description
Number of channels Need: seeking general information (Aware) Need: applying for program or benefit (Apply) Need: following up on a submitted application (Follow-up)
One channel 53% 44% 49%
Two or more channels 31% 43% 48%
Three or more channels 11% 22% 18%

When examining channel mobility, the literature suggests that regardless of the effectiveness of each channel or the nature of the transaction, clients’ expectations and preferences regarding service delivery also likely influence their choice of channel at first contact. Individuals do not automatically switch to other channels when they are accustomed to using a specific channel, but are likely to switch to e-services, for example, if it provides easier and more effective access than the other channels.

When considering clients’ movement between channels, Service Canada’s Client Experience Survey (2017) results indicate that although the Web channel is used by nearly half of clients as a first channel, substantial proportions of the clientele visit an in-person office as their first step instead. Figure 6 presents the order in which clients of the 6 programs in the survey move from channel to channel organized by the clients’ need, or stage in their journey toward receiving a benefit or applying for a program.

Figure 6: Channel mobility by client need

Figure 6

Source: Service Canada (2018), “Client Experience Survey 2017”, p. 77 to 79.

Figure 6: text description

The image is a series of 3 flow charts made of arrows and boxes that are stacked on top of one another. The flow charts depict the movement of clients between service channels. Each flow chart represents a client need, or stage of the client journey. From the top of the image to the bottom, the needs (stage of the client journey) are:

  • seeking general information (aware)
  • applying for Program or Benefit (apply)
  • following up on a submitted application (follow-up)

Need (stage of the client journey): Seeking general information (aware)

When seeking general information, 43% of clients went to the Web channel first. Of these clients, 14% contacted a phone channel as their second channel, and 18% went to the In-Person channel as their second channel. Of the clients who went to a phone channel second, 25% went to the In-Person channel as their third channel. Of the clients who went to the In-Person channel second, 19% contacted a phone channel as their third channel.

A further 31% of clients went to the In-Person channel first when seeking general information. Of these clients, 8% contacted a phone channel as their second channel, and 11% used the Web channel as their second channel. Of the clients who went to a phone channel second, 9% went to the Web channel as their third channel. Of the clients who went to the Web channel second, 29% proceeded to contact a phone channel as their third channel.

Finally, 7% of clients seeking general information contacted a phone channel first. Of these clients, 23% proceeded to the Web channel as their second channel, and 19% visited the In-Person channel as their second channel. Of the clients who used the Web channel as their channel second, 20% went to the In-Person channel as their third channel. Of the clients who went to the In-Person channel second, 3% proceeded to use the Web channel as their third channel.

Need (stage of the client journey): Applying for program or benefit (apply)

When applying for a program or benefit, 44% of clients went to the Web channel first. Of the clients who went online first, 13% contacted a phone channel as their second channel, and 14% went to the In-Person channel as their second channel. Of the clients who went to a phone channel second, 21% went to the In-Person channel as their third channel. Of the clients who went to the In-Person channel second, 21% proceeded to contact a phone channel as their third channel.

A further 40% of clients went to the In-Person channel first when applying for a program or benefit. Of these clients, 7% proceeded to contact a phone channel as their second channel, and 13% used the Web channel as their second channel. Of the clients who went to a phone channel second, 10% went to the Web channel as their third channel. Of the clients who went to the Web channel second, 15% proceeded to contact a phone channel as their third channel.

Finally, 6% of clients applying for a program or benefit contacted a phone channel first. Of these clients, 30% proceeded to the Web channel as their second channel, and 33% visited the In-Person channel as their second channel. Of the clients who used the Web channel as their channel second, 10% went to the In-Person channel as their third channel. Of the clients who went to the In-Person channel second, 6% proceeded to use the Web channel as their third channel.

Need (stage of the client journey): Following up on a submitted application (follow-up)

When following up on a submitted application, 32% of clients went to the Web channel first. Of the clients who went online first, 44% proceeded to contact a phone channel as their second channel, and 16% went to the In-Person channel as their second channel. Of the clients who went to a phone channel second, 18% went to the In-Person channel as their third channel. Of the clients who went to the In-Person channel second, 22% proceeded to contact a phone channel as their third channel.

A further 24% of clients went to the In-Person channel first when following up on a submitted application. Of these clients, 28% proceeded to contact a phone channel as their second channel, and 20% used the Web channel as their second channel. Of the clients who went to a phone channel second, 10% went to the Web channel as their third channel. Of the clients who went to the Web channel second, 18% proceeded to contact a phone channel as their third channel.

Finally, 38% of clients following up on a submitted application contacted a phone channel first. Of these clients, 14% proceeded to the Web channel as their second channel, and 14% visited the In-Person channel as their second channel. Of the clients who used the Web channel as their channel second, 19% went to the In-Person channel as their third channel. Of the clients who went to the In-Person channel second, 11% proceeded to use the Web channel as their third channel.

Delving further into clients’ movement through the channels, results from Service Canada’s Client Experience Survey (2017) suggest that the frequency of these programs’ clients having to use a second or third channel is related to the combination of the clients’ needs (stage of their client journey) and the channel they visit first.

For example, Figure 6 shows that clients who went to the In-Person channel first to seek general information before applying for a program or benefit were less likely to move to another channel before applying than clients who used the Web channel first. Relatively few clients used the phone channel first to seek general information (7%) or to apply (6%), but many of those who did moved on to a second channel to meet their needs. However, clients who used the telephone channel to follow up after applying were less likely to move on to a second channel to follow up than clients who used the Web or In-Person channels first to follow up.

Overall, clients appreciated the options provided by the different channels and ultimately, most were satisfied with the services received. The Client Experience Survey (2017) observed no difference on average in clients’ service experience resulting from the number of channels used when following up on an application. Furthermore, findings from the Canada Pension Plan Retirement Pension focus groups demonstrated that participants used multiple channels in an effort to find the channel that best suited their needs. Results of the Canada Pension Plan Retirement Pension client survey and focus groups indicate that people who are less likely to use more than 1 channel, and more likely to use the In-Person channel instead of the Web channel include:

In addition, several focus group participants referred to the need to use mail, for example, to submit certain documents such as for obtaining the Personal Access Code required to use the My Service Canada Account. For participants who otherwise handled their applications online, the “mail channel” was an annoyance.

For Canada Pension Plan Retirement Pension clients, survey results indicate that approximately 34% of respondentsFootnote 50 accessed multiple Service Canada channels to get information about the program before applying. Of these, 53% used the online channel first, with 11% accessing the in-person and 10% using the telephone channels first because they believed this was the easiest way for them to get information.

A majority of respondents from the survey who accessed multiple channels rated their experience obtaining information as easy, noting the first channel referred them to the appropriate place to get the information they needed, and they were able to access that channelFootnote 51.

Conversely, approximately 14% (n =94) rated the experience as difficult or very difficult, noting that they were unable to get the information they needed from the first channel they went to, nor could they access the channel they were referred to. A small percentage (16%, n=15) of those who found it difficult or very difficult attributed their difficulties to receiving conflicting information from different channelsFootnote 52. In spite of the small number of respondents who experienced difficulties (14%, n=94), it is noteworthy that clients using the Canada Pension Plan Retirement Pension webpages first were more likely than clients using other channels first to report they could not get the information they needed from the first channel they usedFootnote 53.

The participants that seemed the most satisfied with accessing multiple channels were able to do some research online, download the Canada Pension Plan Retirement Pension application forms, then take them to a Service Canada Centre to be reviewed before mailing them. Participants who applied online with the assistance of Service Canada Citizen Service Officers were also satisfied with their experience using multiple channels.

To take a broader perspective beyond the Canada Pension Plan Retirement Pension, the literature suggests that channel differences can be attributed to the demographic group seeking services, with some population groups at higher risk of being vulnerable to access barriers and demonstrating, on average, a preference for the In-Person channel. This is supported by Service Canada’s Client Experience Survey (2017) results across programs indicating that population groups at higher risk of being vulnerable, including official language minority community members, clients with high school education or less, youth, and Indigenous clients, are more likely to use the In-Person channel than other population groups, while seniors aged 60 and over use the In-Person channel at a similar rate (just over half) as clients overall.

While there is successful movement of clients across Service Canada’s multi-tiered and multi-channel service delivery model, employee survey findings suggest that clients may have difficulty accessing and using the channels to which they are referred, which are primarily the Specialized Call Centres and the Web channel.

Client satisfaction with channel mobility

Overall, a majority of clients are satisfied with the services and information they have received. As demonstrated in Figure 7, Client Experience Survey (2017) results indicate that of the 31% of clients who contacted Service Canada only once, 95% rated their satisfaction as high or very high. This dropped to 90% among those who required 2 contacts, and down to 83% satisfaction for those required to contact Service Canada 3 or 4 times.

Figure 7: Client satisfaction by number of contacts with Service Canada

Figure 7

Source: Service Canada (2018). “Client Experience Survey 2017”, p. 83.

Figure 7: text description
Number of contacts Percentage of clients who were satisfied or very satisfied with their service
1 95%
2 90%
3 83%
4 83%
5 to 10 72%
More than 10 63%

Similarly, clients of the 6 programs who used fewer channels were more likely to give a positive response, on average, when asked about various aspects of service delivery, in comparison to those who used more channels.

Furthermore, 81% of clients who went to only 1 channel before applying for a program or benefits reported being able to find the information they needed within a reasonable amount of time. Among those who used 2 or more channels, 72% reported being able to find the information they needed in a reasonable time, and 64% of those who used 3 or more channels reported the same. In a few cases, clients gave slightly higher ratings on average when they contacted 3 or more channels; these results were often observed in relation to application processing and follow-up on applications.

Key informants noted that Canada Pension Plan/Old Age Security Specialized Call Centre agents have been assisting Service Canada’s processing teams to help reduce excess inventory of work for these programs. They suggested that excess inventory of work can lead to client frustration and channel churn, including an increased call volume, which in turn may impact Service Canada’s ability to deliver timely responses to clients. Some key informants suggested that service delivery could be improved for Canada Pension Plan and Old Age Security clients by providing Canada Pension Plan/Old Age Security Specialized Call Centre agents with increased authority and access to documents, similar to the authorities and access of Employment Insurance Specialized Call Centre agentsFootnote 54. Key informants said that the First Point of Contact Resolution pilot project has given more latitude to in-person Citizen Service Officers to help Employment Insurance clients move further along in the application process. They suggested that a similar process could be beneficial for Canada Pension Plan clients.

Results from a survey of front line Service Canada employees indicates that a majority of 1 800 O-Canada agents reported that clients often tell them they do not want to use the channel to which they are being referred to. Similarly, a majority of in-person Client Service Officers reported the same for Old Age Security and Employment Insurance clients, with slightly less than half reporting that Canada Pension Plan Retirement Pension clients prefer not to use the referred channel.

Key informants suggested that client frustration can be caused by not being able to access the service they need through the initial service channel. Service Canada’s Client Experience Survey (2017) found that the higher the number of times a client of any of the 6 surveyed programs had to contact Service Canada, regardless of channel, the less likely they were to rate their satisfaction as being high or very high.

Results from a survey of Canada Pension Plan Retirement Pension clients indicate that while most clients found it easy to get the information they needed from multiple service channels, a small minority reported some difficulties using multiple channels. These include being unable to obtain the information they need from the first channel they used, being unable to access the online channel, and receiving conflicting information from different channels.

These observations are consistent with focus group results indicating that some participants want to use the telephone channel when encountering difficulties online but experienced too long a wait. Others said they do not get the information or assistance that they need from the In-Person and/or telephone channels so they resort to applying online without assistance. Regarding their desire for help at in-person centres, some focus group participants also said they felt their needs were not accommodated and that they were being “pushed” to use the computers at the Service Canada Centres, while others reported that staff were very helpful.

Moreover, key informants said that direct, cross-channel transfer was not available for Canada Pension Plan clients accessing services in-person, and 1 800 O-Canada agents cannot transfer clients directly to Tier 2. Key informants also suggested that enabling Tier 1 channels to directly transfer Canada Pension Plan calls to Specialized Call Centres rather than referring clients, could potentially improve client referrals and reduce channel churn.

Better communication – across channels, between regions, and between regions and headquarters – was suggested to improve understanding by the front line employees of the services available through other channels and the differences and lessons learned across regions. Service Canada is developing an Integrated Channel Management Strategy to break down program, service, and channel silos, in an effort to better integrate operations and direct channel use in the future. A new program knowledge management tool is also planned to help employees respond to clients’ questions about Employment Social Development Canada programs and services.

3.5 Language

Almost all clients are obtaining services and information in the official language of their choice, either directly or through Service Canada’s interpretation options.

Services are sometimes available in languages other than English or French. Among Canada Pension Plan Retirement Pension clients specifically, availability of services in an official or other language was generally not seen to be an issue. However, a few Canada Pension Plan Retirement Pension clients in the North noted that availability of services in the local Indigenous languages and dialects at in-person points of service (Service Canada Centres and Scheduled Outreach) depends on the location, and in-house interpretation services for these languages could be useful.

Results of Service Canada’s Client Experience Survey (2017) indicate that most Canadians contacting Service Canada about any of the 6 programs covered by the survey are able to access services (94%) and documents (93%) in the official language of their choice. These results indicate further that the most highly rated attribute across all programs was the provision of service in both official languages in Service Canada Centres. Similar findings from the employee survey results indicate that some of the least-cited challenges for clients trying to access services are their ability to obtain services in the official language of choice (3%) or in a language other than English or French (12%).

Similarly, results of the Canada Pension Plan Retirement Pension survey indicate that 99% of all respondents received services in the official language of their choiceFootnote 55. Focus group results with clients of the program indicate that language was not an issue for the francophone and immigrant focus group participants. The francophone participants all received services in French as desired, and the immigrant focus group participants were comfortable with and even desired services in English as most had been in Canada for decades. Scarborough participants also pointed out that their Service Canada Centre offers services in a variety of languages, so in general, they did not believe it was an issue. However, some immigrant participants were hesitant to ask questions, which may have prevented them from getting the information and services that they neededFootnote 56.

Language of service was raised by Indigenous focus group participants. In Nunavut, the availability of services in Inuktitut and Inuinnaqtun depends on the location. In addition, some participants raised the need for interpreters in some locations noting that Service Canada staff only spoke EnglishFootnote 57. Given that the Telephone Interpretation Service is available for Indigenous languages, this concern may be interpreted as an example of clients’ lack of awareness of services offered.

From a more general perspective, some of Service Canada’s in-person points of serviceFootnote 58 offer services in both English and French, while others are unilingual English or French, as noted in a review of administrative documents. Unilingual offices offer telephone interpretation services. An administrative document review found that as of July 2018, there are 207 bilingual in-person points of service, 334 English-only In-Person points of service, and 48 French-only in-person points of service.

Administrative data from April 2014 to August 2017 indicate that approximately 77% of calls to 1 800 O-Canada are in English, with the remaining 23% in French. During the same period, approximately 80% of the visits to In- Person Service Canada Centres were completed in English with the remaining 20% in FrenchFootnote 59,Footnote 60. The administrative data also showed that between fiscal years 2014 to 2015 and 2018 to 2019, approximately 80% of calls to Specialized Call Centres were made in EnglishFootnote 61.

It is noteworthy that a higher percentage of clients used the Citizen Access Workstation Service in French than those who interacted in French through in-person visits at Service Canada Centres, according to administrative dataFootnote 62. A potential explanation for this difference could be that these clients are bilingual, but are choosing to conduct their in-person interactions in English even though French is their preferred language. During most of the time period covered by the evaluation, the percentage of clients who used the Citizen Access Workstation Service in French represented between 35% and 40% of Workstation use.

The administrative data further show that between April 2014 and August 2017, fewer than 0.1% of calls to 1 800 O-Canada were handled in a non-official language and 0.3% or fewer of the visits each month to Service Canada Centres took place in a non-official language. These numbers only represent services and information actually provided in languages other than English and French, meaning that the data could potentially underestimate the number of clients who would like to be able to access services and information in another language.

Non-official language supports are available for all in-person services. Service Canada has held a small number of mobile outreach events in other languages, including Arabic, Cantonese, Mandarin, Korean, Punjabi, and Oji-Cree. Employment Social Development Canada is currently exploring the need for additional multi-language service delivery.

3.6 Meeting diverse needs for information

Program take-up depends on client awareness of programs and service delivery options available for accessing them. Population groups at higher risk of being vulnerable are the least likely to be aware of how to access the services and information they require. Marketing efforts ranging from social media to radio advertisements might further improve client awareness of programs and benefits to which they may be entitled.

Some Canadians have challenges finding and understanding the information they require, particularly among clients of Canada Pension Plan and Old Age Security, as well as Indigenous people and people with disabilities. Some aspects of digital services could be more user-friendly, and information written in a more accessible manner.

While 1 800 O-Canada and the Canada Pension Plan-Old Age Security Specialized Call Centres demonstrate consistently high accuracy and completeness of information, not all front line employees have the authority or training to respond to detailed program related questions.

Awareness of services and programs

Canadians’ take-up of programs is dependent on their awareness of them and the service delivery options available for accessing information and applying for relevant programs. Populations at higher risk of being vulnerable, such as seniors, some Indigenous people, and people with lower levels of education, were identified in the literature as the least likely to know how to access the service they required.

In fiscal year 2007 to 2008, Employment Social Development Canada ran a promotion campaign including radio, television, and newspaper, and online banners. Findings indicate that client awareness of the variety of services available through Service Canada’s 3 delivery channels more than doubled (from 30% to 65%) between 2006 and 2010, according to a 2010 Service Canada client satisfaction survey.

However, advertising is no longer a commonly used approach to increasing awareness of services and benefits available through Service Canada’s 3 delivery channels. Instead, resources have been directed towards targeted outreach activities.

Key informants from Employment Social Development Canada pointed to challenges in increasing awareness of services, including resource and capacity issues, co-ordination between channels, services and/or programs, and lack of clarity related to roles and responsibilities.

Marketing efforts ranging from social media to radio advertisements might further improve client awareness of programs and benefits to which they may be entitled.

Finding and understanding information online

Web analytics data on the Canada Pension Plan webpages indicate that clients are accessing the program’s information pages and the Canada Retirement Income Calculator, a tool that can help clients determine the amount of Canada Pension Plan Retirement Pension they may receive.

However, there may be clients who experience challenges finding and understanding information online. Employee survey results suggest that clients often tell front line employees that they are unable to locate the relevant information online (54%) or do not find online information to be clear, sufficient, or specific enough for their needs (47%).

Additionally, surveyed front line employees indicated that many clients continue to experience a range of digital barriers that may adversely impact their ability to find the information they require. This is consistent with key informant evidence suggesting that some aspects of digital service delivery could be more user-friendly, could be better organized, and could be written in a more accessible way, including the provision of illustrative scenarios which could demonstrate the impact of certain choices. Canada.ca Web Exit Survey data and Standardized User Experience Percentile Rank Questionnaire survey support the findings noted previously. In addition, focus group findings indicate that Canada Pension Plan Retirement clients need to access information presented in an easy-to-understand format so that they can easily determine what is relevant to their particular situation.

Similarly, Client Experience Survey (2017) results indicate that Canada Pension Plan and Old Age Security clients may experience challenges in finding and understanding necessary information. Findings indicate that only 64% of Indigenous clients reported being satisfied with the ability to find information in a reasonable time, compared to 79% of non-Indigenous respondents and 73% of Indigenous clients gave a satisfactory rating when asked about understanding the requirements of their application for a program or benefit, compared to 81% of non-Indigenous clients.

Agent ability to provide accurate, consistent and sufficient information

In addition to clients’ own abilities in finding and understanding information, client outcomes are dependent on Service Canada front line employees’ ability to provide accurate and consistent information sufficient to meet client needs. Employee survey results indicate that across all channels and the 3 statutory programs (Old Age Security, Canada Pension Plan, and Employment Insurance), front line employees rate “knowledgeable staff” among 1 of the most effective elements of their channel’s service delivery. This is consistent with Service Canada’s Client Experience Survey (2017) results indicating that 83% of Canada Pension Plan Retirement Pension clients reported that call centre staff were helpful.

Figure 8 presents data from 1 800 O-Canada’s monitoring of information accuracy across programs. The data demonstrates consistently high levels of information accuracy from 93.5% in October 2014 to 94.3% in October 2018. Data on Canada Pension Plan/Old Age Security Specialized Call Centres’ quality monitoring program also demonstrates consistently high accuracy and completeness of information, from 94.2% in fiscal year 2014 to 2015 to 94.1% in fiscal year 2018 to 2019.

Figure 8: Information accuracy (%), 1 800 O-Canada

Figure 8

Source: National Performance Scorecard, Service Canada Performance Package (2014 to 2018).

Figure 8: text description
Month and year of reporting Information accuracy for 1 800 O-Canada
September 2014 93.50%
October 2014 93.50%
November 2014 92.30%
December 2014 85.80%
January 2015 87.00%
February 2015 85.60%
March 2015 87.20%
April 2015 88.10%
May 2015 94.20%
June 2015 89.50%
July 2015 91.30%
August 2015 94.20%
September 2015 94.20%
October 2015 94.80%
November 2015 91.20%
December 2015 85.10%
January 2016 88.00%
February 2016 81.90%
March 2016 87.80%
April 2016 92.30%
May 2016 93.80%
June 2016 92.50%
July 2016 93.20%
August 2016 95.00%
September 2016 94.00%
October 2016 95.00%
November 2016 94.00%
December 2016 87.00%
January 2017 88.40%
February 2017 91.60%
March 2017 92.40%
April 2017 92.30%
May 2017 96.30%
June 2017 94.30%
July 2017 94.70%
August 2017 98.80%
September 2017 95.90%
October 2017 95.30%
November 2017 92.10%
December 2017 90.90%
January 2018 93.60%
February 2018 92.90%
March 2018 93.60%
April 2018 94.10%
May 2018 91.70%
June 2018 92.90%
July 2018 94.00%
August 2018 94.00%
September 2018 94.60%
October 2018 94.30%

However, employee survey results indicate that 29% of front line employees report that clients often claim to have received conflicting information from another channel. An additional 39% of respondents indicate that this occurs sometimesFootnote 63. The most commonly identified sources of conflicting information are the in-person service centres and the Specialized Call Centres, according to surveyed employees.

Key informants suggested that the multi-channel model, with its divisions by channel, may create service gaps. These can take the form of delays in communicating program changes to all service delivery channels and can limit the ability to share client information across channels, tiers, and programs. About half of the in-person Citizen Service Officers and telephone channel agents affirmed that sufficient efforts were made to ensure consistent information across service delivery channels and regions.

Key informant evidence indicates that quality monitoring practices differ between channels, and that there may be an inconsistent approach to quality assurance between programs.

In-person Citizen Service Officers and 1 800 O-Canada agents reported they are unable to respond to clients’ detailed program-related questionsFootnote 64 because they do not have the authority or training to do so. A second commonly reported reason why employees could not respond to client questions was that the information was not in their reference tools, because Tier 1 agents are not authorized to respond to clients’ case-specific questions.

Both in-person Citizen Service Officers and 1 800 O-Canada agents use IMPACTFootnote 65 as their reference tool in interactions with clients. This tool is intended to support the accuracy and consistency of information provided to clients. Key informant results indicates that IMPACT is tailored to meet the specific needs of each channel and is regularly updated to reflect program and policy changes. Moreover, key informants noted that unlike 1 800 O-Canada agents, in-person Citizen Service Officers are not required to use IMPACT and may find the tool unclear and lacking in region-specific information.

Further analysis of training data indicates differences in training across the 3 channels. Figure 9 shows that for the most part, Specialized Call Centre agents were more likely to give higher satisfaction ratings to their reference tool (the Common Reference Tool) compared to in-person and 1 800 O-Canada agents. Specialized Call Centre agents gave higher ratings on average when asked if their reference tool’s information is current/up-to-date and addresses client requests. A notable exception is that 1 800 O-Canada agents are most satisfied that information is easy to find in their version of IMPACT, with 67% reporting satisfaction compared to 23% of in-person Citizen Service Officers.

Key informants suggested that a possible explanation for lower rates of in-person Citizen Service Officer satisfaction with IMPACT may be that there is a need for improved training, especially in the context of changes in the reference tool between 2014 and 2016. As for the multi-channel model, it is noteworthy that front line employees have access to the level and detail of information and authorizations necessary for their tier and channel’s role in the model.

Figure 9: Employee satisfaction with reference tools

Figure 9

Source: Prairie Research Associates Inc. (2018), “Providing Services and Information to Canadians through Service Canada (PSIC) Evaluation: Online Survey of Service Canada Employees” technical report, prepared for Employment Social Development Canada (internal document).

Figure 9: text description
Respondent group Information is easy to find Information addresses client requests Information is current/up-to-date
Specialized Call Centre employees (Canada Pension Plan/Old Age Security) - satisfied (4, 5) 47% 75% 83%
1 800 employees - satisfied (4, 5) 67% 54% 79%
In-person employees - satisfied (4, 5) 23% 48% 60%

As demonstrated in Figure 9, in-person Citizen Service Officers reported the lowest levels of satisfaction with their reference tool, IMPACT.

Similarly, Figure 10 shows considerable variance between different channels regarding the extent to which they rate their training as adequate, relevant, and up to date. Just over half of in-person Citizen Service Officers report that the training they receive is adequate, relevant, and up to date compared to over 83% of 1 800 O-Canada agents, and approximately 3 quarters of Specialized Call Centre agents. The lowest satisfaction amongst employees across all channels related to the refresher training they received.

Figure 10: Employee satisfaction with training

Figure 10

Source: Prairie Research Associates Inc. (2018), “Providing Services and Information to Canadians through Service Canada (PSIC) Evaluation: Online Survey of Service Canada Employees” technical report, prepared for Employment Social Development Canada (internal document).

Figure 10: text description
Respondent group Refresher training Up-to-date training (training is current based on changes to programs, etc.) Adequate training (proper training to conduct your job) Relevant training (proper training to provide required info to clients)
Specialized Call Centre employees (Canada Pension Plan/Old Age Security) - satisfied (4, 5) 45% 73% 75% 75%
1 800 employees - satisfied (4, 5) 69% 83% 85% 85%
In-person employees - satisfied (4, 5) 37% 53% 52% 55%

3.7 Awareness of the Canada Pension Plan Retirement Pension

Clients access general information regarding Canada Pension Plan Retirement Pension and have an overall awareness of the program and their eligibility for it. However, some clients find the information difficult to read through, and feel that it may not address their questions.

Many clients “don’t know what they don’t know”. They lack knowledge of program details, and do not access the key information required to make informed and optimal decisions regarding when to begin their pension. Clients with lower levels of education are less likely to use the tools and information available to inform themselves.

Given the complexity of the Canada Pension Plan Retirement Pension, clients expect the government to better support them in making informed and optimal decisions by more proactively providing sufficient information.

This section presents results of a focused examination of the provision of services and information regarding the Canada Pension Plan Retirement Pension. These client specific findings serve to further bolster general findings presented in this report, which may be relevant to client needs regarding the delivery of other programs.

The Canada Pension Plan Retirement Pension is 1 of 3 pillars of Canada’s Retirement Income SystemFootnote 66. As such, it is intended to provide up to 25% income replacementFootnote 67. The Canada Pension Plan Retirement Pension is a very complex and flexible program. The amount of an individual’s pension depends on the amount and duration of their contribution to the Canada Pension Plan Retirement Pension and the age when they start the pension.

Retirement Pension start age

Age 65 is the standard age to begin receiving the pension. If an individual begins the pension before age 65, it is reduced by 0.6% for each month before age 65Footnote 68. Therefore, an individual who starts receiving their Retirement Pension at the earliest possible age of 60 will receive 36% less than if they had taken it at 65Footnote 69. Thus, the decision to begin receiving the Canada Pension Plan Retirement Pension is a complex 1 which requires individuals to consider not only their Canada Pension Plan Retirement Pension contributions, but other sources of retirement income as well as their relative financial wealth, need, and their general health and anticipated life expectancy.

The Canada Pensions Plan Retirement Pension Survey found that a majority of people surveyed applied before the age of 65 thus incurring lifelong reductions in their pension benefit. A large majority (87%) of survey respondents also reported that they fully understood the impact of their starting age on the amount of their monthly benefit. However, when taking a closer look at this issue, focus groups found that many clients simply “don’t know what they don’t know”Footnote 70. For example, they noted a lack of information about pension details, and about their personal situation, resulting in many people not applying for provisions that may increase their pension entitlement if eligible. Therefore, they possibly may not be making optimal decisions regarding when to begin their pension.

Furthermore, for many clients, their main considerations for beginning their pension before age 65 include health, quality of life, uncertainty about personal life expectancy, immediate financial need, and a sense that the difference in monthly benefit was not worth waiting to applyFootnote 71.

Awareness of Canada Pension Plan Retirement Pension

Focus group evidence indicates that, with the exception of some Indigenous people, most people have a general awareness of the Canada Pension Plan Retirement Pension, and whether they are eligible for it. General information about the Retirement Pension is available on the Canada Pension Plan Retirement Pension website. Many clients access this general information. For example, results of the survey of Canada Pension Plan Retirement clients indicates that 73% of respondents sought general information about the program before applying, slightly more than half (55%) sought information about the impact of starting their Retirement Pension before or after age 65, and 32% sought information about specific pension provisions.

Nevertheless, findings from multiple lines of evidenceFootnote 72 indicate that some clients find the general information difficult to read through, and that it may not address their questions. For example, there are no explicit examples of the dollar amount of pension benefit that may be lost by applying before the standard age of 65.

Pension Plan contributions are not mandatory for Indigenous people living and working on reserves. Therefore, Indigenous people working on reserve may have lower, if any, pension amounts, including fewer supplementary benefits for the families in case of disability or death. Results suggest that increased information about Canada Pension Plan Retirement Pension may be helpful not only to current applicants, but may also assist younger Indigenous people employed on reserve to plan for their own eventual retirement.

Use of government information and tools to inform decisions on the Canada Pension Plan

Because the Retirement Pension is based on contributions made over a lifetime, clients require personalized information such as the amount of contributions they have made to the Canada Pension Plan Retirement Pension in order to understand the pension amount to which they are entitled, and thus to make an informed decision about the optimal age at which to begin their pension.

Such personalized information is not available on the Canada Pension Plan Retirement Pension website or through the in-person or 1 800 O-Canada channels. Rather, this crucial information is available only through Tier 2 services including the My Service Canada Account, and the Specialized Call CentresFootnote 73.

Results of the survey of Canada Pension Plan Retirement clients indicates that less than 1 third of surveyed respondents reported using the most important tools and personalized information including their estimated monthly benefits in My Service Canada Account (31%), their Statement of Contributions (22%), or the Canadian Retirement Income Calculator (19%). Only 3% of surveyed clients reported consulting a financial advisor. Focus group results are consistent with these findings.

Results from a survey of Canada Pension Plan Retirement Pension clients also indicate a clear trend that respondents with lower levels of education and income are less likely to use available tools and information than respondents with higher levels of education and income. Fully 62% of respondents with less than high school did not use any tools or information compared to 38% of those with a completed post-secondary credential.

Additionally, results from focus groups with Canada Pension Plan Retirement Pension clients indicate that many clients turn to non-Government sources for information about the Canada Pension Plan Retirement Pension including friends and family (whose knowledge may not be accurate) and financial advisors (who may not provide impartial advice), and whose services may not be accessible to all CanadiansFootnote 74. Other sources of information include workplace information sessions, and in some instances, disability service providers, both of which clients consider helpful.

Results of the survey and focus groups with Canada Pension Plan Retirement Pension clients further indicate that clients were not often prompted by Service Canada front line employees or the website to consider important factors when deciding the age at which to begin their Retirement Pension including: age (43%); contributions made (29%); health (17%); savings, investments, private pensions (approximately 15%). 36% of surveyed clients reported they were not prompted to consider any of these factors. As noted previously, it is beyond the mandate of front line employees to advise clients regarding the best age to begin their pensions.

Client expectations for information

Focus group results suggests that many clients find the process of trying to inform oneself in order to make the best possible decision “daunting”, even for those who were comfortable and confident in doing their own research. These findings spanned all categories of focus group participants - urban/rural/remote, all education levels, and whether or not a member of a potentially vulnerable group, such as Indigenous or immigrant.

Governments in other countries offer different types of free services, such as seminars and individual appointments, to inform the public about their pension and retirement options. Although some of these services are personalized, governments stop short of providing financial advice or making decisions for clients. (Refer to Appendix D for more details.)

While front line employees report that pensions clients often ask for advice, few surveyed clients are prompted to consider key factors in deciding when to begin their Retirement Pension, very few consulted a financial advisor, and a minority of surveyed clients accessed Government of Canada personalized information and tools that could support them to make a fully informed and optimal decision regarding when to begin their pension. The comments made by several of the participants indicated a feeling of being without support to help them understand how to make this important life decision. Across the groups, participants desired more information and support and several comments indicated a lack of knowledge of available supports.

Moreover, focus group evidence is clear and consistent across focus groups that clients want the Government of Canada to provide them with more proactive direction to support them to make an informed and optimal decision.

3.8 Challenges meeting needs of population groups at higher risk of being vulnerable

Some population groups are more likely to experience non-digital and digital barriers to obtaining the services and information they need. In addition, they may experience more than 1 barrier simultaneously, which can affect access to and the level of satisfaction with the services and information provided by Service Canada.

Non-digital barriers include physical and cognitive limitations, difficulty understanding bureaucratic language in government documents and forms, and negative historical and cultural experiences interacting with the Government of Canada. Satisfaction rates among clients who have experienced non-digital barriers are approximately 20% lower than among other clients.

Digital barriers are those that specifically affect a client’s access to and use of digital services. Some examples of populations at higher risk of facing digital barriers include:

Population groups that are more likely to experience more than 1 digital barrier may be in greater need of service delivery supports through non-digital channels. In the context of increasing digital service offerings, Employment Social Development Canada has developed an E-Vulnerability Index that conceptualizes and measures vulnerability to digital barriers on 3 dimensions: Internet access (infrastructure and cost); comfortability; and competency. The index is intended to help identify Service Canada Centres in areas with high numbers of clients who may experience digital barriers, which can help Service Canada to best support these clients.

Non-digital barriers for population groups at higher risk of being vulnerable

Several population groups experience challenges accessing the services and information they require. For example, some seniors experience physical and/or cognitive challenges such as hearing loss or memory problems that may interfere with their ability to negotiate the Interactive Voice Response systems in the telephone channels, as well as remembering passwords for online accounts such as My Service Canada Account.

Service Canada’s Client Experience Survey (2017) results indicate that among clients with restrictions (including physical restrictions, cognitive/mental health restrictions and others,) satisfaction rates are approximately 20% lower than those with no restrictions affecting their ability to access services.

The literature also suggests that overly bureaucratic language in government documents can be particularly challenging for those with a low level of literacy including people whose first language is neither French nor English. This issue has also been identified as particularly problematic for some Indigenous seniors who experience a general lack of trust in government.

Residential school survivors may avoid interacting with government, afraid they may get into trouble if they make mistakes completing government forms and concerned that by giving private information to the government they are giving up part of themselves to the government. Among Indigenous Canada Pension Plan Retirement Pension clients in particular, focus group findings pointed to some cultural issues that may create further barriers for some people. For example, Nunavut focus group participants noted a cultural reluctance to discuss financial matters including pension benefits.

Digital barriers

Results from a survey and focus group study with Canada Pension Plan Retirement Pension clients confirms that several populations experience elements of e-vulnerability that may pose barriers to their ability to use digital services.

For example, results of the survey of Canada Pension Plan Retirement Pension clients indicates that 16% of respondents did not know how to apply online and 13% did not have a computer. This was especially true of clients in remote communities who were also more likely to report not having access to the Internet at home.

Survey results also indicate that people with higher education and income levels were more likely to use the internet to find information and apply for benefits. By contrast, immigrants, persons with disabilities, and Indigenous respondents were more likely to access in-person services.

Digital barriers exist for service delivery in general. Employee survey results suggest that clients may experience a range of digital barriers, as evidenced in Figure 11. When given the opportunity to explain their selection, surveyed employees also reported that clients refer to other barriers including a lack of computer and or computer literacy, as well as preferring to resolve issues either in person or on the telephone. Additional digital barriers reported include challenges finding required information on the website and concern that information on the website is not clear, sufficient, or specific to their needs. These findings are consistent with Client Experience Survey (2017) results reported on in previous sections.

Figure 11: Digital services barriers experienced by clients as reported by employees (percent of survey respondents who reported the following barriers)

Figure 11

Source: Prairie Research Associates Inc. (2018), “Providing Services and Information to Canadians through Service Canada (PSIC) Evaluation: Online Survey of Service Canada Employees” technical report, prepared for Employment Social Development Canada (internal document).

Figure 11: text description
Barriers Often (51% to 75% of the time) Almost always (76% to 100% of the time) Total
No barriers 5% 1% 6%
Other 11% 7% 18%
Never received Personal Access Code in the mail 9% 3% 12%
Lack of linkage between My Service Canada Account and My Canada Revenue Agency Account 8% 6% 13%
Received the Personal Access Code in the mail but still can't sign in 23% 8% 30%
Can't remember how to navigate the site 34% 11% 45%
Don't have a computer/ability to afford a computer 46% 9% 56%
Don't have Internet/high-speed Internet access at home 45% 11% 56%
Can't find what they are looking for on the website 40% 17% 57%
Can't remember password 42% 21% 62%
Don't know how to use/not familiar with the Internet 50% 16% 66%
Don't know how to use/not familiar with computers 53% 18% 71%
Too many steps in process to register for My Service Canada Account 33% 41% 74%

E-vulnerability

Employment Social Development Canada uses the term “e-vulnerability” to refer to the concept of “digital divide”, namely, the gap between different population groups regarding their opportunities and abilities to access and use digital technologies.

Employment Social Development Canada recently developed an “E-Vulnerability Index” which can identify specific Service Canada Centres serving a population with high numbers of individuals that are at a higher risk of being vulnerable to experiencing digital barriers to obtaining services and information. By providing Service Canada with such location-specific information about e-vulnerable clients, the index is a useful tool to support Service Canada in supporting e-vulnerable clients with their needs for services and information.

The index measures 3 dimensions of cyber vulnerability:

With services being increasingly offered through the Internet, there are people who may need different kinds of support. A review of the literature indicates that several population groups, including some seniors, those living in rural or remote regions, people with lower levels of income, people with lower levels of education, and some Indigenous people, may have a higher likelihood of experiencing 1 or more of these dimensions of e-vulnerability.

For the Canada Pension Plan Retirement Pension program in particular, focus group results indicate that some participants experienced elements of e-vulnerability, particularly about being comfortable with technology. This was the case for participants in urban, rural and remote focus group locations, although it was less of an issue among urban participants. In addition, Indigenous and immigrant participants with less education preferred to complete their applications in person with assistance, suggesting a lack of comfort with e-services.

Seniors

A 65-year-old male immigrant in an urban setting may have different needs than a 78-year-old Indigenous woman living on a reserve in northern Canada, in part, because of differences in their respective levels of education, income, health, literacy, and official language.

The literature indicates that some seniors may be more likely to experience barriers specifically related to the e-vulnerability dimensions of comfortability and competence. Research indicates that age is 1 of the most common barriers to using online services; in general, seniors are less likely to use the online channel (24%) compared to those under 35 years of age (48%).

Seniors over the age of 75 have been found to be much less likely than seniors aged 65 to 75 to use the Internet channel, on average. It bears noting that age-related differences in Internet usage may diminish over time with baby boomers (aged 45 to 65) increasingly turning to the Internet as a source of information for retirement planning, and that daily Internet usage is increasing among older (aged 45 and older) Canadians. This is consistent with results from a survey and focus group study conducted with recent applicants to the Canada Pension Plan Retirement Pension, indicating a high level of use of the internet to search for information and apply for the pension.

From a Gender-Based Analysis Plus perspective, without focusing on any particular program, the literature indicates that the primary difference in the use of Internet can be accounted for by the lower usage rates of Canadians who are both older and low income. For example, in 2012, only 28% of Canadians aged 65 or over in the lowest income quartile used the Internet, compared with 95% of individuals aged 16 to 24 in households in the lowest income quartile.

The literature indicates that a person’s age and level of education are significantly related to proficiency in a technology-rich environment, with 29% of people aged 45 to 54 demonstrating high proficiency levels compared to only 17% of people aged 55 to 65. In addition, seniors in general, may have a higher preference for traditional service channels, especially older seniors, Indigenous seniors, and seniors with official language and/or literacy challenges. This finding is consistent with evidence from the focus group study for the Canada Pension Plan Retirement Pension programFootnote 75.

People living in rural and remote geographical areas

A review of the literature indicates that people living in rural and remote geographical areas may be more likely to experience challenges especially related to the e-vulnerability dimension of Internet access. To focus group participants in Nunavut confirmed internet accessibility remains an issue.

A review of recent Canadian literature indicates that broadband Internet access is available to all Canadians in urban areas, compared to only 85% in rural areas. This lower level of wireless connectivity in some rural communities, including some which are close to large urban centres, is recognized as a significant barrier for accessing services and economic opportunitiesFootnote 76.

To the extent that government service delivery in rural and remote areas, including Northern communities, also relies on Internet connectivity, Internet access issues can also negatively affect these clients’ ability to access Government services and information. These challenges extend to the access and use of Client Access Workstation Services at Service Canada Centres, as well as Service Canada’s outreach efforts in these communities.

Internet cost also poses an access barrier for some Canadians. Canada has some of the highest Internet costs on a global scaleFootnote 77. There is also a geographic component to cost, with urban households generally paying less and having more choices of service providers and types of service than those living in rural areasFootnote 78.

Finally, Internet speed has also been identified as a potential barrier. Research indicates that while 99.3% of Canadian households have access to a broadband download speed of at least 5 MbpsFootnote 79, Canada a relatively slow Internet speed, ranking 19th in the worldFootnote 80.

People with lower levels of income

A review of the literature indicates that people with lower levels of income may experience challenges related to the e-vulnerability dimension of Internet access, specifically concerning affordability. Employee survey results suggest that clients often report they do not have Internet/high-speed Internet access at home and do not have a computer/ability to afford a computer.

Recent research findings indicate that lower-income households are less likely to have Internet subscriptions, and households in the lower income quartile are more likely to have a cellphone (66.8%) than home computer access to Internet (59.7%). The literature suggests that these households may choose to allocate their resources to a service that can provide multiple means of communications – such as telephone and Internet – rather than subscribing to each service individually. Research also indicates that while lower-income households spend less on communications services than higher-income households, they also spend 3 times more on broadband expenditures, as a percentage of their annual income, than the average Canadian household.

People with lower levels of education

A review of the literature indicates that people with lower levels of education may experience challenges especially related to the e-vulnerability dimension of competency. For example, recent results from the Employment Insurance Service Quality Review Survey of Clients found that Employment Insurance clients with lower levels of education were more likely to have difficulties with completing online applications, to require assistance completing an application, and to agree that Client Access Workstation Services where assistance could be provided in-person were helpful.

Service Canada’s Client Experience Survey (2017) results across 6 Employment Social Development Canada programs are consistent, indicating that, on average, individuals with lower education levels were less likely to seek general information online; more likely to need help completing their applications; and, less likely to say completing steps online made the process easier.

Findings from the Programme for the International Assessment of Adult Competencies indicate that in Canada, adults with university-level education possess greater literacy, numeracy, and information-processing skills on average than those with less than university education. Moreover, evidence from the literature indicate that unemployed people and those not in the labour force, generally have poorer information-processing skills than employed people.

Indigenous people

The literature indicates that Indigenous people may be more likely to experience barriers related to all 3 dimensions of e-vulnerability.

Table 3 presents the percentages of First Nations reserves by geographical location that have access to at least 1 broadband Internet service provider, compared to the population as a whole. It indicates that access on all reserves at the national level is only 70% compared to 94% of Internet access for all Canadian households, with access in remote reserves at only 57%. (Refer to Table 3). Moreover, broadband services are offered in a majority of reserves by a single service provider, resulting in higher costs due to lack of competition.

Table 3: First Nations reserves’ access to broadband Internet services (2011)
Population group Percentage with access broadband Internet services
Canadian households (2009) 94%
First Nations reserves (at a national level) 70%
Reserves located in urban areas 78%
Reserves - rural areas 70%
Reserves - remote areas 57%

Source: Centre for the Study of Living Standards (2013), “The Contribution of Broadband to the Economic Development of First Nations in Canada”.

In addition, Statistics Canada evidence indicates that on average, Indigenous people are more likely to experience higher levels of unemployment, have lower levels of income, and experience lower levels of educational attainment compared to the national averageFootnote 81. In light of the challenges related to these barriers described previously, this population may face a higher likelihood of experiencing digital barriers.

Finally, as noted previously, Indigenous people, especially seniors, may be more likely to experience issues related to comfortability with digital services, and may prefer face-to-face interactions. This is confirmed by both survey and focus group results with Canada Pension Plan Retirement clients.

The department’s current outreach initiatives (refer to sections 2.2 and 3.3) are intended to enhance the delivery of services and information to those Indigenous peoples who may be at higher risk of experiencing barriers, which should ultimately help them to access the programs and benefits to which they are entitled. Such an outcome would clearly be beneficial to individuals from this population group who are experiencing these barriers. This would contribute to meeting government and departmental priorities for both service delivery and reconciliation.

Immigrants

Results of Statistics Canada’s 2013 Programme for the International Assessment of Adult Competencies indicate that on average, immigrants obtain lower literacy and numeracy scores, as well as lower scores on the Problem Solving in Technology-Rich Environment component compared to Canadian-born respondents. While proficiency scores vary considerably among sub-groups of immigrant population, results indicate lower literacy, numeracy, and Problem Solving in Technology-Rich Environment scores even among immigrants with university and professional level degrees. This includes immigrants who obtained their highest level of education in Canada. A review of literature also suggests that lower proficiency in Canada’s official languages may contribute to lower results among immigrants.

Results of the survey with Canada Pension Plan Retirement Pension clients also indicate that immigrant respondents reported that they sought help when applying for benefits because they did not understand the process and the application form was too complicated.

4 Key conclusions and recommendations

Guided by the Policy on Service and the Policy on Communications and Federal Identity, Service Canada aims to provide clients with timely and accurate government information and services that meet the diverse information needs of the publicFootnote 82. Service Canada operates in a context of rising and evolving client expectations of service delivery. In recent years, Service Canada has been implementing a broad array of service transformation initiatives across all channels of service delivery with a goal of better meeting clients’ expectations. Guided by the Service Transformation Plan, Service Canada’s modernization efforts are focused on extending digital service offerings, enhancing information technology infrastructure, increasing automation and self-serve options, and introducing or re-introducing targeted service offerings for specific population groups. In light of the substantial and complex transformation efforts underway to improve service delivery, and because this evaluation offers several findings that support these efforts, no recommendations are made.

3 overarching conclusions and 2 recommendations emerge from this evaluation:

1. Service Canada is meeting most client needs for access to services and general information, although challenges exist with timeliness and access to Specialized Call Centres

Overall, clients were found to be able to access the services and general information they require through their preferred channel, in the official language of their choice, and in a timely manner, with a high level of satisfaction. An exception involves timeliness, and accessibility challenges for clients who are looking for personalized information on the Canada Pension Plan Retirement Pension that pertains to their specific situation and needs, such as information on their expected individual pension amounts. Issues were raised about Specialized Call Centres, including an increase in High Volume Messages and wait times and high proportion of abandoned calls, albeit within the 10-minute service threshold. Clients often switch to other channels as a result of difficulties in obtaining the information they require via their preferred channelFootnote 83. The movement between channels reflects that the service delivery model is functioning as designed, with many clients using multiple channels to obtain the information they are seeking. However, client satisfaction decreases as the number of channels used increases, and a number of clients are lost in transition or refuse to proceed to another channel.

Regarding this key finding on Specialized Call Centres, Report 1 of the 2019 Spring Reports of the Auditor General of Canada identified similar challenges noted in this evaluation. It included recommendations, for which the department will be undertaking the following actions:

Since the department has initiated efforts to address the concerns raised pertaining to Specialized Call Centers, no additional recommendations are required.

2. Canadians need and expect improved information to support informed and optimal decision-making regarding complex programs such as the Canada Pension Plan Retirement Pension

General program information regarding Canada Pension Plan Retirement Pension available through all channels is not sufficient to support clients in making informed and optimal decisions regarding the best age to begin their Retirement Pension. Although, the personalized information that clients require to support such decisions is available through Canada Pension Plan/Old Age Security Specialized Call Centres and online through the My Service Canada Account, few clients access this information or use the tools available. In addition, clients were found to lack sufficient knowledge of program details, as well as crucial information such as their lifetime contributions, and generally find it “daunting” to inform themselves sufficiently to make the best decision for themselves. Given the complexity of the Canada Pension Plan Retirement Pension program and the life-long repercussions of the decisions, clients expect the government to support them by more proactively providing easy to understand information that is relevant to clients’ personal situations.

Recommendation #1: Explore innovative options to meeting clients’ needs for specific, personalized information about their Canada Pension Plan Retirement Pension

3. Some Canadians living in rural and remote areas as well as Indigenous people and people with lower levels of education experience barriers to the services and information they require

Some population groups experience greater challenges obtaining services and information that meet their needs, as evidenced by the lower client satisfaction rates among Indigenous people, and people with disabilities. Other population groups at higher risk of experiencing barriers to receiving services and information include people living in rural and remote geographic locations, immigrants and people with lower levels of official language literacy, people with lower levels of income and education, and Indigenous people. These populations may be the least likely to know how to access the services and information they require, and are more likely than other population groups to use the In-Person channel. Moreover, evidence indicates that these population groups may experience a range of non-digital and digital barriers.

Recommendation #2: Continue to identify and reduce barriers in accessing services and benefits amongst potentially vulnerable populations and explore inclusive approaches to providing those services.

Appendix A – Evaluation questions

  1. To what extent does Service Canada’s provision of services and information address a demonstrable need among Canadians generally and specifically among target groups?
  2. To what extent does Service Canada’s current and future provision of services and information about Employment Social Development Canada programs to all Canadians align with government priorities, federal roles and responsibilities?
  3. To what extent are Canadians aware of existing programs and services available via different service delivery channels?
  4. To what extent does Service Canada provide accurate, timely and easy access to Employment Social Development Canada services and information needed by Canadians?
    1. Does channel use vary depending on program, demographic group including target group, and geographic location?
    2. To what extent are clients’ needs for services and information met by the 3 main service delivery channels?
    3. To what extent do clients achieve desired results at first contact? Are there differences by channel?
    4. To what extent does each service delivery channel enhance and/or create barriers to clients’ access to the information and services they require?
    5. What are the factors that could limit Canada Pension Plan Retirement Pension clients’ abilities to use e-service delivery mechanisms to access the services and information they need?
  5. What are the factors that contribute to client movement between different service delivery channels, including movement to the In-Person channel?
  6. To what extent is the alignment between the client-facing service channels and the internal mechanisms that guide the provision of services and information, conducive to service delivery in a timely and accurate manner?
  7. How is service delivery evolving in other jurisdictions in Canada and internationally?
  8. To what extent is the performance measurement strategy accurate, reliable, and complete to support ongoing monitoring and assessment of activities, outputs, and outcomes?
  9. To what extent is the revised infrastructure helping to achieve identified program policy outcomes?
  10. Does Service Canada provide cost-effective access to Employment Social Development Canada services and benefits that Canadians need?

Appendix B – Methods and limitations

This evaluation measured and reported on the contribution of program efforts to realize outcomes pertaining to client service, such as client ability to access timely services and accurate information in the official language of their choice, and through the service delivery channel that best meets their needs. Attribution of impact was not possible because of the nature of the program.

Methods

The following studies were used as lines of evidence for this evaluation. In addition, a Gender-Based Analysis Plus lens was applied to this evaluation to inform data collection and analysis.

Survey of Canada Pension Plan Retirement Pension clients

A survey of Canada Pension Plan Retirement Pension clients was conducted on their recent interactions with Service Canada channels (1 800 O-Canada; Specialized Call Centres, Service Canada Centres, online). Survey questions inquired about clients’ needs for information, the extent to which they were able to meet their needs for information about the Canada Pension Plan Retirement Pension in order to make informed decisions regarding the age at which to begin receiving their benefit. Questions also explored client experiences with service delivery through the various channels. A Gender-Based Analysis Plus approach informed analysis of survey data to produce findings concerning vulnerable populations. The survey was conducted by phone and online from January 7 to March 4, 2019, and achieved 2,017 completions with a survey response rate of 15%.

Survey of Service Canada front line employees

The survey was conducted with Service Canada front line employees or contractors who provide general services and information through Service Canada Centres, mobile outreach services, and 1 800 O-Canada. It also included agents who provide pensions-related services and information through the Canada Pension Plan/Old Age Security Specialized Call Centres. The survey consisted of 120 close-ended and 12 open-ended questionsFootnote 84. It was conducted online through Employment Social Development Canada’s intranet and was made available on the Internet for employees to complete at home on September 7, 2017Footnote 85. A total of 1,224 responses were received for an overall response rate of 63%.

Focus group study with Canada Pension Plan Retirement Pension clients

A focus group study was conducted with Canada Pension Plan Retirement Pension clients on their recent interactions with Service Canada channels (1 800 O-Canada; Specialized Call Centres, Service Canada Centres, online). The objective was to obtain information regarding their needs, expectations, and experiences accessing necessary Canada Pension Plan Retirement Pension-related services and information through Service Canada. The study included 20 focus groups, with a total of 133 individuals who submitted their Canada Pension Plan Retirement Pension applications on or after October 1, 2017. Focus groups were conducted in urban, rural and remote areas, and in both official languages. Efforts were made to ensure focus groups were conducted with potentially vulnerable populations including Indigenous people and immigrants. Focus groups were conducted in February and March 2019.

Key informant interviews

A total of 62 semi-structured interviews were conducted with 64 program officials and other stakeholders to collect in-depth information for specific evaluation questionsFootnote 86. Key informants were selected in collaboration with Service Canada. 1-hour interviews were conducted from September 2017 to March 2018 with the employees of Employment Social Development Canada, with most interviewees being employees of Service Canada.

Administrative data review

A review and analysis of administrative documents was conducted in order to develop a thorough understanding of data collection for Service Canada’s service delivery channels. The review covered Employment Insurance (regular benefits, maternity/parental benefits, and sickness benefits), Old Age Security (including the Guaranteed Income Supplement) and Canada Pension Plan Retirement Pension. The review also used statistics on the accuracy of the payment processing for these 3 programs from the fiscal year 2015 to 2016 Processing Payment Accuracy Review - Annual Report for Employment Insurance, Old Age Security.

Administrative document and file review

The review consisted of internal documentation which guide and describe Service Canada’s delivery of services and information to Canadians. The review covered approximately 120 documents from 2011 to 2017 provided by partners in Service Canada and collected from internal and public Web content. Documents included Service Canada dashboards, performance reports, strategic documents, unclassified internal communications and presentations, and online content from Employment Social Development Canada’s intranet site and Canada.ca. The document review provided important context for a number of evaluation questions.

Web analytics

The Web analytics study collected data on the Internet channel, including use for information and for applications, ease of access and use, and visitor characteristics. Data was collected for the period of December 2015 to December 2017, with a focus on the Canada Pension Plan Retirement Pension website’s 7 service initiation template pages: Overview; Eligibility; How much you could receive; What you need before you start; Apply; After you’ve applied; and While on Canada Pension Plan.

Canada.ca Web Exit Survey and Standardized User Experience Percentile Rank Questionnaire Survey

The Canada.ca Web Exit Survey is a pop-up survey which asks users a series of questions related to their visit to Canada.ca. For the evaluation, survey response data was analyzed for clients who identified the purpose of their visit as being: to learn about Canada Pension Plan, to apply for Canada Pension Plan, to apply for Employment Insurance, to check the status of their Employment Insurance claim, or to submit an Employment Insurance report. The survey provides important information on respondents’ experience with the website’s level of difficulty, accessibility, the amount of time spent, difficulty of comprehending the information, channel mobility, and overall satisfaction.

Additionally, the Standardized User Experience Percentile Rank Questionnaire data from October 2017 to October 2018 was also analyzed. The Standardized User Experience Percentile Rank Questionnaire is an 8- item questionnaire which includes questions pertaining to the overall quality, usability, credibility, trust, loyalty, and appearance. Respondents answer various questions on a value score of 1 (strongly disagree) to 5 (strongly agree). The clients responding to the Questionnaire were using Canada.ca to apply for the Canada Pension Plan, learn about Canada Pension Plan, apply for Employment Insurance, check the status of their Employment Insurance, and submit an Employment Insurance report.

Literature review

The review covers literature from 2006 to 2018. It includes peer reviewed academic articles, grey literature, media coverage, and internal government research on service delivery and modernization initiatives (Canada and international) in order to address evaluation questions.

Service Canada’s Client Experience Survey (2017)

Although not a formal line of evidence, results from the Service Canada Client Experience Survey were used to inform this evaluation. Requests for further information on the Client Experience Survey (2017) can be directed to the Client Feedback Centre of Expertise, Citizen Service Branch.

Limitations

The focus group study and survey of clients is that they do not include respondents from Quebec, as pension beneficiaries residing in Quebec receive the Quebec Pension Plan rather than the Canada Pension Plan.

The Canada.ca Web Exit Survey data is not representative of any particular population and only shows the perceptions from those who responded to the exit survey.

Regarding the Web analytics, due to the Government of Canada’s migration from individual departmental websites to a single Government of Canada site, data was gathered from both ESDC.gc.ca pre-migration (fiscal year 2015 to 2016) and Canada.ca post-migration (fiscal year 2016 to 2017). Furthermore, 2 different tools were used to gather the analytics: Google Analytics (fiscal year 2015 to 2016) and Adobe Analytics (fiscal year 2016 to 2017). These differences limit comparisons between the 2 periods and result in certain data only being available for fiscal year 2016 to 2017.

While the department has made efforts to develop a service channel costing methodology, this work was suspended due to competing priorities. Therefore, the cost analysis is incomplete as a result of the limited information on cost per channel, cost per program and cost per unit of output.

Appendix C – List of technical reports

Please note that while technical studies are not published, they are available upon request.

Prairie Research Associates Inc. (2019), “Providing Services and Information to Canadians through Service Canada (PSIC) Evaluation: Survey of Canada Pension Plan Clients”, prepared for Employment Social Development Canada

Prairie Research Associates Inc. (2019), “Providing Services and Information to Canadians through Service Canada (PSIC) Evaluation: Focus Group Study with Canada Pension Plan Clients”, prepared for Employment Social Development Canada

Prairie Research Associates Inc. (2018), “Providing Services and Information to Canadians through Service Canada (PSIC) Evaluation: Online Survey of Service Canada Employees” prepared for Employment Social Development Canada

Prairie Research Associates Inc. (2017), “Providing Services and Information to Canadians through Service Canada (PSIC) Evaluation: Key Informant Interviews”, prepared for Employment Social Development Canada

Prairie Research Associates Inc. (2018), “The Evaluation of the Provision of Services and Information to Canadians (PSIC): Administrative Data Review”, prepared for Employment Social Development Canada

Employment Social Development Canada (2018), “Web Analytics Study in Support of Providing Services and Information to Canadians”

Employment Social Development Canada (2018), “Providing Services and Information to Canadians through Service Canada: Literature Review Technical Report”

Employment Social Development Canada (2018) “Providing Services and Information to Canadians through Service Canada: Administrative Document and File Review”

Requests for further information on the Client Experience Survey (2017) can be directed to the Office for Client Satisfaction, Citizen Service Branch.

Appendix D – Provision of pension information in Australia and the United Kingdom

Information on pensions can be provided using variety of programs and channels. The evaluation sought to understand some of the international trends in pension service and information delivery by analyzing how the Governments of Australia and the United Kingdom provide pension information. Both countries offer personalized services for information about their individual pension options, but these services do not provide financial advice. Common elements are as follows:

Specific services in Australia

The Financial Capability service provides free information, education, and coaching to help clients improve their financial literacy, manage their money, budget, and make informed decisions about their long-term finances.

MoneySmart is a website with information on managing personal finances, ranging from types of bank accounts and credit cards, to investment vehicles, to the impact of life events on finances. It has a Superannuation and Retirement tab, as well as a “Teaching” tab with financial literacy resources for teachers. It does not offer personal consultations.

The Financial Information Service provides free seminars, tools, and information on personal finances, retirement planning, and financial products. It does not give financial advice or make decisions for clients, but it holds free, in-person retirement and pension planning seminars across Australia. Assistance is also available by phone or via individual in-person appointments.

Specific services in the United Kingdom

Pension Wise is a free, impartial service that helps clients understand options for accessing their pension(s), such as tax implications and advantages and disadvantages of each option. During free hour-long appointments by phone or in person, the service helps people understand the factors they need to consider to make the optimal decision, including their personal and financial circumstances.

Note that a more detailed description and analysis of these options are available upon request.

Page details

Date modified: