Evaluation of the Addressing Air Pollution Horizontal Initiative

Evaluation of the Addressing Air Pollution Horizontal Initiative [PDF - 710 KB]

Acknowledgements

The Evaluation Project Team would like to thank the individuals who contributed to this project. In particular, we would like to acknowledge the contribution of program representatives from Environment and Climate Change Canada, Health Canada and the National Research Council Canada who provided input and comments to inform the findings and recommendations of this evaluation.

List of acronyms and abbreviations
AAPHI
Addressing Air Pollution Horizontal Initiative
AQHI
Air Quality Health Index
AQMS
Air Quality Management System
BLIER
Base-level Industrial Emissions Requirement
CAAQS
Canadian Ambient Air Quality Standards
CCME
Canadian Council of Ministers of the Environment
ECCC
Environment and Climate Change Canada
FY
Fiscal year
GBA+
Gender-based analysis plus
HC
Health Canada
NGO
Non-governmental organization
NOx
Nitrogen oxides
NRC
National Research Council Canada
O3
Ozone
PM2.5
Fine particulate matter
P/T
Provincial/territorial; provinces and territories
SOx
Sulphur oxides
US
United States of America
US EPA
United States Environmental Protection Agency
VOC
Volatile organic compound
WHO
World Health Organization

Executive summary

This report presents the findings from the evaluation of the Addressing Air Pollution Horizontal Initiative (AAPHI), the cornerstone of the federal government’s approach to addressing air pollution. The AAPHI is led by Environment and Climate Change Canada (ECCC) in collaboration with Health Canada (HC) and the National Research Council (NRC). It aims to improve air quality, reduce impacts of air pollution on health and the environment and provide Canadians with the tools to make informed decisions to reduce their exposure to indoor and outdoor air pollutants. Core activities include science and reporting; policy and analysis, mitigation actions for outdoor air quality and indoor air quality activities. ECCC, HC and NRC received about $90 million per year for AAPHI activities between fiscal year (FY) 2016 to 2017 and FY 2019 to 2020.

The evaluation focused on the period from FY 2016 to 2017 to the middle of FY 2019 to 2020 and included all AAPHI activities except HC’s work under the National Radon Program, which will be assessed as part of separate evaluation activities. The evaluation examined questions related to relevance, efficiency and effectiveness (as per the 2016 Treasury Board Policy on Results). Lines of evidence included document and data review, key informant interviews and focus groups.

Findings and conclusions

Relevance

Canada has a low level of ambient air pollution compared to some regions of the world and air quality in the country has generally improved over time. However, available scientific evidence, along with the potential implications of climate change and other emerging issues for air pollution and air quality, underscore the need for ongoing effort.

The AAPHI aligns with federal roles and responsibilities. All stakeholders agreed that the federal government’s role in addressing air pollution and air quality should continue. Both industry and provincial/territorial (P/T) participants in the evaluation emphasized the importance of avoiding duplication with P/T regulatory activities. P/T representatives urged the federal government to clearly articulate and share with the P/T its long-term “master plan” or agenda for air quality. This would help them in planning their own activities, avoid duplication and minimize regulatory and reporting impact on industry.

Although the AAPHI aligns with current federal priorities, there is considerable support among internal and external participants in the evaluation for enhancing its alignment with the government’s climate change and Indigenous reconciliation priorities.

Effectiveness

Key accomplishments of the AAPHI during the period covered by this evaluation include:

However, some planned mitigation measures for outdoor air have not advanced to the extent originally envisioned. These include the establishment, through regulatory or non-regulatory instruments, of BLIERs for a number of sectors, in particular those where consensus was not reached during the Air Quality Management System (AQMS) development process. Progress has been made in establishing BLIERs, including through the Multi-Sector Air Pollutants Regulations and a number of non-regulatory measures. Regulations to limit some volatile organic compounds (VOCs) from the petroleum refining sector establish some BLIERs for the refining sector, but planned regulations to reduce emissions of pollutants other than VOCs from the petroleum refining sector have not been brought forward. There was an expectation that the federal government would move forward appropriately to establish BLIERs where no consensus was reached. To date, this has not happened. However, many measures aimed at addressing climate change are expected to reduce air pollutant emissions in several sectors; there is a need to reconfirm the extent to which measures to address the air pollutants and industrial processes targeted by the BLIERs are still needed in light of these measures.

The need for action in relation to petroleum refineries is supported by data indicating that Canadian refineries emit far more pollutants than their counterparts in the United States and that one or more of the CAAQS for sulphur dioxide, nitrogen dioxide, ozone and fine particulate matter is being exceeded in seven out of 13 areas where there are petroleum refineries and oil sands upgraders. The Government of Canada indicated that it had begun to develop regulations to address these emissions in its 2018 response to Parliament on the review of the Canadian Environmental Protection Act, 1999.

The evaluation found evidence of progress toward some of the expected results of the AAPHI, although in some cases, evidence is lacking to support firm conclusions.

Efficiency

Internal and external participants in the evaluation consider the overall design of the AAPHI to be sound. Perceived strengths include its collaborative approach to delivering key activities, its robust research, science and technical expertise and capacity, its standardized approach to air quality monitoring and reporting and its focus on transparency and reporting to the public. They also saw Canada’s increased profile in recent years as an international leader with respect to air quality research and management as an important strength. International stakeholders praised Canada for its contributions on the international stage and encouraged it to continue playing a leadership role.

Several possible improvements to program design emerged from this evaluation.

Although the AAPHI was without a functional horizontal governance structure or approved air quality agenda for most of the period covered by this evaluation, both a formal governance structure and air quality work plan had been approved as of November 2019.

It is unclear to what extent performance information collected and reported under the AAPHI is being used to inform decision making. There are opportunities to revise the logic model and performance measurement framework to ensure that all program activities are adequately represented and to streamline the number of outcomes. There is also an opportunity to ensure that performance reporting occurs consistently over time for all outcomes and for both indoor and outdoor air. Currently, the ultimate outcomes pertain only to outdoor air.

Recommendations

The following recommendations are directed to ECCC’s Associate Assistant Deputy Minister of Environmental Protection Branch, as the lead senior departmental official responsible for the AAPHI, as well as to HC’s Assistant Deputy Minister of Healthy Environments and Consumer Safety Branch and NRC’s Vice President of Engineering. Deliverables below would be submitted to the ADM Oversight Committee of the Addressing Air Pollution Horizontal Initiative for approval.

Recommendation 1: Improve communication and outreach to partners, stakeholders and the general public related to federal air quality activities. This should include:

The evaluation evidence indicates that while the federal departments involved in the AAPHI generate a large quantity of high-quality information about air pollution and air quality, this information may not be effectively reaching the intended target audiences. Improving communications and outreach could help partners, stakeholders and the public to use the information generated by the program to inform and guide their own activities and behaviours.

Recommendation 2: Advance commitments to develop and establish outstanding Base-level Industrial Emissions Requirements, including in regulations to address emissions from petroleum refineries.

The federal commitment to develop and establish BLIERs, including for the refining sector, predates the AAPHI and the period covered by this evaluation. While some progress has been made to establish BLIERs in regulatory and non-regulatory instruments, including the Multi-Sector Air Pollutants Regulations and the regulations to limit VOC emissions from the refining sector, further steps should be taken to advance this work, if the need is reconfirmed.

In the case of refinery emissions, the need for action is underscored by data indicating that Canadian refineries emit far more pollutants than their counterparts in the United States and that one or more of the Canadian Ambient Air Quality Standards (CAAQS) for sulphur dioxide, nitrogen dioxide, ozone and fine particulate matter is being exceeded in seven out of 13 areas where there are petroleum refineries and oil sands upgraders. The Government of Canada indicated that it had begun to develop regulations to address these emissions in its 2018 response to Parliament on the review of the Canadian Environmental Protection Act, 1999.

Recommendation 3: Better integrate air quality and climate change policy and initiatives, while continuing to recognize these as distinct policy areas.

There is considerable support among internal and external participants in the evaluation for better integrating air quality and climate change policy. It is important to continue to recognize these as distinct policy areas. However, a more systematic consideration and accounting of the inter-relationships between them could optimize federal risk management strategies and improve alignment with the federal government’s climate change priority.

Recommendation 4: Support more meaningful engagement and consultation with Indigenous peoples and explore options for greater Indigenous involvement in air quality monitoring and management.

Evidence indicates that Indigenous peoples are particularly vulnerable to health-related risks, which can be the result of, or exacerbated by, environmental conditions in their communities, including air pollution. There is widespread support among evaluation participants for more meaningful engagement with Indigenous peoples on air quality issues to help mitigate these risks. This would also improve program alignment with the government’s reconciliation priority and the nation-to-nation principle.

Recommendation 5: Recognizing that Canadians spend a large proportion of time indoors and that concentrations of indoor air pollutants can be significant, consideration should be given to enhancing the initiative’s focus on indoor air quality.

At present, most AAPHI activities focus on outdoor air quality and there is limited information on the extent to which the public is aware of and using the information generated about indoor air quality. Increased emphasis on indoor air quality is warranted, considering the large proportion of time (90%) that Canadians spend indoors and the fact that concentrations of air pollutants can, in some circumstances, greatly exceed outdoor concentrations. A changing climate can also affect indoor air quality due to elevated levels of outdoor pollutants, such as smog, wildfire smoke and aeroallergens, that infiltrate into buildings and extreme weather events such as flooding that can lead to the presence of mould indoors.

Context

Overview

This report presents the findings of a horizontal evaluation of the Addressing Air Pollution Horizontal Initiative (AAPHI), the cornerstone of the federal government’s efforts to address air pollution. The AAPHI is led by Environment and Climate Change Canada (ECCC) in collaboration with Health Canada (HC) and the National Research Council (NRC). It aims to improve air quality, reduce impacts of air pollution on health and the environment and provide Canadians with the tools to make informed decisions to reduce their exposure to indoor and outdoor air pollutants.

The AAPHI is a continuation of previous work conducted under the Clean Air Regulatory Agenda, which was in place from 2006–07 to 2015–16. The Air Quality Management System (AQMS), a collaborative federal and provincial/territorial (P/T) approach to reducing air pollution, was established in October 2012. The AQMS consists of the following activities:

Activities to support the ongoing implementation of the AQMS across Canada are an important part of the AAPHI.

AAPHI activities

The AAPHI consists of activities in four main areas: science and reporting; policy and analysis; mitigation actions for outdoor air quality; and indoor air quality activities.

Science and reporting

Science and reporting activities, carried out by ECCC and HC, provide the information required to develop and implement air quality policy and risk management instruments. Foundational research, air quality monitoring and modelling activities identify how air quality is changing and how it is expected to change under baseline conditions and in response to proposed mitigation measures.

Reporting provides Canadians with information on the state of the air in Canada, including information on emission levels and national- and P/T-level long-term trends in air pollution levels. Among other mechanisms, reporting occurs through the interactive State of the Air report, published on the website of the Canadian Council of Ministers of Environment (CCME) as part of the AQMS. In addition, information is provided to raise Canadians’ awareness of and reduce their exposure to, air pollution. This includes daily reporting to Canadians on air quality via the Air Quality Health Index (AQHI).

The Air Quality Health Index (AQHI)

The AQHI is calculated based on the relative risks of a combination of ozone, fine particulate matter and nitrogen dioxide in a given location and uses a scale to show the relative health risk associated with the air in that given location, using the following ratings: low: 1-3; moderate: 4-6; high: 7-10; very high: 10+. It pays particular attention to people who are sensitive to air pollution and provides them with advice on how to protect their health during air quality levels associated with these risk levels. The AQHI is designed to help decision-making to protect one’s health through limiting short-term exposure to air pollution and adjusting activity levels during increased levels of air pollution. It also provides advice on how Canadians can improve the quality of the air they breathe.

Policy and analysis

Policy and analysis is carried out by ECCC and HC. This activity consists of providing strategic advice and analysis to support evidence-based policy as well as regulatory and non-regulatory measures intended to improve air quality for Canadians. It encompasses advice and analysis to support the implementation of the AQMS, including activities related to CAAQS, BLIERs coordination, airshed and air zone coordination and management and mobile sources.

This activity also includes managing and supporting Canada’s participation in international/ bilateral transboundary agreements, in particular the Canada-United States (US) Air Quality Agreement and the Convention on Long-range Transboundary Air Pollution under the United Nations Economic Commission for Europe.

Mitigation actions for outdoor air quality

Mitigation actions for outdoor air quality are undertaken by ECCC. This component of the AAPHI consists of the development, establishment and administration of a range of regulatory and non-regulatory instruments to manage emissions from industrial sectors, vehicles, engines and fuels and consumer and commercial products in order to mitigate the human health and environmental risks associated with outdoor air pollution. This activity encompasses BLIERs instruments under the AQMS; non-BLIERs instruments; work related to the Clean Fuels Strategy to enhance alignment with US fuel quality regulations; and enhanced compliance verification for fuels, vehicles and engines.

Indoor air quality activities

Indoor air quality activities are undertaken by HC and NRC. HC’s activities involve collaboration with P/T representatives to identify and promote best practices in regards to improving indoor air quality. This work also includes conducting health risk assessments and research to provide the scientific basis for these actions, as well as communications and outreach activities. HC also leads the National Radon Program as part of the AAPHI, but this work is outside of the scope of this evaluation. NRC works in partnership with government and industry to improve indoor air quality through ongoing technological advancement (e.g., in relation to building materials, ventilation products, technologies for source control and air cleaning) and identification of methodological techniques to assess potential solutions.

The AAPHI encompasses most federal government activities contributing to the overall goal of improving Canadian air quality. Transport Canada is also responsible for developing regulations that affect air quality, but these activities are not part of the AAPHI. Ultimately, the AAPHI expects to achieve clean air for Canadians and reduce the adverse impacts of air pollution on human health and ecosystems. The AAPHI logic model is shown in Appendix A.

AAPHI resources

ECCC, HC and NRC received approximately $90 million per year for AAPHI activities between 2016–17 and 2019–20, as shown in Table 1.

Table 1: AAPHI planned spending by department, FY 2016 to 2017 to FY 2019 to 2020
Department FY 2016 to 2017 FY 2017 to 2018 FY 2018 to 2019 FY 2019 to 2020
ECCC $65,889,135 $69,210,452 $69,459,597 $66,769,826
HC $22,189,994 $22,189,992 $22,181,607 $22,181,607
NRC $1,813,228 $1,813,228 $2,000,000 $2,000,000
Total $89,892,357 $93,213,812 $93,641,204 $90,951,433

Source: ECCC, HC and NRC financial data; Figures exclude HC’s National Radon Program.

About the evaluation

This evaluation focused on the period from FY 2016 to 2017 to the middle of FY 2019 to 2020 and included all AAPHI activities, with the exception of HC’s work under the National Radon Program, which will be assessed as part of separate evaluation activities. The objectives of the study were to offer insight into the AAPHI’s relevance, efficiency and effectiveness (as per the 2016 Treasury Board Policy on Results), as well as to identify recommendations for possible improvements in the future. Multiple lines of evidence were used, including:

The term “participants in the evaluation” or “evaluation participants” is used in this report to collectively refer to key informants and focus group participants. Except where otherwise noted, reporting on interview and focus group findings focuses on common themes and areas of agreement across and/or within categories of evaluation participant. Appendix B provides a more detailed description of the evaluation approach.

Findings: relevance

Continued need

Findings: Canada has a low level of ambient air pollution compared to some regions of the world and air quality in the country has generally improved over time. However, available scientific evidence, along with the potential implications of climate change and other emerging issues for air pollution and air quality, underscore the need for ongoing effort.

It is well established that air pollution, which has been concisely defined as “the emission of harmful substances to the atmosphere” (Ritchie & Roser, 2017), has detrimental impacts on the environment, human health and economic prosperity. Factors that influence and contribute to ambient (outdoor) air pollution include meteorology, wind patterns, topography, natural sources (e.g., wildfires), level of industrial activity, transportation and other mobile sources and population density.

Outdoor air pollution can have adverse impacts on lakes, rivers, soil, vegetation and fish and wildlife populations, as a result of processes such as acid deposition and eutrophication. Acid deposition occurs when sulphur dioxide, nitrogen oxide and ammonia emissions react with water, oxygen and/or other chemicals in the air and these newly created chemicals – known as secondary pollutants – are deposited to land and water. Eutrophication occurs when high concentrations of nitrogen and phosphorus stimulate algae blooms.

With regard to human health effects, exposure to even low levels of ambient air pollution is tied to significant adverse human health outcomes, such as asthma and other respiratory problems and premature mortality from strokes, lung cancer and heart disease (WHO, 2018), as well as adverse birth outcomes and mental health disorders (Brunst et al., 2019; Dibben & Clemens, 2015; Khan et al., 2019; Seabrook et al., 2019). Furthermore, the evidence indicates that there is no safe level of exposure for key air pollutants, such as fine particulate matter and ozone. In 2017, air pollution was the fifth leading risk factor for mortality worldwide, responsible for more deaths than malnutrition, alcohol use and physical inactivity (HEI, 2019) and the leading environmental risk factor for mortality in Canada (IHME, 2019).

Indoor air pollution is also linked to adverse health outcomes. According to the United States Environmental Protection Agency (US EPA), indoor concentrations of some pollutants can be two to five times higher than outdoor concentrations (US EPA, 2017). Given that Canadians spend approximately 90% of their time indoors (HC, 2018b), indoor air quality has a significant impact on individual exposures to air pollutants. However, the concentrations of indoor air pollutants and periods of exposure that are needed to produce specific health effects are not well understood, suggesting a need for further research in this area (US EPA, 2014).

Populations most vulnerable to the health effects of air pollution include those with existing respiratory or cardiovascular conditions, seniors, young children and pregnant women (GoC, 2016a), as well as those in close proximity to sources of pollution such as major highways and pollution-emitting facilities. Indigenous peoples can be particularly vulnerable to health-related risks, which can be the result of, or exacerbated by, environmental conditions in their communities, including air pollution (Kovesi, 2012; Weichenthal et al., 2013).

Beyond detrimental impacts on the environment and human health, air pollution generates substantial economic costs by negatively affecting the productivity of sectors such as forestry, agriculture, fishing and tourism and through increased health expenditures and reduced worker productivity. Despite improvements in air quality over time, there remains a significant health and economic burden associated with ambient air pollution. HC has recently estimated that 14,600 premature deaths each year in Canada are attributable to ambient air pollution from human sources and that the health impacts of air pollution total $114 billion per year in socioeconomic costs (HC, 2019a).

Canada has a low level of ambient air pollution compared to some regions of the world and indicators of air pollution and air quality in Canada generally show improvements over time. However, available data also indicate that ongoing efforts are needed. For example:

Ongoing action is also needed to address a variety of new and emerging issues that are likely to have implications for air quality and pollution emissions.

For instance, climate change is expected to exacerbate both the prevalence and negative impacts of air pollution. The increasing temperatures associated with climate change are projected to produce longer wildfire seasons, more severe weather and increased risk of drought. In turn, these are expected to affect both outdoor and indoor air quality. For example, wildfires produce air pollutants such as particulate matter and VOCs, among others. As another example, drought may lead to an increase in fine particulate matter, allergen and dust concentrations in the air in affected areas (Yusa et al., 2015). Indoor air quality may also be affected by climate change. Impacts may occur as result of changing indoor air concentrations as outdoor concentrations change; more frequent breakdowns in building envelopes due to extreme weather events; and reduced ventilation stemming from the implementation of energy-efficiency measures that limit the exchange of indoor air with outdoor air (IOM, 2011).

A related issue is the need to address short-lived climate pollutants, which have warming effects on climate and are also associated with direct adverse human health effects. One example is black carbon, a component of fine particulate air pollution originating primarily from transportation sources, as well as wildfires, solid fuels such as coal and wood and industrial processes. Black carbon emissions are estimated to be the second-strongest contributor to current global warming behind carbon dioxide emissions (Ramanathan & Carmichael, 2008). Since the atmospheric lifetime of black carbon and other short-lived climate pollutants is short (i.e., a few days), their impact on climate and air quality can be efficiently reduced by targeting their primary sources.

Another emerging issue is pollution hotspots, geographic areas whose close proximity to heavy industry or other sources of pollutants results in high exposure. In Canada, examples include the area around Sarnia, known as “Chemical Valley” and the Alberta oilsands. In a 2017 report, the Environmental Commissioner of Ontario drew attention to Aamjiwnaang First Nation near Sarnia. The report noted the community has some of the worst air pollution in the country, as well as higher-than-average frequencies of many illnesses (Environmental Commissioner of Ontario, 2017). A recent study found rates of acute myeloid leukemia significantly higher than the national average clustered in Ontario industrial border cities including Sarnia and Hamilton, potentially implicating exposure to materials/pollution from industry as a risk factor for this disease (Ghawazi et al., 2019).

Other emerging issues include the need to:

External participants in the evaluation agreed on the continued need for federal involvement in addressing air pollution and air quality, citing the health, economic and other societal costs of air pollution. They also pointed to the need to address new and emerging issues, such as those noted above. Finally, they noted that there are no other programs with similar scope, mandate and capacity as the AAPHI.  

Alignment with federal responsibilities and priorities

Findings: AAPHI activities are consistent with federal authorities laid out in the Canadian Environmental Protection Act, 1999 and foundational legislation for ECCC, HC and NRC. AAPHI activities are also consistent with the federal government’s roles and responsibilities under the AQMS. While the AAPHI aligns with federal priorities such as environmental protection; science, research and innovation; and open government, there is considerable support among evaluation participants for greater alignment with the government’s climate change and reconciliation priorities.

AAPHI activities are consistent with the federal government’s roles and responsibilities, as articulated in the Canadian Environmental Protection Act, 1999. The Act provides the authority, among others, to undertake research and monitoring; assess and manage the health and environmental risks posed by toxic substances; regulate vehicle, engine and equipment emissions and fuels; and act in cooperation with other levels of government. ECCC, on behalf of the federal government, has the responsibility to engage with other jurisdictions and countries to address air pollution from sources outside Canada that is crossing borders and impacting Canadian air quality. Furthermore, AAPHI activities are consistent with departmental roles and responsibilities as laid out in foundational legislation, including the Department of the Environment Act, the Department of Health Act and the National Research Council Act and with the federal government’s roles and responsibilities in the AQMS.

All external participants in the evaluation agreed that federal involvement in addressing air pollution and air quality should be maintained and many believe there would be a significant gap in this domain without it. For example, P/T representatives indicated that their jurisdictions are heavily dependent on the federal government’s scientific, technical and financial resources in order to fulfill their roles and responsibilities under the AQMS. These include maintaining the air quality monitoring networks in their regions. They noted that they would not have the capacity to sustain their current level of service to the public without it. Similarly, NRC clients emphasized that NRC has unique expertise and capabilities and that the services it provides fill an important gap.

While supporting an ongoing federal role, both industry and P/T focus group participants emphasized the importance of avoiding duplication with P/T regulatory activities. Related to this point, P/T representatives noted that they have little information about the federal government’s planned next steps and timelines with respect to clean air. They urged the federal government to clearly articulate and share with the P/T its long-term “master plan” or agenda for air quality. This would help them in planning their own activities to avoid duplication and minimize regulatory and reporting impact on industry.

While being supportive of an ongoing federal role, industry focus group participants also noted that as air quality continues to improve, the government will need to have a full understanding of the costs and benefits of additional measures to bring about further improvements, including the possibility of diminishing returns and unintended consequences. They urged ECCC and HC to consult broadly in order to obtain a comprehensive understanding of costs and benefits of any potential mitigation measures under consideration.

Alignment with federal priorities

At the time of the evaluation, relevant federal priorities included environmental protection; economic growth and prosperity; climate change; reconciliation with Indigenous peoples; science, research and innovation; and open and transparent government.Footnote 2  Although the AAPHI generally aligns well with federal priorities, there is considerable support among both internal and external participants in the evaluation for enhancing alignment with the government’s climate change and reconciliation priorities. This is discussed in detail in Section 4.1.

Findings: effectiveness

Activities and accomplishments

Findings: Progress has been made towards delivering planned activities in all core activity areas. However, some planned mitigation measures have not advanced to the extent originally envisioned, most notably the development and establishment of some BLIERs, including in regulations to reduce emissions other than VOCs from petroleum refineries.

During the period covered by this evaluation, progress was made towards delivering planned activities in all of the AAPHI’s core activity areas.

Science and reporting

In the area of science and reporting, ECCC and HC conducted foundational research and maintained monitoring networks and inventories such as the National Air Pollution Surveillance program, the Air Pollutant Emissions Inventory and the National Pollutant Release Inventory. They also performed air quality monitoring in collaboration with the P/Ts and conducted risk assessments on the health and environmental effects of air pollution. For example, comprehensive human health risk assessments for sulphur dioxide and nitrogen dioxide provided the evidence-based health rationale for development of CAAQS for these pollutants.

New research activities initiated during the period covered by this evaluation studied the relationship between exposure to air pollution and different health outcomes, some of which focus on specific demographics and vulnerable populations (e.g., children, the elderly, Indigenous communities). One example is the Sioux Lookout Zone Children’s Environmental Health Study. New monitoring activities were also undertaken in collaboration among ECCC, the Province of Ontario and the University of Toronto to establish a roadside air monitoring network in Toronto to monitor traffic-related air pollution.

ECCC and HC continued to report to stakeholders and the public through numerous means, including the Air Pollutant Emissions Inventory Report; the National Pollutant Release Inventory; the Greenhouse Gas and Air Pollutant Emissions Projections Report; the Black Carbon Inventory Report; the Fleet Average NOx Emission Performance of Light-duty Vehicles, Light-duty Trucks and Medium-duty Passenger Vehicles Report; and the Health Impacts of Air Pollution report, as well as the State of the Air report.

ECCC and HC continued implementing the AQHI in collaboration with the P/Ts, municipalities, local health regions, public health units and NGOs. As one element of this, ECCC supported several jurisdictions in adapting the AQHI to their regional needs and circumstances. For example, a specific AQHI for sulphur dioxide was developed for Kitimat by the Province of British Columbia, in collaboration with HC, ECCC and the British Columbia Centre for Disease Control. British Columbia has also tailored the AQHI towards fine particulate matter to address smoke during wildfire season. ECCC completed two major updates to the AQHI numerical forecast systems, including one that systematically incorporates pollutant emissions from satellite-detected wildfires and HC provided funding to the Province of Alberta to develop the AQHI mobile app.

HC disseminated information on outdoor air pollution, impacts on health and how to minimize risks to health through outreach and engagement activities and collaboration with external stakeholders. Specific examples of these activities include:

Policy and analysis

In the area of policy and analysis, ECCC and HC continued to develop Regulatory Impact Analysis Statements, emissions and economic projections, cost-benefit analyses, valuation, competitiveness analyses and other analyses to support the development of regulatory and non-regulatory mitigation measures. Measures that have been proposed and/or implemented are described below under “Mitigation actions for outdoor air quality”.

The departments continued to lead and coordinate the overall implementation of the AQMS, including foundational work in support of the CAAQS development and review process. In collaboration with the P/Ts, new CAAQS for sulphur dioxide and nitrogen dioxide were established and CAAQS for ozone were strengthened. Two guidance documents for air zone management were developed and published and three guidance documents for CAAQS achievement determination (sulphur dioxide, nitrogen dioxide and ozone) were developed. The guidance documents for sulphur dioxide and nitrogen dioxide have been published, with publication of the ozone guidance document pending at the time of writing of this report.

With regard to mobile sources, the Mobile Sources Working Group completed its action plan for FY 2013 to 2014 to FY 2016 to 2017 and as of 2018 was discussing potential new work items for priority sub-sectors such as on-road freight. In 2016, the document Vehicle and Engine Tampering Description and Examples of Acceptable Practices was published on the CCME website.

The AAPHI also initiated the development of a long-term strategy to continue addressing air pollutants and sources that have not yet been addressed.

The program continued its international work, including continued bilateral collaboration with the US under the Canada-US Air Quality Agreement to reduce transboundary air pollution. This work included implementing work plans to address vehicle and engine emissions and emissions from the oil and gas sector and beginning informal discussions on a possible future update to the agreement.

Multilaterally, in 2017, Canada ratified the 1999 Protocol to Abate Acidification, Eutrophication and Ground-level Ozone (the Gothenburg Protocol) and its 2012 amendments and submitted its reduction commitments in 2018. The Protocol addresses transboundary air pollution, in particular air pollutants that contribute to the formation of acid rain and smog and the degradation of water bodies. With the addition of fine particulate matter (including black carbon) to the amended Protocol, it became the first legally binding instrument to also include a focus on short-lived climate pollutants.

Canada participates in The Joint Task Force on the Health Aspects of Air Pollution, established in 1998 within the Convention on Long-range Transboundary Air Pollution. This Task Force evaluates the health evidence for air pollution and develops international air quality guidelines for the World Health Organization (WHO). Canadian scientists participate in a number of other task forces and working groups under this Convention, including the Task Force on Hemispheric Transport of Air Pollution, currently co-chaired by an ECCC scientist and the Working Group on Strategies and Review (the key negotiating body), currently chaired by an ECCC executive.

Canada was also the key proponent for an air pollution-related resolution under the United Nations Environment Programme, which was adopted by the United Nations Environment Assembly in 2017. The resolution calls on member states and the United Nations Environment Programme to undertake various activities to improve air quality, reduce air pollutants and short-lived climate pollutant emissions and work toward a shared global response to air pollution, including by creating a platform for information-sharing and policy cooperation.

Mitigation actions for outdoor air quality

Progress was made in developing, proposing and implementing mitigation actions to reduce emissions of air pollutants from the industrial, transportation, consumer and commercial sectors of the economy, building on previous work under the Clean Air Regulatory Agenda.

The Multi-Sector Air Pollutants Regulations, which were developed under the Clean Air Regulatory Agenda, were put in place. The regulations establish air pollution emission standards set out in a number of BLIERs developed under the AQMS. In particular, the regulations limit the amount of nitrogen oxides emitted from gaseous fuel-fired non-utility boilers, heaters and stationary spark-ignition gaseous fuel-fired engines, as well as the amount of nitrogen oxides and sulphur dioxide emitted from cement kilns.

Under the Core Climate Change Mitigation Program, the Regulations Respecting Reduction in the Release of Methane and Certain Volatile Organic Compounds (Upstream Oil and Gas Sector) and the Reduction of Carbon Dioxide Emissions from Coal-Fired Generation of Electricity Regulations were developed and put in place.These regulations are expected to achieve some of the same air quality objectives anticipated under BLIERs and to result in reductions in air pollutant emissions in addition to greenhouse gas emission reductions.

Non-regulatory instruments, including codes of practice, pollution prevention planning notices and environmental performance agreements, were also developed. These instruments implemented the standards set out as BLIERs for a range of pollutants across several sectors, including iron, steel and ilmenite; aluminum; base metal smelters; iron ore pellets; and pulp and paper.

ECCC amended numerous regulations to manage emissions from the transportation, consumer and commercial products sectors. For the transportation sector, amendments were made to various regulations to limit emissions from on-road and off-road vehicles and engines; and under the Clean Fuels Strategy, amendments were made to various regulations, including the Sulphur in Diesel Fuel Regulations to align Canadian fuel standards with those in the US. ECCC also expanded the quantity and scope of vehicle and engine testing it conducts, established an approach and methodology for enhanced compliance verification for vehicles and engines and implemented enhanced compliance verification for fuels as a five-year enforcement project.

With regard to consumer and commercial products, amendments were made to regulations setting VOC concentration limits for architectural coatings and automotive refinishing products.

In addition, a number of proposed new regulations were published to reduce the release of VOCs from the petroleum sector; to set VOC concentration limits in certain products; and to regulate emissions from off-road large spark-ignition and compression-ignition engines, both mobile and stationary, including those used to produce off-grid diesel-generated electricity in remote locations. A complete overview of mitigation measures for outdoor air implemented and proposed under the Clean Air Regulatory Agenda and the AAPHI is in Table 2.

Table 2: mitigation measures for outdoor air under the Clean Air Regulatory Agenda and the AAPHI

Table 2-A: mitigation measures for outdoor air under the Clean Air Regulatory Agenda and the AAPHI (Regulatory instruments)
Instrument name Link to program area Status on October 1,  2019 Implementation/ Registration/ Publication date Amendments
Fuels Information Regulations, No. 1 Clean Fuels Strategy Active 1977 2000, 2017
Gasoline Regulations Clean Fuels Strategy Active 1990 2006, 2008, 2010, 2017
Contaminated Fuel Regulations Clean Fuels Strategy Active 1991 2000, 2018, 2019
Benzene in Gasoline Regulations Clean Fuels Strategy Active 1997 2006, 2011, 2018
Sulphur in Gasoline Regulations Clean Fuels Strategy Active 1999 2006, 2009, 2015, 2020
Sulphur in Diesel Fuel Regulations Clean Fuels Strategy Active 2002 2006 (twice), 2012 (twice), 2017
Renewable Fuels Regulations Clean Fuels Strategy Active 2010 2011
Off-Road Small Spark-Ignition Engine Emission Regulations Transportation Active 2003 2012, 2017
On-Road Vehicle and Engine Emission Regulations Transportation Active 2003 2006, 2013, 2015
Off-Road Compression-Ignition Engine Emission Regulations Transportation Active 2005 2011
Marine Spark-Ignition Engine, Vessel and Off-Road Recreational Vehicle Emission Regulations Transportation Active 2011 2017
Volatile Organic Compound (VOC) Concentration Limits for Architectural Coatings Regulations Commercial and Consumer Products Active 2009 2018
Volatile Organic Compound) Concentration Limits for Automotive Refinishing Products Regulations Commercial and Consumer Products Active 2009 2018
Reduction of Carbon Dioxide Emissions from Coal-Fired Generation of Electricity Regulations Core Climate Change Mitigation Active 2012 2018
Regulations Respecting Reduction in the Release of Methane and Certain Volatile Organic Compounds (Upstream Oil and Gas Sector) Core Climate Change Mitigation Active 2018 -
Multi-Sector Air Pollutants Regulations BLIERs Active 2016 -
Proposed Regulations Respecting Reduction in the Release of Volatile Organic Compounds  (Petroleum Sector)Footnote 3  CMP/BLIERs Proposed CGI 27 May 2017 N/A
Proposed Off-road Compression-Ignition (Mobile and Stationary) and Large Spark-Ignition Engine Emission RegulationsFootnote 4  Transportation Proposed CGI 9 Mar 2019 N/A
Proposed Volatile Organic Compound Concentration Limits in Certain Products Regulations Commercial and Consumer Products Proposed CGI 2 Jul 2019 -
Table 2-B: mitigation measures for outdoor air under the Clean Air Regulatory Agenda and the AAPHI (Non-regulatory instruments)
Instrument name Link to program area Status on October 1,  2019 Implementation/ Registration/ Publication date
Objectives for Ambient Fine Particulate Matter and Ozone [Canadian Ambient Air Quality Standards for Fine Particulate Matter and Ozone] CAAQS Active 25 May 2013
Canadian Ambient Air Quality Standards for sulphur dioxide CAAQS Active 28 Oct 2017
Canadian Ambient Air Quality Standards for nitrogen dioxide CAAQS Active 9 Dec 2017
Update to Canadian Ambient Air Quality Standards for ozone CAAQS Active 29 Jun 2019
Code of Practice to reduce fugitive emissions of total particulate matter and VOCs from iron, steel and ilmenite sector BLIERs Active 28 May 2016
Code of Practice to reduce emissions of fine particulate matter from the primary aluminium sector BLIERs Active 28 May 2016
Iron, Steel and Ilmenite Sector Pollution Prevention Planning Notice for nitrogen oxides, sulphur dioxide and VOCs BLIERs Active 6 May 2017
Code of Practice for managing particulate matter emissions in the potash sector BLIERs Active Sep 2017
Guidelines for the Reduction of Nitrogen Oxide Emissions from Natural Gas-fuelled Stationary Combustion Turbines BLIERs Active Nov 2017
Performance Agreement Concerning Air Pollutants from the Aluminum and Alumina Sector BLIERs Active 13 Nov 2017
Base Metals Smelter Sector Performance Agreements for sulphur dioxide and total particulate matter BLIERs Active 5 Jan 2018
Performance Agreement Concerning Air Pollutants from the Iron Ore Pellet Sector BLIERs Active 5 Jan 2018
Code of Practice for the management of air emissions from pulp and paper facilities BLIERs Active Jul 2018
Code of practice for reduction of VOC emissions from cutback and emulsified asphalt Commercial and Consumer Products Active Feb 2017

Source: Information provided by ECCC.

Despite these areas of progress, some planned mitigation measures have not moved forward to the extent originally envisioned. Most notably, less progress than planned has been made in developing and establishing some of the BLIERs, including regulations to reduce emissions from the petroleum refining sector.

BLIERs prioritized under the Air Quality Management System

Sectors
  • aluminium and alumina
  • base metal smelting
  • cement
  • chemicals
  • electricity
  • fertilizers
  • iron ore pellets
  • iron, steel and ilmenite
  • oil sands
  • petroleum refining
  • pipelines
  • potash
  • pulp and paper
  • upstream oil and gas
Classes of equipment
  • gaseous-fuel-fired boilers and heaters
  • stationary spark-ignition gaseous-fuel-fired engines
  • natural gas-fueled stationary combustion turbines
Pollutants
  • Fine particulate matter
  • Nitrogen oxides
  • Sulphur dioxide
  • VOCs

When federal and provincial and territorial ministers of Environment agreed to move forward with the implementation of the AQMS in October 2012, 14 industrial sectors, three classes of equipment and four pollutants were identified as priorities (see text box). BLIERs were also prioritized by the federal government for implementation based on instrument type (regulatory or non-regulatory), readiness, level of consensus and impact on emission reductions.

To date, as described above, the federal government has codified some BLIERs in the Multi-Sector Air Pollutants Regulations, while many others have been established as non-regulatory instruments. However, the federal government did not move forward as anticipated to propose and establish BLIERs for which consensus was not reached during the process to develop the AQMS. In particular, plans articulated in AAPHI foundational documents to propose emission standards for petroleum refineries have not proceeded, with the exception of regulations to reduce VOC emissions.Footnote 5  In its 2018 response to the House of Commons Standing Committee on Environment and Sustainable Development’s review of the Canadian Environmental Protection Act, 1999 and associated recommendations, ECCC indicated that it has begun to develop regulations to reduce sulphur dioxide, nitrogen oxide and fine particulate matter emissions from refineries (GoC, 2018b). The status of this work is unclear.

External evaluation participants had mixed perspectives with regard to progress on BLIERs to date. On one hand, industry representatives praised the level of consultation and engagement with industry and the government’s “flexible” approach, which they noted resulted in a decision not to proceed with BLIERs in some cases. On the other hand, P/T and NGO representatives characterized advances in this area as insufficient or disappointing and some singled out the limited regulation of petroleum refinery emissions as a weakness of Canada’s approach to addressing air pollution.

The need for action in this area was highlighted in a recent analysis by Ecojustice, based on 2015 emissions data. This analysis showed that most Canadian refineries emit more pollutants than comparable US facilities and that none show a clear trend of reductions since 2005 (Ecojustice, 2018).Footnote 6  Moreover, according to ECCC, one or more of the CAAQs for sulphur dioxide, nitrogen dioxide, ozone and fine particulate matter is being exceeded in seven out of 13 areas where there are petroleum refineries and oil sands upgraders.

ECCC representatives indicated that the program had planned to undertake an exercise to determine whether the pollutants and processes targeted by the BLIERs that never reached consensus are still relevant. This would include an analysis of the existing requirements faced by the affected sectors, the current emissions situation and potential impacts of climate measures. This analysis was to inform decisions about additional air pollutant control measures and to report back to AQMS stakeholders on the federal government’s intentions related to outstanding BLIERs. This analysis has not been completed.

Indoor air quality activities

In response to internal and external stakeholder requests, HC publishes a variety of science-based documents. These serve to inform partners as well as Canadians, on strategies to reduce one’s exposure to indoor air contaminants. During the period covered by this evaluation, HC published Residential Indoor Air Quality Guidelines for acetaldehyde. The guidelines provided information relating to known health risks, sources and recommended exposure limits, as well as ways to reduce exposure. HC also published Indoor Air Reference Levels for 25 VOCs.  In addition, HC contributed to the development and update of several Canadian Standards Association standards with respect to indoor air (i.e., carbon monoxide detectors, formaldehyde, electrostatic air cleaners) and participated as a member of other standard-setting bodies, such as the American Society of Heating, Refrigerating and Air Conditioning Engineers, whose standards are used throughout building codes in Canada. HC also led the development and publication of proposed regulations to limit formaldehyde emissions from composite wood products with departmental partners.

In an effort to educate Canadians and public health officials, HC produced indoor air quality factsheets and infographics for carbon dioxide, mould, asbestos, cooking and air quality, relative humidity, ventilation and maintaining and improving indoor air quality, as well as a document on ventilation on the indoor environment. These were created for a broad audience, but based on rigourous science assessments in order to provide accurate information to Canadians and stakeholders.

HC covered indoor air quality as part of outreach and education activities, including the delivery of Chemical Awareness and Learning Module sessions and use of a Virtual Reality tool; and it delivered Detect to Protect, a public awareness campaign for carbon monoxide, in collaboration with Canadian Tire, Kidde Canada and Scout Environmental. HC also provided support to the British Columbia Centre for Disease Control for the development of a Carbon Monoxide Monitoring and Response Framework in Long-Term Care Facilities (HC, 2018a).

HC collaborated with NRC on a study that tested two interventions to improve indoor air quality in homes with attached garages and collaborated on an NRC-led study involving development of a preventive maintenance protocol for ventilation systems and its testing in 55 homes in Nunavik.

NRC carried out research studies in five areas, including the aforementioned collaborations with HC: improving ventilation, managing formaldehyde, radon control, reducing wildfire smoke indoors and work relating to the Canadian Committee on Indoor Air Quality and Buildings. NRC also engaged in a variety of knowledge translation and dissemination activities to disseminate the research findings to stakeholders.

Access to information and analysis

Findings: A considerable volume of information and analysis on air quality and air pollution is produced and used to inform decision-making by a range of internal and external partners and stakeholders. Although external evaluation participants agreed on the high quality of the information and analysis available, perceived weaknesses include key studies and reports not being well publicized; information not being consolidated in one easily accessible location; and websites/reports not being updated in a timely fashion. A National Air Quality Communication Strategy, with recommendations for enhancing communication to various target audiences, has been developed by ECCC but not yet implemented.

One of the expected outcomes of the AAPHI is that senior managers and decision makers have access to information and analysis on air quality and air pollution. Based on the document review and interviews with internal key informants, a considerable volume of information and analysis on air quality and air pollution is produced, made available to senior managers within the federal government and used to inform decision-making. Examples include, but are not limited to:

Information and analysis is also available to a range of stakeholders outside the federal government through the Open Data Portal, the National Air Pollutant Surveillance program and CCME websites and other mechanisms. The evaluation evidence indicates that this information is being accessed and used by some stakeholders to support their decision-making. For example:

NGOs and other external evaluation participants likewise commented positively on the quality of information and analysis on air pollution and air quality, but also identified some weaknesses with the dissemination of information to stakeholders. In particular, they observed that:

A few NGO representatives commented specifically on the State of the Air report, observing that although it holds promise as a platform for disseminating information to Canadians, it does not use the latest data that is publicly available elsewhere on the Government of Canada’s website. They also noted that its presentation of ambient air trends as a national average glosses over geographic trouble spots and pointed out that the report is difficult to use in rural and remote areas of Canada with poor telecommunications infrastructure.

ECCC representatives noted that a National Air Quality Communication Strategy was developed for the department in 2019, with recommendations for enhancing communications to various target audiences, including community organizations, health care professionals, media, regulatees, decision makers and the Canadian public. The Strategy was not approved at the time of the evaluation.

Public awareness and behaviour change

Findings: The AQHI was universally praised by external evaluation participants for its simple messaging and standardized approach to reporting on outdoor air quality. However, available evidence indicates that few Canadians are aware of it or using it to guide their behaviour.

At the time of the evaluation, HC had limited information on the extent to which the public is aware of and using the information it generates on indoor air quality. NRC clients agreed that its research and evaluation activities addressed their needs in various ways and informed their decision-making. Furthermore, some NRC evaluated solutions and technologies have experienced market uptake.

As a result of AAPHI activities, Canadians are expected to have increased awareness of indoor and outdoor air quality, air pollution, related health risks and strategies to reduce exposure and to change their behaviour to reduce their exposure to indoor and outdoor air pollutants.

Outdoor air

There is limited data available on the public’s awareness and use of outdoor air quality information in general and the AQHI in particular. The most recent national survey research, conducted in 2017 (Leger, 2017), found that:

Since the survey was conducted, the AQHI has continued to be implemented in communities across the country. As of 2019, the AQHI was available to 80% of Canadians in 111 communities across all P/Ts (HC, 2019b). An estimated 1,380,000 sensitive individuals were reached by AQHI risk communications (ECCC, 2020a).

NGOs, P/T representatives and other external evaluation participants agreed on the value of the AQHI, pointing to its simple messaging and standardized approach to air quality reporting. However, they suspected (in line with the 2017 survey data) that most Canadians do not know about it and are not accessing it. They identified several potential strategies for increasing awareness of the tool and producing changes in behaviour. These include more extensive collaboration with grassroots organizations and local public health agencies, which they believe are more effective than federal government departments at reaching the public with health information and messaging. They also suggested to put more emphasis on helping individuals understand their own sensitivities; to deliver more messaging on what individuals can do to protect themselves; and to use a more “hands-on” approach to information provision.

In addition, both internal and external participants emphasized the need for ongoing surveillance of awareness and behaviours through regular surveys of Canadians. Program representatives explained that undertaking public opinion research is a priority for the near future.

Indoor air

There is limited information on the extent to which HC’s indoor air quality activities have increased awareness on the part of Canadians or prompted them to implement actions to reduce the related risks.

HC representatives indicated that a new performance measure to track use of indoor air quality information has been developed and will be reported on in the future. In addition, indoor air will be included in a survey of Canadians planned for FY 2020 to 2021, which will examine the effectiveness of HC’s health messaging in relation to air quality.

All NRC clients who were interviewed agreed that NRC’s research and evaluation activities addressed their needs in various ways and informed their decision-making. For example:

In some cases, NRC evaluated solutions and technologies have experienced market uptake. For example, 16 radon-controlling products have been validated for industry and are now commercially available.

Compliance with air pollution measures

Findings: Overall, there is limited information on the extent to which regulated communities comply with mitigation measures for air pollution. The program has developed performance indicators for recently introduced mitigation measures and compliance data will be reported in the coming years.

Overall, there is limited information on the extent to which target audiences are complying with federal regulatory and non-regulatory air pollution mitigation measures. As already described, ECCC took steps during the period covered by this evaluation to strengthen compliance review for engines, vehicles and fuels. However, relevant performance data will not be reported by the program until 2021.

The current performance measurement framework also identifies several performance indicators relating to compliance for the Multi-Sector Air Pollutants Regulations. However, as with the fuel quality regulations, relevant performance data are not yet available, since most of the emissions standards are not yet in force. As such, performance data will be reported in the coming years. On June 1, 2019, ECCC received the first annual report for 2018 monitoring data for regulated cement facilities. These data showed that 100% of the cement facilities had installed the required Continuous Emissions Monitoring Systems to monitor their nitrogen oxide and sulphur dioxide emissions, which will allow reporting in support of meeting their emissions targets in the future (ECCC, 2020a).

Reporting on compliance with non-regulatory instruments is not part of the current performance measurement framework, although these usually include requirements for performance reporting. For example, ECCC publishes regular progress summaries for performance agreements for base metals smelters, aluminum and iron ore pelletizing. A 2017 progress report on the code of practice for the reduction of VOC emissions from cutback and emulsified asphalt indicates that 17% of the products had a VOC content exceeding the code’s recommended practices (ECCC, 2019). In response, ECCC indicated its intent to enhance compliance promotion.

Reduced emissions

Findings: Emissions of air pollutants from sources subject to mitigation measures have mainly declined over the last 15 years. However, some emission indicators show evidence of recent increases.

The risk mitigation measures for outdoor air pollutants introduced under the Clean Air Regulatory Agenda and the AAPHI are intended to reduce emissions of these pollutants. Available data indicate that emissions of fine particular matter, sulphur dioxide, nitrogen oxides, VOCs and carbon monoxide from sources subject to mitigation measures have declined since 2006. As shown in Table 3, three-year average emissions declined between 2006 to 2008 and 2016 to 2018, with the percentage reduction ranging between approximately 26% and approximately 63%, depending on the pollutant and source. However, for fine particulate matter and carbon monoxide, the percentage change was slightly lower over this period compared to the period between 2006 to 2008 and 2015 to 2017. This indicates that emissions of these pollutants from sources subject to mitigation measures have increased slightly in recent years, despite the existence of these measures.

Table 3: change in three-year average emission since 2006 to 2008 of select air pollutants subject to mitigation measures
Pollutant Source of emissions Percentage change in three-year average emissions, from 2006 to 2008
From 2006 to 2008 to 2015 to 2017 From 2006 to 2008 to 2016 to 2018
Fine particulate matter Industrial and transportation sources -34.9% -34.6%
Sulphur oxide Industrial and transportation sources -44.6% -63.2%
Nitrogen oxides Industrial and transportation sources -21.0% -32.1%
VOCs Industrial and transportation sources -22.8% -25.7%
Carbon monoxide Transportation and mobile sources -34.3% -32.2%

Source: Data provided by ECCC.

Furthermore, preliminary calculations using 2018 data from the Air Pollutant Emissions Inventory show that Canada’s indicative reduction targets under the Gothenburg Protocol have been attained for VOCs and fine particulate matter and reduced further than the target set for sulphur dioxide.Footnote 7  As of 2018, further reductions of nitrogen oxides were required in order to meet the 2020 target. See Table 4.

Table 4: percentage reduction in national emissions of air pollutants subject to reduction targets under the Gotherburg Protocol, 2005 to 2018
Performance indicator Reduction in emissions Performance relative to 2005 levels
Target (by 2020) Actual (2018)
Percentage reduction in national emissions of sulphur dioxide -55% -63%
Percentage reduction in national emissions of nitrogen oxides -35% -27%
Percentage reduction in national emissions of fine particulate matter -25% -25%
Percentage reduction in national emissions of VOCs -20% -20%

Source: (ECCC, 2020b); Note: Canada’s commitment for fine particulate matter excludes the following open sources: emissions from road dust, construction operations and crop production.

It is important to note that although reductions have been achieved, total emissions of VOCs and nitrogen oxides are still significant (in excess of 1,500,000 tonnes each per year) and, moreover, have increased since 2016. Total emissions of fine particulate matter have trended upward since 2009, although there has been a slight decline in total emissions of fine particulate matter when open sources (road dust, construction operations and crop production) are excluded. Total emissions of sulphur dioxide have declined steadily since 2005. Figure 1  depicts emission trends from 2005 to 2018 for these pollutants, based on data from the Air Pollutant Emissions Inventory.

Figure 1: annual emissions, tonnes, 2005 to 2018, for select air pollutants
Figure 1: annual emissions, tonnes, 2005 to 2018, for select air pollutants

Source: (ECCC, 2020b).

Notes: PM2.5(1)=fine particulate matter emissions from all sources; PM2.5(2)=fine particulate matter emissions excluding emissions from the following open sources: road dust, construction operations and crop production.

Long description

The graph presents the annual emissions for four air pollutants, from 2005 to 2018, expressed in tonnes.

Total emissions of volatile organic compounds declined from nearly 2,500,000 tones in 2005 to just under 2,000,000 tonnes in 2018.

Total emission of nitrogen oxide declined from nearly 2,500,000 tonnes in 2005 just under 2,000,000 tonnes in 2018.

Total emissions of sulphur dioxide declined steadily from about 2,100,000 in 2005 to about 700,000 tonnes in 2018.

Total emissions of fine particulate matter have trended upward over time, going from about 1,400,000 tonnes in 2005 to about 1,600,000 tonnes in 2018. However, when emissions from open sources like road dust, construction operations and crop production are excluded, total emissions of fine particulate matter are fairly constant over time, at less than 500,000 tonnes.

Clean air and reduced adverse impacts

Findings: While a majority of Canadians live in areas where air quality standards are achieved, 25% do not. Furthermore, 30% of P/T air zones did not meet one or more of the 2015 CAAQS for fine particulate matter, ozone, or both. Moreover, air pollution in Canada contributes to thousands of premature deaths and millions of morbidity outcomes every year. Thus, Canadians are still exposed to levels of air pollution that pose risks to their health. In terms of adverse impacts on the environment, an acidification indicator has recently been developed for risks to ecosystems.

The AAPHI has two ultimate outcomes: Canadians have clean air and adverse impacts on human health and ecosystems are reduced.

The first outcome – Canadians have clean air – is difficult to define and measure. Many indicators could potentially be used and are arguably necessary, to provide the complete picture. For outdoor air, the AAPHI measures progress toward this outcome using two indicators related to the CAAQS.Footnote 8 

The first indicator is the percentage of Canadians living in areas where air quality standards are achieved, with a target of 85% of Canadians in 2030.

The second indicator is the percentage of P/T air zones that achieve the CAAQS, with a target of 85% by 2030. P/Ts are responsible for reporting on the status of their air zones through annual air quality reports. While many have published reports with up-to-date information, not all jurisdictions have published data. As a result, this indicator was not calculated at the time of the evaluation.

Table 5 presents summary information, based on ECCC analysis of P/T air quality reports and 2015 to 2017 ambient data available from the National Air Pollutant Surveillance program where jurisdictional reports were not available.Footnote 9  Based on this analysis, 13 out of 42 air zones (30%), in British Columbia, Alberta, Saskatchewan, Manitoba, the Northwest Territories and Ontario, did not achieve the 2015 CAAQS for fine particulate matter, ozone, or both.

Table 5: air zones not meeting the 2015 Canadian Ambient Air Quality Standards
Canadian Ambient Air Quality Standards Air zones not meeting the Canadian Ambient Air Quality Standards
Fine particulate matter (24-hour) British Columbia – Lower Fraser Valley; Central Interior; Georgia Strait Alberta – Lower Athabasca; North Saskatchewan; Red Deer Quebec – South
Alberta – Lower Athabasca; Upper Athabasca; South Saskatchewan; North Saskatchewan
Saskatchewan – Great Plains
Manitoba (has not delineated air zones; considered as one air zone)
Northwest Territories – South Slave
Fine particulate matter (annual) British Columbia – Southern Interior; Central Interior
Alberta – Lower Athabasca
Ozone (8-hour maximum) British Columbia – Lower Fraser Valley
Ontario – Air Zone 2 (Southern Ontario); Air Zone 3 (Hamilton, Sarnia)

Source: Data provided by ECCC.

Overall, although a majority of Canadians “have clean air” based on these indicators, a sizeable minority does not. Furthermore, the evidence indicates that from a health perspective, there is no safe level of exposure for many key air pollutants, including fine particulate matter and ozone.

The second ultimate outcome is reduced adverse impacts on human health and ecosystems. For human health, the performance indicator is the change in the number of deaths per year attributable to air pollution. Most recently, the 2019 edition of the Health Impacts of Air Pollution report estimated 41 per 100,000 Canadians suffered premature deaths per year as a result of air contaminants, specifically particulate matter, nitrogen dioxide and ozone (HC, 2019a). The 2019 estimate is slightly lower than the 2017 estimate of 42 per 100,000 and is due to lower air pollution levels on average, suggesting that some reduction in mortality risk has occurred.

However, in absolute terms, the number of Canadians who die prematurely each year due to air pollution remains significant – 14,600 according to HC’s latest estimates. Furthermore, HC’s analysis shows that air pollution remains responsible for a variety of morbidity outcomes, including 2.7 million asthma symptom days and 35 million acute respiratory symptom days per year (HC, 2019a). Thus, Canadians continue to be exposed to levels of air pollution that pose risks to health. HC concluded that despite improvements in air quality over time, air pollution continues to have impacts on population health in Canada and that ongoing action is needed.

For ecosystems, the following performance indicator has been developed: area of exceedance of ecosystem critical loads of acidity. The performance target is the area of acidity critical load exceedance from a baseline (to be established). Reporting on this indicator will occur in the future. Given its highly technical nature, consideration could be given to developing accompanying explanatory material for the layperson and supplementing this measure with other measures more accessible to the general public.

Findings: efficiency

Program design

Findings: Internal and external evaluation participants consider the overall design of the AAPHI to be sound. Perceived strengths include its collaborative approach to delivering key activities; robust research, science and technical expertise and capacity; standardized approach to air quality monitoring and reporting; and focus on transparency and reporting to the public; as well as Canada’s active participation and leadership in international collaborations related to air quality. Possible improvements include better integration of air quality and climate change policy; greater focus on Indigenous peoples; and greater focus on indoor air quality.

In general, the design of the AAPHI is regarded by internal and external evaluation participants as sound. There is also widespread agreement that the strengths of the initiative include:

Canada’s active participation and leadership in international collaborations related to air quality research and management is also seen as an important strength. Key informants from all three partner departments reported that as a result of Canada’s deliberate efforts on the international stage:

All international key informants consider Canada to be a constructive participant in international collaborations and noted that in recent years it has taken on an increasingly visible leadership role. They encouraged Canada to continue playing this leadership role.

Several possible improvements to the design of the AAPHI emerged from the evaluation.

Better integration between air quality and climate change policy

The precursor to the AAPHI, the Clean Air Regulatory Agenda, addressed both air quality and climate change. However, the AAPHI focuses specifically on air quality, while the Pan-Canadian Framework on Clean Growth and Climate Change (henceforth the Pan-Canadian Framework) has been implemented as a distinct initiative to address climate change.

At present, some AAPHI activities contribute to addressing climate change. Examples include development and implementation of industrial emissions requirements to reduce air pollutants (some of which are linked to climate change), as well as measures to reduce air pollutants from on-road and off‑road vehicles, engines and fuels. In addition, the health and environmental co-benefits from reduction of air pollutants associated with regulations targeting greenhouse gas emission reductions are quantified as part of the cost-benefit analyses for Regulatory Impact Analysis Statements for those regulations. HC has identified “climate linkages” as a theme within its air research funding program and both HC and ECCC personnel are engaged in research exploring climate change, air pollution and air quality. In addition, in July 2017, as part of the Core Climate Change Mitigation Program, ECCC published its Strategy on Short-Lived Climate Pollutants as part of a holistic approach for meeting climate and air quality objectives (ECCC, 2017a).

Nevertheless, there is widespread agreement across internal and external evaluation participants that a more integrated approach to addressing climate change and air pollution should be taken, while recognizing that these are and should be maintained as, distinct policy areas. They identified both a need to better understand the impacts of climate change actions on air pollutants and air pollution actions  on greenhouse gases. As well, they noted that work is required to identify ways to minimize negative impacts and maximize co-benefits in order to optimize risk management strategies. Better integrating air quality and climate change would enhance alignment of the AAPHI with the federal government’s climate change priority.

Greater focus on Indigenous peoples

At the time of the evaluation, some AAPHI activities involve engagement with Indigenous peoples and/or focus on issues relating to Indigenous peoples and air quality. Indigenous organizations are identified in program documentation as a key stakeholder and there is Indigenous representation on some governance committees related to the AQMS. In accordance with its Indigenous Peoples Engagement Strategy, the Energy and Transportation Directorate of ECCC engages with Indigenous groups during regulatory development; holds annual bilateral meetings with its Indigenous partners; and supports engagement with Aamjiwnaang First Nation on air pollution initiatives.

In addition, both HC and NRC have undertaken research studies exploring issues related to air pollution and Indigenous populations. For example, NRC studies have focused on improving ventilation and indoor air quality in homes in Canada’s North. As well, HC is collaborating with Indigenous Services Canada and the Children’s Hospital of Eastern Ontario to fund the Sioux Lookout Zone Children’s Environmental Health Study, which is the largest study of indoor air quality on First Nation reserves at the current time.

Nevertheless, many internal and external evaluation participants believe more should be done to address the needs of and engage with Indigenous peoples with regard to air pollution and quality. Several specific suggestions for improvement came from key informants representing Indigenous communities and organizations.

While acknowledging the need for improvement, program representatives noted that unlike the Pan-Canadian Framework, the AAPHI lacks specific resources dedicated to Indigenous engagement.Footnote 11

Greater emphasis on indoor air quality

The need for more effort on indoor air quality was identified by a subset of external evaluation participants positioned to comment on indoor air. Their suggestions included updating the indoor air quality guidelines; conducting more research relating to VOCs, mould and other indoor contaminants; and enhancing information dissemination to P/Ts, local public health agencies and the general public. They also suggested addressing the relative lack of information to the public about the risks of exposure to consumer products, particularly cleaning products.

Program representatives involved in indoor air quality activities identified several factors that support an increased focus in this area. These include the large proportion of time (90%) that Canadians spend indoors (HC, 2018b), along with the fact that indoor concentrations of some pollutants can, in some circumstances, exceed outdoor concentrations. Internal key informants also noted that environmental events associated with climate change, such as heatwaves and wildfires, can impact indoor air quality.

Governance

Findings: A formal governance structure for the AAPHI and air quality work plan were approved in November 2019. Evaluation findings suggest a need to improve understanding of the roles and responsibilities of those involved in the AAPHI at the working level. Evidence points to a need to ensure consistent communication and coordination, in order to share information, identify areas of mutual interest and potential collaborations and achieve efficiencies.

The AAPHI did not have a functioning formal governance structure or approved air quality agenda for most of the period covered by this evaluation. ECCC key informants who were positioned to comment on governance reported that although such a structure existed under the Clean Air Regulatory Agenda, it eventually became inactive and efforts to resuscitate it were delayed by high turnover at the senior management level within ECCC. They noted that in its absence, some planned resources for some air quality activities shifted to other departmental and Government priorities, such as climate change and plastics, without being formally reallocated. Reported consequences included delays in implementing the airshed pillar of the AQMS, pending a full examination of priorities within the CCME portfolio. It also led to inability to provide federal support to AQMS working groups, complete timely updates to the State of the Air website and engage in strategic thinking about potential new areas of work. As well, challenges were experienced in meeting internal data demands and coordinating across all parts of the program.

A formal AAPHI governance structure and Air Quality Program Workplan were approved in November 2019. Internal key informants who spoke on the matter of governance believe that a functional governance structure and approved workplan are essential to advancing federal air quality initiatives in an efficient and effective manner.

At the working level, evaluation findings suggest a need to improve understanding of the roles and responsibilities of those involved in the AAPHI and to ensure consistent communication and coordination. Program representatives generally reported having a good understanding of the roles and responsibilities of their own organizations, as well as the roles and responsibilities of the other organizations within ECCC, HC and/or NRC with which they regularly interact. However, some admitted not having a strong grasp of how their organization fits into the Initiative as a whole, or said they do not necessarily understand who all the players are in the AAPHI and what their respective roles and responsibilities are. A suggested area of improvement was more clearly articulating roles and responsibilities and ensuring shared understanding. ECCC representatives reported that work is currently taking place to clarify roles and responsibilities.

Representatives from all three departments agreed on the value of regular internal communications and coordination to ensure mutual understanding of roles and responsibilities, share information, identify areas of mutual interest and potential collaborations and achieve efficiencies. However, there were differing views about the extent to which such communication and coordination is currently taking place. It appears that although some efforts are being made to communicate and coordinate internally, this is not always being done consistently or may not always involve all relevant internal partners.

Resources

Findings: Based on available financial reporting, AAPHI partners spent 95% of planned resources. Internal key informants agreed that the resources originally planned for the AAPHI were adequate to support planned activities.

Between FY 2016 to 2017 and FY 2018 to 2019, 95% of planned resources were spent, as shown in Table 6. Both ECCC and HC underspent relative to plans. They spent 96% and 91%, respectively, of the resources planned for the initiative over this period. NRC spent slightly more than planned (108%), although the absolute dollar value is small.

Table 6: planned and actual AAPHI expenditures, FY 2016 to 2017 and FY 2018 to 2019
Department Planned spending Actual spending Amount of variance Actual/planned
ECCC $204,559,184 $196,794,502 -$7,764,682 96%
HC $66,561,593 $60,799,727 -$5,761,866 91%
NRC $5,626,596 $6,087,487 $460,891 108%
Total $276,747,374 $263,681,716 -$13,065,657 95%

Source: ECCC, HC and NRC financial data. Figures exclude resources for HC’s National Radon Program.

Beyond noting that some planned activities were affected by departmental reallocations to other priorities, internal key informants did not provide detailed explanations for these variances. In addition, as discussed in Section 4.2, ECCC key informants noted that some AAPHI resources shifted without being formally reallocated. As a result, available financial data may not reflect the true extent to which ECCC used AAPHI resources for AAPHI activities.

Representatives from all three departments agreed that the resources originally planned for the AAPHI were adequate to support planned activities.

Performance measurement and GBA+

Findings: Performance measurement and reporting are occurring, although the extent to which performance information is being used to support decision-making is unclear. There are opportunities to revise the logic model and performance measurement framework to ensure that all program activities are adequately represented; streamline the number of outcomes; and ensure that performance reporting occurs consistently over time for all outcomes and for both indoor and outdoor air. Gender-based analysis plus (GBA+) is incorporated into some AAPHI activities and is expected to be conducted more consistently in the future.

Performance measurement

A logic model and performance measurement framework have been developed for the AAPHI. The AAPHI has been incorporated into ECCC’s and HC’s Performance Information Profiles for Air Quality. Select indicators from the AAPHI performance measurement framework are incorporated into public reporting by ECCC, HC and the NRC through their Departmental Results Reports.

While performance measurement and reporting are occurring, the extent to which performance information is being used internally to inform decision making is unclear. In interviews, most internal key informants focused on describing challenges associated with performance measurement, rather than describing if and how performance information is used. Identified challenges include, but are not limited to:

From an evaluation perspective, there are opportunities to improve performance measurement and reporting by revisiting the logic model and performance measurement framework. Areas for improvement include:

Examining existing logic models for similar federal environmental and health regulatory programs, such as the Chemicals Management Plan, could help identify core activity areas and outcomes that are similar across these kinds of programs and lead to greater consistency of the AAPHI logic model with those of similar programs at the federal level.

Gender-based analysis plus (GBA+)

GBA+ was conducted during the development of the AAPHI program authorities. It has been incorporated into some AAPHI activities. For example:

Women and Gender Equality Canada (WAGE) defines GBA+ as “an analytical process that provides a rigorous method for the assessment of systemic inequalities, as well as a means to assess how diverse groups of women, men and gender diverse people may experience policies, programs and initiatives”, noting further that “GBA+ is not just about differences between biological (sexes) and socio-cultural (genders)…GBA+ considers many other identity factors such as race, ethnicity, religion, age and mental or physical disability and how the interaction between these factors influences the way we might experience government policies and initiatives.”

Internal key informants from both ECCC and HC noted that the data needed to support GBA+ is not always available.

Conclusions, recommendations and management response

Conclusions

Relevance

The evaluation confirmed an ongoing need for federal action to address air pollution and air quality. Canada has low levels of ambient air pollution compared to some regions of the world and air quality in the country has generally improved over time. However, the available data are not uniformly positive. One quarter of Canadians live in areas where measured outdoor concentrations of fine particulate matter, ozone, sulphur dioxide and nitrogen dioxide exceed one or more of the 2020 CAAQS. Although emissions of most pollutants are expected to decline in Canada over time, some (e.g., emissions of VOCs, fine particulate matter and ammonia), are expected to increase. Moreover, the significant health and economic burden associated with air pollution – estimated at 14,600 premature deaths and $114 billion in socioeconomic costs per year – along with the potential implications for air pollution and air quality of climate change and other emerging issues, underscore the need for ongoing effort.

The AAPHI aligns with federal roles and responsibilities. Furthermore, participants in the evaluation agreed that the federal government plays an important and valuable role in addressing air pollution and air quality and that this role should continue. However, both industry and P/T focus group participants emphasized the importance of avoiding duplication with P/T regulatory activities. P/T representatives urged the federal government to clearly articulate and share with the P/T its long-term “master plan” or agenda for air quality. This would help them in planning their own activities to avoid duplication and minimize regulatory and reporting impact on industry.

Although the AAPHI aligns with current federal priorities, there is considerable support among internal and external participants in the evaluation for enhancing alignment with the government’s climate change and Indigenous reconciliation priorities.

Effectiveness

Key accomplishments of the AAPHI during the period covered by this evaluation include the ongoing implementation of the AQHI across Canada; the development of new CAAQS for sulphur dioxide and nitrogen dioxide and revised CAAQS for ozone; the implementation of the Multi-Sector Air Pollutants Regulations and a number of non-regulatory instruments establishing BLIERs for several pollutants and sectors; and the ratification of the 1999 Protocol to Abate Acidification, Eutrophication and Ground-level Ozone (the Gothenburg Protocol) and its 2012 amendments.

Some planned mitigation measures for outdoor air have not advanced to the extent originally envisioned. These include the establishment, through regulatory or non-regulatory instruments, of BLIERs for a number of sectors where consensus was not reached during the AQMS development process. This includes planned regulations to reduce emissions of pollutants other than VOCs from the petroleum refining sector. Despite the lack of consensus, there was an expectation that the federal government would move forward appropriately to establish BLIERs for these sectors. To date, however, non-consensus BLIERs, including for the refining sector, have not been established or otherwise dealt with.

The need for action on this front is supported by data indicating that Canadian refineries emit far more pollutants than their counterparts in the United States and that one or more of the CAAQS for sulphur dioxide, nitrogen dioxide, ozone and fine particulate matter is being exceeded in seven out of 13 areas where there are petroleum refineries and oil sands upgraders. The Government of Canada indicated that it had begun to develop regulations to address these emissions in its 2018 response to Parliament on the review of the Canadian Environmental Protection Act, 1999.

The evaluation found evidence of progress toward some of the expected results of the AAPHI, although in some cases, evidence is lacking to support firm conclusions.

Efficiency

Internal and external participants in the evaluation consider the overall design of the AAPHI to be sound. Perceived strengths include its collaborative approach to delivering key activities; its robust research, science and technical expertise and capacity; its standardized approach to air quality monitoring and reporting; and its focus on transparency and reporting to the public.

Canada’s increased profile in recent years as an international leader with respect to air quality research and management is also seen as an important strength. Several countries have expressed interest in, adopted, or adapted the AQHI. Work done under the AAPHI has led to the establishment of an international Community of Practice around wildfire smoke and smoke response. Countries around the world look to Canada for its expertise in evaluating the health risks of air pollution. NRC is consulted internationally for its expertise in evaluation of technological solutions to improve indoor air quality. International stakeholders praised Canada for its contributions on the international stage and encouraged it to continue playing a leadership role.

Several possible improvements to program design emerged from this evaluation.

The AAPHI was without a functional horizontal governance structure or approved air quality agenda for most of the period covered by this evaluation. Evidence from internal interviews indicates that this resulted in some AAPHI resources shifting to address other departmental and Government priorities. However, a formal governance structure and air quality workplan were approved in November 2019. Evaluation findings suggest a need to improve understanding of the roles and responsibilities of federal partners involved in the AAPHI at the working level. There is also room to ensure more consistent communication and coordination among them in order to share information, identify areas of mutual interest and potential collaborations and achieve efficiencies.

A logic model and performance measurement framework have been developed for the AAPHI. However, it is unclear whether the performance information collected and reported used to inform decision-making. There are opportunities to revise the logic model and performance measurement framework to ensure that all program activities are adequately represented; streamline the number of outcomes; and ensure that performance reporting occurs consistently over time for all outcomes and for both indoor and outdoor air. Currently, the ultimate outcomes for the AAPHI pertain only to outdoor air.

Recommendations and management response

The following recommendations are directed to ECCC’s Associate Assistant Deputy Minister of Environmental Protection Branch, as the lead senior departmental official responsible for the AAPHI, as well as to HC’s Assistant Deputy Minister of Healthy Environments and Consumer Safety Branch and NRC’s Vice President of Engineering. Deliverables below would be submitted to the ADM Oversight Committee of the Addressing Air Pollution Horizontal Initiative for approval.

Recommendation 1

Improve communication and outreach to partners, stakeholders and the general public related to federal air quality activities. This should include:

The evaluation evidence indicates that while the federal departments involved in the AAPHI generate a large quantity of high-quality information about air pollution and air quality, this information may not be effectively reaching the intended target audiences. Improving communications and outreach could help partners, stakeholders and the public use the information generated by the program to inform and guide their own activities and behaviours.

Statement of agreement or disagreement

Agree with the recommendation.

Management response

ECCC’s Air Emissions Priorities Division, in collaboration with Health Canada and the National Research Council, will finalize the AQP Communications Strategy, which will lay out an approach to improving communications and outreach and submit it for approval. The Strategy will include, but may not be limited to, specific components to address the recommendations above:

Implementation of response to Recommendation 1
Deliverable(s) Timeline Responsible party
An AQP Communications Strategy, that includes target audiences, objectives, activities and timelines, is developed and submitted for approval. September 2021 Director General, Legislative and Regulatory Affairs Directorate, ECCC
A centralized online platform for air quality information, including on the federal government’s air quality agenda, with a schedule for updating this information in a timely manner is created. December 2021 Director General, Legislative and Regulatory Affairs Directorate, ECCC
A list server to facilitate access to studies and publications related to air quality and air pollution, is operationalized. December 2021 Director General, Legislative and Regulatory Affairs Directorate, ECCC
A social media approach for enhancing public awareness of available information, including the AQHI, is developed and submitted for approval. December 2021 Director General, Legislative and Regulatory Affairs Directorate, ECCC

Recommendation 2

Advance commitments to develop and establish outstanding Base-level Industrial Emissions Requirements, including in regulations to address emissions from petroleum refineries.

The federal commitment to develop and establish Base-level Industrial Emissions Requirements (BLIERs), including for the refining sector, predates the AAPHI and the period covered by this evaluation. While some progress has been made to establish BLIERs in regulatory and non-regulatory instruments, including the Multi-Sector Air Pollutants Regulations and the regulations to limit volatile organic compounds (VOC) emissions from the refining sector, further steps should be taken to advance this work, if the need is reconfirmed.

In the case of refinery emissions, the need for action is underscored by data indicating that Canadian refineries emit far more pollutants than their counterparts in the United States and that one or more of the Canadian Ambient Air Quality Standards (CAAQS) for sulphur dioxide, nitrogen dioxide, ozone and fine particulate matter is being exceeded in seven out of 13 areas where there are petroleum refineries and oil sands upgraders. The Government of Canada indicated that it had begun to develop regulations to address these emissions in its 2018 response to Parliament on the review of the Canadian Environmental Protection Act, 1999.

Statement of agreement or disagreement

Agree with the recommendation.

Management response

ECCC’s Air Emissions Priorities Division will lead an analysis to determine the ongoing need for the outstanding BLIERs given measures put in place since 2012. For the petroleum refining sector in particular, ECCC will conduct an analysis of gaps in coverage of sulphur dioxide and other air pollutant emissions from refineries, upgraders and other facilities that will persist once VOC and methane regulations, carbon pricing and other measures are taken into account. A report to senior management will be provided.

If warranted by the analysis, ECCC (led by the Energy and Transportation Directorate) will develop a proposed approach to address emissions of sulphur dioxide and other air pollutants from refineries and other facilities in the petroleum sector.

Implementation of response to Recommendation 2
Deliverable(s) Timeline Responsible party
An initial report that examines the need for outstanding BLIERs, including for refineries, in light of measures adopted since the commitment was first made, is developed and submitted for approval. December 2021 Director General, Legislative and Regulatory Affairs Directorate, ECCC
Detailed analysis of air pollution gaps and outstanding concerns related to the petroleum sector—informing recommendations on potential further risk management actions for the petroleum sector- is conducted December 2022 Director General, Energy and Transportation Directorate, ECCC
If warranted, a proposed approach to address emissions of sulphur dioxide and other air pollutants from petroleum refineries and upgraders is developed and submitted for approval.. December 2023 Director General, Energy and Transportation Directorate, ECCC

Recommendation 3

Better integrate air quality and climate change policy and initiatives, while continuing to recognize these as distinct policy areas.

There is considerable support among internal and external participants in the evaluation for better integrating air quality and climate change policy. It is important to continue to recognize these as distinct policy areas. However, a more systematic consideration and accounting of the inter-relationships between them could optimize federal risk management strategies and improve alignment with the federal government’s climate change priority.

Statement of agreement or disagreement

Agree with the recommendation.

Management response

Preliminary discussions to better integrate climate change and air quality policy have occurred. The Air Quality Program will continue to advance the issue, taking into consideration that it is broader than air quality.

ECCC’s Air Emissions Priorities Division will work with appropriate groups within ECCC and Health Canada towards more systematic consideration of both the impacts on air pollutant emissions of proposed measures to address climate change and the impacts on greenhouse gas emissions of proposed measures to address air pollution. As a first step, a stock-taking exercise to assess the impact of key measures will be undertaken.

Implementation of response to Recommendation 3
Deliverable(s) Timeline Responsible party
Analysis to estimate GHG impacts from key air pollution measures and air pollutant impacts from key climate measures is produced and shared with the governance committees of the Clean Growth and Climate Change and Addressing Air Pollution horizontal initiatives. December 2021 Director General, Economic Analysis Directorate, ECCC

Recommendation 4

Support more meaningful engagement and consultation with Indigenous peoples and explore options for greater Indigenous involvement in air quality monitoring and management.

Evidence indicates that Indigenous peoples are particularly vulnerable to health-related risks, which can be the result of, or exacerbated by, environmental conditions in their communities, including air pollution. There is widespread support among evaluation participants for more meaningful engagement with Indigenous peoples on air quality issues to help mitigate these risks. This would also improve program alignment with the government’s reconciliation priority and the nation-to-nation principle.

Statement of agreement or disagreement

Agree with the recommendation.

Management response

A number of air-related initiatives underway include engagement with Indigenous communities to monitor and manage air quality and this will continue.

ECCC’s Air Emissions Priorities Division, in conjunction with Health Canada’s Safe Environments Directorate, will co-lead the development of a stock-taking exercise to identify current activities and explore options for more meaningful engagement of Indigenous peoples in air quality issues with the goal of identifying areas of greatest interest and developing targeted actions.

Implementation of response to Recommendation 4
Deliverable(s) Timeline Responsible party
A document outlining the current Indigenous engagement activities on air and opportunities for more meaningful engagement is produced. December 2021

Director General, Legislative and Regulatory Affairs Directorate, ECCC

Director General, Safe Environments Directorate, HC

A report, based on consultation with Indigenous peoples, on areas of greatest interest, including potential targeted actions is produced and submitted for approval. December 2022

Director General, Legislative and Regulatory Affairs Directorate, ECCC

Director General, Safe Environments Directorate, HC

Recommendation 5

Recognizing that Canadians spend a large proportion of time indoors and that concentrations of indoor air pollutants can be significant, consideration should be given to enhancing the initiative’s focus on indoor air quality.

At present, most AAPHI activities focus on outdoor air quality and there is limited information on the extent to which the public is aware of and using the information generated about indoor air quality. Increased emphasis on indoor air quality is warranted, considering the large proportion of time (90%) that Canadians spend indoors and the fact that concentrations of air pollutants can, in some circumstances, greatly exceed outdoor concentrations. A changing climate can also affect indoor air quality due to elevated levels of outdoor pollutants, such as smog, wildfire smoke and aeroallergens, that infiltrate into buildings and extreme weather events such as flooding that can lead to the presence of mould indoors.

Statement of agreement or disagreement

Agree with the recommendation.

Management response

A number of indoor air quality initiatives are already underway to improve indoor air, which is vital to the health of Canadians.

Building on this, Health Canada, in collaboration with the National Research Council, will develop a plan that identifies activities to increase emphasis on indoor air quality. This plan may include developing calls for research proposals and exploring new options to leverage technologies (such as portable sensors) to better understand and manage indoor air quality issues.

Implementation of response to Recommendation 5
Deliverable(s) Timeline Responsible party
A plan that identifies activities and timelines to increase emphasis on indoor air quality is developed and submitted for approval. December 2021 Director General, Safe Environments Directorate, HC

Appendix A: AAPHI logic model

Activities Outputs Direct/immediate outcomes Intermediate outcomes Final outcomes

Science and reporting

(ECCC, HC)

  • Public awareness materials (e.g. Air Quality Health Index (AQHI), Infographics, health risk assessments, etc.)
  • Health-related research results
  • Data and information on air pollutants, air quality and exposure
  • Health risk assessments and health benefits analysis
  • Reports to meet international obligations (e.g., biennial reports, UNECE annual report, WHO)
  • Senior managers, partners and stakeholders have access to information and analysis on air quality and air pollution
  • Canadians, including individuals of highest risk (i.e. infants, children and those with pre-existing health conditions), are aware of the health risks of outdoor air pollutants and what they can do to avoid exposure
Canadians avoid exposure to outdoor air pollutants

All themes contribute to the overall program goals:

  • Canadians have clean air
  • Adverse impacts on human health and ecosystems are reduced

Policy and analysis

(ECCC, HC)

  • Participation in international negotiations and fora on air quality
  • Canadian Ambient Air Quality Standards (CAAQS)
  • Implementation of international agreements to reduce transboundary air pollution
  • Federal air quality standards are strengthened
  • Canada’s involvement in international and bilateral transboundary agreements improves air quality
  • Federal measures improve air quality

All themes contribute to the overall program goals:

  • Canadians have clean air
  • Adverse impacts on human health and ecosystems are reduced

Mitigation actions for outdoor air

(ECCC)

  • Regulatory and non-regulatory instruments
  • Compliance reports
  • Compliance promotion materials
  • Regulatees are in compliance with federal air pollution measures
  • Target audiences are following non-regulatory federal air pollution measures
  • Compliance review related to air pollutant regulations is strengthened
Regulatory and non-regulatory instruments reduce Canadian air pollutant emissions

All themes contribute to the overall program goals:

  • Canadians have clean air
  • Adverse impacts on human health and ecosystems are reduced

Indoor air quality activities

(HC, NRC)

  • Guidance documents
  • Public awareness materials
  • Health risk assessments
  • Standards and guidelines for other indoor air pollutants
  • Indoor air quality technologies validation reports
  • Health-related research results
  • Canadians are aware of the health risks and strategies and tools to reduce exposure to indoor air pollutants
  • Develop technological solutions to improve indoor air quality
  • Canadians avoid exposure to indoor air pollutants
  • Increased uptake of products and systems that improve indoor air quality

All themes contribute to the overall program goals:

  • Canadians have clean air
  • Adverse impacts on human health and ecosystems are reduced

For the purpose of the evaluation, the above outcomes were collapsed to create thematic outcomes that served as the basis for this evaluation’s assessment of program performance. Table 7 illustrates how the AAPHI’s intended outcomes align with the thematic outcomes.

Table 7: crosswalk between intended AAPHI outcomes and thematic/evaluation outcomes
Thematic outcome area Contributing expected outcomes
Access to information and  analysis Senior managers, partners and stakeholders have access to information and analysis on air quality and air pollution
Action to improve air quality (reported in Section 3.1, Activities and Accomplishments) Implementation of international agreements to reduce transboundary air pollution
Federal air quality standards are strengthened
Compliance review related to air pollutant regulations is strengthened
Develop technological solutions to improve indoor air quality
Compliance with air pollution measures Regulatees are in compliance with federal air pollution measures
Target audiences are following non-regulatory federal air pollution measures
Increased public awareness Canadians, including individuals of highest risk (i.e. infants, children and those with pre-existing health conditions), are aware of the health risks of outdoor air pollutants and what they can do to avoid exposure
Canadians are aware of the health risks and strategies and tools to reduce exposure to indoor air pollutants
Behaviour change Canadians avoid exposure to outdoor air pollutants
Canadians avoid exposure to indoor air pollutants
Increased uptake of products and systems that improve indoor air quality
Reduced emissions Canada's involvement in international and bilateral transboundary agreements improves air quality
Regulatory and non-regulatory instruments reduce Canadian air pollutant emissions
Clean air Federal measures improve air quality
Canadians have clean air
Reduced adverse impacts Adverse impacts on human health and ecosystems are reduced

Appendix B: evaluation strategy

Evaluation issues and questions

The following questions related to the relevance and performance of the AAPHI were examined in the evaluation.

Relevance

Continued need for the program
Alignment with government priorities
Alignment with federal roles and responsibilities

Performance

Program efficiency
Effectiveness – Achievement of expected results

Evaluation approach and methodology

Several data collection methodologies were used to address the evaluation issues and questions. Evidence drawn from these methods informed the findings and conclusions.

Review of documents and data

The document and data review served to develop a thorough understanding of the AAPHI and to contribute as a line of evidence to address all evaluation questions. Examples of the types of materials reviewed included key policy setting documents, departmental reports, previous evaluation and audit reports, program/project files and selected research and grey literature.

Key informant interviews

Key informant interviews were used to solicit informed opinions and observations on the evaluation questions from various stakeholders involved in or familiar with the AAPHI. A total of 33 group and individual interviews, involving 63 key informants, were conducted by telephone between September 4, 2019 and February 19, 2020. Table 8 shows the number of key informants by respondent category.

Table 8-A: distribution of interviews by key informant category (Program representatives)
Key Informant Category # of key informants
ECCC 23
HC-HECSB (WAQB) 14
NRC 3
Total 40
Table 8-B: distribution of interviews by key informant category (External key informants)
Key Informant Category # of key informants
Researchers and academia 4
Indigenous organizations and communities 4
Representatives of municipalities 5
International stakeholders 4
NRC clients 6
Total 23
Table 8-C: distribution of interviews by key informant category (Overall total)
Key Informant Category # of key informants
Program representatives 40
External key informants 23
Overall total 63

Focus groups

Four focus groups were conducted by teleconference with external stakeholders across Canada, including industry stakeholders, representatives of NGOs and P/T representatives. Potential participants were identified by ECCC and HC. Table 9 shows the number of participants in each group.

Table 9: focus group composition
Group Number of participants
Industry 10 (representing 6 sectors)
NGOs 6
Provinces and territories – AQMS 8
Provinces and territories – AQHI 5
Total – all groups 29

Tailored discussion guides were created for each group and these, along with a backgrounder on the AAPHI, were provided to confirmed participants in advance of their scheduled group.

Limitations and mitigation strategies

The evaluation encountered two main limitations while conducting the evaluation and put in place strategies to mitigate their impact.

Table 10: limitations and mitigation strategies
Limitations Mitigation strategies
Potential key informants and focus group participants were identified through purposive sampling and self-selected into the interview or focus group process once invited to participate. As such, the perspectives of key informants and focus group participants do not represent the views of all relevant partners and stakeholders. Wherever possible, findings from the interviews and focus groups are corroborated with information from other lines of evidence.
Performance information was limited to support firm conclusions on the extent to which the AAPHI has achieved or made progress toward its outcomes. In some cases, performance information is not routinely or regularly collected (e.g., impact of program activities on public awareness and behaviour). In other cases (e.g., impact of risk management measures on air quality), some information is being tracked, but the desired outcomes are expected to emerge over a longer time period than that examined by the evaluation. To the extent feasible, the evaluation addressed this limitation by supplementing available performance information with information from other lines of evidence, such as key informant interviews and publicly available sources of data.

Appendix C: references

Brunst, K. J., Ryan, P. H., Altaye, M., Yolton, K., Maloney, T., Beckwith, T., LeMasters, G., & Cecil, K. M. (2019). Myo-inositol mediates the effects of traffic-related air pollution on generalized anxiety symptoms at age 12 years. Environmental Research, 175, 71–78.

CAPP. (2019). Crude Oil Forecast. Canadian Association of Petroleum Producers.

Cox, K. D., Covernton, G. A., Davies, H. L., Dower, J. F., Juanes, F., & Dudas, S. E. (2019). Human Consumption of Microplastics. Environmental Science & Technology, 53(12),

Dibben, C., & Clemens, T. (2015). Place of work and residential exposure to ambient air pollution and birth outcomes in Scotland, using geographically fine pollution climate mapping estimates. Environmental Research, 140, 535–541.

ECCC. (2017a). Strategy on Short-Lived Climate Pollutants—2017. Cat. No.: En4-299/2017E-PDF; ISBN: 978-0-660-08363-6

ECCC. (2017b, November 9). Departmental Results Report 2016 to 2017, supplementary tables, Department of Environment, chapter 4.

ECCC. (2018a). Canada’s Greenhouse Gas and Air Pollutant Emissions Projections 2018.

ECCC. (2018b). Canadian Environmental Sustainability Indicators: Air Quality. Cat. No.: En4-144/57-2018E-PDF; ISBN: 978-0-660-28053-0.

ECCC. (2018c, November 20). Departmental Results Report 2017 to 2018, supplementary tables: Department of Environment, chapter 4.

ECCC. (2019, February 20). Volatile organic compound emissions from cutback and emulsified asphalt: Progress report 2017. Official title: 2017 Progress report on the Code of practice for the reduction of volatile organic compound (VOC) emissions from cutback and emulsified asphalt. Cat. No.: En14-271/2-2018E-PDF; ISBN: 978-0-660-28868-0.

ECCC. (2020a). Departmental Results Report 2018 to 2019, supplementary tables: Department of Environment, chapter 2.

ECCC. (2020b, March 13). Canada’s Air Pollutant Emissions Inventory.

Ecojustice. (2018, April 30). Inadequate Pollution Control in Canadian Refineries: Media Backgrounder.

Environmental Commissioner of Ontario. (2017). Good Choices, Bad Choices. Environmental Rights and Environmental Protection in Ontario (p. 290).

Gasperi, J., Wright, S. L., Dris, R., Collard, F., Mandin, C., Guerrouache, M., Langlois, V., Kelly, F. J., & Tassin, B. (2018). Microplastics in air: Are we breathing it in? Current Opinion in Environmental Science & Health, 1, 1–5.

Ghawazi, F., Le, M., Cyr, J., Netchiporouk, E., Rahme, E., Alakel, A., Zubarev, A., Powell, M., Moreau, L., Roshdy, O., Glassman, S., Sasseville, D., Popradi, G., & Litvinov, I. (2019). Analysis of Acute Myeloid Leukemia Incidence and Geographic Distribution in Canada From 1992 to 2010 Reveals Disease Clusters in Sarnia and Other Industrial US border Cities in Ontario. Cancer, 125(11), 1886–1897.

Giannadaki, D., Giannakis, E., Pozzer, A., & Lelieveld, J. (2018). Estimating health and economic benefits of reductions in air pollution from agriculture. Science of The Total Environment, 622–623, 1304–1316.

GoC. (1985a). Department of the Environment Act, R.S.C., 1985, c. E-10 (Consolidation).

GoC. (1985b). National Research Council Act, R.S.C., 1985, c. N-15 (Consolidation).

GoC. (1996). Department of Health Act, S.C. 1996, c. 8(Consolidation).

GoC. (1999). Canadian Environmental Protection Act, 1999, (S.C. 1999, c. 33) (Consolidation).

GoC. (2012). The Air Quality Management System: Federal, Provincial and Territorial Roles and Responsibilities.

GoC. (2015). Speech from the Throne to Open the First Session Forty Second Parliament of Canada.

GoC. (2016a). Health risks of air pollution.

GoC. (2016b). Budget 2016. Cat. No.: F1-23/3E-PDF; ISSN: 1719-7740.

GoC. (2017). Budget 2017. Cat. No.: F1-23/3E-PDF; ISSN: 1719-7740.

GoC. (2018a). Budget 2018. Cat No.: F1-23/3E-PDF; ISSN: 1719-7740.

GoC. (2018b). Follow-up report to the House of Commons Standing Committee on Environment and Sustainable Development on the Canadian Environmental Protection Act, 1999.

GoC. (2019a). Budget 2019. Cat No.: F1-23/3E-PDF; ISSN: 1719-7740,

GoC. (2019b, December 5). Moving Forward Together. Speech from the Throne to open the First Session of the Forty-Third Parliament of Canada.

GoC. (2020, September 23). A stronger and more resilient Canada: Speech from the Throne to open the Second Session of the Forty-Third Parliament of Canada.

HC. (2018a). Health Canada 2017–2018 Departmental Results Report. Catalogue No H1-9 / 32E-PDF; ISSN 2560-810X.

HC. (2018b). Ventilation and the indoor environment. Cat. No.: H144-54/1-2018E-PDF; ISBN: 978-0-660-25488-3

HC. (2019a). Health impacts of air pollution in Canada: Estimates of morbidity and premature mortality outcomes, 2019 report. Cat. No.: H144-51/2019E-PDF; ISBN: 978-0-660-31165-4

HEI. (2016, March 9). Multipollutant Mixtures.

HEI. (2019). State of Global Air 2019. Special Report.

IHME. (2019). Global Burden of Disease 2017.

IOM. (2011, June). Climate Change, the Indoor Environment and Health. Report Brief.

Jerrett, M. (2015). The death toll from air-pollution sources. Nature, 525(7569), 330–331.

Khan, A., Plana-Ripoll, O., Antonsen, S., Brandt, J., Geels, C., Landecker, H., Sullivan, P., Bocker Pedersen, C., & Rzhetsky, A. (2019). Environmental pollution is associated with increased risk of psychiatric disorders in the US and Denmark. PLoS Biol, 17(8).

Kovesi, T. (2012). Respiratory disease in Canadian First Nations and Inuit children. Paediatrics & Child Health, 17(7), 376–380.

Prime Minister of Canada. (2015a). Minister of Environment and Climate Change Mandate Letter 2015.

Prime Minister of Canada. (2015b, November 12). Minister of Health Mandate Letter 2015.

Prime Minister of Canada. (2019a, December). Minister of Health Mandate Letter 2019.

Prime Minister of Canada. (2019b, December 12). Minister of Environment and Climate Change Mandate Letter 2019.

Ramanathan, V., & Carmichael, G. (2008). Global and regional climate changes due to black carbon. Nature Geoscience, 1(4), 221–227.

Ritchie, H., & Roser, M. (2017). Our World in Data: Air Pollution.

Seabrook, J. A., Smith, A., Clark, A. F., & Gilliland, J. A. (2019). Geospatial analyses of adverse birth outcomes in Southwestern Ontario: Environmental Research, 172, 18–26.

Statistics Canada. (2020, July 8). The Decline in Production and Investment in Canada’s Oil and Gas Sector and its Impact on the Economy.

US EPA. (2014, June 11). Exposure and Health Effects of Mixtures of Air Pollutants.

US EPA. (2016a, February 29). Tribal Air Quality Monitoring

US EPA. (2016b, July 21). Basic Information about Air Quality TIPs [Tribal Implementation Plans].

US EPA. (2017, November 2). Introduction to Indoor Air Quality.

US EPA. (2019). Petroleum Refinery National Case Results.

Vianello, A., Jensen, R. L., Liu, L., & Vollertsen, J. (2019). Simulating human exposure to indoor airborne microplastics using a Breathing Thermal Manikin. Scientific Reports, 9(1), 1–11.

Weichenthal, S., Mallach, G., Kulka, R., Black, A., Wheeler, A., You, H., St-Jean, M., Kwiatkowski, R., & Sharp, D. (2013). A randomized double-blind crossover study of indoor air filtration and acute changes in cardiorespiratory health in a First Nations community. Indoor Air, 23(3), 175–184.

WHO. (2018). How air pollution is destroying our health.

Yusa, A., Berry, P., J.Cheng, J., Ogden, N., Bonsal, B., Stewart, R., & Waldick, R. (2015). Climate Change, Drought and Human Health in Canada. International Journal of Environmental Research and Public Health, 12(7), 8359–8412.

Page details

Date modified: