Monitoring positive mental health and its determinants in Canada: the development of the Positive Mental Health Surveillance Indicator Framework - HPCDP: Volume 36-1, January 2016
Volume 36 · Number 1 · January 2016
Monitoring positive mental health and its determinants in Canada: the development of the Positive Mental Health Surveillance Indicator Framework
This article has been peer reviewed.
Correspondence: Heather Orpana, Public Health Agency of Canada, 785 Carling Avenue, Office 523B1, Ottawa, ON K1A 0K9; Tel: 613-878-5011; Fax: 613-941-9502; Email: email@example.com
Introduction: The Mental Health Strategy for Canada identified a need to enhance the collection of data on mental health in Canada. While surveillance systems on mental illness have been established, a data gap for monitoring positive mental health and its determinants was identified. The goal of this project was to develop a Positive Mental Health Surveillance Indicator Framework, to provide a picture of the state of positive mental health and its determinants in Canada. Data from this surveillance framework will be used to inform programs and policies to improve the mental health of Canadians.
Methods: A literature review and environmental scan were conducted to provide the theoretical base for the framework, and to identify potential positive mental health outcomes and risk and protective factors. The Public Health Agency of Canada’s definition of positive mental health was adopted as the conceptual basis for the outcomes of this framework. After identifying a comprehensive list of risk and protective factors, mental health experts, other governmental partners and non-governmental stakeholders were consulted to prioritize these indicators. Subsequently, these groups were consulted to identify the most promising measurement approaches for each indicator.
Results: A conceptual framework for surveillance of positive mental health and its determinants has been developed to contain 5 outcome indicators and 25 determinant indicators organized within 4 domains at the individual, family, community and societal level. This indicator framework addresses a data gap identified in Canada’s strategy for mental health and will be used to inform programs and policies to improve the mental health status of Canadians throughout the life course.
Keywords: health status indicators, mental health
- The Public Health Agency of Canada developed a conceptual framework for the surveillance of positive mental health and its determinants in Canada.
- Included in 4 ecological levels—individual, family, community and society—were 5 outcomes and 25 determinant indicators.
- The framework provides a structure for positive mental health surveillance data that will inform mental health promotion programs and policies across the life course.
- The framework addresses a key data gap identified in Canada’s strategy for mental health Changing Directions, Changing Lives.
The Public Health Agency of Canada (the Agency) defines mental health as "the capacity of each and all of us to feel, think, and act in ways that enhance our ability to enjoy life and deal with the challenges we face. It is a positive sense of emotional and spiritual well-being that respects the importance of culture, equity, social justice, interconnections and personal dignity."Footnote 1 Similarly, the World Health Organization (WHO) defines mental health as "a state of well-being in which every individual realizes his or her own potential, can cope with the normal stresses of life, can work productively and fruitfully, and is able to make a contribution to her or his community."Footnote 2 The positive dimension of mental health is emphasized in the definition of health in the WHO constitution: "Health is a state of complete physical, mental and social well-being and not merely the absence of disease or infirmity."Footnote 2
Public health surveillance, one of six core public health functions,Footnote 3 is defined as "the continuous, systematic collection, analysis and interpretation of health-related data needed for the planning, implementation and evaluation of public health practice."Footnote 4 The Agency's surveillance programs monitor and report on a range of topics related to chronic disease, injury and health behaviours, including mental illness and suicide, in the Canadian population. Canada's national mental health strategy, Changing Directions, Changing Lives,Footnote 5 recommended "strengthen[ing] data and research to develop a better understanding of the mental health needs and strengths of diverse population groups"Footnote 5 and "improv[ing] mental health data collection, research, and knowledge exchange across Canada." Footnote 5 As part of the 2013 federal budget, the Government of Canada directed that $2 million be reallocated each year for three years to enhance data on mental health, improve knowledge and foster collaboration. While the Agency has an established mental illness surveillance system,Footnote 6 there was no surveillance system focussing on the positive mental health of Canadians in 2013. To address this gap, and in consultation with key stakeholders and experts, the Agency set out to develop a conceptual framework and a core set of indicators for its surveillance of positive mental health and its determinants. The indicators will be used to inform programs and policies to improve the mental health status of Canadians throughout their life course. Although public health professionals as well as policy and program developers and decision makers are the primary audience, we anticipate that the public will be interested because of the increasing attention paid to positive mental health and well-being.
In this paper, we describe the process undertaken by the Agency to establish a Positive Mental Health Surveillance Indicator Framework as well as the rationale for and the principles underlying this project and the progress to date. This includes the conceptual framework and the core indicators for surveillance purposes.
To identify existing mental health surveillance frameworks, a librarian conducted a literature search using Embase (1974 to 2013), Medline (1946 to 2013) and PsycINFO using the following keywords and their combinations: mental health, mental disorders, indicators, criteria, method, measure, policy, policies, develop, surveillance, taxonomy, framework, performance, health status indicators, quality indicators and health care. Results were limited to French and English articles, and articles that were clinically oriented or focussed on a particular patient population were excluded. Altogether, 88 unique articles were identified for review. An additional Internet search used Google and the keywords mental health, surveillance, and framework.
Components of existing surveillance frameworks were identified, for example, in Waddell et al.,Footnote 7 ParkinsonFootnote 8 and Korkeila et al.Footnote 9 although there were no frameworks that focussed exclusively on positive mental health and most of the surveillance frameworks were strongly oriented towards mental illness. In addition, we reviewed population health and health promotion approaches that provided the socioecological organizing structure for the framework.Footnote 10Footnote 11Footnote 12
Based on these searches, a conceptual framework, which provided the underlying theoretical foundation for this project, was developed in consultation with Mental Health Commission of Canada (MHCC) experts. This conceptual framework was reviewed by the MHCC Directors and the MHCC's Expert Advisory Council. The framework integrated conceptual elements that were important for describing positive mental health in the population (see Figure 1).
Positive mental health conceptual framework for surveillance
Text Equivalent - Figure 1
Figure 1 depicts the conceptual framework that was developed by the Public Health Agency of Canada in consultation with Mental Health Commission of Canada experts. The framework integrates conceptual elements that are important for describing positive mental health in the population.
The selected indicators are presented in the form of a socioecological model representing the 4 domains (individual, family, community and society) in which these risk and protective factors exist. Each domain influences the positive mental health of the population and is considered a potential entry point for interventions that promote mental health.
Figure 2 summarizes the steps in the development of the Positive Mental Health Surveillance Indicator Framework.
Development process for Positive Mental Health Surveillance Indicator Framework
Text Equivalent - Figure 2
Figure 2 summarizes the steps in the development of the Positive Mental Health Surveillance Indicator Framework.
Four components were integrated into an overarching conceptual framework that provided the base on which indicators were selected. Based on the selection criteria stemming from a literature search, indicators were selected through another literature search. Stakeholder consultations helped select determinant indicators and prioritize the indicators. Through an environmental scan, measures were identified, then selected by way of stakeholder consultation surveys.
Four components were integrated into an overarching conceptual framework that provided the base on which indicators were selected.
First, positive mental health was conceptualized as a state of well-being that all individuals, regardless of whether they are experiencing a mental illness, are able to enhance.5 The concept of positive mental health applies to everyone and therefore holds promise as a mechanism to positively shift the population distribution of well-being.
Second, risk and protective factors, or determinants of positive mental health, were identified as important components of the framework; these factors are the focus of efforts to intervene and improve population mental health.Footnote 13
Third, a socioecological model representing the domains in which these risk and protective factors exist was embedded in the conceptual framework.Footnote 8Footnote 11 These individual, family, community and society domains are shown in Figure 1. Each domain influences the positive mental health of the population and is considered a potential entry point for interventions that promote mental health.
Fourth, the life course was represented in the conceptual framework because risk and protective factors vary and accumulate and experiences in early life may continue to affect positive mental health in later life.Footnote 14 The life course stages identified were childhood (0–11 years), youth (12–17 years) and adulthood (≥ 18 years). While these broad categories are heterogeneous, the decision was made to maintain high-level life course stages, with any further refinements reflected in specific indicators and measures. While all but four indicators are the same in the life course stages, the way these concepts are measured changes according to each stage.
Indicator selection criteria
Once the conceptual framework was identified, each of the framework domains was populated with selected indicators and measures. Indicators were defined as concepts that could be measured and reported on, while measures operationalized the indicators through survey questions, scales or other methods.
Five selection criteria (relevant, actionable, accurate, feasible and ongoing) were used to prioritize the positive mental health indicators and measures. The definitions adopted for these criteria (see Table 1) are widely used to assess indicators.Footnote 15 We also chose these to align with the selection criteria used for the Chronic Disease Indicator FrameworkFootnote 16 as well as international indicator frameworks.Footnote 17Footnote 18Footnote 19Footnote 20 Relevance and actionability were considered within the context of public health programs and policy; accuracy, feasibility and the ongoing nature of the data were considered in the context of the surveillance programs that would collect these data. These criteria were used to select and prioritize indicators as well as to select measures.
|Provides information that is considered to be meaningful and relevant to the target user.Footnote 16Footnote 17Footnote 18
|Provides information that can inform, influence, or change public health practice or policy.Footnote 16Footnote 17Footnote 18
|Reflects the best evidence. It has to be scientifically sound, valid, reliable, sensitive to change, interpretable and complete.Footnote 16Footnote 17Footnote 18
|Data are available and of sufficient quality to report on or data collection can be put into place at a relatively low cost.Footnote 16Footnote 17Footnote 18
|Data are collected regularly and trends can be compared over time.Footnote 16Footnote 17Footnote 18
Indicator identification and selection
We identified a comprehensive list of potential indicators for a positive mental health indicator framework in the retrieved literature (Figure 1). Where needed, we looked up other relevant literature in support of specific content areas, such as positive mental health outcomes.
First, we identified positive mental health outcome indicators based on contemporary positive mental health and well-being theory, which generally identifies two components: hedonia, or feeling good, and eudaimonia, or functioning well.Footnote 21 Hedonia is reflected in measures of positive affect and satisfaction with life (emotional well-being), while eudaimonia taps into functioning well, for example, being able to engage in valued activities and have meaningful relationships (psychological and social well-being).Footnote 22 Outcomes were also chosen to align with the Agency's operational definition of positive mental health.Footnote 23
We then selected positive mental health determinant indicators to capture the risk and protective factors for positive mental health that exist in the individual, family, community and society domains. We identified a number of such indicators in the literature and in other mental health frameworks (for example, Waddell et al.,Footnote 7 ParkinsonFootnote 8 and Korkeila et al.Footnote 9) A thematic synthesis of indicators grouped similar concepts together to streamline the framework and make it more intelligible. We established a clear and concise definition of each indicator as well as an evidence-based rationale establishing the relationship between each determinant and positive mental health.
An initial list of 5 outcome indicators and 77 potential positive mental health determinant indicators was identified (see Table 2).
|Initial list of possible indicators
|Final list of indicators
|A. Positive Mental Health Outcomes
| 1.1. Hedonic well-being
| 1. Self-rated mental health
3. Life satisfaction
| 1.2. Eudaimonic well-being
| 4. Psychological well-being
5. Social well-being
| B. Risk and Protective Factors
| 1.1. General health
| 6. Health status
(Self-rated mental health under Outcomes)
| 1.2. Personal health practices
|7. Physical activity
| 1.3. Addiction and health risk behaviours
|8. Substance use (Alcohol and Drugs)
| 1.4. Growth and development
|3. Nurturing childhood environment
| 1.5. Biology and genetic endowment
| 1.6. Personality
| 1. Resilience
4. Control and self-efficacy
| 1.7. Spirituality and religiosity
| 1.8. Adverse childhood experiences
| 1.9. Current stressful life
| 5. Violence
(Discrimination under Society domain)
| 1.10. Coping
| 2.1. Family structure
|5. Household composition
| 2.2. Family relations
| 1. Family relationships
2. Parenting style
| 2.3. Family general health
|3. Family physical and mental health status
| 2.4. Parental health living practices
|4. Substance use by family members
| 2.5. Caregiving
|6. Household income
| 3.1. Social capital
| 3.2. Social support, social provisions, and social networks
| 3. Social support
2. Social networks
| 3.3. Peer and friend relationships
| 3.4. Inclusion and belonging
| 3.5. School and work environments
| 4. School environment
5. Workplace environment
| 3.6. Access to and organization of health and social services
| 3.7. Participation
| (Political participation under Society domain)
1. Community involvement
| 3.8. Neighbourhood characteristics
| 6. Neighbourhood social environment
7. Neighbourhood built environment
| 3.9. Community cohesion
|6. Neighbourhood social environment
| 3.10. Trust and safety
|6. Neighbourhood social environment
| 4.1. Social justice
| 4.2. Equity/equality
| (Household income under Family domain)
| 4.3. Physical environment (Built and natural environments)
| (Neighbourhood social environment and
Neighbourhood built environment under Community domain)
| 4.4. Politics and Governance
| 4.5. Laws and policies
| 4.6. Culture
|3. Political participation
Based on previous experiences the Agency had with using a modified Delphi approach to select indicators for the Chronic Disease Indicator FrameworkFootnote 16 and develop national indicators for osteoporosis in Canada,Footnote 24 we developed an iterative consultation process that would allow a structured approach to indicator selection while taking into account the views and needs of different stakeholder groups. The primary purpose of surveillance data is to inform public health action; for the purposes of the consultation, stakeholders were considered to be public health professionals working in mental health surveillance, programs or policy both internal and external to the Agency.
Two iterative consultation processes were undertaken to reduce the initial list of 77 determinant indicators to a more succinct list.
First, the Mental Health and Mental Illness Surveillance Advisory Committee, a Canadian expert advisory group that advises the Agency on the development, use and evaluation of mental health and mental illness surveillance information, was invited to an in-person meeting in January 2014. This committee includes members from academia, national organizations and provincial/territorial governments. The committee of 10 was divided into two separate breakout sessions: one group of 5 focussed on indicators in the individual domain, while the other group of 5 focussed on indicators in the family, community and society domains. Both subgroups reviewed the initial list of indicators, discussed the concepts underlying each indicator and provided feedback on reorganizing and prioritizing the indicators. They then reported their findings and decisions to the entire committee. Based on two selection criteria (relevant and actionable), the committee came to a consensus on the primary positive mental health outcomes and the top five determinant indicators in each domain. The indicator list was narrowed to 30 determinant indicators that represented the most relevant and actionable indicators associated with positive mental health.
A second phase of consultation was then conducted with the Mental Health Promotion Task Group, a subgroup of the Healthy People and Communities Steering Committee (HPCSC). HPCSC is one of the three federal/provincial/territorial steering committees that report to the Pan-Canadian Public Health Network Council.Footnote 25 This task group is made up of mental health promotion experts from several provincial and territorial governments as well as representatives from the Agency and the First Nations and Inuit Health Branch of Health Canada.
As with the first phase of consultation, the concepts underlying each indicator and the evidence for the associations between the risk and protective factors and the positive mental health outcomes were discussed. The 11 task group representatives were asked to decide if any of the 30 determinant indicators in the revised list were redundant or if any were missing, and then to prioritize indicators. They were asked to use web-based voting technology to select the 5 (out of 12) most relevant and actionable indicators for the individual domain, 3 (out of 7) for the family domain and 4 (out of 8) for the community domain. (The society domain was not part of the selection as it included only 3 identified indicators.) Each chosen indicator received one vote, and the sum of the votes for each indicator was used to rank them from most to least preferred; this ranking was presented back to the task group for validation.
This selection process led to 5 indicators (“Tobacco Use,” “Problem Gambling,” “Teenage Parents,” “Caregiving for a Family Member” and “Participation and Volunteering”) being removed from the list of 30 because they received few votes, resulting in 25 determinant indicators. (“Participation and Volunteering” were subsequently re-included as measures under the community involvement indicator in the community domain). On further review, “Resilience and Coping” was separated into 2 indicators for clarity, and 2 other indicators were re-grouped into one, “Trust and Neighbourhood Social Environment,” as they had significant overlap when we were identifying measures.
This resulted in a total list of 25 determinant indicators across the 4 contextual domains (individual, family, community, society).
See Table 2 for a comparison of the initial and the final list of indicators.
Measures identification and selection
Once the indicators were selected, we reviewed Canadian population-based surveys to identify measures for each of the indicators. Where relevant, we also reviewed other data sources such as geospatial data. We then assessed the identified measures using three selection criteria (accurate, feasible and ongoing).
Before identifying the measures, we assessed the indicators for their applicability to different age groups. Recognizing that some are more salient to particular life course stages, we identified separate measures for children (0–11 years), youth (12–17 years) and adults (≥ 18 years). “Nurturing Childhood Experiences,” “Parenting Style” and “School Environment” were included only in the child and youth frameworks; “Work Environment” was included only in the adult framework. The adult framework has been completed (please contact the authors to receive a copy), while the child and youth measures are currently under development.
Based on the results of the scan of surveys and other data sources, we identified measures and data sources that could potentially be used to report on the selected indicators at the national level in Canada. We included data sources that were no longer active and for which ongoing data would not be available as well as those sources that focussed solely on specific subpopulations only when no other data sources were identified. In addition to reviewing measures available on existing Canadian population surveys, we reviewed other literature to identify alternate measures for a number of indicators, particularly for those for which no ongoing Canadian data sources exist.
We conducted an online consultation to gather expert and stakeholder advice on the best measures to report on the prioritized indicators. The same groups that were consulted earlier were invited to participate, that is, the Mental Health Promotion Task Group and the Mental Health and Mental Illness Surveillance Advisory Committee, as well as Agency employees in surveillance and mental health promotion. The first phase of the two-phase survey-based consultation focussed on positive mental health outcome measures as well as the measures for the determinant indicators in the individual domain. The second phase focussed on the measures for the determinant indicators in the three remaining domains: the family, community and society domains. The surveys presented the measures identified through the environmental scan of surveys and data sources for each of the positive mental health outcome and determinant indicators, by life course stage (child, youth, adult), where applicable. Experts and stakeholders were asked to use accuracy and feasibility as their primary selection criteria for the measures. The ongoing availability of the data was considered ideal but not necessary.
Three types of questions were asked in the consultation surveys:
- where an existing measure was identified as the only available data for an indicator, participants were asked for comments on the use of this measure for the framework and if they were aware of additional validated scales or measures;
- when there were multiple possible measures for the same indicator, experts were asked to choose the measure they believed best reflected the given indicator, or to comment on the suitability and availability of the measures; and
- when measures had not been identified for an indicator, experts were asked to recommend some, and where possible, their corresponding data sources.
Based on the feedback received, we considered the most accurate and feasible measures, and tried, as much as possible, to choose measures from the same data sources. Where no ongoing source was found, we identified measures from one-time surveys or discontinued surveys, for example, the Survey of Young Canadians and the National Longitudinal Survey of Children and Youth, that could be used for an initial round of reporting and as possible content for future surveys. Measures from these sources were flagged as priorities for data development to support future reporting.
If multiple measures were considered to be accurate, feasible and ongoing,
- measures that had national coverage were preferred over those with partial geographic coverage;
- measures from recent surveys were preferred over those from older surveys;
- measures that fully covered the age range for children, youth or adults were preferred over those with a limited age range; and
- measures that had been psychometrically tested and validated for population surveys were preferred over those where this evidence was not apparent.
If multiple measures met these additional considerations, those from the Canadian Community Health Survey were preferred for adults to facilitate modelling and trend analysis. Similarly, measures from the Health Behaviour in School-Aged Children survey or the Canadian Community Health Survey were preferred for youth over those from other data sources.
During each phase of consultation, additional measures or data sources suggested by stakeholders were reviewed for inclusion in the framework to ensure that it represented the best evidence on positive mental health and its determinants. Data gaps were identified where measures were unavailable or of insufficient quality, and the Agency is proactively collaborating with its partners to identify mechanisms to fill key data gaps.
Two summary reports written by the Agency present the consultation findings to our stakeholders. The first focusses only on the adult framework, while the second reports on the child and youth frameworks.
Conclusions and implications
The Positive Mental Health Surveillance Indicator Framework forms the foundation on which indicators and measures to report on positive mental health among Canadians are selected. The indicators paint a comprehensive picture of the positive mental health outcomes and associated key determinants for children, youth and adults in Canada. Overall, 5 positive mental health outcomes and 25 related determinant indicators within the individual, family, community and society domains have been selected, and associated measures identified for adults. Psychometric analyses indicate that the proposed approach to reporting on positive mental health outcomes is empirically supported.Footnote 26 Measures are currently being identified for the child and youth frameworks, and data for youth are expected to be ready for release in 2016.
This work supports the promotion of positive mental health as an important public health activity, and the framework fills an important data gap as identified in Canada’s mental health strategy. The aim of the framework is to provide a snapshot of positive mental health among Canadians; it has the potential to inform mental health promotion and mental illness prevention programs and policies at multiple levels. Differences in levels of positive mental health may help identify those groups that could benefit from intervention, and the patterns of risk and protective factors will help inform the nature of those interventions. Based on the analysis of historical data, we anticipate being able to observe shifts, over time, in the positive mental health profile of Canadians.
A major success of this work was the focus on a collaborative approach through the development of strong stakeholder relationships. The creation of the framework relied on collaboration and consultation with provincial and territorial governments, non-governmental organizations, including the MHCC, and researchers. These relationships ensured that the framework was based on stakeholder needs as well as the best evidence about positive mental health, and that the framework would be able to inform research, programming and policy decisions.
Reporting on the indicators and measures is a priority. The first infographic on positive mental health is available at http://www.phac-aspc.gc.ca/mh-sm/mhp-psm/pmh-smp-eng.php. The Positive Mental Health Surveillance Indicator Framework Quick Stats, 2016 Adult Edition, are also published in this issue, providing the latest data for positive mental health outcomes, and risk and protective factors. An online Infobase will be available in 2016, allowing users to explore data from the framework by key sociodemographic variables such as age, sex, income and immigrant status. We foresee a continued focus on data development to address data gaps and continued improvement of the selected indicators and measures. Additional work is underway to develop a similar surveillance framework for suicide, including its risk and protective factors, many of which are shared with positive mental health. Future work may lead to more outcomes that reflect Canada’s mental health strategy, including mental illness and suicide.
We would like to thank the Mental Health and Mental Illness Surveillance Advisory Committee for their expert advice and feedback on the selection of indicators and measures, Marianna Ofner for leading initial work on the positive mental health conceptual framework development, and the Mental Health Promotion Unit for providing ongoing input in our surveillance work.
- Date modified: