The 2014 Survey on Living with Chronic Diseases in Canada on Mood and Anxiety Disorders: a methodological overview - HPCDP: Volume 36-12, December 2016
Volume 36 · Number 12 · December 2016
The 2014 Survey on Living with Chronic Diseases in Canada on Mood and Anxiety Disorders: a methodological overview
S. O’Donnell, MSc Footnote 1; R. Cheung, PhD Footnote 1; K. Bennett, PhD Footnote 2; C. Lagacé, MSc Footnote 1
This article has been peer reviewed.
Correspondence: Siobhan O’Donnell, Surveillance and Epidemiology Division, Centre for Chronic Disease Prevention, Health Promotion and Chronic Disease Prevention Branch, Public Health Agency of Canada, 785 Carling Avenue, Ottawa, ON K1A 0K9; Tel: 613-301-7325; Fax: 613-941-2057; Email: email@example.com
Introduction: There is a paucity of information about the impact of mood and anxiety disorders on Canadians and the approaches used to manage them. To address this gap, the 2014 Survey on Living with Chronic Diseases in Canada–Mood and Anxiety Disorders Component (SLCDC-MA) was developed. The purpose of this paper is to describe the methodology of the 2014 SLCDC-MA and examine the sociodemographic characteristics of the final sample.
Methods: The 2014 SLCDC-MA is a cross-sectional follow-up survey that includes Canadians from the 10 provinces aged 18 years and older with mood and/or anxiety disorders diagnosed by a health professional that are expected to last, or have already lasted, six months or more. The survey was developed by the Public Health Agency of Canada (PHAC) through an iterative, consultative process with Statistics Canada and external experts. Statistics Canada performed content testing, designed the sampling frame and strategies and collected and processed the data. PHAC used descriptive analyses to describe the respondents’ sociodemographic characteristics, produced nationally representative estimates using survey weights provided by Statistics Canada, and generated variance estimates using bootstrap methodology.
Results: The final 2014 SLCDC-MA sample consists of a total of 3361 respondents (68.9% response rate). Among Canadian adults with mood and/or anxiety disorders, close to two-thirds (64%) were female, over half (56%) were married/in a common-law relationship and 60% obtained a post-secondary education. Most were young or middle-aged (85%), Canadian born (88%), of non-Aboriginal status (95%), and resided in an urban setting (82%). Household income was fairly evenly distributed between the adequacy quintiles; however, individuals were more likely to report a household income adequacy within the lowest (23%) versus highest (17%) quintile. Forty-five percent reported having a mood disorder only, 24% an anxiety disorder only and 31% both kinds of disorder.
Conclusion: The 2014 SLCDC-MA is the only national household survey to collect information on the experiences of Canadians living with a professionally diagnosed mood and/or anxiety disorder. The information collected offers insights into areas where additional support or interventions may be needed and provides baseline information for future public health research in the area of mental illness.
Keywords: Mood disorders, anxiety disorders, mental health impacts, disease management, survey methodology, health surveys, population surveillance, Survey on Living with Chronic Diseases in Canada
- The 2014 Survey on Living with Chronic Diseases in Canada–Mood and Anxiety Disorders Component (SLCDC-MA) is the only population-based household survey to date that has collected information on the experiences of Canadians living with professionally diagnosed mood and/or anxiety disorders.
- A total of 3361 respondents (68.9% response rate) completed the survey, which covered a broad range of topics including diagnosis, impacts on usual and work-related activities, stress, sleep, social relationships, health professional contacts and recommendations, medication use, counselling and self-management practices.
- The information collected provides insights into areas where additional support or interventions may be needed. Survey findings also provide baseline information for future public health research in the area of mental illness.
Mood and anxiety disorders are the most common mental health problems affecting Canadians.Footnote 1 In 2013, an estimated 3 million people (11.6%) aged 18 years or older reported having one or both types of disorder.Footnote 2 Mood disorders are characterized by the lowering or elevation of a person’s mood and include depressive and bipolar disorders. Anxiety disorders are characterized by excessive and persistent feelings of worry and fear and include generalized anxiety disorder, specific phobias, social anxiety disorder, agoraphobia, obsessive-compulsive disorder, panic disorder and posttraumatic stress disorder.Footnote 3 Mood and anxiety disorders often co-occurFootnote 4,Footnote 5,Footnote 6,Footnote 7,Footnote 8,Footnote 9 and their co-occurrence with other mental disorders (such as substance abuse disorder and impulse control disorder) is also common.Footnote 9,Footnote 10,Footnote 11
The impairments associated with mood and anxiety disorders can be profound, interfering with activities of daily living and the ability to maintain employment, and disrupting relationships with friends and family.Footnote 3 Fortunately, professional care combined with active engagement in self-management strategies can reduce the impact of these disorders and improve the well-being of those affected.Footnote 12 However, many challenges remain regarding access to and receipt of effective treatments.Footnote 13 A large proportion of people with these disorders fails to seek care and remains undiagnosed. Among those who do seek care, it has been documented worldwide that a substantial proportion receives suboptimal treatment or no treatment at all.Footnote 14,Footnote 15,Footnote 16,Footnote 17 Lack of knowledge, attitudes and/or beliefs and fear of the stigma of mental illness and its treatment are among the more commonly cited barriers to seeking care, while practical barriers such as time constraints, costs and access to mental health services are less frequently reported.Footnote 18,Footnote 19
At present, there is a lack of up-to-date information on the experiences of Canadians living with mood and/or anxiety disorders, and more specifically, the impact these disorders have on Canadians’ usual and work-related activities and the approaches used to manage them. To address these gaps, the Public Health Agency of Canada (PHAC), in conjunction with Statistics Canada, conducted the 2014 Survey on Living with Chronic Diseases in Canada–Mood and Anxiety Disorders Component (SLCDC-MA).Footnote 20
PHAC initiated the development of the SLCDC in 2006, as there was a lack of information directly attributable to particular chronic diseases or conditions. Specific data gaps identified included symptom control, health education, self-management, clinical care, prevention interventions and factors related to adherence and health behaviours. Between 2009 and 2011, the SLCDC collected data on hypertension, arthritis, chronic respiratory conditions and diabetes and, in 2014, it focussed on mood and anxiety disorders. These diseases and conditions were selected on the basis of their prevalence, their importance to public health and the priority surveillance work being done by PHAC.
As an introduction to a collection of original articles reporting on different aspects of Canadians’ experiences living with a mood and/or an anxiety disorder using the 2014 SLCDC-MA, this article describes the survey objectives and methodology and examines the characteristics of the final sample.
The 2014 SLCDC-MA, a cross-sectional follow-up survey to the 2013 Canadian Community Health Survey (CCHS)–Annual Component, includes Canadians 18 years and older with self-reported, professionally diagnosed mood and/or anxiety disorders.Footnote 21 The CCHS, a cross-sectional annual survey, collects information related to various aspects of health in the Canadian household population including several self-reported, professionally diagnosed chronic conditions.Footnote 22 Therefore, the CCHS can be used to determine the prevalence of these chronic conditions in the Canadian population. As well, it serves as the sampling frame for the SLCDC and a source of additional sociodemographic and health information since responses from the SLCDC are linked to the CCHS.
The main purpose of the 2014 SLCDC-MA was to provide detailed information on a wide variety of topics related to the experiences of Canadians living with professionally diagnosed mood and/or anxiety disorders, which is not feasible in a general population-based health survey such as the CCHS. For instance, the 2014 SLCDC-MA collected information on the impacts of respondents’ mental health (e.g. disorder-attributable limitations in usual and work-related activities) and the management approaches used (e.g. medications, psychological counselling and self-management strategies). Given that the 2014 SLCDC-MA only includes people who reported having been diagnosed with a mood and/or an anxiety disorder, the estimates derived reflect the characteristics of that population, not the prevalence of the conditions.
The objectives of the 2014 SLCDC-MA were to (1) assess the impact of mood and/or anxiety disorders on Canadian adults’ usual and work-related activities; (2) describe how people with mood and/or anxiety disorders manage their disorder; (3) identify the barriers to care and self-management strategies; and (4) identify factors that influence mental illness outcomes.
Survey content development
The content of the 2014 SLCDC-MA was developed through an iterative, consultative process between PHAC and Statistics Canada, with input from members of PHAC’s Mental Health and Mental Illness Surveillance Advisory Committee (Advisory Committee).Footnote * Content selection was informed by the survey objectives, data gaps identified by PHAC and the Mental Health Commission of Canada (MHCC)Footnote 12 as well as recommendations from the Advisory Committee.
Survey questions relevant to the domains of interest were derived from a variety of sources including publicly available population-based surveys, published instruments and/or well-known scales. Certain questions were modified based on consultations with experts and some were informed by existing national clinical practice guidelines. Questions were grouped into modules based on theme or subject matter. A description of each module, the source of the questions or instruments included, and other relevant information is summarized in Table 1.
|Module||Content focus||No. of questionsTable 1 - Footnote a||Brief description||Source|
Abbreviations: CCHS, Canadian Community Health Survey; n/a, not applicable; SLCDC-MA, Survey on Living with Chronic Diseases in Canada–Mood and Anxiety Component.
|1. Survey introduction||Administrative||n/a||Provides the respondent with the necessary background and purpose of the survey.||n/a|
|2. General health||General||4||Asks respondents about their general health, life satisfaction, mental health and life stress.||Questions from the General health module of the 2013 CCHS–Annual ComponentFootnote 23 were repeated since they serve as a good warm-up, are sensitive to change and important in the assessment of the health status of those with mood and anxiety disorders.|
|3. Confirmation of diagnosis||Mood or anxiety disorder–specific||7 (11)Table 1 - Footnote b||Confirms that the respondent belongs to the target population, and asks about the type of mood and/or anxiety disorder, the age at diagnosis and the age at first symptoms.||Modified screening questions from the Chronic conditions module of the 2013 CCHS–Annual ComponentFootnote 23 to inquire if the respondent has, or ever has been diagnosed with a mood and/or an anxiety disorder. All other questions were adopted from a previous disease/condition-specific cycle of the SLCDCFootnote 24 to capture the topics of interest in relation to mood and anxiety disorders.|
|4. Medication use||Mood or anxiety disorder–specific||11||Focusses on the respondent’s use of prescription medications, to help manage their mood and/or anxiety disorder, reasons for no longer taking/having never taken, adherence patterns, and the use of natural health products.||Modified questions from previous disease/condition-specific cycles of the SLCDCFootnote 24,Footnote 25,Footnote 26,Footnote 27 to capture the topics of interest in relation to mood and anxiety disorders.|
|5. Self-management||Mood or anxiety disorder–specific||9 (22)Table 1 - Footnote c||Asks respondents about things they may have done as a result of being diagnosed to help manage their mood and/or anxiety disorder, the status of their engagement at the time of survey, and reasons for not doing so. Questions are similar to those in the Clinical recommendations module in an effort to determine whether respondents are following the recommended best practices.||Modified questions from previous disease/condition-specific cycles of the SLCDCFootnote 24,Footnote 25,Footnote 26,Footnote 27 which were informed by clinical guidelines/best practices related to self-management of mood and anxiety disorders.Footnote 28,Footnote 29|
|6. Contact with health professionals||Mood or anxiety disorder–specific||5||Asks respondents about interactions with health professionals regarding their mood and/or anxiety disorder in the past 12 months. Some questions specifically ask about psychological counselling.||Modified questions from the 2013 CCHS–Annual ComponentFootnote 23 to capture the topics of interest in relation to mood and anxiety disorders.|
|7. Clinical recommendations||Mood or anxiety disorder–specific||7||Documents specific recommendations suggested by a doctor or other health professional that may help respondents manage their mood and/or anxiety disorder.||Modified questions from previous disease/condition-specific cycles of the SLCDCFootnote 24,Footnote 25,Footnote 26,Footnote 27 and informed by clinical practice guidelines/best practices related to the management of mood and anxiety disorders.Footnote 28,Footnote 29|
|8. Restriction of activities||Mood or anxiety disorder–specific||8||Asks respondents about being limited in usual activities in the past 12 months because of their mood and/or anxiety disorder.||Modified questions from the Health status (SF-36) module in the 2013 CCHS–Annual ComponentFootnote 23 to capture the topics of interest in relation to mood and anxiety disorders.|
|9. Restriction of work-related activities||Mood or anxiety disorder–specific||7||Asks respondents about current and past employment status, and changes made to work-related activities due to their mood and/or anxiety disorder.||Modified questions from US National Health Interview Survey (NHIS).Footnote 30|
|10. Sleep||Mood or anxiety disorder–specific||3||Asks respondents about the number of sleep hours, whether they have difficulty going to sleep or staying asleep and reasons why they may have trouble going to sleep or staying asleep.||Questions from the Sleep module in the 2013 CCHS– Annual ComponentFootnote 23 were repeated since they are sensitive to change. In addition, a question asking why respondents may have trouble sleeping was added.|
|11. Stress||Mood or anxiety disorder–specific||3||Asks respondents about the various stressors encountered in daily life, their ability to deal with them, and the main source of stress.||Questions from the Stress - Sources module in the 2013 CCHS–Annual ComponentFootnote 23 were repeated since they are sensitive to change. The question on sources of stress was modified to ensure that the response options were read to the respondent.|
|12. Social provisions scale||Mood or anxiety disorder–specific||10||Focusses on the degree to which respondents’ social relationships provide various dimensions of social support.||Social Provisions Scale (24 items) developed by Cutrona and Russell (1987),Footnote 31 and validated in French by Caron (1996, 2013).Footnote 32,Footnote 33|
|13. Administration||Administrative||4||This module informs respondents about the linking of their information from the 2014 SLCDC-MA to their responses from the 2013 CCHS–Annual Component. Respondents are then asked if this information can be shared with Statistics Canada’s share partners.||2013 CCHS–Annual Component.Footnote 23|
Questions were reviewed to ensure age- and population-appropriateness, suitability for telephone administration, and relevance to the 2014 SLCDC-MA objectives. Using the 2013 CCHS questionnaire as a guide, questions were organized by theme, and reformatted focussing on sequencing and skip patterns, standardization of scales and points of view and consistent use of language. Response bias and respondent fatigue were considered when removing leading questions and potential redundancy.
Respondent burden and the time constraints of a telephone interview dictated, for the most part, the length of the survey. Content included in the questionnaire for qualitative testing was determined based on ease of analysis and interpretation, and on the potential for translating the resulting information into actionable public health messages.
Questions related to specific themes were removed before qualitative testing if they: (1) were already covered on the 2013 CCHS, and therefore can be obtained through record linkage (e.g. educational attainment and nutrition); (2) were too broad to be adequately addressed within the allocated survey time (e.g. health utility index, stages of behavioural change); (3) required detailed explanations; or (4) were judged to be better measured via a longitudinal survey (e.g. recovery).
Questions were added to obtain respondents’ permission to share data and link their 2014 SLCDC-MA responses to those of the 2013 CCHS. The English questionnaire was translated into French to allow for implementation in the two official languages of Canada. The French translation of the questionnaire was validated in a side-by-side review. The final questionnaires were then built into a computer-assisted telephone interview (CATI) application, which ensured consistent survey administration by interviewers.
Statistics Canada’s Questionnaire Design and Review Centre (QDRC) tested both the English and the French 2014 SLCDC-MA questionnaires in face-to-face interviews with selected respondents.
Qualitative testing interviews were conducted in March 2013 in Toronto (English) and in Montreal (French). The 2012 CCHS–Annual Component was used as the frame to select respondents for the interviews. A total of 26 participants took part in the testing, representing a cross section of persons who reported having a mood and/or an anxiety disorder that had been diagnosed by a health professional in the 2012 CCHS interview. Informed by theoretical frameworks and methods based in cognitive and social psychology,Footnote 34,Footnote 35 each interview explored the four steps of the cognitive process used to respond to a questionnaire: (1) understanding the question and response categories; (2) recalling and/or searching for the requested information; (3) thinking about the answer and making a judgment about what to report; and (4) reporting the answer. All interviews were conducted by a trained interviewer from the QDRC and observed from behind a one-way mirror by members of the 2014 SLCDC-MA project team (i.e. personnel from Statistics Canada and PHAC).
The QRDC produced reports on the results of the English and French qualitative testing interviews, which were then used to further refine and finalize the survey content. Overall, the survey was well received by participants. They reported that the modules within the questionnaire flowed well and the questions within the modules covered the main aspects of living with a mood and/or an anxiety disorder. However, modules that measured the concepts of resiliency and masterywere somewhat difficult for participants to answer, due to the inclusion of questions that alternated between positive and negative concepts, and to the sensitive nature of the topics covered. In light of this difficulty, the 2014 SLCDC-MA project team decided to remove these modules from the questionnaire. Furthermore, the team made modifications to some of the retained modules in an effort to improve clarity on what was to be reported and to ensure proper identification of in-scope respondents.
The final, 20-minute questionnaire comprises 12 modules, addressing each of the objectives of the 2014 SLCDC cycle. The full questionnaire is available on Statistics Canada’s website at http://www23.statcan.gc.ca/imdb/p2SV.pl?Function=getSurvey&SDDS=5160
The target population of the 2014 SLCDC-MA was Canadians aged 18 years and older as of 31 December, 2013, living in private dwellings in the 10 provinces, who responded affirmatively to at least one of the following two 2013 CCHS questions: “Remember, we’re interested in conditions diagnosed by a health professional and that are expected to last or have already lasted six months or more. Do you have a mood disorder such as depression, bipolar disorder, mania or dysthymia?” or “Do you have an anxiety disorder such as a phobia, obsessive-compulsive disorder or a panic disorder?” The study results therefore relate to Canadians who sought care for a mood or an anxiety disorder or both and received a diagnosis. Since the sample does not include Canadians who did not seek care, or who attempted to obtain care but were unsuccessful despite the presence of mood and/or anxiety disorder symptoms that meet diagnostic criteria, the applicability of the results to these individuals is uncertain.
Residents of the three territories, people living on Indian reserves or Crown lands, people living in institutions, full-time members of the Canadian Forces and residents of certain remote regions were excluded. With the exception of the three territories, the exclusions are those of the 2013 CCHS sampling frame. Overall, these exclusions represent approximately 3% of the Canadian population.
In addition, respondents with a mood and/or an anxiety disorder living in one of the 10 provinces who met any of the following criteria were excluded from the sample:
- they did not have a valid telephone number;
- they completed the CCHS interview by proxy; and/or
- they did not give permission to share their responses with Statistics Canada share partners and to link their 2014 SLCDC-MA responses to those of the 2013 CCHS.
The survey sample was developed using a two-phase design: the first phase was the 2013 CCHS sample and the second was the 2014 SLCDC-MA sample. The 2013 CCHS sample was selected from two frames: an area frame designed for the Labour Force Survey and a list frame of telephone numbers, with each frame making up half of the sample. The 2014 SLCDC-MA sampling frame consisted of 2013 CCHS respondents who met the criteria outlined in the target population section.
The 2014 SLCDC-MA sample was designed to produce reliable estimates at the national level by age group and sex. The targeted age groups were 18 to 34 years, 35 to 49 years, 50 to 64 years and 65 years and older (Table 2). As well, the sample allows for estimates at the regional level (Atlantic, Quebec, Ontario, Prairies, and British Columbia). The sample size was limited by the number of people who reported having been diagnosed with a mood and/or an anxiety disorder in the 2013 CCHS.
|Sex||Age group (years)||Selected sample size||Modelled number of in-scope cases||Modelled in-scope rate||Number of respondents||Response rate|
Abbreviation: SLCDC-MA, Survey on Living with Chronic Diseases in Canada–Mood and Anxiety Disorders Component.
Data collection and processing
Statistics Canada collected data for the 2014 SLCDC-MA in two waves, each consisting of a five-week period: the first took place in November/December 2013, and the second in February/March 2014. Selected respondents were interviewed from centralized call centres using the CATI application.
Statistics Canada used several practices to minimize non-response. Introductory letters were sent to the targeted respondents explaining the purpose of the survey before the start of the collection period. Interviewers were instructed to make all reasonable attempts to obtain interviews; when a respondent was no longer available at the phone number provided on the 2013 CCHS, attempts were made to find their current number. For people who at first refused to participate, additional efforts were made, including a letter followed by a second call, in order to convince the respondent of the importance of their participation. Finally, to remove the possibility of language as a barrier, Statistics Canada was prepared to recruit interviewers with a wide range of language competencies if necessary. This was not required, however, as all interviews were conducted in either English (80%) or French (20%).Footnote 36
Between April and September 2014, Statistics Canada processed, estimated, and documented the data. Editing, coding and the creation of derived and grouped variables were performed either at the interview stage (for editing and coding) or at the data processing stage (derived and grouped variables creation). A survey weight was given to each person on the final data file; the weight can be interpreted as the number of people in the population that are represented by the respondent. The 2014 SLCDC-MA weighting process began with the 2013 CCHS person-level share weight, because the 2014 SLCDC-MA survey frame was composed of respondents from this survey. A five-step weighting strategy was then used to adjust the sample weight for exclusions, sample selection, in-scope rates, non-response and permission to share and link.
Given the complex sampling design of the 2014 SLCDC-MA, the variance cannot be calculated using simple formulas and requires a resampling method. The bootstrap is an inference technique based on successive resampling. The survey bootstrap exploits the existing sample to build synthetic samples called “replicates.” These replicates are used to estimate the variance of a parameter. Statistics Canada developed coordinated bootstrap weights for the 2014 SLCDC-MA because of its dependence on the 2013 CCHS sample. Hence, the starting point for the 2014 SLCDC-MA bootstrap weights was the 500 replicates from the 2013 CCHS share bootstrap file. Each bootstrap replicate was adjusted using the five adjustments steps listed previously. More information about the weighting process can be found in the 2013 CCHS User Guide.Footnote 22
For respondents who agreed to share and link their responses, the 2014 SLCDC-MA data were linked to the 2013 CCHS.
Data confidentiality and availability
To preserve respondent confidentiality, all personal identifiers were removed from the share-linked file. Data were ready for use in October 2014 and were made available to PHAC, Health Canada and provincial health ministries. Researchers and third parties can access the 2014 SLCDC-MA data through university-based Research Data Centres run by Statistics Canada.
Statistics Canada determined that ethics approval to administer the 2014 SLCDC-MA was not required as no physical measures were collected. No privacy or confidentiality risks, as governed by the Privacy Impact Assessment policy, were identified, and the Chief Statistician allowed the survey to proceed.
Respondents’ participation in the 2014 SLCDC-MA was completely voluntary and proxy interviews were not permitted. Statistics Canada is prohibited by law from releasing any information it collects that could identify any person, business or organization, unless consent has been given by the respondent as per the Statistics Act.Footnote † Statistics Canada’s share partners for the CCHS (i.e. PHAC, Heath Canada and provincial and territorial health departments) have access to the data under the terms of their respective data-sharing agreements. These data files contain information only on respondents who agreed to share their data with Statistics Canada’s share partners and to link their responses from the 2014 SLCDC-MA to their responses from the 2013 CCHS. Personal identifiers were removed from the share files to respect respondent confidentiality. Users of these files must first certify that they will not at any time disclose information that might identify a survey respondent.
Out-of-scope cases correspond to respondents approached to complete the survey but who should not be included because they do not meet the eligibility criteria for the survey.
The respondents of the 2014 SLCDC-MA were classified into two groups: resolved and unresolved cases. The unresolved case group consists of those respondents that could not be contacted during data collection, resulting in uncertainty about whether they belonged to the out-of-scope or in-scope category. The resolved case group consists of respondents that were selected in the sample and with whom Statistics Canada established contact and thus could determine whether they were out-of-scope or in-scope for the survey. Out-of-scope respondents included, for example, those who identified themselves as having a mood and/or an anxiety disorder in the 2013 CCHS but said they never had either disorder during the 2014 SLCDC-MA interview.
In order to minimize the number of out-of-scope cases in the 2014 SLCDC-MA, two questions were included for follow-up with those respondents who reported that they do not currently have a mood or an anxiety disorder diagnosed by a health professional. These questions were aimed at identifying respondents who had ever been diagnosed with either type of disorder, but were no longer experiencing symptoms or who were able to manage their condition through medication or changes to their lifestyle. As a result, these respondents were included in the survey, which resulted in an overall reduction in the number of out-of-scope cases.
However, due to the number of out-of-scope cases, the total number of people who reported a mood and/or an anxiety disorder differs between the 2013 CCHS and the 2014 SLCDC-MA. The 2013 CCHS likely includes some respondents who reported having a mood and/or an anxiety disorder but do not (false positives). Conversely, the 2014 SLCDC-MA likely excluded some respondents who really do have the condition but who indicated otherwise to avoid completing the survey (false negatives). The extensive verifications performed through the Confirmation of Diagnosis module may have potentially contributed to increasing the validity of the 2014 SLCDC-MA diagnosis data, although this has not been empirically studied.
Generally, survey errors can be divided into sampling errors and non-sampling errors. Sampling errors occur because inferences about the entire population are based on information obtained from only a sample of that population, while non-sampling errors occur as a result of various systematic and random errors not attributed to sampling.Footnote 22
All 2013 CCHS respondents who reported a mood and/or an anxiety disorder were selected for the 2014 SLCDC-MA, after excluding respondents for operational reasons. However, because the 2013 CCHS is a sample survey, the 2014 SLCDC-MA is not a census of people with mood and/or anxiety disorders. It is an accepted fact that somewhat different estimates would be obtained if a census had been performed using the same questionnaire, interviewers, processing methods, etc.
Non-sampling errors may occur at almost every step of a survey operation and can arise from problems in coverage, non-response, response and processing errors.Footnote 21 Non-sampling errors cannot be quantified or mitigated by increasing the sample size.
Coverage errors occur when cases are omitted (under-coverage), duplicated or wrongfully included (over-coverage). The 2014 SLCDC-MA has the same coverage as the 2013 CCHS in the 10 provinces. Given the high coverage rate of the CCHS, it is unlikely that any significant bias was introduced into the 2014 SLCDC-MA data.
Non-response errors are the result of insufficient answers to the survey questions and can vary from partial non-response (i.e. failure to answer just one or several questions) to complete non-response. In the 2014 SLCDC-MA, people who partially responded to one or more questions were removed from the survey; however, as respondents tend to complete the questionnaire once they start the interview, partial non-response is rare. Complete non-response occurs because the interviewer is either unable to contact the respondent, or the respondent refuses to participate in the survey. In an effort to reduce the risk of being unable to follow up with selected respondents during the time period between the administration of the 2013 CCHS and the 2014 SLCDC-MA, the data collection was divided into two waves. Those who participated in the first six months of the 2013 CCHS data collection period were contacted as part of the first wave (November/December, 2013), while those in the latter six months of the 2013 CCHS data collection period comprised the second wave (February/March, 2014). The use of two waves ensured that the lag time between the 2013 CCHS and 2014 SLCDC-MA was no greater than 14 months. Complete non-response was addressed by adjusting the weight of individuals who responded to the survey to compensate for those who did not respond and to minimize any bias arising from non-response.
Response error may arise as a result of interviewers misunderstanding instructions, respondents making errors in answering questions or answers being incorrectly entered on the questionnaire. Statistics Canada implemented quality assurance measures in order to minimize these types of errors. These measures included the use of highly skilled interviewers, extensive training of interviewers with respect to the survey procedures and questionnaire, observation of interviews to ensure proper techniques and procedures were followed as well as to detect problems of questionnaire design or misunderstanding of instructions, and the use of procedures to ensure that data-capture errors were minimized. Finally, processing and tabulation errors were minimized by performing coding and quality checks to verify the processing logic.
We used descriptive analyses to characterize the survey respondents’ sociodemographic characteristics. The analyses were carried out using SAS Enterprise Guide version 5.1 (SAS Institute, Cary, NC, USA). To account for sample allocation and survey design, all estimates were weighted using survey weights generated by Statistics Canada in order to reflect the age and sex distribution of the household population aged 18 or older in the 10 provinces. Furthermore, variance estimates (95% confidence intervals and coefficients of variation) were generated using the bootstrap weights provided with the data.Footnote 37
The sociodemographic characteristics included in this analysis are:
- sex (female; male);
- age (18–34; 35–49; 50–64; 65+ years);
- marital status (single; married or living common-law; widowed, separated, divorced);
- educational attainment (less than secondary school graduation; secondary school graduation, no post-secondary; some post-secondary education; post-secondary graduation);
- household income adequacy quintiles;
- immigrant status (yes; no);
- length of time in Canada since immigration (≤ 20 years; > 20 years);
- Aboriginal status (yes; no);
- place of residence (urban; rural);
- geographical region (Atlantic; Quebec; Ontario; Prairies; British Columbia); and
- self-reported type of disorder diagnosed by a health professional (mood disorder only; anxiety disorder only; both mood and anxiety disorder).
Income was measured using the adjusted household income adequacy quintiles. Respondents were divided into quintiles based on the ratio of their total household income to the low income cut-off corresponding to their household and community size, as derived by Statistics Canada. This measure provides, for each respondent, a relative measure of their household income to the household incomes of all other respondents.Footnote 22 For respondents with missing income information, Statistics Canada uses nearest-neighbour donor imputation, which models income based on family structure, sociodemographics, some health variables, and income derived from aggregate tax information. Income was imputed for 23% of the 2014 SLCDC-MA respondents who did not provide a best estimate to the total household income question (14.7% who fully reported income range; 4.1% who partially reported income range; and 4.7% who provided no income information).
Final 2014 SLCDC-MA sample
The sample design of the 2014 SLCDC-MA is shown in Figure 1, and the initial sample size, modelled in-scope cases and response rate by sex and age group are summarized in Table 2. A total of 7563 respondents who reported being diagnosed with a mood and/or an anxiety disorder by a health professional were captured in the sampling frame (2013 CCHS). Upon applying the predetermined exclusion criteria for the 2014 SLCDC-MA, 1688 respondents were excluded.
Abbreviations: CCHS, Canadian Community Health Survey; N, total population size; n, subsample size; SLCDC-MA, Survey on Living with Chronic Diseases in Canada–Mood and Anxiety Disorders Component.
Text Equivalent - Figure 1
Figure 1: 2014 SLCDC-MA sample design
This figure depicts the sample design of the 2014 SLCDC-MA.
A total of 7563 respondents who reported being diagnosed with a mood and/or an anxiety disorder by a health professional were captured in the sampling frame (2013 CCHS). Upon applying the predetermined exclusion criteria for the 2014 SLCDC-MA (being less than 18 years of age, being a resident of one of the three territories, not having a valid phone number, completing CCHS interview by proxy, not giving permission to share or link CCHS data), 1688 respondents were excluded.
Of the 5875 respondents selected for the 2014 SLCDC-MA, 707 were found to be out-of-scope due to being resolved cases, and an additional 287 were estimated to be out-of-scope based on predictions of logistic modelling (being incorrectly classified as having the condition in the CCHS, deliberately providing answers in order to be screened out of the survey, emigrated, deceased).
After excluding the out-of-scope respondents (resolved and unresolved), there were 4881 respondents within the modelled in-scope sample. Lastly, an additional 1520 respondents were excluded due to non-response (not having a valid phone number, not agreeing to participate, not completing the whole survey, not giving permission to share or link CCHS data), leaving a final sample of 3361 available for analysis (1021 males and 2340 females).
Of the 5875 respondents selected for the 2014 SLCDC-MA, 707 were found to be out-of-scope (resolved cases) which resulted in an out-of-scope rate of 17.0%. An additional 287 were estimated to be out-of-scope based on predictions of logistic modelling (unresolved cases).
After excluding the out-of-scope respondents (resolved and unresolved), there were 4881 respondents within the modelled in-scope sample (i.e. respondents eligible for the 2014 SLCDC-MA interview), resulting in a modelled in-scope rate of 83.1%.
Lastly, an additional 1520 respondents were excluded due to non-response (complete and partial), leaving a final sample of 3361 available for analysis. The overall response rate for the 2014 SLCDC-MA was therefore 68.9%. The response rate was at its lowest among men (57.3%) and women (60.6%) from 18 to 34 years of age.
Sociodemographic characteristics of Canadians aged 18 years and older with mood and/or anxiety disorders
The sociodemographic characteristics of the population with mood and/or anxiety disorders are presented in Tables 3 and 4 and Figure 2. Almost two-thirds (64%) were female. While the highest proportion was aged 50 to 64 years, the proportion of young (18–34 years) and middle aged (35–64 years) were fairly evenly distributed. Seniors (65+ years) represented only 15% of the population. More than half (56%) were married or in a common-law relationship, approximately a quarter were single and the remaining 18% reported being separated, divorced or widowed. Close to two-thirds (60%) reported having obtained a university degree, post-secondary certificate or diploma. Household income was fairly evenly distributed between the adequacy quintiles; however, individuals were more likely to report a household income within the lowest (23%) versus highest (17%) adequacy quintile. The majority (88%) were Canadian-born, and two-thirds (67%) of the immigrants had been living in Canada for more than 20 years. Most (95%) were of non-Aboriginal status and the majority (82%) resided in an urban setting. The geographical distribution of the population was as follows: 40% resided in Ontario, 20% in Quebec, 17% in the Prairies, 14% in British Columbia and 9% in the Atlantic Provinces. Finally, 45% reported being diagnosed by a health professional with a mood disorder only, 24% with an anxiety disorder only, and 31% reported having been diagnosed with both.
|Sociodemographic characteristics||2014 SLCDC-MA
(n = 3361)
|nTable 3 - Footnote a||%Table 3 - Footnote b (95% CI)|
Abbreviations: CI, confidence interval; Q, quintile; SLCDC-MA, Survey on Living with Chronic Diseases in Canada–Mood and Anxiety Disorders Component.
|Single/never married||823||26.3 (23.8–28.7)|
|Less than secondary school graduation||528||12.7 (10.9–14.4)|
|Secondary school graduation||728||21.5 (19.1–23.9)|
|Some post-secondary education||176||5.6 (4.3–6.8)|
|Post-secondary certificate, diploma or university degree||1895||60.3 (57.3–63.2)|
|Household income adequacy quintiles|
|Q1 (lowest quintile)||903||23.0 (20.6–25.3)|
|Q5 (highest quintile)||497||17.3 (15.0–19.7)|
|Time in Canada since immigration|
|Less than or equal to 20 years||61||33.5 (22.7–44.3)|
|More than 20 years||222||66.5 (55.7–77.3)|
|Place of residence|
|British Columbia||408||13.7 (12.0–15.4)|
|Type of disorder|
|Mood disorder only||1531||45.2 (42.2–48.2)|
|Anxiety disorder only||770||24.0 (21.5–26.6)|
|Mood and anxiety disorder||1060||30.7 (28.0–33.4)|
|Type of disorder||Overall
nTable 4 - Footnote a
%Table 4 - Footnote b (95% CI)
nTable 4 - Footnote a
%Table 4 - Footnote b (95% CI)
|Age groups (years)
nTable 4 - Footnote a
%Table 4 - Footnote b (95% CI)
Abbreviations: CI, confidence interval; SLCDC-MA, Survey on Living with Chronic Diseases in Canada–Mood and Anxiety Disorders Component
|Mood disorder only||1531
|Anxiety disorder only||770
|Mood and anxiety disorder||1060
Distribution of Canadians aged 18 years and older with mood and/or anxiety disorders by (a) marital status, (b) educational attainment, (c) household income adequacy quintiles, (d) geographical region, (e) type of disorder by sex and (f) type of disorder by age groups, 2014 SLCDC-MA
Abbreviation: SLCDC-MA, Survey on Living with Chronic Diseases in Canada–Mood and Anxiety Disorders Component.
Notes: Percentages are based on weighted numbers to reflect the Canadian population aged 18 years and older with mood and/or anxiety disorders living in the 10 provinces; error bars represent 95% confidence intervals.
Text Equivalent - Figure 2
Figure 2: Distribution of Canadians aged 18 years and older with mood and/or anxiety disorders by (a) marital status, (b) educational attainment, (c) household income adequacy quintiles, (d) geographical region, (e) type of disorder by sex and (f) type of disorder by age groups, 2014 SLCDC-MA
The sociodemographic characteristics of the population with mood and/or anxiety disorders are presented in Tables 3 and 4 as well as this figure. Almost two-thirds (64%) were female. While the highest proportion was aged 50 to 64 years, the proportion of young (18–34 years) and middle aged (35–64 years) were fairly evenly distributed. Seniors (65+ years) represented only 15% of the population. More than half (56%) were married or in a common-law relationship, approximately a quarter were single and the remaining 18% reported being separated, divorced or widowed. Close to two-thirds (60%) reported having obtained a university degree, post-secondary certificate or diploma. Household income was fairly evenly distributed between the adequacy quintiles; however, individuals were more likely to report a household income within the lowest (23%) versus highest (17%) adequacy quintile. The majority (88%) were Canadian-born, and two-thirds (67%) of the immigrants had been living in Canada for more than 20 years. Most (95%) were of non-Aboriginal status and the majority (82%) resided in an urban setting. The geographical distribution of the population was as follows: 40% resided in Ontario, 20% in Quebec, 17% in the Prairies, 14% in British Columbia and 9% in the Atlantic Provinces. Finally, 45% reported being diagnosed by a health professional with a mood disorder only, 24% with an anxiety disorder only, and 31% reported having been diagnosed with both.
The 2014 SLCDC-MA is the only population-based household survey to date that provides data on the experiences of Canadian adults with a professionally diagnosed mood and/or anxiety disorder. Topics covered by the survey include usual and work-related activities, stress, sleep, social relationships, clinical management strategies such as health professional contacts and recommendations, medication use, counselling and self-management practices. This survey addresses important data gaps identified by PHAC, the MHCCFootnote 12 and other external stakeholder organizations.
Our findings with respect to the distribution of the sociodemographic characteristics among Canadian adults with mood and/or anxiety disorders generally agree with those from other studies. With respect to sex, mood and anxiety disorders have consistently been shown to be more common among females than males.Footnote 38,Footnote 39 Many factors may explain this, including behavioural (women have been shown to have more positive help-seeking attitudes than men),Footnote 40 biological (hormonal fluctuations related to various aspects of reproductive function are thought to predispose women to depression),Footnote 41 and sociocultural (women report experiencing stress related to work and family responsibilities more frequently than men).Footnote 42
Studies carried out on populations with mood or anxiety disorders using a similar age range (18 years and older) have also shown that the age distribution of these disorders peaks in middle-age and declines in older age.Footnote 38,Footnote 39,Footnote 43 The higher proportion of respondents in the middle-aged group may relate, in part, to the unique challenges that these individuals often face, such as stress associated with an imbalance between work and personal or family life.Footnote 44,Footnote 45
Marital status is a key determinant of health and it is widely acknowledged that married individuals report better health outcomes and a lower risk for mortality than those who are not married, particularly men.Footnote 46 Just over half of those in our study were married or in a common-law relationship, which is slightly higher than those found in other Canadians studies.Footnote 38,Footnote 39 It is worth noting that these other studies further demonstrate that those with mood and anxiety disorders were less likely to be married or in a common-law relationship than those unaffected by these disorders.
Education is another important determinant of health and can have a significant influence on income level as well as economic well-being.Footnote 47 The proportion of those with post-secondary education in our study was similar to the findings from other Canadian studies.Footnote 38,Footnote 39,Footnote 48 All aforementioned studies found people with mood and anxiety disorders completed post-secondary education in the same proportion as those without these disorders.Footnote 38,Footnote 39 However, when broken down by type of post-secondary education attained, people with these disorders were less likely to have a post-secondary education at the Bachelor level or above than those who were not affected.Footnote 48 With respect to income, while those in our study were more likely to report household income adequacy in the lowest quintile than in the highest, their household income adequacy was generally more evenly distributed between the quintiles compared to other studies.Footnote 38,Footnote 39,Footnote 48 Consequently, results based on data from the 2014 SLCDC-MA regarding health status, disorder-attributable impacts on usual and work-related activities and the management strategies adopted may reflect the best-case scenario, given the wealth of evidence that those of lower socioeconomic status are less healthy and less likely to adopt positive health behaviours.Footnote 49
A slightly higher proportion of those in our study were of immigrant status than those found in other Canadian studies.Footnote 38,Footnote 39 These studies further demonstrated that those affected by mood and anxiety disorders were less likely to be immigrants than those unaffected,Footnote 38,Footnote 39 which may, in part, be explained by the “healthy immigrant effect,” whereby foreign-born status presents a health advantage.Footnote 50 Knowing that this health advantage lessens with the length of time lived in Canada,Footnote 50 it is important to note that a large proportion (66.5%) of those who reported being an immigrant in our study had lived in Canada for more than 20 years.
The proportion of those living in a rural area and the proportion who reported to be of Aboriginal descent in our study were comparable to other Canadian studies.Footnote 38,Footnote 39 Neither these studies nor ours demonstrated a difference between those with and those without mood and anxiety disorders in terms of the proportion living in a rural area or having Aboriginal status.Footnote 38,Footnote 39 Given that Aboriginal peoples are known to be at greater risk for mental illness,Footnote 51,Footnote 52 and that those living in the territories and persons living on reserves or Crown lands were not included in these studies nor ours, these findings could be a reflection of the underrepresentation of Aboriginal peoples in the population sampled.
Finally, a third of those in our study reported having been diagnosed with both mood and anxiety disorders. Epidemiological studies from Europe and the United States have shown consistently high comorbidity rates for current and lifetime depressive and anxiety disorders, ranging from 44% to 81%.Footnote 6,Footnote 7,Footnote 8,Footnote 9 Differences in the sampling frame and/or diagnostic criteria used may account for differences in study results. Furthermore, it has been shown that individuals with co-occurring mental health issues tend to demonstrate significantly greater impacts on health and use of mental health services.Footnote 38,Footnote 53,Footnote 54 Since differences between those with comorbid disorders and those with one disorder only may emerge in terms of respondents’ health status, disorder-attributable impacts on usual and work-related activities and management or self-management practices, consideration should be given to stratifying the survey data by disorder type.
Strengths and limitations
The 2014 SLCDC-MA provides detailed information on a wide variety of topics related to the experiences of Canadians living with mood and/or anxiety disorders, which is not feasible in a general population-based health survey. Furthermore, responses are linked to those from the source survey (the 2013 CCHS), creating an even richer dataset because the CCHS collects additional health-related information on topics such as comorbidities, lifestyle behaviours and health determinants. Associations between different factors can be explored; however, causal inferences cannot be drawn from the results due to the survey’s cross-sectional design.Footnote 55
While the 2014 SLCDC-MA was developed to be nationally representative, the generalizability of the data to the entire Canadian population may be restricted due to the exclusion of the territories and some populations known to be at risk for mental illness, such as Aboriginal peoplesFootnote 51,Footnote 52 living on reserves or Crown lands, the homeless,Footnote 56 institutionalized patients,Footnote 57 and prison residents.Footnote 58 The study sample is also limited to Canadians who sought care and received a mood and/or an anxiety disorder diagnosis. Hence, the generalizability of the results to those who do not seek care but meet diagnostic criteria for a mood and/or an anxiety disorder is uncertain.
As with most population-based health surveys, the 2014 SLCDC-MA relies on self-reporting of mental disorders and health-related practices or events with no third-party corroboration or verification of these self-reports. While it is the most practical method of assessing disease status and its impact in large population studies, self-reporting of health events is susceptible to misclassification due to social desirability bias, recall bias and conscious non-reporting, resulting in potential under- or overestimation of disease burden, both individual and societal. Research has found acceptable to good agreement between self-reported physical health conditions and diagnoses made by medical professionals,Footnote 59 but validation of the questions used in the CCHS to ascertain self-reported mood and anxiety disorders has not yet, to our knowledge, been examined.
During the data collection period of the 2013 CCHS, the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-V)Footnote 60 was released. However, given that data collection was well underway during the transition from the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition-Text Revision (DSM-IV-TR)Footnote 61 to the DSM-V, the mood and anxiety disorders as defined within the DSM-IV-TR are reflected in the case finding questions in the 2013 CCHS.
Analytical limitations due to available sample size should be anticipated when disaggregating data by age, sex (especially males), geography or other characteristics of interest. For example, it was not possible to provide a statistical description of the population by ethnic group, as the estimates for the different categories had high coefficients of variation (CV), indicating high sampling variability and estimates of unacceptable quality. Consideration was given to collapsing Black, Arab and Asian ethnic groups into a “non-White” category; however, this resulted in a very diverse group, a persistently high sampling variability (CV = 22%) and a potentially limited or non-meaningful interpretation of the results.
Finally, the 2014 SLCDC-MA response rate (68.9%) was lower relative to previous SLCDC cycles (75% to 83.2%).Footnote 62,Footnote 63 There is a well-documented general decline in response rates for surveys both in Canada and around the world, and the 2014 SLCDC-MA’s response rate follows the same pattern as other general and health-related surveys.Footnote 64 Since non-responders did not agree to share their information with Statistics Canada’s share partners, which includes PHAC, their sociodemographic characteristics and the reasons for not participating in the survey are unknown.
Mood and anxiety disorders are the most common mental disorders in Canada and have a major impact on the daily lives of those affected by them.Footnote 1 At present, the 2014 SLCDC-MA, a cross-sectional follow-up survey to the 2013 CCHS, is the only Canadian population-based household survey reporting information on the impact of these disorders on usual and work-related activities, and the strategies used to manage them. The survey data can offer insights to public health practitioners and clinicians about areas where additional support or intervention may be needed, and can provide baseline information for future public health research in the field of mental illness.
The 2014 SLCDC-MA was funded by PHAC and developed in conjunction with Statistics Canada. This survey was developed through the contribution of time and expertise from members of PHAC’s Mental Health and Mental Illness Advisory Committee. The 2013 CCHS was conducted by Statistics Canada in partnership with Health Canada and PHAC, with funding from the Canadian federal government. No external financial or material support was obtained for this study.
Conflict of interest
The authors declare no conflict of interest.
Report a problem or mistake on this page
- Date modified: