The Ontario Food and Nutrition Strategy: identifying indicators of food access and food literacy for early monitoring of the food environment

Beatrice A. Boucher, MHSc (1,2); Elizabeth Manafò, MHSc, RD (3); Meaghan R. Boddy, MPH, RD (1); Lynn Roblin, MSc, RD (4); Rebecca Truscott, MHSc, RD (1)

https://doi.org/10.24095/hpcdp.37.9.06

Author references:

1. Prevention and Cancer Control, Cancer Care Ontario, Toronto, Ontario, Canada

2. Department of Nutritional Sciences, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada

3. Ryerson University, Toronto, Ontario, Canada

4. Ontario Public Health Association, Toronto, Ontario, Canada

Correspondence: Beatrice Boucher, Cancer Care Ontario, 620 University Avenue, Toronto, ON  M5G 2L7; Tel: 416-978-9800; Fax: 416-971-6888; Email: beatrice.boucher@cancercare.on.ca

Rebecca Truscott, Cancer Care Ontario, 620 University Avenue, Toronto, ON  M5G 2L7;
Tel: 416-978-9800; Fax: 416-971-6888; Email: rebecca.truscott@cancercare.on.ca 

Abstract

Introduction: To address challenges Canadians face within their food environments, a comprehensive, multistakeholder, intergovernmental approach to policy development is essential. Food environment indicators are needed to assess population status and change. The Ontario Food and Nutrition Strategy (OFNS) integrates the food, agriculture and nutrition sectors, and aims to improve the health of Ontarians through actions that promote healthy food systems and environments. This report describes the process of identifying indicators for 11 OFNS action areas in two strategic directions (SDs): Healthy Food Access, and Food Literacy and Skills. 

Methods: The OFNS Indicators Advisory Group used a five-step process to select indicators: (1) potential indicators from national and provincial data sources were identified; (2) indicators were organized by SD, action area and data type; (3) selection criteria were identified, pilot tested and finalized; (4) final criteria were applied to refine the indicator list; (5) indicators were prioritized after reapplication of selection criteria. 

Results: Sixty-nine potential indicators were initially identified; however, many were individual-level rather than system-level measures. After final application of the selection criteria, one individual-level indicator and six system-level indicators were prioritized in five action areas; for six of the action areas, no indicators were available.

Conclusion: Data limitations suggest that available data may not measure important aspects of the food environment, highlighting the need for action and resources to improve system-level indicators and support monitoring of the food environment and health in Ontario and across Canada. 

Keywords: nutrition policy, public health surveillance, healthy diet, food supply, health promotion, environmental health, food environment

Highlights

  • Key food environment features are included in the Ontario Food and Nutrition Strategy (OFNS), which aims to improve the health of Ontarians through policy and programs that promote healthy food systems and environments.
  • The OFNS Indicators Advisory Group used publicly available data to identify seven early indicators of healthy food access and food literacy; however, data availability and quality were limited.
  • Limitations suggest that available data may not measure important aspects of the food environment, highlighting the need for action and resources to improve system-level indicators and support monitoring of the food environment and health in Ontario and across Canada.  

Health of Canadians and the food environment: the need for monitoring and surveillance

The contribution of diet to overall health and the development of cancer and other chronic disease is well documented.Footnote 1-3  Yet, in general, Canadian diets are not consistent with recommended healthy eating patterns or advice.Footnote 4-7  Additionally, a number of economic and social factors such as education, income and food insecurity influence diet and importantly affect Canadian health and health care costs.Footnote 8-10

Although individual factors such as food preferences and skills affect dietary decisions and intake, they do so within the context of food environments—the collective physical, economic, policy and sociocultural surroundings, opportunities and conditions that influence food choices and nutritional status.Footnote 11 Footnote 12  The food environment in Canada has changed substantially over recent decades with the growth of global food systems that include large-scale retail stores, fast food outlets and highly processed food products that may be negatively associated with health.Footnote 13-15  These changes relate to the four key food environment features of (1) geographic food access; (2) availability; (3) affordability; and (4) food quality, which affect food choices and eating patternsFootnote 16 Footnote 17  and interact with the socioeconomic disparitiesFootnote 18  that challenge the health of Canadians.

To address the challenges Canadians generally face within their food environments, a coordinated intergovernmental and multistakeholder approach to food policy development is essential and must consider the broader environmental influences that affect health and well-being.Footnote 11 Footnote 12 Footnote 19  Such an approach necessarily relies on evidence-informed decision making and the ability to track and compare outcomes of research, programs and policies related to the food environment. Recent international and Canadian reports have identified an important role for comprehensive and regular monitoring of the food environment, as well as diet, health and inequality measures to assess population status and tailor policy and program development.Footnote 11 Footnote 12 Footnote 16  Although previous food environment assessments have been undertaken across Canada,Footnote 16  there appears to be a lack of strategies that integrate food, agriculture and nutrition at the provincial and federal levels and that comprehensively include multiple factors related to the food environment and health. This report describes an Ontario initiative that integrates multiple sectors and factors, reviews available indicators and supports efforts across Canada to develop provincial and national strategies and surveillance systems to improve the food environment and Canadian health. A comprehensive description of the initiative is detailed elsewhere.Footnote 20 Footnote 21

The Ontario Food and Nutrition Strategy

The Ontario Food and Nutrition Strategy (OFNS) is an expert- and evidence-informed strategy for improving the health and well-being of Ontarians through food policies and programs that also contribute to reducing the financial burden of chronic disease.Footnote 21  The OFNS was collaboratively developed by individuals from 26 key organizations representing agriculture, food, health, education and Indigenous interests. Between 2009 and 2016, contributions from a broad group of stakeholders were also incorporated via numerous consultations. Fifty-nine organizations from academia; municipal, provincial and federal government; and public health and civil society provided feedback through in-person meetings and online consultations (237 online submissions were received). Based on this broad development process, the OFNS outlined a comprehensive, multistakeholder, coordinated approach to food policy development that works across the food, agriculture and nutrition sectors. The intended impact is to make healthy food the preferred and easiest choice for Ontarians by promoting diverse, healthy and resilient food systems and environments that improve diet and health, and contribute to an equitable and prosperous economy.

To achieve this, the OFNS identified three key strategic directions (SDs):Footnote 21 ,p.6

  • Healthy Food Access (SD1): “access to and the means to choose and obtain safe, healthy, local and culturally acceptable food”;
  • Food Literacy and Skills (SD2): “information, knowledge, skills, relationships, capacity and environments to support healthy eating and make healthy choices where [Ontarians] live, gather, work, learn and play”; and
  • Healthy Food Systems (SD3): “diverse, healthy and resilient food systems that promote health and contribute to an equitable and prosperous economy.”

The three strategic directions encompass 25 targeted action areas in total, which are described in a separate report.Footnote 21

While aspects of the food environment are included in all three OFNS strategic directions, this report describes work undertaken to identify early indicators to monitor and inform progress in the 11 action areas of Healthy Food Access (SD1) and Food Literacy and Skills (SD2). Key food environment features—food access, availability, affordability, quality—are clearly identifiable in SD1, and are also embedded in SD2 through restrictions on advertising, increased access to information on healthy eating and other environmental factors that influence food literacy and affect dietary outcomes and health.Footnote 22-25  Salient aspects of the food environment should be measured using valid and reliable provincial indicators; given the relative newness of this field, it is expected that food environment definitions and indicators may evolve in future reports to encompass the complexity of factors that influence food choice.Footnote 16 Footnote 17

Process for identifying early indicators of the food environment

An OFNS Indicators Advisory Group (“the Advisory Group”) was formed with representation from municipal boards of health, provincial and national government agencies and academic and nongovernmental organizations to scan and identify existing data sources and determine the best available indicators of healthy food access and food literacy as the initial measures for Ontario. The project also aimed to identify data gaps and articulate considerations for future data collection to promote the robust monitoring and evaluation of issues that influence food access and literacy. Based on criteria from the National Health Service (UK), the Advisory Group defined indicators as succinct measures that describe and help users understand, compare and improve the current food system and environment.Footnote 26 ,p.5

The Advisory Group used a five-step process to identify, review, select and prioritize indicators for Healthy Food Access, and Food Literacy and Skills (Figure 1), that included the use of quality criteria during indicator selection (Figure 2). Step 1 consisted of an environmental scan of national and provincial reports, other documents and data sources that provide system-level as well as behaviour- and knowledge-based data or indicators relevant to one or both OFNS strategic directions and their action areas. Although the intent was mainly to identify system-level indicators, data collection began with a broad set of available data in case system-level indicators were unavailable. Step 2 involved extracting and organizing possible indicators for each SD into detailed spreadsheets by action area and data type. Step 3 entailed identifying indicator selection criteriaFootnote 26-28  by pilot testing their application to a sample of potential indicators (done by a subgroup of the Advisory Group). Final criteria were based on fundamental issues of data possibility and feasibility, face validity and importance and relevance within a public health context.Footnote 29 Footnote 30  Step 4 included using final selection criteria to create a short list of indicators for each strategic direction. Step 5 involved prioritizing indicators on the short list using a consensus-building technique after each Advisory Group subgroup member independently reapplied the selection criteria and ranked the importance of indicators within each action area. This process resulted in the final list of indicators for each strategic direction.

Figure 1 - Indicator selection process and outcomes for two strategic directions in the Ontario Food and Nutrition Strategy, 2016

Figure 1 - Text Equivalent

Figure 1 depicts the five-step process used by the Advisory Group to identify, review, select and priori¬tize indicators for Healthy Food Access, and Food Literacy and Skills. Step 1 consisted of an environmental scan of national and provincial reports, other doc-uments and data sources that provide sys¬tem-level as well as behaviour- and knowledge-based data or indicators rele¬vant to one or both OFNS strategic direc¬tions and their action areas. Although the intent was mainly to identify system-level indicators, data collection began with a broad set of available data in case system-level indicators were unavailable. Step 2 involved extracting and organizing possi¬ble indicators for each SD into detailed spreadsheets by action area and data type. Step 3 entailed identifying indicator selec¬tion criteria by pilot testing their appli¬cation to a sample of potential indicators (done by a subgroup of the Advisory Group). Final criteria were based on fun¬damental issues of data possibility and feasibility, face validity and importance and relevance within a public health context. Step 4 included using final selection criteria to create a short list of indicators for each strategic direction. Step 5 involved prioritizing indicators on the short list using a consensus-building technique after each Advisory Group sub¬group member independently reapplied the selection criteria and ranked the importance of indicators within each action area. This process resulted in the final list of indicators for each strategic direction.

Overall, 69 indicators were proposed from the environmental scan and organized into 11 action areas. The initial assess¬ment excluded 34 items that were pre¬dominantly measures of individual nutrition behaviour or knowledge, result¬ing in a long-list of 35 indicators. After first application of the selection criteria, 28 indicators remained. From these, six system-level indicators were prioritized as well as one individual-level “global” indi¬cator of food skills (ability to cook from basic ingredients). Three prioritized indicators for Healthy Food Access included system-level measures of house¬hold food insecurity, cost of the Nutritious Food Basket31 and municipal and provin¬cial healthy eating policies, in three of six action areas. Four prioritized indicators for Food Literacy and Skills included three system-level measures of student food skills education, dietitian access and dietitian supply, and one indi¬vidual-level measure of general cooking skills in two of five action areas.

Figure 2 - Quality criteria and indicator selection pathway for two strategic directions in the Ontario Food and Nutrition Strategy, 2016

Figure 2 - Text Equivalent

This figure presents the quality criteria used during Healthy Food Access, and Food Literacy and Skills indicator selection.

To address possibility and feasibility: Are credible data already available or can be collected at a relatively low cost?

To address validity: Does this indicator really measure the issue (i.e., action areas)?

Will the indicator be able to detect and display a change (i.e., sensitivity)?

To address importance and relevance: Does this indicator measure a sufficiently important question/service as it relates to action area?

Overall, 69 indicators were proposed from the environmental scan and organized into 11 action areas. The initial assessment excluded 34 items that were predominantly measures of individual nutrition behaviour or knowledge, resulting in a long-list of 35 indicators. After first application of the selection criteria, 28 indicators remained. From these, six system-level indicators were prioritized as well as one individual-level “global” indicator of food skills (ability to cook from basic ingredients; SD2). Three prioritized indicators for Healthy Food Access included system-level measures of household food insecurity, cost of the Nutritious Food BasketFootnote 31  and municipal and provincial healthy eating policies, in three of six action areas (Table 1). Four prioritized indicators for Food Literacy and Skills included three system-level measures of student food skills education, dietitian access and dietitian supply, and one individual-level measure of general cooking skills in two of five action areas (Table 2). For six of the 11 action areas, there were no indicators available. Overall, although certain early indicators of food access, literacy and the food environment were identified, the general scarcity of system-level data and the many data gaps suggest that the adequacy and scope of existing publicly available data to comprehensively measure and monitor important aspects of the food environment are limited. 

Table 1. Action areas and indicators for the Healthy Food Access strategic direction (SD1) of the Ontario Food and Nutrition Strategy
Action area   Indicator Data source
1.1 Increased individual & household food security 1 Percentage of Ontario households that were food insecure, by level of food insecurity [marginally, moderately, severely] CCHS
1.2 Increased access to safe, healthy, local & culturally acceptable food   No indicator available  
1.3 Increased use of healthy, local food by public sector organizations   No indicator availableTable 1 - Footnote a  
1.4 Increased distribution & promotion of equitably-priced healthy, local food 2 Regional cost of Nutritious Food BasketTable 1 - Footnote b MoHLTC
1.5 Reduced access to high calorie, low-nutrient food, beverages & snacks 3 Number of existing provincial and/or municipal prevention policies as they relate to risk factor of unhealthy eating CPAC
1.6 Enhanced food access through land use management & planning   No indicator available  
 

Source: Adapted from Ontario Food and Nutrition Strategy Indicator Advisory Group. Determining food access and food literacy indicators for the Ontario Food & Nutrition Strategy; 2016. p. 13. Available from: https://sustainontario.com/custom/uploads/2012/04/OFNS-Final-Report-v3.1-April-8-2016.pdf

 

Abbreviations: CCHS, Canadian Community Health Survey; CPAC, Canadian Partnership Against Cancer; MoHLTC, Ontario Ministry of Health and Long-Term Care.

Table 1 - Footnote a

"Number of food service operators in Ontario that implement a local food procurement policy” was identified as potential indicator; data collection has been proposed but data availability was uncertain.

Return to Table 1 - Footnote a referrer

Table 1 - Footnote b

The Nutritious Food Basket is a survey tool used to measure the affordability of nutritious food in Ontario.31

Return to Table 1 - Footnote b referrer

Table 2. Action areas and indicators for the Food Literacy and Skills strategic direction (SD2) of the Ontario Food and Nutrition Strategy
Action area   Indicator Data source
2.1 Increased healthy eating knowledge, skills & capacity 1 Percentage of secondary school students in Ontario who earned at least one credit in a course that included a food skills component OME
2 Personal ability to cook from basic ingredientsTable 2 - Footnote a CCHS
2.2 Increased access to public information about healthy eating through retailers & food services   No indicator available  
2.3 Restricted advertisement of unhealthy food, beverages & snacks to children   No indicator available  
2.4 Increased availability of professional nutrition services 3 Number of persons accessing an Eat Right Ontario dietitian (phone or by email) ERO
4 Number of dietitians practising in family health teams and community health centres CDO
2.5 Enhanced services for at-risk populations   No indicator available  
 

Source: Adapted from Ontario Food and Nutrition Strategy Indicator Advisory Group. Determining food access and food literacy indicators for the Ontario Food & Nutrition Strategy; 2016. p. 14. Available from: https://sustainontario.com/custom/uploads/2012/04/OFNS-Final-Report-v3.1-April-8-2016.pdf

 

Abbreviations: CCHS, Canadian Community Health Survey; CDO, College of Dietitians of Ontario; ERO, Eat Right Ontario; OME, Ontario Ministry of Education.

Table 2 - Footnote a

This is the only individual-level indicator included in report; Canada-wide data will be used as a proxy for this indicator since Ontario-specific data are not available

Return to Table 2 - Footnote a referrer

Limitations and future considerations for identifying indicators in Ontario and beyond

A major challenge in identifying OFNS indicators was the need to rely on existing data sources, which revealed several limitations in data availability and quality. This led to the identification of early indicators that were often constrained (e.g. based on face validity rather than more robust validity criteria), as well as the overall dearth of system-level data for many action areas. Although national surveys were viewed as potential sources of proxy provincial data, they do not appear to include food environment variables other than food insecurity, suggesting an absence of system-level data at the national level as well.

Furthermore, although numerous indicators had been proposed after the initial document scan, most were not retained, including several that were considered downstream measures of specific dietary knowledge or behaviours (e.g. self-reported skills in peeling, chopping and slicing vegetables or fruits) rather than desired upstream indicators of the food system and environment. Overall, these limitations highlight the need for system-level provincial indicators that are diverse, robust and based on measures that have been rigorously tested for validity and reliability.Footnote 17  Additionally, although members of the Advisory Group were aware that recent provincial initiatives had proposed to collect food environment data, as noted in the action area for increased use of healthy, local food in public sector organizations (Table 1), current data availability was uncertain. This suggests that improved communication and coordination will be needed among partners to collect and share relevant data and create a comprehensive monitoring plan.

Working within these data limitations, however, the Advisory Group prioritized indicators that they considered the “best available,” although these may not sufficiently assess critical aspects of the food environment, or adequately monitor its impact, trends or change. While this paper describes the process and challenges of selecting indicators for Ontario, it is useful to consider that other Canadian jurisdictions face similar issues related to the availability of regular, consistent and valid food environment data, as suggested in a recent report by Health Canada.Footnote 16 

Next steps for the Ontario Food and Nutrition Strategy

The Ontario Food and Nutrition StrategyFootnote 21  was launched in January 2017 and will be implemented through a shared delivery model whereby stakeholder groups and partners lead and support work in self-identified areas of interest and expertise. The seven indicators prioritized in this report will form the initial monitoring framework for two of the OFNS strategic directions. Dependent on funding, data for these indicators will be analyzed to provide a modest baseline assessment of food access, food literacy and the food environment in Ontario, and reanalyzed longitudinally to determine the extent of change over time. This initial monitoring will help identify where efforts and resources are needed to support improvements in surveillance and outcomes, including through the development of provincial and national policies. Opportunities for additional funding will be explored to support the identification of indicators for the third and final strategic direction, Healthy Food Systems, and advancement of strategies to encourage the systematic, ongoing collection of provincial and national data for all OFNS actions.

To our knowledge, few, if any, other provinces have developed comprehensive food, agriculture and nutrition strategies that address the complexity of contributions to the food environment and health. This shortcoming also appears to extend to the federal level, where separate (rather than integrated) healthy eating and agri-food policies are being developed.Footnote 32 Footnote 33  Nonetheless, the data limitations identified in this report may assist multiple stakeholders to advocate for robust surveillance systems that consider all or select aspects of OFNS action areas,Footnote 21  particularly since many are shared with other provincial, national and international initiatives such as the Report Card on Healthy Food Environments and Nutrition for Children in CanadaFootnote 34  and the International Network for Food and Obesity/non-communicable diseases Research, Monitoring and Action Support (INFORMAS).Footnote 11 Footnote 12  This overlap in effort will serve to enhance opportunities and synergies to create, test and implement valid and comprehensive measures of food access, food literacy and the food environment that will be able to monitor and inform provincial, national and international programs and ultimately improve the diet and health of Canadians.

Acknowledgements

The authors thank Ahalya Mahendra (Public Health Agency of Canada), Brian Cook (Toronto Public Health), Colleen Smith (Ag-Scape), Jocelyn Sacco (Public Health Ontario), June Matthews and Paula Dworatzek (Brescia University College at Western University), Leslie Whittington-Carter (Dietitians of Canada), Lisa Mardlin VandeWalle (Registered Dietitian, Private Practice), Lyndsay Davidson (Chatham Kent Public Health Unit), Rhona Hanning (University of Waterloo), and Ryan Turnbull (Eco-Ethonomics) for their contributions to the OFNS Indicators Advisory Group and their dedication to identifying and prioritizing indicators for this project.

This work was made possible by financial support from the Public Health Agency of Canada and in-kind support from Cancer Care Ontario and Ontario Public Health Association. Figures and tables were adapted with permission from the Ontario Food and Nutrition Strategy Group and the OFNS Indicators Advisory Group. Comprehensive descriptions of the strategy and the indicators work are provided elsewhere.Footnote 20 Footnote 21

Conflicts of interest

The authors declare no conflicts of interest.

Authors’ contributions

RT, LR, EM, and BAB contributed to the design of the study; BAB, EM, RT, MRB, and LR performed data analysis and interpretation; BAB and EM drafted the manuscript; and BAB, EM, RT, MRB and LR revised for critical content. All authors have approved the final manuscript.

Page details

Date modified: