Annex A: Evaluation framework for the FMC initiative

Evaluation questions	Indicators	Data sources
1. Is there a continued need for the recruitment and integration of French-speaking immigrants into FMCs?	Consistency of the Initiative with Part 7 of the Official Languages Act Alignment with legislative obligations Key stakeholders identify continuing need	Document review (briefing notes, Action Plan for Official Languages, Roadmap for Canada’s Linguistic Duality 2008–2013, Speech from the Throne, budgets, etc., as well as the various government guidance documents) Key informant interviews (managers at CIC national and regional headquarters, Steering Committee members, regional committee members, other key stakeholders)
2. Is the Initiative aligned with CIC and Government of Canada priorities?	Consistency of the Initiative with CIC and government priorities	Document review (briefing notes, Action Plan for Official Languages, Roadmap for Canada’s Linguistic Duality 2008–2013, Speech from the Throne, budgets, etc., as well as the various government guidance documents) Key informant interviews (managers at CIC national and regional headquarters, Steering Committee members, regional committee members, other key stakeholders)
3. Is this Initiative consistent with federal roles and responsibilities?	Profile/existence of alternative programs with similar outcomes delivered by other levels of government Perceptions of CIC and other stakeholders on roles and responsibilities	Document review Key informant interviews (managers at CIC national and regional headquarters, steering committee members, regional committee members, other key stakeholders)
4. Have the main partners undertaken coordination, collaboration and research activities to support the implementation of the Initiative?	Evidence of partners undertaking coordination, collaboration and research activities Measurement of how the activities undertaken by the regional committees are aligned with the priorities of the Steering Committee. Evidence that the provinces/territories participated in supporting the implementation of the Initiative	Document review Minutes of the Steering Committee and the Implementation Committee (internal administrative data) Internal administrative data Meeting minutes Progress reports Key informant interviews (managers at CIC national and regional headquarters, Steering Committee members, regional committee members, other key stakeholders) Case studies
5. Are French-speaking foreign nationals aware of opportunities to immigrate to FMCs?	Number of participants at information sessions Views of potential French-speaking immigrants on the opportunities available in FMCs prior to their arrival in Canada Views of CIC representatives in several missions on awareness and promotional activities (number of sessions, participation rate, perception of level of interest) Perception and analysis of trends concerning the number of applications received following a promotional activity	Document review (report on the Destination Canada information sessions and reports on activities to recruit foreign students [DFAIT]) Key informant interviews (managers at CIC national and regional headquarters, Steering Committee members, regional committee members, other key stakeholders) Case studies (including focus groups with French-speaking clients)
6. Do Francophone immigrants obtain strengthened settlement services in French in FMCs?	Number of contribution agreements signed Type of settlement services in FMCs Number of service points offering services in French to newcomers Evidence of efforts by the networks to implement and maintain reception and settlement services for French-speaking immigrants in FMCs	Document review (contribution agreements) Data analysis (iCAMS data, administrative data, etc.) Key informant interviews (managers at CIC national and regional headquarters, Steering Committee members, regional committee members, other key stakeholders) Case studies (including focus groups with Francophone clients)
7. Have the initiatives helped to achieve the objectives set in terms of the number of French-speaking immigrants going to FMCs?	Number and percentage of Francophone immigrants settling in FMCs Views of service providers and other stakeholders on the increase in the number of French-speaking immigrants	Data analysis Case studies Key informant interviews (managers at CIC national and regional headquarters, Steering Committee members, regional committee members, other key stakeholders)
8. Have FMCs improved their settlement and reception services capacity in order to facilitate the recruitment, reception, integration and retention of French-speaking immigrants in FMCs?	Type of settlement services in FMCs Number of service providers that offer services in French Number of Francophone service providers Number and type of activities of network committees Number and type of promotional activities undertaken by partners Views of key stakeholders on improvements Balance between the capacity of service delivery organizations and the needs of French-speaking immigrants in FMCs	Document review (network committees’ notes, reports) Data analysis (not clear if information is available from existing sources) Case studies
9. Is the Initiative guided by a clear mandate and specific roles, responsibilities and objectives?	Clear mandate with specific objectives, roles and responsibilities: Nature of the Initiative mandate, objectives, roles and responsibilities Perceptions of CIC and PCH Degree of common understanding of the Initiative mandate, roles, responsibilities and objectives: within CIC between CIC and PCH between CIC and other stakeholders (service providers, community organizations) between this Initiative and the Strategic Plan between the Steering Committee and regional committees	Document review Key informant interviews (managers at CIC national and regional headquarters, Steering Committee members, regional committee members, other key stakeholders) Case studies
10. Are communications, relationships and information-sharing among program stakeholders effective?	Extent / quality / appropriateness of communications / relationships / information sharing: within CIC between CIC and PCH between CIC and other stakeholders (service providers, community organizations) between the Steering Committee and regional committees between the communities and the provinces/territories	Document review (national strategic framework; national, provincial/territorial and local action plans; national, provincial/territorial and local implementation plans) Key informant interviews (managers at CIC national and regional headquarters, Steering Committee members, regional committee members, other key stakeholders) Case studies
11. Is the management of the Initiative coordinated and supported by the tools, resources (human and financial) and mechanisms needed to ensure effective delivery?	Extent/appropriateness of management tools, resources (human and financial), and mechanisms Extent/quality of management coordination (direction/processes/instructions/reporting/timelines) Within CIC Within PCH Views of CIC and PCH	Document review Key informant interviews (managers at CIC national , international [Paris Mission] and regional headquarters, Steering Committee members, regional committee members, other key stakeholders) Case studies
12. Are performance measurement, monitoring and reporting for this Initiative sufficient to ensure Initiative accountability?	Extent/appropriateness of performance measurement, monitoring and reporting practices (including financial tracking) Quality of performance measurement, monitoring and reporting tools (e.g. framework, data collection tools) and data Measures undertaken following management’s response to the findings of the 2006 evaluation	Document review Key informant interviews (managers at CIC national and regional headquarters, Steering Committee members, regional committee members, other key stakeholders)

Features

Consultations

Find public consultations of issues that affect Canadians

Publications

Find out about publications regularly produced by IRCC