Appointment processes: how to conduct interviews
This page is currently under review.
Assessment Oversight and the Personnel Psychology Centre
Public Service Commission of Canada
Cat. No. SC3-141/2009E-PDF
ISBN 978-1-100-12968-6
© Her Majesty the Queen in Right of Canada, represented by the Public Service Commission of Canada, 2009
Table of Contents
- Overview
- Section 1: The Structured Interview
- Section 2: Before the Interview
- Assembling the Interview Board
- Serving as a Member of the Interview Board
- Clarifying the Scope and Objectives of the Interview
- Positioning the Interview in the Appointment Process
- Designing the Interview Note-Taking Booklet
- Identifying the Qualifications to be Assessed
- Developing Interview Questions
- Questions to avoid
- Developing an Assessment Booklet
- Inviting Applicants to the Interview
- Training the Interview Board
- Administrative Arrangements
- Summary Tips for Practitioners
- Section 3: During the Interview
- Section 4: After the Interview
- Section 5: Evaluating the Interview Process
- Section 6: Additional Sources of Information
- References
- Appendix A: Sample Interview Note-Taking Booklet
- Appendix B: Sample Interview Assessment Booklet
- Appendix C: Structured Interviewing - Summary Check List
- Appendix D: Applicant Reaction Questionnaire
- Appendix E: Abbreviated Interview Board guide
- Appendix F: Train-the-Trainer Presentation
About This Guide
The purpose of this Structured Interviewing Guide is to provide an overview of a methodology for the development and administration of structured interviews. It provides fundamental information as well as advice to help hiring managers and Human Resources (HR) specialists get the most out of structured interviews. This Guide will help hiring organizations in the federal public service to realize the full potential of structured interviews and support merit-based appointments. The Guide is intended for anyone who develops, conducts or evaluates structured interviews. This audience may include managers, human resources (HR) practitioners, internal and external consultants, applicants and others who are interested in learning more about the structured interview process.
The content of the Guide was gathered following a review of the academic and professional literature, best practices research from the private and public sectors and consultations with various stakeholders with expertise in designing and conducting structured interviews.
The Guide consists of six sections that describe the features of a structured interview and outline the process before, during and after the interview. Each section consists of several subheadings and hyperlinks for quick reference and includes practical tips for HR practitioners. The appendices feature useful tools such as sample interview booklets, a "Train-the-Trainer" presentation, a summary checklist and a feedback questionnaire to assess applicant reactions to the interview.
Important message to the reader
The methodology presented in this Guide can be adapted according to the needs of the organization and to suit the context in which the structured interviews will be used. If you have any questions about the Assessment Policy, please consult the PSC's Website.
Employment interviews are one of the most widely used and influential assessment tools in the appointment process. Of all the factors that impact interview effectiveness, their structure has emerged as the most critical. It is well-established that structured interviews are better than unstructured ones at predicting on-the-job performance. In addition, the information obtained from a structured interview tends to be more accurate and reliable, less subject to bias and more legally defensible. Using a more structured approach improves the likelihood that hiring decisions will be based on merit.
Realizing the full potential of a structured interview requires paying careful attention to each stage of the interview process, from preparation through to development, implementation, and evaluation. Following the suggested practices in this Guide will facilitate this task and ensure that hiring managers and Human Resources (HR) practitioners fully benefit from the time and effort they invest in this valuable assessment tool.
The Guide is divided into the following six sections:
- The structured interview: This section includes general information on the structured interview and its advantages, the risks associated with an unstructured interview, relevant legal issues, and an overview of the structured interview process.
- Before the interview: This section provides practical tips on how to design interview booklets, including how to identify the qualifications to be assessed and how to develop interview questions. It also addresses important activities such as inviting applicants, arranging for assessment accommodation, if required, and preparing the interview board.
- During the interview: This section provides step-by-step guidance on how to conduct an interview, such as initiating and closing the interview, asking effective interview questions, and note-taking techniques.
- After the interview: This section offers guidance on how to accurately assess applicant responses and avoid common assessment errors, how to integrate interview results with other information to support the selection and informal discussion processes and how to provide feedback to applicants.
- Evaluating the interview process: This section discusses the importance of evaluating the effectiveness of the interview. Included are tips on how to modify the interview process to ensure that it continues to meet organizational requirements, especially if it is used on an ongoing basis.
- Additional sources of information: This section lists additional resources such as current research and best practices regarding structured interviewing.
Interviews may be placed on a continuum, from unstructured to structured. At one end of the continuum, an unstructured interview is completely unplanned – questions are asked spontaneously, vary across candidates, and responses are not evaluated in any consistent manner. At the other end, the highly structured interview includes questions that are based on a thorough analysis of job requirements and the merit criteria required to perform the work. All candidates are asked the same questions and their responses are assessed in a standardized manner against job-relevant criteria using a predetermined rating scheme. These features help to establish a clear link between performance at the interview and performance on the job and minimize the impact of personal bias on the assessment process.
UNSTRUCTURED | STRUCTURED |
---|---|
Development | |
|
|
Administration | |
|
|
Evaluation | |
|
|
Interviewer Training | |
|
|
Structured interviews provide a number of advantages over unstructured ones, including:
- Enhanced objectivity and equal opportunity. By asking the same questions and assessing responses according to the same job-relevant criteria, candidates have an equal opportunity to demonstrate their qualifications and to be assessed fairly. In addition, the use of an interview board rather than one individual assessor increases objectivity since consensus on a final evaluation must be reached.
- Accuracy and prediction. Since questions are linked to job-related competencies, a candidate's responses are more likely to predict their on-the-job performance. Research has shown that structured interviews are up to twice as effective at predicting job performance as unstructured ones1-2.
- Greater legal defensibility. When structured interviews are developed and administered according to professional guidelines, they are more likely to be legally defensible. To date, the following three components have been found to be most closely scrutinized by the courts when using an interview:
- The consistency of applying the interview across applicants;
- The job-relatedness of the interview questions; and
- The extent to which the interview process was designed to be objective.
Research has consistently shown that unstructured interviews can lead to poor hiring decisions because they are more vulnerable to:
- Bias and inequity: People are often unaware of their own biases and how these biases unconsciously influence their decisions. Research has shown that attributes such as physical attractiveness3, similarity of the applicant to the interviewer4, gender5 and race6 can inappropriately influence an interview board's assessment. Personal beliefs and values may also influence the unstructured interview process so that different questions may be asked of different people, or the same answer provided by different applicants may be interpreted differently.
- Inaccuracy and low prediction: Research has consistently shown that unstructured interviews are relatively ineffective at predicting job performance7-8. This finding is largely attributed to the use of questions that are not necessarily based on qualifications required to perform the work. Since the assessment criteria are unclear, interview board members may inaccurately and inadvertently judge applicants on irrelevant factors. Also, unstructured interviews make it easier for applicants to give answers they think the interview board is looking for, rather than answers that provide accurate information on how they will perform once on the job.
- Legal vulnerability: Unstructured interviews are more likely than structured ones to be challenged in court, based on grounds of illegal discrimination9. A review of 158 U. S. federal court cases involving hiring discrimination from 1978 to 1997 revealed that unstructured interviews were challenged in court more often than any other type of selection device10. Even more important is an examination of the outcomes of such legal challenges. Unstructured interviews were found to be discriminatory in 59% of these cases, whereas structured interviews were found NOT to be discriminatory in 100% of cases.
The model presented in the figure below outlines the key activities that take place before, during, and after the structured interview. Each of these activities enhances the quality and legal defensibility of the obtained information. A brief description of the three main interview stages is provided below to illustrate how the proposed interview process unfolds. Sections two to five of this Guide provide more detailed information on how this model can be applied in the appointment process. The hiring manager, HR practitioner or others may carry out different tasks in the interview process. The interview board may be asked to perform some of these tasks before, during, and after the interview.
Before conducting interviews, a common understanding of the interview board's role and the purpose and scope of the interview should be determined. Issues such as the number of applicants to interview and where to position the interview in the appointment process are also discussed.
Key documents that form the basis of the structured interview and ensure its validity are then reviewed. These may include the job description, competency profile, and merit criteria that can help to identify the task requirements and qualifications needed to perform the job successfully. In this way, interview questions that relate directly to job performance may be developed.
Creating booklets for note-taking and assessing the applicant is useful. A note-taking booklet includes descriptions of the qualifications to be assessed and the questions that are linked to them. An assessment booklet is a form for rating applicants against job- relevant qualifications. The questions and rating criteria are the same for all candidates to ensure consistency of approach and comparability of information and results. Sample Interview Note-taking Booklet and Assessment Booklets, which can be tailored to an organization's specific appointment process, are provided in Appendices A and B.
The next task is to attend to administrative matters such as providing information to candidates prior to the interview, arranging for a location for interviews, inviting applicants to the interview, and arranging assessment accommodations as required. Before interviews are held, the interview board ensures it is well-prepared by undergoing training on skillful interviewing, as required, and by reviewing all relevant steps involved in a structured interview.
During the interview, the board should provide a standard introduction to all applicants, including an explanation of the format of the interview, the questions to expect, and how the board will be recording responses. After asking an interview question, the board may need to probe a person's answer for greater detail or ask follow-up questions. This ensures that the board elicits as much information as it needs to fully understand and assess the applicant's qualifications. The board concludes the interview by thanking the person, outlining the next steps in the appointment process, and providing the candidate a final opportunity to ask any other questions.
After the interview, board members assess each person's performance against the qualifications required to perform the work, by reviewing the interview responses and reaching consensus on a single evaluation for each qualification assessed. These interview results are then integrated with those of other assessment tools, such as tests or reference checks, to reach a final assessment for all applicants. The hiring manager then selects the person who is the "right fit" for the job at hand. The Public Service Employment Act (PSEA) provides candidates with the opportunity for an informal discussion to discuss the reasons why they were not selected.
Once the appointment process is complete, the effectiveness of the structured interview should be evaluated, especially if it is intended for future use. By identifying the strengths and areas of improvement related to the interview content and process, the structured interview will continue to meet the organization's requirements.
Adapted from the U. S. Merit Systems Protection Board, Washington D. C.
The priority entitlements within the PSER are referred to as “regulatory priorities”. Persons with a regulatory priority are appointed after persons with a statutory priority, but in no relative order.
- Surplus employees: Employees from other organizations who have been advised by their deputy head that their services are no longer required, but before any lay-off becomes effective (PSER, section 5);
- Note: Within their own organization, a surplus employee has a statutory priority entitlement under the PSEA, section 40.
- Employees who become disabled: Employees who become disabled and who, as a result of the disability, are no longer able to carry out the duties of their position (PSER, section 7);
- RCMP members: Certain members discharged for medical reasons (PSER, section 7.1);
- CAF members: Certain members released for medical reasons not attributable to service (PSER, section 8.) Only members of the regular force, the special force, the reserve force on Class B service of 180 days or more or on Class C reserve service are eligible.
- Relocation of spouse or common-law partner: Indeterminate employees who have been granted leave for such relocations, whose positions have not been staffed indeterminately (PSER, section 9);
- Reinstatement: Certain persons with a priority entitlement who were appointed or deployed to a position in the public service at a lower level (PSER, section 10); and
- Surviving Spouse or Common-law Partner: Surviving spouses or common-law partners of persons employed in the public service, the CAF or the RCMP, whose death is attributable to the performance of duties (PSER, section 8.1).
The priority entitlements within the PSER are referred to as “regulatory priorities”. Persons with a regulatory priority are appointed after persons with a statutory priority, but in no relative order.
- Surplus employees: Employees from other organizations who have been advised by their deputy head that their services are no longer required, but before any lay-off becomes effective (PSER, section 5);
- Note: Within their own organization, a surplus employee has a statutory priority entitlement under the PSEA, section 40.
- Employees who become disabled: Employees who become disabled and who, as a result of the disability, are no longer able to carry out the duties of their position (PSER, section 7);
- RCMP members: Certain members discharged for medical reasons (PSER, section 7.1);
- CAF members: Certain members released for medical reasons not attributable to service (PSER, section 8.) Only members of the regular force, the special force, the reserve force on Class B service of 180 days or more or on Class C reserve service are eligible.
- Relocation of spouse or common-law partner: Indeterminate employees who have been granted leave for such relocations, whose positions have not been staffed indeterminately (PSER, section 9);
- Reinstatement: Certain persons with a priority entitlement who were appointed or deployed to a position in the public service at a lower level (PSER, section 10); and
- Surviving Spouse or Common-law Partner: Surviving spouses or common-law partners of persons employed in the public service, the CAF or the RCMP, whose death is attributable to the performance of duties (PSER, section 8.1).
The PSEA sets out the Public Service Commission's (PSC) authority to make appointments in the public service and to delegate this authority to deputy heads in federal government organizations. The PSC has developed the Appointment Framework, including the Assessment Policy, to guide its delegates in building their own staffing systems, while ensuring that merit, non-partisanship and the guiding values of access, fairness, representativeness, and transparency are respected.
Merit is served when a person to be appointed to a position meets the essential qualifications for the work to be performed, as established by the deputy head, including official language proficiency. In addition, managers may take into consideration other merit criteria such as asset qualifications, operational requirements, and present or future organizational needs. The Assessment Policy governs one of the essential steps in the appointment process, namely to assess applicants against the qualifications required for the position. The policy states that the assessment of qualifications must be designed and implemented without bias, political influence, or personal favouritism, and does not create systemic barriers. A well-structured interview is a robust assessment tool that can be used to achieve that purpose.
When properly conducted, the structured interview provides a wealth of information on job-relevant criteria, enabling fair and accurate assessment of qualifications and facilitating making appointment decisions based on merit. The Assessment Policy requires that a structured interview be conducted as part of the assessment process for all Executive-level appointments, unless an exception to this requirement is granted by the PSC. Also, when the EX appointment is for an acting over four months, the acceptable alternative to the structured interview and structured reference check is a narrative assessment that assesses all of the relevant merit criteria using concrete behavioural examples, including the Key Leadership Competencies. The narrative assessment must be signed by the hiring manager or another manager who is sufficiently familiar with the applicant’s performance and accomplishments to attest to the accuracy of the information provided.
Language of assessment: The PSEA requires that an examination or interview, when conducted for the purpose of assessing qualifications other than language proficiency, must be conducted in English, French, or both, at the option of the candidate. Failure to do so is one of the grounds for a complaint to the Public Service Staffing Tribunal (PSST). The Policy on Official Languages in the Appointment Process offers additional guidance on these requirements. However, an examination or interview, when conducted for the purpose of assessing the qualifications of the candidate in the knowledge and use of English or French or both, or of a third language, is to be conducted in that or those languages.
Assessment accommodation: The Employment Equity Act (EEA) requires employers to identify and eliminate barriers to the employment of designated groups, and to institute positive policies and practices and to make reasonable accommodation to ensure that representation is achieved in the workforce. Aligned with the EEA, the Employment Equity in the Appointment Process Policy states those requirements that ensure that the public service reflects and respects our diverse society. Organizations must provide reasonable accommodation through all stages of the appointment process. The Assessment Policy also offers guidance on accommodation in the assessment process, through Testing in the Public Service, the Guide for Assessing Persons with Disabilities as well as the Guidelines for Fair Assessment in a Diverse Workplace. These publications are intended to help managers fulfill their obligations in the appointment process when assessing persons requiring assessment accommodation.
Prohibited grounds: The Canadian Human Rights Act defines prohibited grounds of discrimination. These include: race, national or ethnic origin, colour, religion, age, sex (including pregnancy or childbirth), sexual orientation, marital status, family status, disability, and conviction for which a pardon has been granted. Interview questions must avoid these prohibited topics both directly and indirectly. It is inappropriate to inquire about areas that are unrelated to actual job performance, such as hobbies, social activities, political beliefs, residence, medical status, and any past legal actions (including workers' compensation claims), and safety complaints. Outside of the structured interview format, casual conversation can be equally dangerous as it can easily stray into prohibited topics. Deviating from job-related topics can create the impression of an undisciplined process or that hiring will be based on issues that are not job-related. While there is no need to be artificially rigid, a businesslike focus on the task of interviewing the applicant is recommended.
The importance of documentation: Should an appointment decision be challenged, it is essential to document the processes followed and how decisions were made. Managers need to be able to explain their staffing decisions should there be complaints to the PSST. Therefore, when using a structured interview in an appointment process, it is recommended that the following information be kept on file:
- The merit criteria, as assessed by the interview board and how the criteria were defined, as well as their relative importance, if applicable.
- The structured interview questions, asked of all applicants.
- The assessment criteria, such as the effective behavioural indicators for the behavioural or situational questions or the correct responses to knowledge questions.
- The rating scale, including the numerical scores and narrative descriptors, if applicable.
- The detailed notes of the interview board members, for each response.
- The individual applicant's results and the rationale.
- How the results from the interview were integrated with other sources of information, in order to make appointment decisions.
The following summary recommendations will enhance the effectiveness and legal defensibility of an employment interview:
- Ensure that interview questions are job-related and based on the requirements of the target position.
- Avoid questions that are related to prohibited topics.
- Use standardized administration. This includes asking the same questions of all applicants.
- Enhance the objectivity of the assessment of applicants by having a well-defined and documented scoring system, and procedures.
- Provide training to ensure that board members know how to conduct fair and unbiased interviews.
- Use interview boards rather than individual interviewers. Diversity in board membership is also preferable.
- It is important to use the same board members for all applicants, whenever possible.
The priority entitlements within the PSER are referred to as “regulatory priorities”. Persons with a regulatory priority are appointed after persons with a statutory priority, but in no relative order.
- Surplus employees: Employees from other organizations who have been advised by their deputy head that their services are no longer required, but before any lay-off becomes effective (PSER, section 5);
- Note: Within their own organization, a surplus employee has a statutory priority entitlement under the PSEA, section 40.
- Employees who become disabled: Employees who become disabled and who, as a result of the disability, are no longer able to carry out the duties of their position (PSER, section 7);
- RCMP members: Certain members discharged for medical reasons (PSER, section 7.1);
- CAF members: Certain members released for medical reasons not attributable to service (PSER, section 8.) Only members of the regular force, the special force, the reserve force on Class B service of 180 days or more or on Class C reserve service are eligible.
- Relocation of spouse or common-law partner: Indeterminate employees who have been granted leave for such relocations, whose positions have not been staffed indeterminately (PSER, section 9);
- Reinstatement: Certain persons with a priority entitlement who were appointed or deployed to a position in the public service at a lower level (PSER, section 10); and
- Surviving Spouse or Common-law Partner: Surviving spouses or common-law partners of persons employed in the public service, the CAF or the RCMP, whose death is attributable to the performance of duties (PSER, section 8.1).
An interview board is one that is comprised of two or more individuals. Research has shown that interviews conducted by a board are more valid than those conducted by only one interviewer11. An interview board can reduce the impact that personal biases may have on the selection of an employee. Multiple interviewers may also capture information that a single interviewer might overlook, thus ensuring a more balanced, and complete assessment of the applicant.
Effort should be made to have interview boards reflect the diverse backgrounds of the applicant pool. This diversity may help to put applicants at ease and make the outcome more acceptable to them. Research has shown that using diverse interviewing panels can reduce or eliminate rating biases due to race and similarity in attitudes between interviewees and interviewers12-13. The Objective Eye is a relevant resource to consult because it brings managers and designated group members together to discuss the possibility of participating on assessment boards.
To the extent possible, it is important that the same board members interview all applicants in a given appointment process in order to increase consistency and standardization of the assessment. Potential board members could include:
- the immediate supervisor of the open position, who is likely the most knowledgeable about the activities and responsibilities of the position;
- the division director;
- an HR representative; and/or
- a potential co-worker.
The hiring manager is responsible for selecting the members of the interview board and for ensuring that board members:
- understand the nature of the position and its merit criteria;
- are qualified, including being proficient in the required official language to communicate effectively and assess fairly;
- are aware of techniques to reduce bias; and
- are free from real or apparent conflicts of interest that may affect the outcome of the process.
A manager should also consider selecting interview board members who have been trained in, and are experienced with, the structured interview process.
Members of the interview board must carry out their responsibilities without bias, political influence or personal favouritism. All members must be familiar with the interview process and maintain objectivity when assessing applicants. They may also be involved with:
- developing the interview questions and answer keys;
- developing the interview process such as preparing the introduction, deciding on the number and sequence of questions, and the time limit for the interview;
- collecting and documenting assessment information; and
- providing feedback to applicants, such as informal discussion, as required.
It is recommended that one member of the interview board be assigned the role of lead interviewer. This person is responsible for the introduction, determining who will ask specific questions, asking some of the questions, and concluding the interview.
The first step in designing a structured interview is to clarify its purpose and objectives, making it easier for the board to determine the type of information to collect, and the process that will be used to collect it. An advantage of the structured interview is that it can allow the employer to learn more about the applicant and vice versa.
From the employer's perspective, the interview can add considerable value to the appointment process by:
- filling information gaps in other assessment tools such as applicant forms or resumés;
- assessing qualifications that can be best measured via face-to-face interaction, such as interpersonal relations or oral communication; and
- giving the applicant the chance to demonstrate their qualifications "live" by responding to actual job situations.
For the applicant, the interview is an opportunity to learn more about the job and the organization, and to begin to develop realistic expectations about both. Treating the interview as a two-way exchange can also have a positive influence on the perception of the hiring organization. For instance, research has shown that perceptions of the interview process and the interpersonal skills of the interview board members, as well as their skills in listening, recruiting, and conveying information about the organization and the target job, affect the applicant's evaluation of the interview board members as well as the organization14-15.
It is therefore important to strike a balance between meeting the needs of the employer and the applicant, while using the interview to obtain the necessary information to determine the "right fit" for the position.
Two important questions that need to be addressed at the early stages of planning are how many applicants will be interviewed and at what stage in the appointment process will the interview be conducted?
Whether all applicants or only those that meet the required qualifications should be interviewed depends on a number of factors. These include the size of the applicant pool, the other types of assessment tools used in the appointment process and the resources available.
When dealing with large applicant pools, the order in which assessment tools are administered can have a significant impact on the cost of the selection process. One way to minimize time and costs is to first eliminate applicants with insufficient qualifications, using relatively inexpensive selection methods such as automated screening on training, experience, and education. As a result, the organization can use more expensive selection tools such as the interview, on a smaller number of highly qualified people.
On the other hand, when dealing with a smaller applicant pool, it may be appropriate to assess critical qualifications in a preliminary interview. For example, early stages of the process may focus on assessing essential job qualifications. Follow-up interviews can then be conducted with the reduced number of applicants, to explore their asset qualifications, or vice versa.
Once the job requirements have been reviewed (i. e. Statement of Merit Criteria, competency profile and job description), an Interview Note-taking Booklet may be designed. To do so, the interview board will need to identify the qualifications to assess and develop questions that tap into these factors.
The following information about the interview process should be included in the booklet:
- The applicant's name or identification number, board members' names, and the date of the interview;
- The introductory greeting;
- Questions in the order in which they will be asked;
- Reserved spaces for note-taking; and
- Information concluding the interview.
Appendix A provides a sample Interview Note-taking Booklet that can be adapted to specific appointment processes. Each interview board member should have an Interview Booklet for each applicant being assessed.
When developing interview questions, the board must decide which qualifications from the Statement of Merit Criteria will be assessed. To maximize the validity of the appointment process, the interview should build on information from other assessment tools. The following questions may assist in determining which kinds of qualifications to assess in an interview:
- Which qualifications can be accurately assessed using an interview - for example, flexibility and personal initiative?
- Which qualifications would be better assessed in a face-to-face situation - for example, oral communication or interpersonal skills?
- Are there any qualifications that are partially assessed or not assessed at all by other means in the process?
Personality attributes (e. g. responsibility, dependability, initiative and persistence) and applied social skills (e. g. interpersonal relations, oral communication, persuasiveness, team focus, and the ability to work with people) are the qualifications most often assessed in interviews16. These qualities provide employers with an idea of how potential employees are likely to act on the job and how well they can interact with others.
The Key Leadership Competencies can also be used as a basis for the structured interview and provide a good indication of how applicants would perform on the job. Values and Ethics, Strategic Thinking, Engagement, and Management Excellence, relate to qualifications such as oral communication, interpersonal skills, teamwork, initiative, and behavioural flexibility, which can be assessed effectively through structured interviews17.
An interview, however, may not be the best tool to assess certain qualifications. For example, although job knowledge can be accurately assessed in an interview, if there are many questions requiring detailed answers, the use of written tests may be more cost-effective. Similarly, mental ability may also be better assessed through the use of standardized, written tests rather than an interview. Ultimately, the job requirements, organizational needs and the available assessment tools, should dictate whether qualifications should be assessed through an interview, another type of assessment tool, or a combination of tools.
Number of qualifications assessed: Experts advise limiting the number of qualifications assessed in an interview, as research shows that evaluations are more valid when assessors focus on a limited number of factors18. Trying to assess too many factors in too little time may yield superficial data of limited value, resulting in an ineffective assessment19. The recommendation is for a maximum of seven qualifications to be assessed in an interview20. The remaining qualifications in the Statement of Merit Criteria would be assessed by other means such as written tests, simulations, or reference checks, ensuring that individuals are fully assessed before making the appointment decision.
Once the qualifications to be covered in the interview have been determined, the next step is to develop questions that assess these qualifications. Interviews can cover a range of qualifications from work experience, training and education, to specific job qualifications such as knowledge, skills, abilities, and personal attributes. Competency-based questions should beformulated to target specific behavioursrelated to the qualifications and work to be performed. These behavioural indicatorsallow for a more accurate and objective assessment of the applicant.
When developing competency-based interview questions,board members may wish to ask themselves the following questions:
- What is the difference between employees who are strong in a particular qualification and those who are not?
- In what situations is the qualification demonstrated?
- What is the impact of different courses of action? What makes a particular action or response effective? What makes it ineffective?
Three of the most common and effective types of interview questions are situational, behavioural, and job knowledge questions. Although each of these formats can be independently effective, a more comprehensive assessment can be achieved by combining different types of questions for a given qualification. Each of these methods is described in greater detail below.
Situational questions: These questions present applicants with a hypothetical situation relevant to the position. These situations are typical of what applicants are likely to encounter on the job. Applicants are asked to describe what they would do in such a situation, taking into consideration available resources and the context of the job. This type of question is based on the premise that people's intentions are predictive of their future behaviour. The applicant's answers are evaluated against established criteria, discussed later in this section.
Situational interviews have been found to be highly valid and resistant to assessor error such as contrast error, and race or gender bias, also discussed later in this section21-22. They have been found to apply across a variety of jobs and qualifications. One advantage of situational questions is that applicants respond to a hypothetical situation rather than describing experiences from their past, thus not placing anyone at a disadvantage. Responses tend to be directly comparable and are easier to rate reliably by multiple interviewers23.
For situational interview questions to be most effective, examples of job-specific events and actual behaviours should be collected from subject matter experts such as supervisors or job incumbents. These examples represent exceptionally good or poor performance on the qualification being assessed, and provide the hypothetical situations that will be presented in the interview question. As situational questions are derived from actual examples of job performance, the job-relevance of these questions is ensured. Research has demonstrated that most interviewees tend to prefer situational questions over behavioural questions, because they are less memory-dependent and more relevant to the target job24.
Examples of Situational Questions to Assess Teamwork
- Suppose you had an idea for a change in procedure to enhance work quality, but some members of your work team were against any type of change.
- What would you do in this situation? Why?
- What factors would you consider?
- Who would you involve?
- Consider a situation where you and a co-worker are working on a project together. You both agreed on how the work was to be divided up. However, your co-worker fails to do their share of the work.
What would you do?
Behavioural questions: Behavioural questions ask applicants to describe a previous work or life event that is relevant to the position. They are usually about a time when they had to demonstrate a particular qualification that is important for the job. These questions are suitable for most types of positions and are recommended when applicants have relevant experience, and it is more informative to know their past behaviours rather than their intentions.
As with situational questions, behavioural questions are developed using on-the-job events collected from subject matter experts. Research has found behavioural interviews to be highly valid in predicting job performance25. Behavioural questions are usually straightforward and easy to develop, based on the qualifications identified in the Statement of Merit Criteria. They reflect the behaviour that applicants would engage in under similar circumstances. Because responses are open to verification through follow-up questions, it is risky for applicants to provide inaccurate or untruthful answers to behavioural questions.
When asking behavioural questions, ascertain the following:
- The particulars of the situation, task, problems or context;
- The actions that the applicant took in response to the situation; and
- The achieved results or the impact of the actions taken.
Example of Behavioural Questions to Assess:
Financial Management
Tell us about a time when you were required to make a difficult budget decision:
- How did you go about analyzing the issue and making a decision?
- What was the result of your decision?
Teamwork
- What was the biggest difference of opinion you ever had with a co-worker?
- What did you do to try to resolve it?
- What was the outcome?
Here are examples of both situational and behavioural questions that evaluate a qualification, and related effective behaviours:
Developing Questions to Assess "Ability to Plan"
What does it mean to "plan" in the context of the position? What would be some specific activities of good and bad planners? What are the levels of complexity, the time constraints and any obstacles or challenges that are usually encountered? What is the impact of different planning actions or behaviours? Are different approaches to planning equally effective?
Definition
Establishes a systematic course of action for self and others, to ensure accomplishment of specific objectives. Sets priorities, goals and timelines to achieve maximum productivity and to ensure objectives are met on time.
Effective behavioural indicators
- Sets priorities with an appropriate sense of what is most important;
- Keeps detailed records of activities related to the accomplishment of stated objectives;
- Plans with an appropriate and realistic sense of the time demands involved;
- Knows status of one's own work at all times; and
- Creates action plans for achieving performance expectations.
Example of a Behavioural Interview Question
Describe how you managed your work schedule the last time you had competing deadlines to meet.
What steps did you take to make certain that you would manage your time most effectively?
What was the result?
What feedback did you receive?
Example of a Situational Interview Question
What would you do if you were solely responsible for managing a large scale project with very tight deadlines? What steps would you take to ensure you met all your deadlines on time?
Job knowledge questions: These questions typically assess the technical or professional knowledge required to perform the duties of the position. With these questions, applicants are asked to demonstrate their knowledge in specific areas such as basic accounting principles, computer programming, financial management, policy, or legislation, etc.
Job knowledge has been successfully evaluated in interviews26. Assessing job knowledge in an interview is particularly useful when the position for which you are hiring requires the verbalization of technical information and work procedures. For example, in advisory or consulting jobs, most of the requests for service are verbal. It may also be possible to provide accommodation for persons with disabilities, and assess job knowledge in the interview instead of in a written knowledge test.
Assessing job knowledge in the interview would not be recommended if there are a large number of job knowledge questions, especially if the answers are fairly short and routine. In such cases, a written test would be more efficient and usually less expensive to administer and score. It would also not be appropriate in situations where the questions deal with complex behaviours such as diagnosing defects, operating equipment or manipulating data or information. In these situations, job simulations or written knowledge tests are usually more appropriate.
When developing job knowledge questions, the challenge is in deciding how much knowledge one should be expected to have versus what can be learned later on in the job. Such questions should assess knowledge of information that is essential or important to the overall performance of the job and not knowledge that is difficult but only peripheral to the job at hand. Knowledge questions should not ask about material that is easily learned on the job or that would be taught as part of a training program for the job.
When assessing job knowledge in an interview, it is a good practice to inform applicants in advance that knowledge will be assessed, as additional preparation may be required.
Example of a Job Knowledge Question
Description: How has the new PSEA changed the hiring process in the public service?
Demonstration: How would you go about designing interview questions that ensure that the assessment of applicants is based on merit?
Job simulations:In simulations, applicants are asked to perform a task that they would be required to do on the job. Although simulations have not traditionally been considered as interview questions, they are often used by managers for this purpose. For example, an applicant could be provided with a budget sheet and asked questions related to the work required to do the job.
As with the other types of interview questions, the simulation should also be standardized. Applicants should be given instructions and a brief scenario, either verbally or in writing, and the same questions must be asked of every applicant. An assessment guide for all applicants needs to be prepared to ensure consistency of the assessment.
However, some caution is warranted with this type of interview question. First, the scenario and the questions need to be job-related and based on the qualifications required to do the job. Second, simulations should not take up a large part of the interview, but be used to supplement applicant information obtained from the other types of interview questions. Third, the artificiality of this type of exercise may make some applicants uncomfortable.
The priority entitlements within the PSER are referred to as “regulatory priorities”. Persons with a regulatory priority are appointed after persons with a statutory priority, but in no relative order.
- Surplus employees: Employees from other organizations who have been advised by their deputy head that their services are no longer required, but before any lay-off becomes effective (PSER, section 5);
- Note: Within their own organization, a surplus employee has a statutory priority entitlement under the PSEA, section 40.
- Employees who become disabled: Employees who become disabled and who, as a result of the disability, are no longer able to carry out the duties of their position (PSER, section 7);
- RCMP members: Certain members discharged for medical reasons (PSER, section 7.1);
- CAF members: Certain members released for medical reasons not attributable to service (PSER, section 8.) Only members of the regular force, the special force, the reserve force on Class B service of 180 days or more or on Class C reserve service are eligible.
- Relocation of spouse or common-law partner: Indeterminate employees who have been granted leave for such relocations, whose positions have not been staffed indeterminately (PSER, section 9);
- Reinstatement: Certain persons with a priority entitlement who were appointed or deployed to a position in the public service at a lower level (PSER, section 10); and
- Surviving Spouse or Common-law Partner: Surviving spouses or common-law partners of persons employed in the public service, the CAF or the RCMP, whose death is attributable to the performance of duties (PSER, section 8.1).
Example of a Job Simulation
HR technicians are required to administer written exams. This includes reading exam instructions to the applicants. Please read these exam instructions to us as if you were reading them to a large group of applicants.
Any questions that may discriminate against applicants on the basis of any of the following grounds are prohibited: race, national or ethic origin, colour, religion, age, sex (including pregnancy or childbirth), sexual orientation, marital status, family status, disability, and conviction for which a person has been granted pardon.
Interview questions should always be job-related.
Probing questions:
Applicants' responses will vary in length and level of detail. This variability is acceptable as long as enough information is obtained to assess each qualification fairly and accurately. However, there may be a need to request additional examples or more specific information to more fully understand the applicant's answer. Asking probing or follow-up questions is a necessary component of the interview because it helps to ensure that sufficient data is obtained for all qualifications being assessed.
The following example illustrates how probing questions can clarify the applicant's role in a specific situation.
Applicant: "We designed a forty-story building complete with a four-story underground garage and glassed-in mezzanine. "
Interviewer: "What was your specific role in the project?"
Applicant: "I assisted the architects by making multiple copies of the plans using a blue line machine and by running errands. "
Probing questions are generally acceptable in a structured interview, but they should not result in the introduction of new topics or issues, since the structured interview is intended to ask the same questions of each applicant. Otherwise, some applicants may be inadvertently advantaged, while others, disadvantaged. It is also important not to reveal effective behavioural indicators through probing questions.
The recommended approach is to develop discretionary probing questions at the same time as structured interview questions. These discretionary, standardized probes should ensure that enough details of the situation, the applicant's behaviour in the situation and the outcome of the behaviour are being described. Probing questions can also be used to help applicants focus on specific incidents when they are responding with generalizations.
Listed below is a series of sample probing questions that can help to elicit specific details about the who, when, where, what, why and how of the applicant's responses. This list is followed by a summary of "do's" and "don'ts" to consider when designing interview questions.
Sample Probing Questions
Who:
- Who else was involved?
- Who else helped you with this situation?
When:
- How long ago did this happen?
- When did all this take place?
Where:
- Where did this take place?
What:
- What was the [situation/issue/problem]?
- What were the [results/outcomes]?
- What actions did you decide to take, and when?
- What was your role?
- What part did you play in making the decision to _______ ?
- What did you say, or do that [did/didn't] work?
- What was the message you were trying to convey?
- What were you trying to convince or persuade them of?
- What techniques did you use to keep yourself and your work organized?
- What did you do when your work started to get behind?
- What was the deadline?
- What actions did you take to ensure you met the deadline?
Why:
- Why was this situation a particular challenge?
- Why was this person difficult?
- Why did you take that approach?
- Why was it important to meet the deadline?
How:
- How did you develop this idea?
- How did you convince your supervisor to adopt it?
- How did it help the organization?
- How did you prepare for it? How did you size up the situation?
Source: BC Public Service Agency
Do | Don't |
---|---|
|
|
Number of questions: Although it is generally recommended that more than one question be asked for each qualification assessed, there is no rule for the exact number. While some experts recommend asking more than one question per qualification, others suggest at least three questions per qualification27. However, the exact number of questions is a function of:
- The breadth of the qualification to assess and its importance in successful job performance; and
- The overall number of assessed qualifications, the type of questions asked and the amount of interview time available.
If, for example, a given qualification entails many different behavioural indicators, it may take more questions to collect enough information to assess that qualification adequately than if there were only a few behavioural indicators. Ultimately, information should be collected until the topic is exhausted or until the interview board judges that enough information was gathered to perform an accurate assessment.
Time constraints should also be considered. An interview of over 90 minutes can be exhausting for both applicants and board members. In contrast, an interview of only 30 minutes may render rather superficial assessments. It is recommended that interviews be 45-60 minutes, with a maximum of 90 minutes in length.
The number of questions covered within the allotted interview time will also be a function of the types of questions asked. Typically, it should allow three minutes for a knowledge question, and up to ten minutes for a situational or behavioural question. These time constraints reinforce the recommendation that one should aim to assess a relatively small number of qualifications in an interview, ideally no more than seven.
Organizing interview questions:When asking more than one question per qualification, it is recommended that the questions be grouped so that the interview board can ask all the questions assessing a qualification before moving on to another one. This facilitates the analysis and assessment process for interview board members, since all of the information on a given qualification will have been considered together.
Other decisions will also need to be made by the board regarding the interview format and process, such as whether applicants should be given time on-site to prepare for the interview. Generally, it is good practice to give time for applicants to prepare on-site. It is reasonable to allow roughly 30 minutes for applicants to review the questions and prepare their responses. Board members should also decide in advance which questions each person will ask applicants. It is essential to conduct the interview in the same way for each applicant.
Board members need to decide in advance how they are going to assess interview responses in a fair and accurate manner. One way to ensure the same assessment criteria are applied consistently is to develop an Assessment Booklet for evaluating applicants' performances. When designing such booklets, it is important to consider the kinds of actions, responses, and behaviours that are effective and relevant for each qualification assessed. The use of a rating scale can enable a more precise assessment against the qualifications to determine the "right fit" for the position and by minimizing subjective bias.
Qualifications can be rated against a variety of scale types. The simplest scale provides only "meets/does not meet" choices. This type of scale could be used when assessing only one applicant for an acting appointment. Alternatively, the appointment process may require an expanded rating scale to make meaningful distinctions between applicants and determine the "right fit" for the job.
A sample rating scale:In order to assess applicants fairly, board members should use a common rating scheme and scoring procedure for each applicant. This standardized approach improves the accuracy of judgements made by board members and helps in later comparisons among applicants. Below is an example of a combined (verbal and numerical) rating scale:
Does not meet the qualification | Meets the qualification | |||
---|---|---|---|---|
1 Very Poor. Unacceptable. |
2 Poor. Below average. |
3 Moderate. Good. Acceptable. Satisfactory. Average. |
4 Strong. Above average. |
5 Very Strong. Excellent. |
Ratings provided for each qualification should be accompanied by a brief rationale as to why the rating was given, based on the behavioural evidence provided. For instance, a rating may be justified by noting that "the applicant made up for poor project planning by taking the initiative to ensure the project was completed on time. "
Behaviourally-anchored scales: When developing rating scales, one useful format is to distinguish different points on the rating scale using specific behaviours. This precision will help to ensure that all share a common understanding of what a given qualification means and what kinds of behaviours represent weak, moderate and strong performance on related interview questions. In order to create appropriate behavioural anchors for the scale, it is important to review documents such as the Statement of Merit Criteria, the competency profile and the job description.
The number of points on a rating scale can vary, usually from three to seven. When rating qualifications, a five-point scale is typically suitable. The scale may also vary in the breadth and level of detail provided in the behavioural description. For instance, the figure below provides a basic description of the expected responses for an applicant to receive a score of 1, 3 or 5 for situational and behavioural questions.
Situational question: Suppose you had an idea for a change in procedure to enhance work quality but some members of your work team were against any type of change. What would you do? What factors would you consider? Why?
Who would you involve?
Rating scheme:
- (5) Excellent answer: Explain the change and try to show the benefits. Discuss it openly in a meeting.
- (3) Good answer: Ask them why they are against change. Try to convince them.
- (1) Unacceptable answer: Tell the supervisor.
Behavioural question: What was the biggest difference of opinion you ever had with a co-worker? How did you resolve it? What was the outcome?
Rating scheme:
- (5) Excellent answer: My co-worker and I looked into the situation, found the problem and resolved the difference. We had an honest conversation.
- (3) Good answer: Compromised. Resolved the problem by taking turns, or I explained the problem (my side) carefully.
- (1) Unacceptable answer: I got mad and told the co-worker off, or we got the supervisor to resolve the problem, or I never have differences with anyone.
Alternatively, greater precision can be gained by incorporating more detailed behaviours into the rating scale. This does not mean simply "cutting and pasting" the behavioural indicators for the qualification being measured. Rather, it entails outlining specific answers to the questions that define the different proficiency levels.
Detailed Behavioural Scale Assessing Interpersonal Skills
Definition: shows understanding, courtesy, tact, empathy, concern; develops and maintains relationships; may deal with people who are difficult, hostile, distressed; relates well to people from varied backgrounds and situations; is sensitive to individual differences.
Behavioural question: Describe a situation in which you had to deal with people who were upset about a problem.
Probes:
- What events led up to this situation?
- Who was involved?
- What specific actions did you take? What was the outcome or result?
Benchmark Level |
Level Definition | Level Examples |
---|---|---|
5 | Establishes and maintains ongoing working relationships with management, other employees, internal or external stakeholders or clients. Remains courteous when discussing information or eliciting highly sensitive or controversial information from people who are reluctant to give it. Effectively handles situations involving a high degree of tension or discomfort involving people who are demonstrating a high degree of hostility or distress. |
|
4 |
|
|
3 | Cooperates and works well with management, other employees or clients on short-term assignments. Remains courteous when discussing information or eliciting moderately sensitive or controversial information from people who are hesitant to give it. Effectively handles situations involving a moderate degree of tension or discomfort involving people who are demonstrating a moderate degree of hostility or distress. |
|
2 |
|
|
1 | Cooperates and works well with management, other employees or clients during brief interactions. Remains courteous when discussing information or eliciting non-sensitive or non-controversial information from people who are willing to give it. Effectively handles situations involving little or no tension, discomfort, hostility or distress. |
|
Source: United States Office of Personnel Management
In the absence of detailed behaviours to define a rating scale, an alternative option is to provide a generic description of performance for each point on the scale. An example is provided below.
Ratings | Qualifier | Generic Description |
---|---|---|
5 | Strong. Excellent. Exceptional. Much more than acceptable. |
Extremely effective performance. Significantly above criteria for successful job performance. Meets all major/essential/core criteria or acceptable equivalents and several additional criteria. The behaviour is very well-developed and demonstrated with a high degree of consistency, impact and depth. This behaviour is demonstrated even under challenging circumstances. There are no gaps in the demonstration of the behaviour. Surpassed expectations. Reserved for the exemplary set of skills that yield a particularly sophisticated approach to handling the situation. |
4 | Very good. Full performance of behaviours. Above average. |
More than adequate for effective performance. Generally exceeds criteria relative to quality and quantity of behaviour required for successful job performance. Meets most of the major/essential/core criteria or acceptable equivalents and several of the minor/additional criteria. The behaviour is also very well-developed although there may be an occasional gap in consistency, impact and depth. No major deficiencies exist in the areas assessed. Consistently demonstrated better-than-average level of performance. Describes/demonstrates the full range of skills appropriate for handling the situation and the desired result, or outcome is obtained. |
3 | Moderate. Good. Acceptable. Satisfactory. Average. |
Should be adequate for effective performance. Meets criteria relative to quality and quantity of behaviour required for successful job performance. Some of the major and minor criteria were met; some deficiencies exist in the areas assessed but none is of major concern. The behaviour is demonstrated to a moderate degree with some gaps in consistency, impact and depth. Describes/demonstrates a sufficient range of skills for handling the situation and the desired outcome is obtained. |
2 | Weak. Below average. |
Insufficient for performance requirements. Generally does not meet criteria relative to quality and quantity of behaviour required for successful job performance (e. g. , meets half or less of the criteria). There are many gaps in the demonstration of the behaviour. Does not describe/demonstrate a sufficient range of skills appropriate for handling of the situation, or describes plausible but inappropriate behaviours for handling the situation or the desired result or outcome is not obtained. |
1 | Unacceptable. Poor. Much less than acceptable. |
Significantly below criteria required for successful job performance. Few or no criteria met. There are significant gaps in the demonstration of the behaviour. A major problem exists. No answer or inappropriate answer. Describes/demonstrates counterproductive behaviours that have negative outcomes or consequences (i. e. , make the situation worse). |
The priority entitlements within the PSER are referred to as “regulatory priorities”. Persons with a regulatory priority are appointed after persons with a statutory priority, but in no relative order.
- Surplus employees: Employees from other organizations who have been advised by their deputy head that their services are no longer required, but before any lay-off becomes effective (PSER, section 5);
- Note: Within their own organization, a surplus employee has a statutory priority entitlement under the PSEA, section 40.
- Employees who become disabled: Employees who become disabled and who, as a result of the disability, are no longer able to carry out the duties of their position (PSER, section 7);
- RCMP members: Certain members discharged for medical reasons (PSER, section 7.1);
- CAF members: Certain members released for medical reasons not attributable to service (PSER, section 8.) Only members of the regular force, the special force, the reserve force on Class B service of 180 days or more or on Class C reserve service are eligible.
- Relocation of spouse or common-law partner: Indeterminate employees who have been granted leave for such relocations, whose positions have not been staffed indeterminately (PSER, section 9);
- Reinstatement: Certain persons with a priority entitlement who were appointed or deployed to a position in the public service at a lower level (PSER, section 10); and
- Surviving Spouse or Common-law Partner: Surviving spouses or common-law partners of persons employed in the public service, the CAF or the RCMP, whose death is attributable to the performance of duties (PSER, section 8.1).
Source: British Columbia Public Service Agency, Manager's HR Toolkit
An example of an Assessment Booklet that can be tailored to any appointment process is available in Appendix B.
Prior to the interview, each applicant should be given information on its format. It should be made clear that the interview will be structured with an interview board and specify the types of questions that will be asked, the qualifications assessed and the amount of time allotted for the interview.
Prior to the interview, information about the organization and the position to be staffed may be sent to applicants. Additional information such as dress code, pay range, benefits and working conditions, as well as any specific requirements such as shift work, may also be covered ahead of time. In so doing, the structured interview questions will be the main focus during the allotted time, ensuring that applicants have ample time to answer.
All applicants should be informed of the interview format, the qualifications to be assessed and the expected duration so that applicants can make an informed request for accomodation.
Whether an applicant will require accommodation should also be ascertained prior to the interview. Deputy heads have a duty to accommodate applicants in the appointment process and to remove barriers to employment. It is important to remind applicants in a timely fashion of their right to request accommodation and to ensure that the necessary arrangements are made.
If you have any questions or for further information on establishing appropriate accommodation, please refer to the Guide for Assessing Persons with Disabilities.
Example of Accommodation
In one appointment process, it was decided that applicants should receive the interview questions in writing prior to the interview; however, one of the applicants was visually impaired.
To accommodate an applicant with visual limitations, it might be appropriate to transfer the questions to an electronic document that can be read on a screen or with voice software. Alternatively, a reader might also be an appropriate accommodation.
Research indicates that skilful interviewing requires training and feedback28-29. It is important that all members of the interview board be properly trained on how to conduct structured interviews and how to assess applicants to ensure fairness in the staffing process.
Board member preparation should cover the following topics:
- How to build rapport with applicants;
- Effective questioning;
- The importance of taking good notes and how to do so;
- The assessment criteria and procedures;
- Assessor biases, common assessment errors and how to minimize them; and
- How to arrive at a final board rating.
For more details on training, a "Train-the-Trainer" presentation is provided in Appendix D.
It is important to create and follow an interview schedule to ensure a smooth interview process. If the allotted time for interviews is inadequate, the process will fall behind schedule. Delays can have a negative effect on applicants and board members which may affect the assessment process. It may also convey a negative image of the organization.
The person in charge of scheduling will need to know the expected duration of the interview to ensure ample interviewing time. Pre-testing your interview to ensure that an adequate amount of time is allocated is useful for this purpose. When conducting back-to-back interviews, it is also good practice to allow for 15 minutes between interviews so that they do not overlap even if they run over time and also to permit board members to take breaks.
To the extent possible, the reserved interview room should be well-lit and free from noise and other distractions. The atmosphere should be calm so as not to intimidate applicants. Water, pens/pencils and paper should be offered. The seating arrangements can also have an impact on the interview atmosphere. It is preferable to position applicants and board members around a small table or at the corner of a larger table rather than to have the applicants sit at one side of a large table with the board members all seated along the other side.
Prior to the first interview, board members should go through the Interview Booklet to review the process and assign the role of lead interviewer to one member. The Interview Booklet contributes to the standardization of the interview process.
Developing interview questions:
- Base situational and behavioural questions on events that have occurred in the position to be filled. The more that questions are based on what really happens on the job, the better they will be at predicting job performance.
- Balance the interview towards the positive. Plan to ask questions focussing on applicants' successes first. Applicants may then be more forthcoming discussing situations where they were not as successful.
- Ensure that you design your questions so the applicant will know that you want them to describe the particulars of the situation, task, problems, or context, the actions taken (or not), and the result or impact.
- For knowledge questions, identify the specific facts, concepts, techniques or regulations that are crucial. Take into account the relative importance of each of these knowledge areas, in deciding how many questions you will require.
- Make sure that your questions are clear and unambiguous. Have them reviewed by someone who was not involved in their development.
Developing and using rating scales:
- Be clear on the expected, effective answers that meet or do not meet qualifications.
- Choose the words or phrases for the points on a scale and their accompanying definitions that are most appropriate for the qualification being assessed and the selection tool being used.
- Don't get overly detailed. These are key indicators only. An exhaustive list of all possible criteria is not required.
Arranging assessment accommodation:
- Ensure that all applicants are informed of the interview format, the qualifications to be assessed, the expected duration and their right to request accommodation.
- To avoid undue delays, contact applicants who request accommodation as soon as possible.
- Maintain an open dialogue with applicants in order to understand their needs.
- Establish appropriate accommodation according to the Guide for Assessing Persons with Disabilities and the Guidelines for Fair Assessment in a Diverse Workplace.
Even the well-conceived interview is only as effective as its administration process. An interviewer's skill in areas such as establishing rapport, probing, managing applicant reactions and effective note-taking have a considerable impact on the validity and fairness of the interview process. In addition, board members serve as organizational "ambassadors" and their treatment of applicants sends a powerful message about the culture, priorities and concerns of the organization they represent. In this way, an applicant's experience in the interview can impact on the organization's ability to attract talent. The purpose of this section is to provide step-by-step guidance on how to conduct a structured interview in a professional and effective manner.
- The interview board should ensure the following preparation prior to the arrival of the applicant:
- Board members should meet at least 15 minutes before the first applicant arrives to discuss the interview format and to ensure that all necessary materials are available.
- Each board member should have a copy of the Interview Note-taking Booklet, as well as the Interview Assessment Booklet,for each applicant.
The following arrangements should also be made:
- Applicants should be provided with water and pens/pencils and paper for the interview.
- If applicants are allotted time to prepare prior the interview, they should be placed in a private room, given a copy of the interview questions (without divulging the behaviours that are targeted in each question), placed in a private room and given the following instructions:
"Here are the questions. You have ______ minutes to prepare for the interview. Here are the questions. You will then meet with the interview board. "
- Applicants should be allowed to bring the interview questions and their notes to the interview, so they can refer to them throughout.
It is important to start the interview in a relatively informal and friendly manner to help put the applicant at ease. This is a particularly important step since interviews can be stressful for some applicants. Establishing and maintaining rapport with applicants contributes to the validity of the interview by reducing their anxiety and allows them to feel comfortable and to give honest and candid responses.
The lead interviewer should begin by welcoming the applicant, thanking them for attending, and introducing the other board members. As part of the introduction, the lead interviewer should:
- Provide welcoming remarks, such as an explanation of the goal of the interview and the role of the interview board. Reiterate the language in which the interview will be conducted (at the choice of the applicant) and remind applicants that they may request accommodation, if needed.
- Describe how the interview will unfold and indicate how long it will take, including an explanation that the interview questions are based on job-relevant qualifications and that all applicants in the process will be asked the same questions.
- State that the board members will be taking turns asking questions, will be taking notes and will provide an opportunity for applicants to ask questions at the conclusion of the formal interview questions.
- Give a clear signal that the interview is about to begin.
Board members may use the following statement as a guideline for presenting interview questions to the applicant (this applies whether questions are given in advance of the interview or not):
"The interview will consist of __________ questions (situational and/or behavioural and/or knowledge questions, as applicable).
The behavioural questions ask about a time in your life when you have dealt with a certain type of situation. When answering these questions, it is important that you provide enough background information to allow us to understand the situation. Be as specific as possible about your role in the events - what you did, how and why you did it, and what the outcome of the situation was. The situational questions ask you what you would do if you were placed in a hypothetical situation. Knowledge questions ask about the technical or basic knowledge required to perform the duties and responsibilities of the position.
Before responding to any of the questions, feel free to take a few moments to collect your thoughts and think about your answer.
Where necessary or appropriate, you may use the same situation or example to answer more than one question. Throughout your responses, we may interject from time to time with follow-up questions to gather additional information.
We will be taking notes throughout the interview as we want to capture in full the content of your responses as much as possible. You will have approximately ___ minutes to answer each question. Do you have any questions before we begin?"
Some applicants may not be accustomed to board members taking notes. Therefore, it is important that applicants understand that this note-taking is to ensure full credit is given to them for the knowledge, skills and abilities demonstrated during the interview.
During the interview, board members should focus on asking the interview questions, listening to applicants' responses, asking follow-up questions when necessary, and taking detailed notes. The assessment of applicants' responses should not occur during the interview; they should be assessed immediately afterward.
Below are some important points for the interview board to consider when asking questions:
- Make sure applicants have a copy of the interview questions and ask them to follow along.
- Be sure to read each question aloud slowly and clearly.
- Do not divulge the specific behavioural indicators being assessed by any question since this would serve to "lead" the applicant's response and may give an unfair advantage.
Asking probing questions:It is important to obtain as much detail as possible regarding the applicant's behaviours - what the applicant would do in the case of the situational questions, and what the applicant actually did in the case of the behavioural event questions. In addition to the "what", it is important to focus on the "how" and "why" of the behaviours described. For behavioural questions, it is also important to understand the general background of the situation, the applicant's role in it, and the outcome.
When asking probing questions, the board must ensure it sticks to predetermined questions and not introduce new questions or reveal the behavioural indicators. Examples of probing questions can be found in Section Two.
While it is important to gather all relevant information, board members need to manage the flow of the interview and set time limits. Some applicants may spend a considerable amount of time answering each question or provide irrelevant information. If this occurs, time may expire before all qualifications are addressed and all of the needed information is extracted. Although the interview is designed for the applicant to do most of the talking, the board may need to intervene with a brief comment to bring responses back to a relevant topic or to a conclusion.
Examples of How to Intervene
- "What was the outcome?"
- "What was your contribution?"
- "What is the main point of this illustration?"
- "I appreciate you providing that information, but now we need to move on to our next question. "
A well-conducted interview will project the image of a professional organization, which will be favourably viewed by most individuals, particularly those who are not successful but who may consider re-applying for employment in the future. In addition, unsuccessful applicants will be less likely to challenge a process they perceive to be rigorous and equitable. To that end, managing the applicant's reactions, should they feel embarrassed or experience some other difficulty during the interview, is essential.
For instance, should applicants mention negative aspects about a situation or about themselves, the interviewer can empathize with the applicant and then suggest that they move on to another aspect of the question. For example, "I understand that it was a difficult situation. Could you tell me about…?"
Should an applicant avoid a question or an aspect of a question, the interviewer can acknowledge the applicant's difficulty, then politely invite the applicant to address that aspect of the question. For example, "I understand it may be difficult to find an example, but we would really be interested in knowing about a situation where you…".
If an applicant persists in not answering a question, the interviewer should not insist. The interviewer may proceed with another question and indicate that the board may want to return to the unanswered one later. For example, "I understand. If you agree, we can come back to this question later in the interview. In the meantime, could you tell me about…?". Prior to ending the interview, the interviewer can return to the unanswered question by politely inviting the applicant to address this aspect: "Before we end the interview, could we come back to question three and could you describe to us a situation where…?".
A proper assessment includes taking notes for each applicant's responses throughout the interview. Note-taking serves two purposes: to help capture and recall the content of the interview and assess applicants' responses accurately, and also to create records to reconstruct the interview process or support an employment decision based on the interview30. Human memory is imperfect and selective. Without notes, it is possible to selectively recall an applicant's strengths and weaknesses, or be unable to recall an applicant's responses at all.
To capture all relevant information, board members should attempt to take notes steadily over the course of the interview. Notes should reflect what the applicant says, rather than how it is said. There are two exceptions in which brief descriptive notes are recommended:
- If the interview is used to assess a qualification such as oral communication, where both content and delivery are relevant; or
- If an applicant's behaviour raises questions about their qualifications or suitability. For example, notes should be taken to document an applicant's inordinately long time to respond to questions or to describe an inappropriate interaction.
To maximize the usefulness of notes, they should be:
- Based on careful observations of behaviours and facts related to the qualifications being assessed.
- As complete and as close to verbatim as possible, in order to recall the applicant's responses.
- An accurate record of what the applicant said or did, not the interviewer's inferences or judgements.
An explicit conclusion should be provided at the end of the interview. Keeping in mind that the interview is a recruitment tool, the lead interviewer should effectively conclude the interview by:
- Providing a clear signal of the end of the interview.
- Providing an opportunity for the applicant to ask questions.
- Explaining the next steps in the appointment process and the approximate time frame.
- Collecting the interview questions and notes from the applicant before he or she leaves the interview room.
- Offering closing remarks, thanking the applicant for participating in the interview, answering any general questions and escorting the applicant out of the room.
The interview questions and related documents, as well as the applicant's responses and other information, are protected materials and should be handled and stored according to departmental/agency guidelines.
- Consider having one interview board member greet and brief the applicant in a private area outside of the interview room. The applicant then has an opportunity to ask any questions in a more relaxed setting.
- Consider allowing applicants to answer the questions in the order they would prefer; it may assist in making them more comfortable with the process.
- Stick to the structured interview format. Providing introductions, asking questions, probing or asking follow-up questions and closing the interview should be done the same way for all applicants.
- When asking questions, look for "I", as you want to know what the applicant did, even when working in a group. Look as well for clear actions and specific situations.
- Watch for "we, our, the team", vague actions, typical or general situations (for behavioural questions) and probe or redirect as needed.
- Be flexible about the degree and amount of probing, restating, rephrasing, paraphrasing and revisiting questions, since initial responses vary among applicants. Some applicants may need little or no prompting, while others may need more. The key here is to ensure that each applicant has had a fair opportunity to demonstrate their qualifications; this does not mean that you have to stick to a rigid script.
- Take detailed behavioural notes on answers, observations, and concrete facts – not judgements.
- Do not assess the responses during the interview.
After the interview, the board is ready to arrive at ratings on the job qualifications for each applicant. To accomplish this task, board members will need their completed Interview Note-taking Bookletand theInterview Assessment Booklet, which include the rating scheme in relation to the qualifications assessed (see Appendices A and B for examples of these booklets).
The results obtained from interviews should be carefully evaluated in order to accurately assess the qualifications required and to minimize personal bias. This evaluation involves a sequence of key steps beginning with individual assessments by members of the interview board, followed by an assessment based on a group consensus. The integration of the interview results, along with other obtained information concludes the appointment process. In addition, the interview board may be involved in informal discussion or in providing feedback to the applicant. In this section, guidance is offered on each of these key components.
It is recommended that board members assign independent ratings for each applicant shortly after their interview, in order to better remember the applicant's performance and not to be influenced by the opinions of other members. Each of the interview questions is typically designed to assess one main qualification. However, if more than one question is asked for a qualification, each board member will need to review the applicant's responses across questions and come up with a single rating for that qualification.
Board members may observe that an applicant's response to a question targeting one qualification also provides behavioural evidence for another. If this is the case, all of the behavioural evidence provided should be used, even if it appears in responses to questions targeting other qualifications. As a result, the information provided by the applicant is used optimally.
Using the rating scale: Board members may choose from a variety of rating scales when evaluating job qualifications (see Section Two - Developing an Assessment Booklet). Whichever scale is applied, evaluations must be based on the behavioural evidence collected for each qualification. This evaluation will require a thorough understanding of the qualification definitions and behavioural indicators prior to assigning any ratings. With this information, the board should be in a position to assess each applicant's responses according to:
- The scope of behaviours and extent to which the behavioural indicators for a qualification were demonstrated in an applicant's responses (e. g. quantity and consistency); and
- The depth to which the observed behaviours were demonstrated during the interview (e. g. degree of complexity, soundness and precision).
With one member of the board chairing the discussion, consensus is reached on the assessment of the applicant's performance. Reaching consensus as a group has been found to be more valid than other methods 31-32. Assessment by consensus causes interviewers to explain their ratings to their peers, resulting in more accurate evaluations. The fact that board members agree on the rating given and that they have all seen the applicant demonstrate the behaviours both contribute to the rigour of the process. The board has to justify the rating based on concrete observations.
To reach consensus, going through the following seven steps is recommended. Note that the interview board must assign a single group evaluation for each qualification.
Step 1 - All members of the board review the definition of the first qualification to be assessed and its behavioural indicators.
Step 2 - Board members independently review their notes and determine which of the behavioural indicators associated with the qualification under review were demonstrated in the interview. They should record examples of the applicant's demonstration of the behavioural indicators that reflect the scope and depth of their performance across the interview.
Step 3 - Each board member independently assesses the applicant on the qualification, using an appropriate rating scale.
Step 4 - The board members then discuss their individual assessments of the qualification and determine a group evaluation for the applicant. This discussion continues until a consensus is reached.
Step 5 - The chair ensures that the final consensus evaluation is recorded. The rationale for the evaluation is also recorded; examples of the behaviours that the applicant demonstrated and the scope and depth to which the behaviours were demonstrated, should be provided.
Step 6 - Having reached consensus on the first qualification, the board then proceeds to assess the remaining qualifications, in turn.
Step 7 - The final consensus assessment, along with notes for the rationale, and interview board notes, are kept in the applicant's file.
The priority entitlements within the PSER are referred to as “regulatory priorities”. Persons with a regulatory priority are appointed after persons with a statutory priority, but in no relative order.
- Surplus employees: Employees from other organizations who have been advised by their deputy head that their services are no longer required, but before any lay-off becomes effective (PSER, section 5);
- Note: Within their own organization, a surplus employee has a statutory priority entitlement under the PSEA, section 40.
- Employees who become disabled: Employees who become disabled and who, as a result of the disability, are no longer able to carry out the duties of their position (PSER, section 7);
- RCMP members: Certain members discharged for medical reasons (PSER, section 7.1);
- CAF members: Certain members released for medical reasons not attributable to service (PSER, section 8.) Only members of the regular force, the special force, the reserve force on Class B service of 180 days or more or on Class C reserve service are eligible.
- Relocation of spouse or common-law partner: Indeterminate employees who have been granted leave for such relocations, whose positions have not been staffed indeterminately (PSER, section 9);
- Reinstatement: Certain persons with a priority entitlement who were appointed or deployed to a position in the public service at a lower level (PSER, section 10); and
- Surviving Spouse or Common-law Partner: Surviving spouses or common-law partners of persons employed in the public service, the CAF or the RCMP, whose death is attributable to the performance of duties (PSER, section 8.1).
The PSC Assessment Policy requires that deputy heads and their delegates ensure that "the assessment is designed and implemented without bias, political influence or personal favoritism and does not create systemic barriers". Therefore, in their evaluations, members of the board must make every effort possible to minimize the potential for assessment errors and personal biases. Although assessment involves judgment, there are ways to minimize this subjectivity and to maximize objectivity throughout the process.
The success and value of the interview relies on the quality of the assessment process. Assessment errors occur when an assessor's evaluation is influenced by something other than the information provided by the applicant during the interview.
Here is a list of common assessment errors, with suggestions on how to minimize these errors. It is intended to help board members recognize and guard against them when assessing applicants, thereby maximizing accuracy, consistency, and fairness.
First impressions: This is the tendency to let a first impression influence the assessment of the applicant's responses. Interviewers must be aware that they may unconsciously judge an applicant positively or negatively from the outset, which may result in them assessing the applicant according to their own beliefs, rather than according to the applicant's true performance on the qualifications being assessed.
Leniency and stringency: These errors involve the general tendencies for the interviewer to consistently assess applicants high (leniency effect) or low (stringency effect). Board members need to be aware that they might have a different understanding of the requirement for the job, and the qualifications assessed and that they need to be fair in assessing applicants.
Central tendency: In this case, interviewers may be reluctant to rate applicants high or low, and end up rating all applicants as average. The middle points on the rating scale are used, while avoiding the extreme points.
"Halo" and "horn" effects: These errors involve the tendency to allow one good (halo) or bad (horn) response to influence the evaluation of all other responses of an applicant. Board members need to monitor themselves when they are so impressed by an applicant on one qualification that they attribute positive qualities for all other criteria assessed, regardless of the evidence. Conversely, when an applicant does poorly in one area, they may be under-rated in others.
Contrast effect: This is the tendency to assess an applicant in comparison to the performance of a previous applicant instead of using the rating scale and expected behaviours. Board members have to be aware that they might encounter applicants who will stand out, positively or negatively, and that subsequent applicants may be under or over-assessed as a result. In such cases, board members must not compare applicants, but focus on evaluating each applicant on the qualifications being assessed.
Fatigue: As assessors become fatigued during a lengthy interviewing process, they can become less consistent or less stringent in their note-taking, listening, or application of the assessment criteria.
Stereotypes: This error occurs when an interviewer's own personal biases and preconceptions of a good employee influence the evaluation. Stereotyping is often based on demographics such as sex, race, ethnicity, or age, but can also involve other variables such as degree of education, politics, or interests. Board members must be aware that their personal beliefs and perceptions of what is needed for the job may impact their evaluations of applicants.
Similar-to-me: This error occurs when an applicant is given more favourable evaluations than warranted because of a similarity to the interviewer in some way (e. g. race, sex, age, attitudes or background). The reverse, dissimilar-to-me, can also occur where an applicant is given less favourable evaluations than warranted, because of perceived differences.
Interviews are not usually the only source of information about an applicant. Customarily, there is the applicant's résumé, which will include information about previous work experience and educational background. Information may also be collected through additional assessment instruments or methods such as work samples, simulations, assessment centres, written tests, career achievement records or reference checks. When collecting information from various sources, it is important to combine the information systematically in order to arrive at a final appointment decision. Otherwise, even when using valid selection instruments, combining the information haphazardly may result in poor, inconsistent decision-making.
If several methods are used to assess a qualification, it is advisable to collect the relevant information from all sources and to then make one overall assessment. This approach involves combining information from different sources to evaluate applicants and then determining which ones meet the qualifications. For example, all the information gathered in an interview with respect to a given qualification can be combined with relevant information elicited from a reference check. This information can then be integrated into a single overall evaluation, determining whether or not the applicant meets or does not meet that qualification.
Under the PSEA, informal discussion provides one mechanism through which applicants, who are eliminated from consideration for an appointment, may discuss the reasons for the decision with the hiring manager. For instance, applicants may request feedback from a hiring manager on their performance in a structured interview. Should an applicant request feedback, consideration needs to be given as to what information will be shared and how feedback will be given. For information on the informal discussion process, please refer to the Policy on Informal Discussion and the Guide to Implementing the Informal Discussion Policy.
Applicants should be able to discuss any information pertaining to their candidacy that would help them understand the decision for elimination. Participants in an informal discussion would normally have access to any personal information gathered in the appointment process. This information could include any factors that were taken into account, including the merit criteria used, how the assessment was carried out and the evaluation of that person. The information provided should relate only to the applicant who is no longer being considered for appointment. Personal information about other applicants must not be disclosed in the informal discussion.
Consideration must also be given to protecting proprietary information, such as standardized tests and structured interviews. Any disclosure of information would have to respect the Privacy Act, the Access to Information Act and the Public Service Employment Regulations (PSER) established by the PSC concerning the disclosure of information obtained during the course of investigation. Any request for access to or copies of the structured interview and how it is scored could be refused if it could compromise the integrity of the assessment or provide an unfair advantage. It is important to discuss any such request with a Human Resources (HR) advisor before the informal discussion takes place.
If an applicant requests feedback on their performance in a structured interview once all the interviews have been completed, and if the interview questions will not be used again, then any information on the applicant's performance may be shared. This information could include any of the following:
- Documents submitted by the applicant;
- The interview questions;
- Interviewers' notes;
- The qualifications and behavioural indicators assessed;
- The assessment criteria; and
- The results of the assessment of the applicant's qualifications.
However, if interviews are ongoing or the questions are to be used again, the interview may qualify as a standardized test. A standardized test is a systematic procedure for assessing an individual's behaviour in order to evaluate job-relevant qualifications. The procedure is systematic in five areas: development, content, administration, scoring, and communication of results. The content of the test is the same for all test-takers. The test is administered according to standard instructions and procedures and is scored according to a set protocol. Standardized test information should not be disclosed if doing so will affect the validity or the continued use of the test or if it will provide an unfair advantage to any applicants.
As per the PSER, "the Commission shall not disclose a standardized test, or information concerning a standardized test, owned by an organization or the Commission or that is commercially available, if obtained in the course of an investigation under the Act, unless it can be disclosed, with or without conditions set by the Commission, in a manner that will not affect the validity or continued use of the standardized test or will not affect the results of such a test by giving an unfair advantage to any person. " This statement does not necessarily mean that standardized tests are exempt from disclosure, but essentially requires that any disclosure must take place only under conditions that ensure that the disclosure will not affect the validity or continued use of the test.
In this situation, any feedback provided to applicants should be done without reference to the protected content of the interview (e. g. the behavioural indicators assessed or the Interview Assessment Booklet). It is best to outline the qualifications assessed and to speak in general terms about the applicant's performance on the qualifications. Do not discuss the specifics of the interview questions, the applicant's responses to specific questions or the assessment of their responses to the questions.
Assigning independent ratings
- Assign independent ratings immediately after the interview.
- Assess the qualifications separately.
- Consistently and continually apply your assessment procedures for all applicants. If you realize that your assessments have changed along the way, review previous assessments in light of the new information and adjust accordingly.
- Apply the rating scale as intended, by using its full range.
- Be aware of, and minimize, common errors and biases that may influence your judgement.
- Consider the quality of the provided information, especially if you suspect that the applicant is not being entirely frank or if there is inconsistent information.
- Try not to place undue weight on isolated incidents. Rather, look for overall patterns in the evidence. Also consider the possibility that the applicant's performance may have been influenced by situational factors.
Arriving at the final board assessment
- Discuss the assessment as a group and question each other's individual assessments.
- Consistently base your assessments on information related to the job qualifications and assessed behavioural indicators.
- Sometimes, evidence of personal conflicts between a board member and an applicant can affect how information is perceived. If you become aware of such conflicts, weigh that information carefully and evaluate the likelihood of such conflicts recurring.
Integrating information from multiple sources
- Ensure that the pattern of evidence and behaviour is consistent across assessment methods (e. g. application, résumé, interview, reference check).
- If negative information is uncovered, consider the source and verify the accuracy with other sources of information before making a decision about the applicant.
- If information is conflicting, continue checking until you are satisfied that a pattern is evident.
Giving feedback
- Review the documentation regarding the person who was eliminated from consideration.
- Explain the decision relative to the candidate's application and provide information that will assist the person in understanding the decision.
- Stay focussed on what is relevant to the discussion: the requirements of the position, the merit criteria, how you assessed the qualifications, and why the person was eliminated.
- Listen to the person and provide an opportunity for them to explain any concerns and present any supporting information.
- Maintain a non-defensive and non-confrontational manner throughout the discussion.
- Seek assistance if the issue is beyond what you are comfortable dealing with or if the discussion goes beyond the decision to eliminate the person from the appointment process.
- Demonstrate a willingness to review a decision if an error was made.
- Resolve issues, or at the very least, ensure that there is an understanding of the decision.
- Consider deferring a contentious discussion to allow time to reflect and to address the issue at a later time, with assistance if necessary.
Once you have completed an appointment process, it is important to review and evaluate the structured interview process and its outcomes to identify strengths and areas for improvement. This review is especially important if it will be used for future assessments. By evaluating the interview process, you can determine how it may need to be adapted to ensure that it continues to fulfill your organization's requirements, thereby resulting in effective hiring decisions.
The following is a list of questions to help evaluate your structured interview:
- Is the interview successful at predicting success on the job?
- Do the interview questions make useful job-related distinctions among applicants?
- How are applicants performing on the interview? Are different groups performing differently?
- How do applicants perceive the interview (e. g. job relevance, fairness)?
- How influential are the results of the interview in the final hiring decision?
- Are interviewers comfortable with the interview questions and process?
- Are interviewers applying the rating scales consistently?
Asking these questions and acting on the answers will help to ensure that the structured interview remains relevant, useful, and legally defensible.
As part of the review, you may want to collect applicant and interviewer reactions to the structured interview. For example, a survey can be used to assess applicants' reactions following the interview. Such a survey can assess applicants' perceptions of the service they received (e. g. the professionalism of the interview board), the content of the interview questions, the interview process, and the perceived fairness of the process.
An applicant reaction survey, with a rating scale, may be designed so that the collected data can be analyzed and interpreted easily. The meaning of each point on the scale must be clear to ensure you collect accurate data. You may wish to include a neutral response option on your rating scale. You may also need to include a "don't know" response option if there is a chance respondents might select a neutral response when they really don't know the answer. An example of an Applicant Reaction Questionnaire is provided in Appendix E.
The process outlined previously is not intended to be a formal validation of the structured interview. A validation study is a rigorous statistical analysis of the interview and its outcomes in order to demonstrate that it measures job-related criteria and predicts job performance. A validation study can also assess the success and failure rates of an organization's hiring decisions. Furthermore, by scientifically identifying the factors that predict job success and eliminating those that do not, validation studies can help improve organizational decision-making.
Formal validation may not be feasible or cost-effective for low-volume jobs. However, organizations should seriously consider validating their structured interviews for high-volume jobs where the cost of validation will be more than justified by the increased validity and defensibility of the interview. In fact, HR practitioners are increasingly realizing the need for validation studies, because linking interview results to job performance promotes both merit and equity in the hiring process.
Validating a structured interview involves analyzing the relationship between scores on the structured interview, and outcome measures such as job and training performance and job tenure. Therefore, conducting a validation study of a structured interview requires that information be collected on some or all of these outcome measures.
Note: This document is available on-line in PDF and RTF formats only. If you require an alternative format, please contact 819-420-8671 or CFP.CPP-PPC.PSC@cfp-psc.gc.ca for assistance. Please visit our help page for assistance with PDFs.
The PSC's Personnel Psychology Centre is a valuable resource to consider when designing and conducting structured interviews.
To learn more about best practices in structured interviewing , please consult the Websites of the following professional associations:
- Human Resources Professionals Association of Ontario (HRPAO) is an internationally recognized membership association for HR practitioners. With over 16,000 members in 28 chapters in Ontario and around the world, HRPAO offers a range of HR information resources, professional development and networking opportunities.
- La Société Québécoise de Psychologie du Travail et des Organisations (SQPTO) is the principal collective of psychologists in Québec, who practice organizational psychology, including areas of staffing and personnel assessment. The SQPTO is a valuable source of information about the latest trends in work psychology and other related areas.
- The Society for Human Resource Management (SHRM) is the membership organization for private-sector HR specialists. SHRM is a key source of information about trends in hiring practices outside the public sector.
- L'Ordre des conseillers en ressources humaines agrées et des conseillers en relations industrielles agrées du Québec (ORHRI) is a source of highly-relevant reference material in the areas of HR management and industrial relations in Québec. The ORHRI promotes the development of HR professionals by offering information and educational services, a training program, online reference tools and an HR publication.
- The Society for Industrial and Organizational Psychology (SIOP) is the primary membership organization for psychologists who specialize in personnel selection. SIOP is a good source of information about the most recent research on the validity of assessment tools and techniques.
Below is some additional reading material on structured interviews:
- Eder, R. W. , & Harris, M. M. (1999). The Employment Interview Handbook. Sage Publications, Thousand Oaks, California.
- Gatewood, R. D, & Field, H. S. (2001). Human Resource Selection. Harcourt College Publishers, Fort Worth. See Chapter 12 "The Selection Interview", page 521-566.
- Pettersen, N. J. et Durivage, A. (2006). L'entrevue structurée :pour améliorer la sélection du personnel. Québec. Presses de l'Université du Québec.
- U. S. Merit Systems Protection Board (2003). The Federal Selection Interview: Unrealized Potential.
- British Columbia Public Service Agency (2007). Managers' HR Toolkit.
Any Feedback?
The priority entitlements within the PSER are referred to as “regulatory priorities”. Persons with a regulatory priority are appointed after persons with a statutory priority, but in no relative order.
- Surplus employees: Employees from other organizations who have been advised by their deputy head that their services are no longer required, but before any lay-off becomes effective (PSER, section 5);
- Note: Within their own organization, a surplus employee has a statutory priority entitlement under the PSEA, section 40.
- Employees who become disabled: Employees who become disabled and who, as a result of the disability, are no longer able to carry out the duties of their position (PSER, section 7);
- RCMP members: Certain members discharged for medical reasons (PSER, section 7.1);
- CAF members: Certain members released for medical reasons not attributable to service (PSER, section 8.) Only members of the regular force, the special force, the reserve force on Class B service of 180 days or more or on Class C reserve service are eligible.
- Relocation of spouse or common-law partner: Indeterminate employees who have been granted leave for such relocations, whose positions have not been staffed indeterminately (PSER, section 9);
- Reinstatement: Certain persons with a priority entitlement who were appointed or deployed to a position in the public service at a lower level (PSER, section 10); and
- Surviving Spouse or Common-law Partner: Surviving spouses or common-law partners of persons employed in the public service, the CAF or the RCMP, whose death is attributable to the performance of duties (PSER, section 8.1).
A key objective of the Assessment Oversight Division of the PSC is to provide system-wide, merit-sensitive assessment tools, as well as guidance and advice related to personnel assessment in the public service. We would like your feedback on this Guide. If you have any suggestions as to how the document can be improved to reflect the needs of hiring organizations in the federal public service, please send these comments to: CFP.DEP-PDD.PSC@cfp-psc.gc.ca
Appendices
- Appendix A: Sample Interview Note-Taking Booklet (PDF 32 Kb) (RTF 1.07 Mb)
- Appendix B: Sample Interview Assessment Booklet (PDF 54 Kb) (RTF 1.26 Mb)
- Appendix C: Structured Interviewing - Summary Check List (PDF 38 Kb) (RTF 1.06 Mb)
- Appendix D:Applicant Reaction Questionnaire (PDF 16 Kb) (RTF 1.10 Mb)
- Appendix E: Abbreviated Interview Board guide (PDF 415 Kb) (RTF 5.32 Mb)
- Appendix F: Train-the-Trainer Presentation (PDF 127 Kb) (RTF 2.75 Mb)
Note: This document is available online in PDF format only. If you require an alternative format, please contact 819-420-8671 or CFP.DEP-PDD.PSC@cfp-psc.gc.ca for assistance. Please visit our help page for assistance with PDFs.
- McDaniel, M. A., Whetzel, D. L., Schmidt, F. L., & Maurer, S. D. (1994). The validity of employment interviews: A Comprehensive Review and Meta-Analysis. Journal of Applied Psychology, 79, 599-616. [Return]
- Weisner, W. H. & Cronshaw, S. F. (1988). A meta-analytic investigation of the impact of interview format and degree of structure on the validity of the employment interview. Journal of Occupational Psychology, 61, 275-290. [Return]
- Morrow, P. C. (1990). Physical attractiveness and selection decision making. Journal of Management, 16, 45-60. [Return]
- Dipboye, R. L. (1992). Selection Interviews: Process Perspectives. South-Western Educational Publishing, Cincinnati, Ohio.[Return]
- Graves, L. & Powell, G. (1996). Sex similarity, quality of the employment interview and recruiters' evaluation of actual applicants. Journal of Occupational and Organizational Psychology, 69, 243-261.[Return]
- Prewett-Livingston, A., Feild, H. S., Veres, J. G., & Lewis, P. M. (1984). Effects of race on interview ratings in a situational panel interview. Journal of Applied Psychology, 81, 178-186. [Return]
- Ulrich, L., & Trumbo, D. (1965). The selection interview since 1949. Psychological Bulletin, 63, 100-116.[Return]
- Schmitt, N. (1976). Social and situational determinants of interview decisions: Implications for the employment interview. Personnel Psychology, 29, 79-101. [Return]
- Williamson, L. G., Campion, J. E., Malos, S. B., Roehling, M. V., & Campion, M. A. (1997). Employment interview on trial: Linking interview structure with litigation outcomes. Journal of Applied Psychology, 82(6), 900-912.[Return]
- Terpstra, D. A., Mohamed, A. A., Kethley R. B. (1999). An analysis of federal court cases involving nine selection devices. International Journal of Selection and Assessment, 7(1), 26-34. [Return]
- McDaniel, M. A., Whetzel, D. L., Schmidt, F. L., & Maurer, S. D. (1994). The validity of employment interviews: A comprehensive review and meta-analysis. Journal of Applied Psychology, 79, 599-616. [Return]
- Lin, T., Dobbins, G. H., & Farh, J. (1992). A field study of race and age similarity effects on interview ratings in conventional and situational interviews. Journal of Applied Psychology, 77(3), 363-371. [Return]
- Howard, J. L., & Ferris, G. R. (1996). The employment interview context: Social and situational influences on interviewer decisions. Journal of Applied Social Psychology, 26 (2), 112–136. [Return]
- Kohn, L. S., & Dipboye, R. L. (1998). The effects of interview structure on recruiting outcomes. Journal of Applied Social Psychology, 28, 821-843. [Return]
- Schmitt, N., & Coyle, B. W. (1979). Applicant decisions in the employment interview. Journal of Applied Psychology, 61, 184-192. [Return]
- Pettersen, N.J. et Durivage A. (2006). L'entrevue structurée: pour améliorer la sélection du personnel. Québec. Presses de l'Université du Québec. [Return]
- Huffcutt, A. I., Conway, J. M., Roth, P. L., & Stone, N. J. (2001). Identification and meta-analytic assessment of psychological constructs measured in employment interviews. Journal of Applied Psychology, 86(5), 897-913. [Return]
- Ulrich, L., & Trumbo, D. (1965). The selection interview since 1949. Psychological Bulletin, 63, 100-116. [Return]
- Gatewood, R. D., & Field, H. S. (2001). Human Resource Selection. Harcourt College Publishers (p. 534).[Return]
- Huffcutt, A. I., Conway, J. M., Roth, P. L., & Stone, N. J. (2001). Identification and meta-analytic assessment of psychological constructs measured in employment interviews. Journal of Applied Psychology, 86(5), 897-913. [Return]
- Maurer, S. D. (2002). A practitioner-based analysis of interviewer job expertise and scale format as contextual factors in situational interviews. Personnel Psychology, 55(2), 307-327. [Return]
- Sue-Chan, C., & Latham, G. P. (2004). The situational interview as a predictor of academic and team performance: A study of the mediating effects of cognitive ability and emotional intelligence. International Journal of Selection and Assessment 12 (4), 312–320. [Return]
- Pulakos, E. D., & Schmitt, N. (1995). Experience-based and situational interview questions: Studies of validity. Personnel Psychology, 48, 289-308. [Return]
- Bosshardt, M. J. (1992). Situational interviews versus behavior description interviews: A comparative validity study. Unpublished doctoral dissertation, University of Minnesota, USA. [Return]
- Pulakos, E. D., & Schmitt, N. (1995). Experienced-based and situational interview questions: Studies of validity. Personnel Psychology, 48, 289-308.[Return]
- Huffcutt, A. I., Conway, J. M., Roth, P. L., & Stone, N. J. (2001). Identification and meta-analytic assessment of psychological constructs measured in employment interviews. Journal of Applied Psychology, 86(5), 897-913.[Return]
- Pettersen, N.J. et Durivage A. (2006). L'entrevue structurée: pour améliorer la sélection du personnel. Québec. Presses de l'Université du Québec.
[Return] - Carlson, R. E. (1967). Selection interview decisions: The effect of interviewer experience, relative quota situation, and applicant sample on interviewer decisions. Personnel Psychology, 20(3), 259-280.[Return]
- Jacobs, R., & Baratta, J.E. (1989). Tools for staffing decisions: What can they do? What do they cost? In W.F. Cascio (Ed.), Human Resource Planning, Employment and Placement. Washington, DC: Bureau of National Affairs. [Return]
- Middendorf, C. H., & Macan, T. H. (2002). Note-taking in the employment interview: Effects on recall and judgments. Journal of Applied Psychology, 87(2), 293-303. [Return]
- Pulakos, E. D. Schmitt, N., Whitney, D., & Smith, M. (1996). Individual differences in interview ratings: The impact of standardization, consensus discussion, and sampling error of a structured interview. Personnel Psychology, 49, 85-103. [Return]
- Wiesner, W. H., & Cronshaw, S. F. (1988). A meta-analytic investigation of the impact of interview format and degree of structure on the validity of the employment interview. Journal of Occupational Psychology, 61, 275-290.[Return]
Page details
- Date modified: