{"id":3606,"date":"2013-03-19T12:34:03","date_gmt":"2013-03-19T11:34:03","guid":{"rendered":"http:\/\/www.viasto.com\/en\/?post_type=post&p=3606"},"modified":"2020-01-30T10:18:22","modified_gmt":"2020-01-30T08:18:22","slug":"study-results-for-professional-aptitude-testing-asynchronous-video-interviews-more-reliable-and-objective-than-cv-screening","status":"publish","type":"post","link":"https:\/\/www.viasto.com\/en\/blog\/study-results-for-professional-aptitude-testing-asynchronous-video-interviews-more-reliable-and-objective-than-cv-screening\/","title":{"rendered":"Video interviews more objective than CV- Screening"},"content":{"rendered":"

The latest viasto study investigated the reliability and objectivity of decisions based on asynchronous video interviews. The result: a candidate\u2019s aptitude is assessed more reliably with asynchronous video interviews than it is with CV-screening. Hence, the interview suite<\/em> offers crucial quality advantages in the early stages of the recruiting process.<\/p>\n

<\/p>\n

In today\u2019s \u201cwar for talent\u201d, it is necessary to use selection methods and instruments that produce reliable and objective results. The results have to enable an objective assessment of a candidate\u2019s aptitude that is independent of the evaluators (HR and hiring departments). It should make no difference whether Ms. Smith or Mr. Roberts evaluates the candidate \u2013 the result has to be the same. Only a selection method that produces objective results, leads to correct hiring decisions. This is the only way in which the best candidates can be identified and selected. With increasing pressure on HR departments to make the quality of their work measurable within the organization, Key Performance Indicators (KPIs) are increasingly in focus. This leads to the question: How reliable are the selection instruments currently in use?<\/p>\n

The study: comparison of asynchronous video interviews and CV-screening<\/h6>\n

The objectivity and reliability of CV-screenings and asynchronous video interviews in personnel selection was assessed in a study with more than 130 participants. Participants were asked to judge whether or not the candiate was suitable for an advertised job on the basis of a candidate\u2019s CV and a candidate\u2019s answers in an 8-minute asynchronous video interview. The participants were shown the CV or the video interview, and asked to evaluate whether they would invite the candidate to next round of recruiting steps (e.g. \u201cI would invite the candidate to a face-to-face interview.\u201d). Furthermore, the participants evaluated the candidate\u2019s performance on competencies like \u201cmotivation to perform\u201d, \u201cteam spirit\u201d and \u201ccommunication skills\u201d. The quality of those decisions was assessed in the study. In professional aptitude testing, quality of decisions is described by calculating the inter-rater agreement. The higher the agreement between the evaluators concerning the candidate\u2019s aptitude, the more objective and reliable the considered selection method is (see infobox). In analyzing the results, CV-screening and asynchronous video interviews were directly compared: Which method has the higher inter-rater- agreement? Which method is therefore more suitable to assess a candidate\u2019s aptitude and competencies reliably?<\/p>\n\n\n\n
\n
\n

INFOBOX<\/strong><\/p>\n

Inter-rater reliability is calculated by the extent of agreement that a set of independent evaluators reach concerning the aptitude of a candidate. In psychologist-jargon: an intraclass correlation was determined as a reliability coefficient. Should all the evaluators assess the candidate\u2019s aptitude to be exactly the same, the agreement reaches a value of 1. With such a perfect inter-rater agreement, the candidate\u2019s aptitude is assessed faultlessly and at maximum accuracy and it doesn\u2019t matter who is evaluating the candidate. In this case, the results of the selection method are objective and independent of the involved evaluators. If the inter-rater agreement is close to 0, the selection method cannot lead to reliable and valid decisions. The evaluations would be exclusively and subjectively dependent on the evaluators people and would not show the \u201ctrue\u201d aptitude of the candidate.<\/em><\/p>\n<\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

Overview of the results<\/strong><\/h6>\n
    \n
  1. Candidates’ competencies are reliably assessed based on asynchronous video interviews<\/li>\n
  2. Asynchronous video interviews are more reliable and objective than CV-screening<\/li>\n
  3. Hiring decisions based on asynchronous video interviews are fair<\/li>\n
  4. A set of different candidate\u2019s competencies can be assessed clearly and selectively<\/li>\n<\/ol>\n
    Result 1: Candidate\u2019s competencies are reliably assessed based on asynchronous video interviews<\/strong><\/h6>\n

    Candidate’s competencies can be assessed more clearly, unambiguously and objectively with an asynchronous video interview. Based on the competency definitions provided below the video answers, the participants assessed the candidates faultlessly and made the correct decisions for their organization. With an inter-rater agreement of 0.91 (as a reminder: 0 = arbitrary assessment, 1 = perfect agreement), an outstanding quality of decisions was achieved. According to scientific guidelines inter-rater agreements of 0.60 are already regarded as satisfactory (Obermann, 2009). In comparison: structured face-to-face selection interviews achieve an inter-rater agreement of 0.70 on average (Conway, Jako & Goodman, 1995; Wiesner & Cronshaw, 2011).<\/p>\n

    Result 2: Asynchronous video interviews are more reliable and objective than CV-screening<\/strong><\/h6>\n

    The results showed that the same study participants, who reached a very high agreement concerning the video interviews, assessed the CV (every participant assessed the same CV in relation to the same job advertisement) with a very low agreement. Statistical testing showed that the assessment of a candidate\u2019s aptitude was significantly more precise in the video interview than in the CV screening. This means: If decisions in personnel selection are based on asynchronous video interviews, they are reliable. Suitable candidates are invited and unsuitable candidates are filtered out early in the recruiting process. As a result, candidate\u2019s aptitude is always assessed in exactly the same manner, no matter who evaluates the video sequences. The method itself guarantees good quality decisions, irregardless of who carries out the assessment.<\/p>\n

    Result 3: Hiring decisions based on asynchronous video interviews are fair<\/strong><\/h6>\n

    One attribute that often endangers diagnostically valuable decisions is the candidate\u2019s physical attractiveness. When evaluating a candidate\u2019s aptitude based on video interviews, the study participants were not biased by the attractiveness of the participant being evaluated. Participants who described the candidate as attractive evaluated the candidate\u2019s aptitude just as reliably as participants who described the candidate as unattractive. This was a further indicator of the high objectivity of asynchronous video interviews. Since the General Anti-Discrimination Act was published in 2006, personnel selection in German organizations has to be proven to be free of discrimination whatsoever. The decision of whether an applicant is invited to further recruiting steps or hired, cannot at any point in the process, be biased by his or her physical appearance, age or gender. Evaluators are allowed to take into account is the candidate\u2019s objective aptitude for the job. This is exactly what happens in asynchronous video interviews.When evaluating the CV, however, the study participant\u2019s evaluation were biased by the candidate\u2019s attractiveness, visible in the photo on top of the CV. The aptitude of exactly the same candidate was rated higher by participants who perceived the candidate as highly attractive, compared to participants who perceived the candidate to be unattractive. \u201cThe more attractive, the more suitable\u201d was the implicit but wrong attitude of the participants when it came to evaluating the CV.<\/p>\n

    Result 4: Different candidate competencies can be assessed clearly and selectively<\/strong><\/h6>\n

    Study participants were able to distinguish clearly between the different competencies they were asked to evaluate in the video sequences. Competencies like \u201cteam spirit\u201d, \u201canalytical thinking\u201d or \u201ccompetence in a foreign language\u201d could be directly and unambiguously observed in the video interview. The competency-based evaluation process of the video interview makes it easy to display complex competency profiles of candidates \u2013 a prerequisite for making sound hiring decisions. In order to evaluate a candidate\u2019s fit to the job and the organization, hiring managers want to increasingly have a more valid impression of a candidate\u2019s abilities and skills at an early stage of the recruitment process. With asynchronous video interviews, this assessment of distinct competencies is already available during the first screening processes.<\/p>\n

    Summary<\/h6>\n

    The results show that asynchronous video interviews, allow those involved in the recruiting process to make more reliable and objective decisions concerning a candidate\u2019s aptitude. The distinct evaluation of various competencies enables sound assessment of the candidate\u2019s fit to both the job requirements and organization\u2019s culture. By integrating the interview suite<\/em>, organizations can ensure the crucial quality advantages at an early stage of the selection process.<\/p>\n","protected":false},"excerpt":{"rendered":"

    The latest viasto study investigated the reliability and objectivity of decisions based on asynchronous video interviews. The result: a candidate\u2019s aptitude is assessed more reliably with asynchronous video interviews than it is with CV-screening. Hence, the interview suite offers crucial quality advantages in the early stages of the recruiting process.<\/p>\n","protected":false},"author":9,"featured_media":7624,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"yoast_head":"\nStudy: Asynchronous video interviews more reliable and objective than CV- Screening | viaso<\/title>\n<meta name=\"description\" content=\"Candidate\u2019s aptitude is assessed more reliably with asynchronous video interviews than it is with CV-Screening.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.viasto.com\/en\/blog\/study-results-for-professional-aptitude-testing-asynchronous-video-interviews-more-reliable-and-objective-than-cv-screening\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Study: Asynchronous video interviews more reliable and objective than CV- Screening | viaso\" \/>\n<meta property=\"og:description\" content=\"Candidate\u2019s aptitude is assessed more reliably with asynchronous video interviews than it is with CV-Screening.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.viasto.com\/en\/blog\/study-results-for-professional-aptitude-testing-asynchronous-video-interviews-more-reliable-and-objective-than-cv-screening\/\" \/>\n<meta property=\"og:site_name\" content=\"interview suite\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/viasto\/\" \/>\n<meta property=\"article:published_time\" content=\"2013-03-19T11:34:03+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-01-30T08:18:22+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.viasto.com\/en\/wp-content\/uploads\/2013\/03\/image203.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"800\" \/>\n\t<meta property=\"og:image:height\" content=\"533\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@viasto\" \/>\n<meta name=\"twitter:site\" content=\"@viasto\" \/>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"https:\/\/www.viasto.com\/en\/wp-json\/wp\/v2\/posts\/3606"}],"collection":[{"href":"https:\/\/www.viasto.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.viasto.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.viasto.com\/en\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/www.viasto.com\/en\/wp-json\/wp\/v2\/comments?post=3606"}],"version-history":[{"count":1,"href":"https:\/\/www.viasto.com\/en\/wp-json\/wp\/v2\/posts\/3606\/revisions"}],"predecessor-version":[{"id":14883,"href":"https:\/\/www.viasto.com\/en\/wp-json\/wp\/v2\/posts\/3606\/revisions\/14883"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.viasto.com\/en\/wp-json\/wp\/v2\/media\/7624"}],"wp:attachment":[{"href":"https:\/\/www.viasto.com\/en\/wp-json\/wp\/v2\/media?parent=3606"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.viasto.com\/en\/wp-json\/wp\/v2\/categories?post=3606"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.viasto.com\/en\/wp-json\/wp\/v2\/tags?post=3606"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}