Overview
This feature helps users to identify the suspicious behavior of candidates by monitoring a candidate’s webcam activity during the test duration. Through this, you can identify, review, and eliminate possible cases of cheating, allowing you to quickly move to the next steps in the hiring process.
The captured images will be categorized under different sections based on the category under which an image is flagged by the Image Analysis solution. Five images will be displayed under each section for a quick preview of the suspicious activity.
Enabling Image Analysis
Image Analysis is turned off by default. You can enable the feature after consulting with your team.
- Under Image Proctoring, turn on the Image Analysis toggle.
- You can click on the help icon to view the related support article.
- You can also view the HackerRank NYC laws for AI.
- Additionally, HackerRank's AI-powered plagiarism solution has gone through an independent bias audit consistent with the NYC AI Law. Summary of Bias Audit Results (HackerRank's Image Analysis System)
- When you enable the Image Analysis detection, the following prompt displays the effects on your workflow:
- Provide your consent and select the checkbox and click Agree & Enable.
Candidate Experience
When you enable Image Analysis, the system automatically takes a candidate's consent. The candidate will be notified with a prompt message to allow webcam access.
- When the candidate launches the test, a prompt message is displayed to provide consent that the candidate is fine with taking the proctored test and allowing the webcam access.
- After allowing the webcam access, the candidate is notified to take the test in a well-lit and private place.
- When the candidate clicks Continue, the webcam captures the candidate's image to confirm that the same candidate is taking the test.
- Once the candidate is allowed access to the test, a confirmation is prompted to capture the candidate's biometric information.
- The candidate can agree to the declaration and click Agree & Start to start taking the test.
Note: Candidates can take proctored tests only using Chrome, Safari, Edge or Firefox browsers.
Reviewing a Candidate’s Suspicious Activity
You can review the suspicious activity of the candidate by going to the detailed report from the candidate list page of a test.
- Go to a test and click the Candidates tab. The candidate list is displayed.
- Click on a candidate to view the report. The Candidate Summary window is displayed on the right of the screen.
- Click the Attempt Activity tab and expand the Image Analysis pane to view the Image Analysis of the candidate captured during the test attempt.
Reviewing Candidate’s Suspicious Activity on the Detailed Report Captured on Webcam
A series of images of the candidate are captured during the test when the candidate attempts a test which has Image Analysis enabled. These images display any suspicious activity detected during the test.
The image analysis results are categorized based on the following:
Multiple Faces
The illustration displays the experience captured when multiple faces are detected during the test. The user can then assess, based on these images, how to proceed with the candidate.
Secondary Faces
The illustration displays the experience captured when secondary faces are detected during the test. This helps to identify any imposters trying to take a test on a candidate's behalf. The user can then assess, based on these images, to proceed with the candidate.
No Faces
The illustration displays the experience captured when no faces are detected during the test. This helps to identify if a candidate is trying to get help or if there is any other malpractice. The user can then assess, based on these images, to proceed with the candidate.
Static Faces
Image analysis also detects static image projections during tests, helping identify candidates who use image spoofing software to appear live. The illustration displays the experience captured when someone tries to project static images during a test. This enhancement ensures that all candidates are present and actively participating, thereby maintaining the integrity of the test.
HackerRank also collects feedback from users to ensure that we improve the precision of our solution.
Reviewing Suspicious Webcam Activity on the CSV Exports
The proctoring information is also captured on the exported CSV files:
- In the CSV exported file, three additional columns are added to make it easy for the users to filter out candidates based on the suspicion severity, suspicion score, and the reason for suspicious activity, as shown in the following table:
Proctor Activity Suspicion Severity | Proctor Activity Suspicion Score | Proctor Activity Reasons |
High | 9 | Multiple faces detected, No faces detected |
Medium | 7 | Multiple faces detected |
Medium | 5 | Multiple faces detected |
Medium | 7 | Attempt of spoofing with webcam detected |
These examples help you to filter candidates based on their Proctoring activities.
Example 1: If you are concerned only about highly suspicious candidates, use the Proctor Activity Severity column and filter out candidates marked as High.
Proctor Activity Suspicion Severity | Proctor Activity Suspicion Score | Proctor Activity Reasons |
High | 9 | Multiple faces detected, No faces detected |
Medium | 7 | Multiple faces detected |
Medium | 5 | Multiple faces detected |
Example 2: If you are fine with moving ahead with candidates flagged for reasonable suspicious activity because you do not have enough candidates, use the Proctor activity suspicion score column to filter candidates appropriately.
Proctor Activity Suspicion Severity | Proctor Activity Suspicion Score | Proctor Activity Reasons |
High | 9 | Multiple faces detected, No faces detected |
Medium | 7 | Multiple faces detected |
Medium | 5 | Multiple faces detected |
For example, you may consider progressing candidates on the lower end of the suspicion scale. As Medium ranges from 5-7, you can use the Proctor activity suspicion score column and choose candidates marked as 5 (5 being the lowest on the Medium scale).
Note: Suspicion scores between 8-10 are marked as High, 5-7 are marked as Medium, and <5 are marked as No.
Recommendation: When you progress candidates marked as a Medium to the next stage, it is recommended that you assess the candidates further to ensure their skills are a good match and that the candidate did not cheat in the previous round.