Overview
HackerRank integrates with Oracle Recruiting Cloud for Tests and Interviews to facilitate an easy and seamless hiring experience. The purpose of this document is to walk through different use cases supported by the HackerRank - Oracle Recruiting Cloud (ORC) Integration and cover FAQs.
Key Features
- Send Test invites to candidates from ORC via your Candidate Selection Process
- View candidate’s Test results in ORC, including score and evaluator feedback
- Have a direct link to a candidate’s Test report from ORC
- Include Tests in your ORC job application flow - you can choose if candidates take this Inline (while applying to the job) or at the end of the job application.
- Generate HackerRank Interview links for Virtual & Remote Onsite Interviews with candidates
- View Interview results and scorecard information from interviewers
- Have a direct link to the candidate’s interview report from ORC
Prerequisites
- HackerRank - ORC Integration Setup is completed
- User has access to a HackerRank license
- User has access to requisitions on ORC
Types of Assessment Triggers supported
Oracle Recruiting Cloud offers various assessment triggers that can be configured to send assessments to candidates. HackerRank has built the integration to support all these configurations that users can set up in ORC.
These include:
- Selection Process (CSP) Trigger
While configuring a requisition, assessment triggers are tied to ORC Phases and States. Each Phase and State can have one assessment tied to it. We support both a Single Phase setup and a Multi-Phase setup.
In this case, we send an email invite to candidates to complete the assessment. - CSP Automated Initiation via Phase/State
When a candidate is moved to the trigger Phase and State, the configured assessment will be sent to the candidate. - CSP Manual Initiation
Assessment tied to any Phase and State can be triggered to a candidate manually even without moving them to the trigger state. - External Applyflow Trigger
When this trigger is set up, candidates will be asked to take the assessment right after completing the job application on their ORC application profile.
We would recommend using this trigger type only for HackerRank Tests. Since at this stage, a live HackerRank Interview would not be a logical assessment.
Candidate Experience:
After a candidate finishes applying for the job on the career site, they will land on the application confirmation screen.
At this point, they see a message that they have submitted the job application. Here, they will also see an action item to complete an assessment to be considered for the position with a link to take the assessment.
In addition to the message shown by ORC, we also send an email invite to candidates. This will use your default HackerRank email settings.
This is if candidates miss the message on the ORC page or want to attempt it at a later point in time. - External Applyflow Inline Trigger
When this trigger is set up, candidates will be asked to complete an assessment while filling out the job application and before submitting their application.
We would recommend using this trigger type only for HackerRank Tests. Since at this stage, a live HackerRank Interview would not be a logical assessment.
Candidate Experience:
While candidates are applying for a job, they will see an assessment block that informs them to take an assessment. They need to complete the assessment before they can submit the job application.
When the candidates’ click on the “Take Assessment” button, ORC redirects them to HackerRank for completing the assessment.
Once candidates complete the questions, they can submit the assessment.
After submission, they see a success message for a few seconds before being redirected back to their ORC job application.
At this stage, they see the ORC assessment block updated to reflect the completion of the assessment. Now, the candidates can submit the job application.
For this assessment trigger type, we do not send an email invite to candidates since they will be taking the test before applying and cannot attempt the test at a later point in time.
Types of HackerRank Assessments
HackerRank platform supports two types of assessments. Both these types of assessments are supported via integration with ORC.
- HackerRank Tests
-
- Includes asynchronous coding tests, code review questions, MCQs
- Includes Projects
For HackerRank Test invites from Oracle, we send email invites to candidates with a link to take the assessment, except for the External Applyflow Inline trigger type.
- HackerRank Interviews
-
- Includes synchronous interviews with single or multiple interviewers
For HackerRank Interview links generated from ORC, we do not send email notifications to candidates. We send the links back to ORC, recruiters or recruiting coordinators can then share this link with candidates and interviewers.
- Includes synchronous interviews with single or multiple interviewers
Adding Assessments to a Requisition
Once the integration is set up and your team has defined the assessments to be used for a job, you should be able to add HackerRank Tests and Interviews to an ORC requisition.
- Navigate to the “Job Requisitions” page under “Administer Workforce”> “Hiring”. Click on “+Add” in the top right to create a new requisition.
You will have to go through the steps to create a new requisition. This includes all the necessary requisition setup information. - Under the “Configuration” setup, you can choose the preferred Candidate Selection Process and External Application Flow.
Based on the selected CSP flow, you will have the option to define Phases and States that trigger an assessment.
The External Application Flow will define the flow through which the candidate will be presented an external assessment. If you prefer to not include an external assessment, the selected External Application Flow will not affect the assessment trigger. - Under “Screening Services”, users have the option to add Background Checks, Assessments, or Tax Credit services. Select “+Add” under the “Assessments” section.
- Select “HackerRank” as the assessment partner and choose the relevant user account.
If you have a specific user account provisioned, then you could use that. Else select “ORC_HACKERRANK_USER” as the user account.
If you select a specific user email under user account, then you would only be able to choose a HackerRank test that the user has access to. For “ORC_HACKERRANK_USER”, you would be able to select any of the HackerRank tests in your company's account.
Click “OK”. Then click on the edit (pencil) icon. This is a Single Phase assessment setup since the “Add Assessment Phases” box is not selected. - Users will be presented with options to choose assessments for various flows.
Assessments selected under internal and external job assessment flows will be presented to the candidates as a part of the job application flow. (Defined by External Application Flow selected in Step 2)
Users can also choose a single Phase and State to trigger one assessment to the candidate. The Phase and State can be selected from the drop-down and users can map one HackerRank assessment to it. Users can choose a HackerRank Test or a HackerRank Interview. This assessment will be triggered via the CSP flow when a candidate is moved to that Phase and State.
For HackerRank Tests: Choose any test name from the drop-down. This test will be sent out to the candidate when they are moved to the mapped Phase and State. Please ensure that the recruiter assigned to the requisition has access to the test on HackerRank.
For HackerRank Interviews: Users have the option to generate a unique HackerRank interview link in up to 5 interview stages. Note that one link can be used by multiple interviewers for the same candidate. Select one of the 5 HackerRank Interview options for each stage where you need to conduct a HackerRank interview. - For Multi-Phase Assessment Setup, select “HackerRank” as the assessment partner and choose an appropriate user account. Select the “Add Assessment Phases” option.
Click “OK”. Then click on the edit (pencil) icon. - Users will be presented with options to choose assessments for various flows.
Assessments selected under internal and external job assessment flows will be presented to the candidates as a part of the job application flow. (Defined by External Application Flow selected in Step 2)
Users can also choose one assessment to be triggered for each available Phase and State. Users can choose a unique HackerRank Test or a HackerRank Interview under each Phase and State label. These assessments will be triggered via the CSP flow when a candidate is moved to that Phase and State. - Click “Save”. Proceed with the requisition completion. Once it is posted, the requisition will be available for candidates.
Triggering Assessments to Candidates
Once a requisition has been posted and live, candidates can apply for the position. There are multiple flows through which candidates may be asked to take an assessment.
- External Applyflow or External Applyflow Inline Trigger
If an assessment is set up to be triggered as a part of an external apply flow, the assessment will be presented to the candidates automatically.
External Applyflow assessments are shown to candidates right after they finish their job application. Inline assessments are shown to candidates as a part of the job application requirements.
Both these assessments will be visible on the candidate profile. Once a candidate sees this assessment, the status will be shown as “Requested”. Since these assessments are triggered by candidate actions, they will be tagged as “Requested by candidate”. - Candidate Selection Process Trigger
When an assessment is tied to a Phase and State in the CSP, it can be triggered by moving candidates to that Phase and State.
To move a candidate, select “Move” from the top right within the candidate profile.
From the details section, move the candidate to a desired Phase and State. If an assessment has been set up, users will see a popup confirming that an assessment will be triggered.
Triggering HackerRank Tests
If a HackerRank Test is triggered via the CSP, candidates will receive an email from HackerRank asking them to take the test.
If a HackerRank Interview was requested via the CSP, HackerRank will generate a unique interview link and send it back to the candidate’s ORC profile.
After the assessment (test or interview) is triggered, the candidate’s HackerRank profile will also reflect the action. This will maintain a mapping of the user who requested the assessment from ORC.
The recruiter requesting assessments from ORC needs a HackerRank license with the same email address.
Reviewing Results and Evaluation
Once a candidate has completed their HackerRank test or interview, their results will be available on HackerRank. These results will also be synced with ORC.
The feedback available for HackerRank tests and interviews is different. Here is a screenshot of the candidate’s ORC profile before completing a HackerRank assessment.
ORC provides 6 fields for HackerRank to update:
- Status - Reflects the status of the assessment
- Score - Candidate’s score on the assessment
- Assessment Percentile - Percentile based on the maximum score
- Band - Current band on assessment
- Comments - Additional information to help understand assessment results
- View Results - Button with a hyperlink to detailed HackerRank reports
HackerRank Tests
On completion of the HackerRank test, candidates' test scores and percentiles will be sent back to ORC.
HackerRank updates the provided fields as follows:
- Status - This field will reflect the latest status. Based on the type of trigger, this field can take one of the following values: Not Triggered, Requested, Initiated, Started, Completed By Candidate, Completed - Pass, Completed - Fail
- Score - This will reflect a numeric value for the candidate’s test score.
- Assessment Percentile - This will reflect a numeric value for the candidate’s test percentile.
- Band - Upon completion, the band can be either of the following: To Be Evaluated, Pass, Fail. As a default, the band will be set to “To Be Evaluated” upon assessment completion. If a cutoff score is set on the test level in HackerRank, the band will automatically update to “Pass” or “Fail”.
- Comments - For HackerRank tests, we provide additional test results in the comment section. This includes Max Score, Attempt Endtime, Question Details.
- View Results - Upon test completion, this link will direct to the most recently completed HackerRank assessment report.
Evaluating HackerRank test results
- When a candidate has completed their assessment, the result fields will be updated on the ORC profile. The following 2 fields will indicate recently completed and unevaluated test results.
Status - “Completed by Candidate”
Band - “To Be Evaluated” - Users can review candidates’ scores. For detailed HackerRank report, click on the “View Results” button. This button will direct you to the candidate’s most recently completed HackerRank assessment report.
Users will require a HackerRank license in order to view candidate’s detailed report on HackerRank. - Once a user evaluates the candidate’s test submission and code, the user can decide to either mark the candidate as “Test Completed - Qualified” or “Test Completed - Failed” on HackerRank.
- Based on the evaluation on HackerRank, the ORC profile status for that particular test will update to “Completed - Pass” or “Completed - Fail”. The Band will also update to “Pass” or “Fail”.
Once this is done, the hiring team can decide whether to disposition the candidate or move them forward in the hiring process.
Please note that ORC only supports updating the Status once. So you may not be able to update the candidate’s status between “Pass” and “Fail” multiple times.
HackerRank Interviews
Once a HackerRank interview is triggered for the candidate, a unique link will be posted back to the candidate’s ORC profile. This interview link can be used to conduct interviews with the candidate.
HackerRank updates the provided fields as follows:
- Status - This field will reflect the latest status. Based on the type of trigger, this field can take one of the following values: Not Triggered, Requested, Initiated, Started, Completed By Candidate, Completed - Pass, Completed - Fail
- Score - This will remain blank or “0” for HackerRank interviews.
- Assessment Percentile - This will remain blank or “0” for HackerRank interviews.
- Band - Upon completion, the band can be either of the following: To Be Evaluated, Pass, Fail. As a default, the band will be set to “To Be Evaluated” upon assessment completion.
- Comments - For HackerRank interviews, we provide additional details in the comment section. This includes Title, StartTime, EndTime, Interviewer Details, Scorecard.
- View Results - Upon completion, this link will direct to the most recently completed HackerRank assessment report.
Evaluating HackerRank interview results
- When the interview ends, the result fields will be updated on the ORC profile. The following 2 fields will indicate recently completed and unevaluated interviews.
Status - “Completed by Candidate”
Band - “To Be Evaluated” - Users can review the interview feedback. For a detailed HackerRank report, click on the “View Results” button. This button will direct you to the candidate’s most recently completed HackerRank assessment report.
Users will require a HackerRank license in order to view candidates’ detailed reports on HackerRank. - On the detailed HackerRank interview report, users can see candidates’ live coding submissions, whiteboards, and feedback from interviewers.
After reviewing the necessary information, users can choose the evaluation and mark the candidate with a “Thumbs Up” or “Thumbs Down” on HackerRank. - Based on the evaluation on HackerRank, the ORC profile status for that particular interview will update to “Completed - Pass” or “Completed - Fail”. The Band will also update to “Pass” or “Fail”.
Once this is done, the hiring team can decide whether to disposition the candidate or move them forward in the hiring process.
Please note that ORC only supports updating the Status once. So you may not be able to update the candidate’s status between “Pass” and “Fail” multiple times.
The hiring team can follow the same steps to review results for successive assessments upon completion.