Overview
This article explains the different evaluation methods to enable filtering candidates at scale. HackerRank provides candidate performance scores based on model performance metrics applicable to the Data Science questions. As Data Science evaluation is very subjective, and the emphasis is on the approach a candidate takes to solve a question, HackerRank recommends that hiring managers evaluate filtered candidate submissions manually.
Data Science questions are scored primarily after a thorough analysis of the candidates' solution Jupyter Notebook, available in the candidates' Test Report.
Read more about accessing and evaluating a Candidates' Test Report here.
Manually Scoring a Data Science Question
Prerequisites
- You must have a HackerRank for Work account.
- You must have at least one test attempted by Candidates and their submissions pending for further evaluation.
Scoring Using the HackerRank Scoring Rubric
Data Science questions are manually evaluated and therefore the candidate test report experience offers a scoring rubric for each question to help the hiring manager perform an efficient, consistent manual evaluation on data science solutions.
To access the scoring rubric, click on the Interviewer Guidelines section of the detailed candidate report tab, and use the solution Jupyter Notebook, the evaluation script, and so on for all HackerRank Data Science questions, as shown below in the image.
Steps
- Navigate to Tests and select the required Test.
- Click the Candidates tab, and select a Candidate entry pending evaluation.
- On the Candidates Test Summary page, click the Detailed tab to view the detailed Test Report of the Candidate.
- Alternatively, in the Summary tab, scroll down the page and click View detailed report for a particular question.
- For a detailed Candidate Test Report, you can choose to expand and view the question description, the interviewer guidelines with the scoring rubric (containing the solution Notebook, the evaluation script, and so on for all the library Data Science questions). You can also review the candidate's submitted Jupyter notebook, by either downloading a Zip file or by launching a temporary Jupyter session with the candidate's code.
- The contents of the questions can also be viewed and assessed on the test report Detailed tab, as they are rendered inline.
- Launching the Jupyter session enables you to review all the files in the submission, run data cells, run any scripts, and try different aspects of the candidate submission, as shown below.
- Upon completing your evaluation, proceed to manually enter your score, and leave any candidate feedback. This completes the scoring for the particular question.
Learn about how to analyze a Data Science Test Report in detail here.
HackerRank also offers auto-scoring for the Data Science questions, learn more about it here