Skip to main content
↑

Scoring a Coding Question

  • Updated
Hide
In this article

Overview

A coding question requires the applicant to submit code in any of the available languages to solve the task. Coding questions are scored using test cases, which are designed to evaluate the correctness and efficiency of a candidate’s code. Test cases are a set of specified inputs and expected outputs with a given execution condition, and they provide the basis for automated evaluation of a candidate’s code.

Each question has a total of 8-15 test cases that cover different scenarios, of which 2 to 3 may be sample test cases that help the candidate understand the problem. The candidate can see the input and output of the sample test cases, and the rest of the test cases are hidden. A range of test cases that vary in difficulty level (e.g., edge and corner cases) is designed to measure a code submission's correctness.
Once a candidate submits their code, it is run against all the test cases in a standard execution environment and condition. The output from the candidate’s code is compared with the expected output to see whether the test case has passed or failed. Each test case has a set score, the candidate can obtain either a full score or zero, with no partial credit per test case. The overall score on an item is the sum of the scores of the individual test cases.

 

Sample Test Cases

There are 11 test cases for a coding question with two-sample test cases and nine hidden test cases. 

The table below illustrates the points scored by a candidate:

Type of Test Case

Number of Test Cases

Points Assigned to a Test Case

Total Score

Total Number of Passed Test Cases per candidate

Candidate's Total Score

Sample

2

0

2*0=0

2

2*0= 0

Hidden- easy

3

5

3*5=15

3

3*5=15

Hidden-medium

4

10

4*10=40

3

3*10=30

Hidden Difficult

2

20

2*20=40

1

1*20=20
 

11

  

95

  

65

 

 

 

Related articles