If you search for a question from the HackerRank library on the Internet, and if it appears on the search results, matching structurally and semantically with the HackerRank library question, it is termed a leaked question. To help you identify these questions, HackerRank has a feature called the leaked questions indicator inside the library.
How to Find the Leaked Questions
When a question from the question library is checked for a 'leak,' the HackerRank for Work tool performs an automated web search to find and match the problem statement with any similar content available on the web. String matching algorithms are used to identify matching terms, and the tool then returns a list of websites where it found parts of the statement with a percentage match.
The steps below illustrate how leaked questions are marked in the HackerRank library and how they can be remediated.
Note: If you find a matching link to any library questions, you can also report it to HackerRank. Click here to learn more about how to report a question as leaked from UI.
Leaked Questions Indicator in Library
- On logging into the HackerRank for Work account, click on the Library tab on the home page to view the list of questions available in the HackerRank library and your company questions.
- A 'leaked' question is displayed with a 'red triangle' and clicking on the icon displays the sources on the internet where content similar to the problem statement is available.
- As mentioned, the tool matches similar words, and the matched text is displayed in bold when you view the sources where the question is available on the internet.
- The UI shows the different sources from the internet where the Question is possibly available.
- If you wish to hide all the leaked questions from the question library, you can select the Hide Leaked Questions checkbox to achieve the same. Note that this checkbox is selected by default to ensure that the leaked questions are hidden.
- You can locate all the leaked questions in your My Company or Hacker Library from the Leaked tab. This tab displays the leaked questions found in the HackerRank library. You can select the My Company or the HackerRank options to view the list of leaked questions. The Hide Questions with No Test Impact check box allows you to hide the questions that have no impact on your tests.
Leaked Question Indicator in Tests
- The same functionality is available at a 'test' level. As shown below, you can see if any question(s) present in a test are leaked.
Replace Question Functionality
If a question in your existing test shows a leaked question indicator, you can replace it with a new question with the Replace question functionality. The workflow is explained below.
- Click on the Leaked Question Indicator beside the question name.
- On the following screen, you can see the source where the question is leaked. If you want to replace that question, click on the Replace Question button at the bottom of the window.
- You are now redirected to the HackerRank Library page. The replace question functionality automatically places the filters such as skills, question type, difficulty level, recommended time, and score. You can select the question and click on Replace button.
- On the following screen, you can see the comparison between the existing leaked question and the new question that will replace it. Click Confirm to replace the question in your test.
- Once you replace the question, the test will be moved to draft mode. You must publish it again to use it.
Handling Leaked Questions
When you see that a library question is leaked, it is recommended that you need not immediately remove the leaked question. But instead, follow certain change management best practices.
Here are some best practices you can follow when you encounter a leaked question:
- If you find a leaked question in the library or at the time of test creation, it is recommended that you select the Hide Leaked Questions checkbox and use unleaked questions in tests.
- If an existing test has a question that is marked as leaked, you can:
- Remove that question from the test or replace it with a similar unleaked question using the Replace Question functionality.
- If the test is in progress, you can use your discretion to monitor the plagiarism checker for that question more efficiently. For more information about plagiarism detection, here. You can also reach out to us at email@example.com for troubleshooting.
- If you find that a completed test had a leaked question, you can choose to disregard the question while tabulating scores from the candidate attempts.
- You can also consider modifying the problem statement (since that's mostly what our tool matches similar content for) such that it's not extremely generic or easily available on the internet.
Note: The tool highlights whether or not a question is leaked and checks for leaked content approximately once every month. As described above, the results are almost perfectly accurate, and we employ due diligence while dealing with 'leaked' content. We advise you to do the same based on the nature of the question(s).