We are constantly updating HackerRank for Work with new improvements and fixes. Here is a summary of customer facing updates we have made from July 1st 2019 to October 1, 2019.

CodeScreen Updates

New Candidate User Experience

The new candidate site replaces the old test taking experience of a candidate. In the past, it was very difficult to navigate between the question, code and the results while coding. With this update, we have improved the coding experience for easier navigation as well as improved the landing page to make it cleaner.

Improved Coding Experience

Improved Landing page

 

New Test Wizard for Startup Customers

We have released a Simplified Test Creation Wizard for Free Trial and Startup users. The Wizard includes the following improvements: 

• Test creation takes as little as 30 seconds
• The Wizard includes a Data Science screening test
• Predesigned tests are auto-published
• Test name and test duration are auto-generated and easily editable
• Questions are of high quality and not leaked
• Questions are relevant to the role

Text change for Code Timeout

For coding questions, when a particular code takes a longer time to run than what our environment supports, we used to show “Timeout Exceeded” as the error. This was not clear for the candidates and created a lot of confusion. To clear the confusion, we have changed the message to reflect that the code was not executed within the limits, and also provide a link to the time limits provided by the HackerRank environment. This was done for both CodePair and CodeScreen.

Display full error stack trace in CodeScreen and CodePair

In the past, in coding questions, we were truncating the error stack trace to prevent candidates from going through the stack trace and identifying the hidden test case which was failing. This was blocking candidates from understanding the error which will help them fix their code. We are now showing the full stack trace (up to 10kb) during exceptions so that candidates can identify the error more clearly. This was done for both CodePair and CodeScreen.

Ability to clone HackerRank Library questions

We now offer the ability to clone Library questions. This feature will help you create personalized questions without having to create questions from scratch.  

Recommended Time for Questions

To make it easier to choose the right questions for screening tests, we’ve added Recommended Time to the question creation process and enabled the ability to sort questions using Recommended Time.

We have updated all questions in the HackerRank library with a recommended time to complete the question. We’ve also performed a one-time update on your custom questions. The time recommendations for custom questions were set based on the amount of time it took 10 or more candidates to solve the question correctly.

For custom questions where fewer than 10 candidates have completed the challenge correctly,  the Recommended Time is calculated based on attempt data for HackerRank Library questions of the same type. In this case, the Recommended Time reflects the amount of time it took most candidates to solve the same type of question correctly.

Users can easily adjust the Recommended Time for their custom questions:

 

 

Customers can also sort questions according to Recommended Time in the Library:

Learn more about Recommended Time here.

Recommended Time for Tests

To make it easier to give candidates enough time, we are introducing a recommended time for tests. This is based on the recommended time for all questions in the test. You will see a warning if the candidates will not have enough time to complete the test.

 

Improved Library Search

We’ve improved the accuracy and flexibility of our Library search to enable customers to find relevant questions faster. Leaked questions are hidden by default.

Flag for Manually-graded Questions

Manually graded questions in the Library are now easily identifiable in the Library and Tests in order to help Recruiters and Hiring Managers to choose the right questions for their tests.  

 

Review code in CodePair

Previously, test evaluators faced challenges in evaluating submitted code as there was no option to modify/ run the candidate’s-code-submission in the IDE. This button now appears beside the question in the detailed-report and, when clicked, creates a CodePair session with question and solution already loaded in the IDE.

An evaluator can then modify the submitted code and run it in an IDE to better evaluate the candidate.

CodePair Updates

Interviewer License

This was a new license type and role introduced specifically designed to give limited access to just interviewing workflows. The interviewer has the ability to create questions in the library and take technical interviews using CodePair. They can also view any candidate reports that are shared with them.

 

 

REPL Console for Python, Ruby, and Javascript

The REPL console helps developers execute blocks of code in realtime, thus helping them write correct code during their interviews. We added REPL console support for Python, Ruby, and Javascript. We also enhanced the CodePair screen by removing protruding icons and complex settings.

 

Support for exporting up to 10,000 CodePair interviews

Some of our customers were facing issues downloading all of their codepair interviews using the export to Excel functionality in HRW. The page was getting stuck because of the large number of interviews they had. We added a feature to support exporting up to 10,000 interviews at once and also gave the capability to send the excel as an email instead of waiting for it to download.

 

Improved light theme for CodePair

 The light theme in CodePair has existed for a long time but faced complaints that the colors were too contrasting to use. We improved the light theme to make it more soothing to the eyes thus giving “light theme” fans a good alternative to the dark theme.

 

HackerRank Projects

Data Science Questions

We created a new set of real-world challenges that focus on assessing Data Scientist skills. These include:

• Data Wrangling
• Modeling
• Data Visualization
• Machine Learning

Updates also include a dedicated candidate experience with integration of Jupyter Notebooks, library questions, pre-designed ready-to-go Data Science tests and Data Science reports.

 

To know more Data Science, click here.

Show Environment info in Projects question creation

The question creation workflow inside Projects now shows the list of packages available inside the platform by default. This is to help customers and our content creators know about our environment, and what is available upfront.

Support for RHEL 8 and Ubuntu 18.04 in DevOps

We now support RHEL 8 and Ubuntu 18.04 in DevOps. This has been a constant ask from our customers. When you create a new DevOps question, you will be able to select one of these operating systems.

The older operating systems - Ubuntu 14.04 and RHEL 7 are now deprecated but existing questions and tests will continue to work as expected. New questions must be created on the new OSes.

 

Platform Updates

Diversity and Inclusion settings

We’ve launched a dedicated settings page that supports our customers in building a diverse and inclusive workplace. The settings on this page can be turned on/ off individually by the company admin.

Time accommodations

This allows the recruiter to easily add allotted time to a test invite. This can be used to accommodate candidates with special needs. Time accommodation can be added while inviting the candidates to the test. Accommodation details automatically flow into the invite email.

 

Hide candidate’s identity in test reports:

This gives the recruiter an option to download anonymized reports for tests. These reports mask all identity-related details about the candidate and ensure anonymity.

Developers can only see the anonymized version of the report on the UI

 

Hide personal information in Codepair:

This provides the recruiter with an option to download anonymized reports for codepair sessions. Developers can access only the anonymised reports on the UI.

Additionally, this makes the CodePair session anonymous. It blocks video-calling and hides the identities of a candidate from the interviewer and vis-a-vis.

 

Compliance and security settings

We’ve launched the compliance and security settings page. It gives the company admin an option to turn on/ off features which help in staying compliant and ensuring data protection and privacy.

1. Archive all emails sent to candidates through Hackerrank.
   This helps customers to keep an easily-accessible record of all communication that happens through HRW. When turned on, a copy of all emails that are sent from HackerRank to the candidate will be sent to a dedicated email address.
   
2. Timeout inactive sessions.
   This helps customers to extend internal data-security & protection policies to HRW users. Company admin can set a timeout limit for his/ her organization. Once set, users with inactivity beyond the set limit will be automatically logged-out.

 

 

Integration Updates

LinkedIn Talent Hub Integration

With this new integration, users can now connect LinkedIn Talent Hub directly to CodePair for easier scheduling. Recruiters can schedule a CodePair session directly from Talent Hub, while hiring managers can start a scheduled CodePair session from within Talent Hub.

The Talent Hub + CodePair integration workflow

From Talent Hub, users can schedule a CodePair interview directly from a message.

To start, as a best practice, we suggest Creating a CodePair Interview stage within your hiring process to track which candidates you are actively interviewing. You can then schedule CodePair interviews with those candidates. Here’s how it works:

1. Once you’ve identified the profile of the candidate you’d like to interview with CodePair, choose “Message”
2. From the Compose Message pop-out, click the calendar icon at the bottom of the window.
3. Click the settings icon, then turn on “Use Video Conferencing”
4. From the Video Conferencing dropdown, select CodePair from HackerRank
5. Write your message to the candidate & send

The result is a simplified candidate experience through LinkedIn Messages. Once the hiring manager or recruiter sends the request to schedule an interview, the candidate can schedule an interview from your team’s available time slots directly through LinkedIn:

How to connect Talent Hub to HackerRank for Work

Those already using LinkedIn Talent Hub can connect Talent Hub to HackerRank for Work through the Integrations section of LinkedIn Talent Hub:

1. From LinkedIn Talent Hub, choose your profile on the top right hand side of the screen and select “Settings”
2. On the left hand side, select “Integrations” from under the “Advanced” menu
3. Find the “CodePair from HackerRank” integration from the list and click “Authorize”
4. When promoted, log into HackerRank for Work
5. When prompted for permission to connect HackerRank for work, click “Allow”
6. The integration is now authorized. CodePair will now show as an Authorized extension.

Note: You need administrator permissions on both HackerRank for Work and Linkedin Talent Hub in order to authorize this integration

More Information

 

Fixed Issues

Multiple customer-impacting issues were fixed during Q3. Here are some of the top issues that were fixed:

• Candidates unable to type in the editor
• Questions erroneously moving to other sections and sections not behaving intuitively
• Payment page issues
• Dark Theme issues in CodePair
• Full-Screen mode fixes
• MySQL Schema validator
• Archiving questions

Changes or Regressions

• Removed the DroidRank question type for new customers
• Changed the HackerRank for Work Login Page
• Role-based Assessments are now called HackerRank Projects
  • DevOps is now part of Projects
  • Database questions are now present under Programming questions inside “Create new question” dialog
    
  • Ubuntu 14.04 and RHEL 7 are deprecated for DevOps (formerly SudoRank). Customers won’t be able to create new questions on this but existing tests and questions will continue to work. We will share a end-of-life plan for older OSes in Q4.