Our Philosophy
We are observing significant changes in the AI <> developer productivity space which will change the software development landscape in the coming years.
- Copilots will level the field for basic programming skills and boost developer productivity. Developers will collaborate with the copilots to review, edit, and approve the generated code.
- Newer tools are being launched at an accelerated pace. Cognition AI’s Devon, the 1st AI developer. Ellipsis built an AI-enabled code review agent. Code completes etc have been a part of Copilot for a while now.
This will lead to the changes below in the expectations from a new-age developer.
- Developers would increasingly use AI-generated code. They must be exposed to validating and testing AI-generated pre-authored code. Strong fundamentals in coding help build and maintain code.
- Developers must be experts in code review, prompt engineering, testing, training large language models, and dealing with non-deterministic outcomes.
- Borders b/w FE, BE, etc, will vanish. Full-stack devs who can build end-to-end applications leveraging AI tools would be the norm.
HackerRank is building a hiring process that closely mimics the evolving world of human + AI. . New features being built allow customers to create interviews based on real-world, business-specific problems, so that customers can hire future-ready developers in an AI-first world.
New functionality:
- Assess candidates’ coding fundamentals with real world challenges
- Create tasks that resemble feature building from a PRD,
- Fix bugs from a support ticket
- Perform code review
- Design scalable systems
- Work collaboratively with an AI assistant
- Explore team fit by simulating working together on daily tasks
- Leverage the same problem context across all hiring rounds by using the same code repository.
The rest of the document details the product flow and setup required to conduct Next-Gen interviews with customers.
Note:The functionality described in this article is currently in limited availability. Reach out to support@hackerrank.com or your account manager for more information or to request access.
Workflow
- Log in to your HackerRank account.
- Create an interview using the create interview CTA in the Interviews tab
- Then, you will see the repositories tile, from which you can get started.
- A code repository is the fundamental unit on which interviews are powered. E-Commerce - MERN could be the code repository that will be used for all SDE 2 FE hiring.
- Go through the readme file for an overview of the E-commerce repository.
- The code repository contains bug fixes, system design, and feature development tasks. Tasks can be chosen for each interview from the E-commerce MERN stack. A sample sequence can be found below:
-
- Interview 1: Coding: Feature building + Bug fix
- Interview 2: System Design
- Hiring Manager round
- Value Fit round
- Blue indicates the rounds where the hiring plan will change from an existing process.
-
- An AI assistant is automatically enabled for the candidate. The candidate will have access to the live AI assistant for the above tasks.
- As an interviewer, you can view the candidate’s interaction with AI in real-time. The entire transcript will also be available in reports.
- All interviews can be carried out using the same code repository. It builds a progressive interview that leverages context and inputs from the previous interview. You can start your second interview for this candidate with the same flow and the same repositories. The tasks previously used for the candidate would be marked as previously attempted. You can choose from the remaining tasks for the subsequent rounds.
- Reports will be available for all interviews. The candidate pack will contain a detailed timestamp timeline of the interview along with the reports for each interview.
Recommendations to create a smooth Interview experience
We recommend the following to ensure all candidates feel comfortable and confident navigating the new environment.
-
- Provide the candidate with ~5 minutes to familiarize themselves with the UI and Code repository.
- Inform candidates as to where they can find their AI assistant and how you expect them to interact with the tool.
Steps For the Interview Workflow
Choosing the repository
- You can select a repository from Quick pad or your left Nav
- From quick pad:
- From left nav:
- Select the relevant code repository
Choosing the relevant tasks
- Once the repository is chosen, you must add the relevant interview tasks.
- You can add tasks by choosing them from the repository’s listing.
AI assistant to the candidate
- An AI assistant will be available for the candidate for the feature building using AI assistant task.
- The interviewer will be able to monitor the conversation between the assistant and the candidate at all times. The same will be captured in the interview reports too.
- The customer can turn off the AI assistant by requesting HackerRank.