Container-based real-world Project questions are great at testing a candidate’s knowledge of frameworks and skills in building real applications. Candidates get access to an IDE that provides features similar to development-level IDE.
Tests with Front End, Back End, Full-Stack, Data Science, and DevOps questions will have this experience.
However, containers introduce some scaling limitations at a customer company level. These limitations are important to provide a good candidate experience.
The scaling limitation for each question type is mentioned in the following table.
|Question Type||Logins Per Minute||Concurrent Sessions|
Inviting Candidates in Bulk for Projects Tests
- If you expect your candidates to login in a staggered manner, you can go ahead and invite all the candidates. There should not be any negative candidate experience.
- If you expect all the candidates to log in at once or if your test starts at a particular time:
- Candidates might see a prompt to wait for some time when they reach the threshold mentioned in the table above. (Check candidate experience section for more details)
- To mitigate this situation, it is recommended that you invite candidates in batches
- If inviting candidates in batches is not an option, reach out to your customer success manager or write to us at firstname.lastname@example.org for additional support and options.
- If you expect more candidates than the given limit to take the test in parallel, reach out to us through email@example.com to inquire about temporary increases in capacity to support your event.
Candidate Experience in Events with Projects Tests
- The first 30 candidates will be provisioned servers for the test and will be able to start the test. In the case of the DevOps questions, the number is 20.
- All remaining candidates will see a prompt saying, “We are seeing unusually high traffic. We are trying to provision a server for your test. Try again after the countdown below.” They will see a timer for a minute before they can retry logging into the test.
- After the first minute, the next set of candidates will be provisioned servers, and so on.
- If the candidates in a session exceed the limit, the first set of candidates will be logged in to the test, and the next set of candidates will see an error: “Our servers are at capacity. Please try to take this test after some time”. As existing candidates finish their attempts, new candidates will be allowed to log into the test.