make your assessments more e˜ective with test analytics · metric will also help you assess the...

7
Make your assessments more effective with test analytics

Upload: others

Post on 18-Oct-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Make your assessments more e˜ective with test analytics · metric will also help you assess the di˛culty level of the test, change the cut-o˜ score, or relook at the sourcing funnel

Make your assessments more e�ective with test analytics

Page 2: Make your assessments more e˜ective with test analytics · metric will also help you assess the di˛culty level of the test, change the cut-o˜ score, or relook at the sourcing funnel

Introducing test analytics in HackerEarth assessments

We have introduced ‘test analytics’ in the HackerEarth platform which can accurately measure the e�ectiveness of an assessment. In this guide, we will be covering how you can define and improve the quality of your assessments with this feature.

Accurate screening of candidates is possible only with a high-quality assessment. Building quality in assessments takes time and requires a consistent measure of the process against standards that define its quality.

Page 3: Make your assessments more e˜ective with test analytics · metric will also help you assess the di˛culty level of the test, change the cut-o˜ score, or relook at the sourcing funnel

1. Measure the success rate of your assessment

Once candidates have attempted your test, navigate to the Analytics tab to get an overview of your assessment. This feature allows you to:

In a single view, the funnel provides you metrics on test participation and test clearance rates.

Track the drop o� rate of candidates in each stage of an assessment

View the candidate hiring funnel to track the number of invited candidates who’ve attempted the test, cleared the cut-o� score, and finally have been shortlisted

Page 4: Make your assessments more e˜ective with test analytics · metric will also help you assess the di˛culty level of the test, change the cut-o˜ score, or relook at the sourcing funnel

Here, 320 out of 450 ( 71%) candidates have scored marks higher than the median score, which indicates that the quality

of candidates from this test was high.

With the test analytics feature, you can view the distribution of candidates who’ve attempted the test based on test scores. Also, it gives you information about the number of candidates who scored more than the median and cut-o� test scores or took more than the median time to complete the test.

2. View the health score to choose only high-quality questions

Page 5: Make your assessments more e˜ective with test analytics · metric will also help you assess the di˛culty level of the test, change the cut-o˜ score, or relook at the sourcing funnel

Additionally, you can use this feature to view the distribution of candidates based on test completion time. According to this chart, 61 out of 121 ( 50%) candidates have taken longer than the median completion time to take the test, indicating the test was challenging for them to complete on time.

Page 6: Make your assessments more e˜ective with test analytics · metric will also help you assess the di˛culty level of the test, change the cut-o˜ score, or relook at the sourcing funnel

Compare the attempted to invite ratio and the cut o� to attempted ratio of a test with respect to all tests that have been run using the platform

Benchmark your test with respect to all tests on the platform

3. Get insights to improve the quality of your assessment

A percentage increase in the attempt rate of a test indicates that the test was successful when compared to all tests on the platform. Similarly, a percentage increase in the cut-o� clearance rate of a test indicates a higher quality of candidates ( in your assessment pool) when compared to all tests on the platform. This metric will also help you assess the di�culty level of the test, change the cut-o� score, or relook at the sourcing funnel.

The test analytics feature provides insights to help you improve the quality of your assessments significantly. With this feature, you can:

Page 7: Make your assessments more e˜ective with test analytics · metric will also help you assess the di˛culty level of the test, change the cut-o˜ score, or relook at the sourcing funnel

4. Share insights with the rest of the team

Download the report as a PDF or share it as a link online with your hiring manager.

You can identify areas of improvement in the process to ensure that you craft quality assessments every time.

Try using test analytics in your assessments and let us know how it works for you. If you need any help on using this feature, write back to us at [email protected]. If you’re new to HackerEarth and

want to create accurate skill-based developer assessments, sign up for our 14-day free trial.