Validity and Reliability of Tests

1. Validity and Reliability of tests -

Pre-employment testing not only help employers assess the job-specific skills of applicants but also add to the legal defensibility of the employers. To ensure the legal defensibility, you must checkValidity and Reliability of Assessments.

1.1 Reliability:

Test reliability depends on how consistently the test measures the skills required for a specific job role. A test can be considered as a reliable test if a person appears for it repeatedly, and the results are similar for every attempt.

Types of reliability:

i. Test-retest Reliability:

Indicates repeatability obtained by giving the same test twice at different timings to a group of applicants.
Ex. If a test is designed to assess the technical skills given to a set of applicants twice in a time period of two weeks. The results obtained from the two attempts will indicate the reliability of the test.

ii. Alternate or parallel form reliability:

Indicates the stability of the test after administering different forms of a pre-employment test.
Ex. To check if the logical reasoning test is reliable, create a set of questions that will evaluate the logical reasoning and then divide the test into two parts. The outcome of both sets should be similar. If they are the same it means all the items measure the same characteristics and can be used interchangeably.

iii. Inter-rater reliability:

The test likely to be reliable if two or more raters give the same score and take the same assessment decision. Inter-rater reliability is useful because the evaluators will not interpret the same results; raters may disagree as to how well certain responses of the constructor skill being assessed.

iv. Internal consistency reliability:

The test is reliable if the different characteristics of the test yield similar results.

1.2 Validity:

Validity is the degree to which the pre-employment screening test assesses what it purports to assess and how well it evaluates the competencies of the applicants.

While reliability is necessary, the validity of the test is also equally important.

• Validity identifies if the characteristic being measured by a test is related to job qualifications and requirements
• Validity helps you to make a decision or prediction about people based on their test performance
• Validity tells you how good a pre-employment test is for a particular job role

Types of Validity:

i. Construct Validity:

It ensures that the pre-employment test measures only the intended characteristics and no other variables. In other words, you measure a trait or skill that is part of the overall desired skill needed for success on the job. To measure the construct-related validity, you would look at the scores from the assessment correlated with scores from other established tests that measure the same characteristics.

ii. Content Validity:

It ensures that the content of a test is relevant and measures requirements and qualifications for the job role. if you were hiring for a job that required the ability to transcribe the content, testing for the rate at which the candidate types would be high regarding content-related validity.

iii. Criterion-related validity:

It indicates that the test demonstrates a correlation or other statistical relationship between test performance and job performance. Those who score high on the test tend to perform better on the job.