The below table provides a broad overview of the test review process.

test-review-process

The below provides an overview of the test review process for successful or unsuccessful submissions.

test-review-process-criteria

Key Principles for review criteria

  • Clear, transparent and openly available
  • Objective and easy to use for ratings
  • Specify minimum standard for certification
  • Provide clear guidelines to encourage developers to strive for excellence
  • Allow for contextualisation to be done relevant to application of test (i.e., not only insist on South African population norm as a standard).
  • Only categories deemed critical to determine the psychometric quality of the instrument are rated

Pre-Assessment checklist

  • Covers materials to be included in submission
  • Basic content to be included in the manual:
    • Rationale
    • Description of development of the test
    • Description of test, scales, items, rating scales
    • Administration, scoring, and interpretation procedures
    • Sufficient evidence to be able to review psychometric properties

Review of the measure

  • Reliability information
    • Covers most types of reliability coefficients
  • Validity information
    • Content validity (for SJTs, ACs, Interviews, etc)
    • Construct validity
    • Criterion-related validity
    • Bias/equivalence
  • Norms
    • Normative
    • Domain-based and Criterion-based