§ 139 Examination Development, Validation, and Occupational Analysis Policy

  1. The Legislature finds and declares that occupational analyses and examination validation studies are fundamental components of licensure programs. It is the intent of the Legislature that the policy developed by the department pursuant to subdivision (b) be used by the fiscal, policy, and sunset review committees of the Legislature in their annual reviews of these boards, programs, and bureaus.
  2. Notwithstanding any other provision of law, the department shall develop, in consultation with the boards, programs, bureaus, and divisions under its jurisdiction, and the Osteopathic Medical Board of California and the State Board of Chiropractic Examiners, a policy regarding examination development and validation, and occupational analysis. The department shall finalize and distribute this policy by September 30, 1999, to each of the boards, programs, bureaus, and divisions under its jurisdiction and to the Osteopathic Medical Board of California and the State Board of Chiropractic Examiners. This policy shall be submitted in draft form at least 30 days prior to that date to the appropriate fiscal, policy, and sunset review committees of the Legislature for review. This policy shall address, but shall not be limited to, the following issues:
    1. An appropriate schedule for examination validation and occupational analyses, and circumstances under which more frequent reviews are appropriate.
    2. Minimum requirements for psychometrically sound examination validation, examination development, and occupational analyses, including standards for sufficient number of test items.
    3. Standards for review of state and national examinations.
    4. Setting of passing standards.
    5. Appropriate funding sources for examination validations and occupational analyses.
    6. Conditions under which boards, programs, and bureaus should use internal and external entities to conduct these reviews.
    7. Standards for determining appropriate costs of reviews of different types of examinations, measured in terms of hours required.
    8. Conditions under which it is appropriate to fund permanent and limited term positions within a board, program, or bureau to manage these reviews.
  3. Every regulatory board and bureau, as defined in Section 22, and every program and bureau administered by the department, the Osteopathic Medical Board of California, and the State Board of Chiropractic Examiners, shall submit to the director on or before December 1, 1999, and on or before December 1 of each subsequent year, its method for ensuring that every licensing examination administered by or pursuant to contract with the board is subject to periodic evaluation. The evaluation shall include (1) a description of the occupational analysis serving as the basis for the examination; (2) sufficient item analysis data to permit a psychometric evaluation of the items; (3) an assessment of the appropriateness of prerequisites for admittance to the examination; and (4) an estimate of the costs and personnel required to perform these functions. The evaluation shall be revised and a new evaluation submitted to the director whenever, in the judgment of the board, program, or bureau, there is a substantial change in the examination or the prerequisites for admittance to the examination.
  4. The evaluation may be conducted by the board, program, or bureau, the Office of Professional Examination Services of the department, the Osteopathic Medical Board of California, or the State Board of Chiropractic Examiners or pursuant to a contract with a qualified private testing firm. A board, program, or bureau that provides for development or administration of a licensing examination pursuant to contract with a public or private entity may rely on an occupational analysis or item analysis conducted by that entity. The department shall compile this information, along with a schedule specifying when examination validations and occupational analyses shall be performed, and submit it to the appropriate fiscal, policy, and sunset review committees of the Legislature by September 30 of each year. It is the intent of the Legislature that the method specified in this report be consistent with the policy developed by the department pursuant to subdivision (b).