TEST DEVELOPMENT SPECIALIST TRAINEE
DEFINITION:
Under the close supervision of a Test Development Specialist 4 or other supervisory official in the Division of Test Development and Analytics, in the Civil Service Commission, as a trainee and productive worker, receives on-the-job training in the employee selection processes, and learns to perform test development tasks including designing and developing open competitive and promotional Civil Service examinations, analyzing and interpreting statistical data and establishing cut-off points; does other related duties as required.
NOTE: The examples of work for this title are for illustrative purposes only. A particular position using this title may not perform all duties listed in this job specification. Conversely, all duties performed on the job may not be listed.
EXAMPLES OF WORK:
Under supervision, as a trainee and productive worker:
Receives training in government personnel procedures and practices, and the specific work processes and methods of the Civil Service Commission.
Learns to conduct job analyses on assigned titles to determine critical tasks performed and underlying knowledge, skills, and abilities (KSAs) needed to successfully perform those tasks.
Learns to analyze the data/information obtained through job analyses to develop test plans that involve calculating various weights and percentages, determining which KSAs are testable, and calculating the number of items needed to appropriately measure each subject area or KSA; determines the most appropriate test mode and time factor.
Learns to select, write, and edit test items.
Attends and observes meetings with subject matter experts to develop, review, and/or validate oral, essay, or multiple-choice test items.
Learns to conduct assessor training for subject matter experts and Test Development staff who participate in scoring various types of examinations.
May observe test administration for various types of examinations.
Learns to analyze statistical information contained within raw score distributions (RSDs) to determine the validity of test items, identify items that are too easy, too hard, or unclear, and identify items that may be miskeyed; learns to calculate adverse impact and establish cut-off points that are submitted for review and approval.
May learn to work as a member of a team on special testing projects.
May learn to perform basic research in the area of employee selection.
Learns to draft correspondence, technical reports, memoranda, and other written materials.
Maintains records and files.
Will be required to learn how to utilize various types of electronic and/or manual recording and information systems used by the agency, office, or related units.
REQUIREMENTS:
NOTE: Applicants must meet one of the following or a combination of both experience and education. Thirty (30) semester hour credits are equal to one (1) year of relevant experience.
Four (4) years of professional experience in job analysis and/or test development, including or supplemented by eighteen (18) semester hour credits in Psychology, Education, or Sociology, and three (3) semester hour credits in Statistics.
OR
Possession of a bachelor's degree including or supplemented by eighteen (18) semester hour credits in Psychology, Education, or Sociology, and three (3) semester hour credits in Statistics from an accredited college or university.
OR
Possession of a bachelor's degree in Psychology from an accredited college or university.
NOTE: "Professional experience" refers to work that is analytical, evaluative, and interpretive; requires a range of basic knowledge of the profession's concepts and practices; and is performed with the authority to act and make accurate and informed decisions.
LICENSE: Appointees will be required to possess a driver's license valid in New Jersey only if the operation of a vehicle, rather than employee mobility, is necessary to perform the essential duties of the position.
KNOWLEDGE AND ABILITIES:
Knowledge of descriptive statistics and psychometrics.
Knowledge of the general guidelines on employee selection procedures.
Knowledge of general job analysis methods and techniques.
Knowledge of general employee selection research techniques and procedures.
Knowledge of test development principles, including test mode selection, identification of content areas, subtest weighting strategies, and item development, after a period of training.
Ability to learn division policies and procedures related to test development, security, and assembled examinations.
Ability to comprehend and learn the Merit System principles, N.J.A.C.4A, and Title 11A (Civil Service Act).
Ability to learn the Test Development & Analytics Technical Standards.
Ability to apply research principles and methods to test validation and development.
Ability to analyze data/information.
Ability to perform basic mathematical and statistical calculations (e.g., percentages, mean, standard deviation, etc.).
Ability to establish and maintain cooperative working relationships with associates, representatives from local and state agencies, members of the public, and others.
Ability to keep current with new concepts and developments in the field of testing.
Ability to understand and carry out oral and written directions.
Ability to communicate both orally and in writing.
Ability to prepare clear, concise, and accurate reports.
Ability to learn how to utilize various types of electronic and/or manual recording and information systems used by the agency, office, or related units.
Ability to read, write, speak, understand, and communicate in English sufficiently to perform the duties of this position. American Sign Language or Braille may also be considered as acceptable forms of communication.
Persons with mental or physical disabilities are eligible if they can perform the essential functions of the job with or without reasonable accommodation. If the accommodation cannot be made because it would cause the employer undue hardship, such persons may not be eligible.
ADVANCEMENT:
Appointees who successfully complete the twelve (12) month training period will be eligible for advancement to the Test Development Specialist 1 title in accordance with the New Jersey Civil Service Commission procedures.
The inability of an employee in this trainee title to attain a level of performance warranting advancement to Test Development Specialist 1 shall be considered as cause for separation.
This job specification is applicable to the following title code:
