In testing, one size never fits all. Organizations and programs are unique and what works for others may or may not work for you.
Determining the best type of assessment for a given credential and knowing how to construct assessments to meet customer expectations and industry standards requires unbiased vision and a wealth of experience. Unlike other companies who steer all programs to the same answer, The Caviart Group finds the assessment approach that is best for each program.
Traditional and Performance Based Testing
The Caviart Group has created tests for millions of candidates in all types of professions, in hundreds of countries and multiple languages. We have years of experience with all types of assessment models from simple multiple-choice and other selected response tests, to constructed response tests and simulations.
We have developed assessments that include multiple types of stimuli and responses including images, audio and video stimuli, and three-D interactive graphics. We have also developed patient case management problems, computer simulation problems, video-based and live performance tests.
We have also developed non-test based assessment programs including oral examinations, portfolio review programs and work sample assessments processes.
Analysis is the search for truth, and analyses for licensure examinations must be designed not only to seek this truth but also to provide the information required to ensure the legal defensibility of the results.
The analysis normally begins with a panel of subject matter experts working with a testing expert to develop a list of all the work activities or tasks that must be performed by a person in that occupation. This list is then turned into a survey instrument so that the opinions of many practitioners can be collected.
The results from analysis are used to design a plan for the examination which identifies the topics that will be covered on the examination. The plan will also specify the number of test questions that will appear on the examination from each of the tasks or topics included in the outline. Following the specifications in the exam blueprint will ensure that every edition of the exam covers the same subject matter in the same proportions.
After the test has been designed, subject matter experts (SMEs) are recruited to write the test questions. After the test items have been drafted, they are professionally edited and then peer reviewed by SMEs. The editing process ensures that the items are consistent in style and format, that they are grammatically correct, and that they clearly present the problem that the examinee is to solve.
Items are normally pilot-tested or field-tested prior to being used on an examination. This process allows test developers to evaluate the item's performance prior to including it as a scored item on an examination.
Results Analysis and Psychometrics
We have administered tests around the world in all types of environments. We will help you determine the best test administration process for your program in whatever the best format is whether computer-based, paper-based or performance-based format.
The Caviart Group can administer tests for you, help you deliver your own tests or help you select one or more external test delivery channels, whichever best meets your needs.
The Caviart Group test developers and psychometricians have years of experience in constructing tests to meet program needs and industry best practices. All of our programs are designed and developed to be legally defensible as valid assessments of candidate ability.
We monitor and analyze initial and ongoing test results to ensure that items are performing correctly and that the tests continue to perform as expected. Our statistical evolution process ensures that tests continue to improve statistically with each edition.