DOCUMENT RESUME TM 001 277 ED 060 119 Radic,logic Technologist (medical ser.) 078.368 -- TITLE Technical Report on Development of USES Aptitude Test Battery. Manpower Administration (DOL), Washington, D.C. U.S. INSTITUTION Training and Employment Service. TR-S-80 REPORT NO Jul 67 PUB DATE 23p. NOTE MF-$0.65 EC-$3.29 EDRS PRICE *Aptitude Tests; *Cutting Scores; Evaluation DESCRIPTORS Criteria; Job Applicants; *Job Skills; Norms; Occupational Guidance; *Personnel Evaluation; *Radiologic Technologists; Radiology; Test Reliability; Test Validity GATB; *General Aptitude Test Battery IDENTIFIERS ABSTRACT The United States Training and Employment Service first published in 1947, has General Aptitude Test Battery gwri been included in a continuing program of research to validate the The GATB tests against success in many different occupations. Learning consists of 12 tests which measure nine aptitudes: General Ability; Verbal Aptitude; Numerical Aptitude; Spatial Aptitude; Form Perception; Clerical Perception; Motor Coordination; Finger Dexterity; and Manual Dexterity. The aptitude scores are standard general working population, scores with 100 as the average for the established in and a standard deviation of 20. Occupational norms are significant terms of rinimum qualifying scores for each of the aptitude measures which, when combined, predict job performance. Cutting scores are set only for those aptitudes which aid in predicting the performance of the job duties of the experimental jobs with sample. The GATB norms described are appropriate only for in content similar to that shown in the job description presented personnel this report. A description of the validation sample and a evaluation folly' are also included. (AG) United States Employment Service Test Research Report Development of USES Aptitude Test Battery i\d9 for Radio logic Technologist [medical ser.) 078.368 -41 -t Qat' be. rear U S DEPARTMENT OF HEALTH. EDUCATION & WELFARE OFFICE OF EDUCATION THIS DOCUMENT HAS BEEN REPRO- DUCED EXACTLY AS RECEIVED FROM THE PERSON CR ORGANIZATION ORIG- INATING IT POINTS OF VIEW OR OPIN- IONS STATED DO NOT NECESSARILY REPPESENT OFFICIAL OFFICE OF EDU- CATION POSITION OR PC,-ICY U.S. DEPARTMENT OF LABOR MANPOWER ADMINISTRATION BUREAU OF EMPLOYMENT SECURITY Technical Report on Development of USES Aptitude Test Battery For Radiologic Technologist (medical ser.) 078.368 S-80 U. S. Employment Service in Cooperation with California, Michigan and Pennsylvania State Employment Services July 1967 FOREWORD The United States Employment Service General Aptitude Test Battery Since that time the GATB has (GATB) was first published in 1947. been included in a continuing program of research to validate the tests against success in many different occupations. Because of its extensive research base the GATB has come to be recognized as the best validated multiple aptitude test battery in existence for use in vocational guidance. The GATB consists of 12 tests which measure 9 aptitudes: General Learning Ability, Verbal Aptitude, Numerical Aptitude, Spatial Aptitude, Form Perception, Clerical Perception, Motor Coordination, The aptitude scores are Finger Dexterity, and Manual Dexterity. standard scores with 100 as the average for the general working population, with a standard deviation of 20. Occupational norms are established in terms of minimum qualifying scores for each of the significant aptitude measures which, in For any given occupation, combination, predict job performance. cutting scores are set only for those aptitudes which contribute to the prediction of performance of the job duties of the experi- It is important to recognize that another job might mental sample. have the same job title but the job content might not be similar. The GATB norms described in this repert are appropriate for use only for jobs with content similae7tht shown in t e jp description included in this report. Frank H. Cassell, Director U. S. Employment Service 3 GATB Study Nos. 2074 2389, 2410 and 2647 DEVELOPMENT OF USES APTITUDE TEST BATTERY For Radiologic Technologist (medical ser.) 078.368-030 This report describes research undertaken for the purpose of validating and cross-validating General Aptitude Test Battery (GATB) norms for the occupa- The following norms were tion of Radiologic Technologist 078.368. established: GATB Aptitude Mininum Acceptable GATB Scores G - General Learning Ability 95 - Verbal Aptitude 95 S - Spatial Aptitude 80 RESEARCH SUMMARY Sample: 75 (16 male and 59 female) Isorkers employed as Radiclogic Technologists by various doctors and at various hospitals in Pennsylvania. Criterion: Supervisory ratings Design: Concurrent (test and criterion data were collected at approximately the same time). Minim= aptitude requirements were determined an the basis of a job analysis and statistical analyses of aptitude mean scores, standard deviations, aptitude-criterion correlations and selective efficiences. Concurrent Validity: Phi Coefficient (0) ma .44 (P/2(.0005) Effectiveness of Norms: Only 68 percent of the non-test-selected workers used for this study test-selected with the were good workers; if the workers had been 32 percent of S-80 norms, 83 percent would have been good workers. workers, the non-test-selected workers used for this study were poor 17 if the workers had been test-selected with the S-80 norms, only The effectiveness of the norms percent would have been poor workers. is shown graphically in Table 1: TABLE 1 Effectiveness of Norms With Tests Without Tests 83% 68% Good Workers 17% 32% Poor Workers VALIDATION SAMPLE DESCRIPTION Size: N 75 Occupational Status: Employed workers Work Setting: Workers were employed by various doctors and in various hospitals throughout the State cf Pennsylvania. Employer Selection Re-uirements: High school graduation is generally required for acceptance Education: into training. Registration with the American Society of X-Ray Technicians Experience: requires two years of training in an accredited school or on-the-job training before the registration examinations (rhese requirements may vary in different can be taken. hospitals.) No tests used for acceptance for training. Tests: Principal Activities: are those shown in the Appendix. The job duties for each worker 5 3 Minimum Experience: All workers had twenty months of on-the-job training. TABLE 2 Product-Moment Correla- Means, Standard Deviations (SD), Ranges and Peerson and Experience tions with the Criterion (0 for Age, Education Range SD Mean I. .264* 19-45 28.3 7.3 Age (years) .195 #9-17 1.5 13.1 Education (years) 22-264 .243* 54.8 80.3 Experience (months) years of ftwo trainees with less than 12 education included. *Significant at the .05 level EXPERIMENTAL TEST BATTERY during March and April All 12 tests of the GATB, B-1002A were administered 1955. CRITERION job proficiency. The criterion data consisted of supervisory ratings of by the doctor; Radiolcgic Technologists employed by a private doctor were rated Ratings were made supervisor. those employed at a hospital were rated by the administeredo at approximately the same time as the tests were Ratina,Scale: pertinent A preliminary rating scale consisted of items based on The preliminary job factors taken from the job analysis schedule. scale was scale was reviewed by a prominent doctor before the final thirteen The final descriptive rating scale consisted of set up. (The scale is not available but the items were ratable traits. [Michigan] shown similar to items in the scale for Check Study #2 The doctors and supervisors were instructed to in the Appendix.) the "average technologist" rate each person on each item in relation to Numerical ratings were as above average, average, or below average. assigned arbitrarily to correspond to the qualitative categories, for each item, as follows: Above average = 35 = 20 Average Below average = 5 4 Reliability: Since only one set of ratings was obtained, no measure of criterion reliability is available. Criterion Distribution: Possible Range: 65-455 Actual Range 110-455 Mean: 386.8 Standard Deviation: 88.1 Criterion Dichotomy: The criterion distribution was dichotomized into high and low groups by placing 32% of the sample in the low group to correspond with the percentage of workers considered unsatisfactory or marginal. Workers in the high group were designated as "good workers" and those in the low group as "poor workers." The criterion critical score was 231. APTITUDES CONSIDERED FOR INCLUSION IN THE NORMS Aptitudes were selected for tryout in the norms on the basis of a qualitative analysis of job duties involved and a statistical analysis of test and criterion data. Aptitudes S and Q which do not have a significant correlation with the criterion were considered for inclusion in the norms because the qualitative analysis indicated that an above average or high degree of Aptitude S is required for satisfactory job performance; Aptitude Q had a relatively- high mean score and a relatively low standard deviation. With employed workers, a relatively low standard deviation indicates chat some pre-selection may have taken place and this restricted range of scores (low standard deviation) will depress the correlation between the aptitude and the criterion. A relatively high mean score with employed workers may also indicate some sample pre-selection. Tables 3, 4 and 5 show the results of qua/itative and statistical analyses. - 5 - TABLE 3 Qualitative Analysis (Based on the job analysis the aptitudes indicated appear to be important to the work performed) Aptitude Required to comprehend, learn and apply G - General Learning Ability the basic principles and procedures of Radiologist Technology during formal and on-the-job training; to understand and accurately carry out written or verbal instructions of the radiologists, physcian or supervising technician; to exercise judgment when applying principles of radiology in the use of X-Ray equipment and in caring for the patient. Required to understand, learn and use - Verbal Aptitude medical and technical terminology during training period; to understand, give and follow written and verbal specific Radiology instruction regarding or Fluoroscopy requests and examinations; to converse effectively with patients and medical personnel. Required to visualize the location, size S - Spatial Aptitude and shape of internal organs and bone structures in order to properly position patients and equipment for X-Ray and Fluoroscopy; to estimate thickness of part of anatomy to be radiographed. =ID MID TABLE 4 Means, Standard Deviations (SD), Ranges and Pearson Product-Moment Correla- tions with the Criterion (0 for the Aptitudes of the GATB Aptitude G - General Learning Ability 104.7 77-138 13.8 .295* - Verbal Aptitude 109.8 .283* 15.0 82-147 101.4 N - Numerical Aptitude 74-130 13.7 .428 ** S - Spatial Aptitude 97.3 65-147 -.043 17.2 108.4 P - Form Perception 16.3 69-157 .100 Q - Clerical Perception 116.5 14.2 88-150 .168 K - Motor Coordination 111.9 17.6 .211 62-159 F - Finger Dexterity 108.3 61-163 17.8 .099 M - Manual Dexterity 105.4 19.2 34-143 .198 *Significant at the .05 level **Significant at the .0I level TABLE 5 Summary of Qualitative and Quantitative Data GVNSPQK Type of Evidence Aptitudes Job Analysis Data Important Irrelevant X Relatively High Mean X X X X X Relatively Low Standard Deviation X Significant Correlation X with Criterion X X GVNS Aptitudes to be Considered for Trial Norms DERIVATION AND VALIDITY OF NORMS Final norms were derived on the basis of a comparison of the degree to which trial norms consisting of various coMbinations of aptitudes G, 17, N, S and Q at trial cutting scores were able to differentiate between the 68% of the sample consider-' 4 workers and the 32% of the sample considered poor workers. Trial cutti, ,cores at five-point inter:vela approximately one standard deviation below the mean are tried because this will eliminate about one- third of the sample with three-aptitude norms. For two-aptitude trial norms, 9