Software Evaluation Criteria

Information in the Program These information criteria cover the following aspects of the program: - relevance to the audience, - appropriate language, - organization of the information, and - information quality. Career Development Process These criteria evaluate the compatibility of the program with important career development principles. User Interaction These criteria cover the user's interaction with: - the program, - the objectives and features of the program, and - your analysis of it. Technical Aspect of the Software and Materials These criteria cover aspects of the computer hardware and programs. Support Services These criteria cover aspects of support for professionals who implement the program: written materials - staff training - service - cost For each applicable criterion, rate the program: 5 = Outstanding 4 = Good 3 = Satisfactory 2 = Poor 1 = Unsatisfactory Outstanding 5 4 Unsatisfactory 3 2 1

Percentage Rate Average Information in the Program 20% 0 10 1. The information is clear, concise, and informative to the intended audience 2. The language is nondiscriminatory. Content is free from race, ethnic, gender, age, and other stereotypes 3. The content is free from spelling and grammatical errors 4. All subjects are covered in a comprehensive manner. It covers all relevant instructional programs. 5. The information for each topic encourages comparisons among schools or occupations

Percentage Rate Average Information in the Program 20% 0 10 6. The information is based on empirical data that are current and valid 7. Updated information is distributed promptly 8. In a personal search questionnaire, there is a clear, empirical relationship between characteristics of the user and those of the occupations, schools, or other activities being sorted 9. In a program using off-line or computer-administered assessment instruments, those instruments conform to accepted standards of validity and reliability 10. Advice is clearly distinguished from factual information. The sources of advice are identified 11. Statements made in one component are consistent with those made in other components of the program Percentage Rate Average Career Development Process 10% 0 5 1. The program motivates individuals to develop their own career plans 2. The program fosters self-knowledge relevant to work and learning 3. The program helps individuals to integrate and develop their values, interests, abilities, skills, and goals 4. Using the program broadens an individual's awareness of current options for employment and education 5. The program supports informed decision making by helping individuals generate ideas, obtain necessary information, and evaluate alternatives in responsible and personally relevant ways 6. Using the program integrates planning with previous experiences 7. The user, not the program, controls the decision making 8. The structure of the program demonstrates that career planning is a developmental, lifelong process 9. The program is appropriate for individual use 10. The program is appropriate for small group use 11. The program can be a useful resource in a counseling program 12. The program provides information that can be useful in instruction 13. Using the program contributes to a person's career development Percentage Rate Average User Interaction 25% 0 12.5 1. The purpose of the program is well defined and clearly explained to the user 2. The organization is clear, logical, and effective, making it easy for the intended audience to understand

Outstanding 5 4

Unsatisfactory 3 2 1

Outstanding 5 4

Unsatisfactory 2 1

Outstanding 5 4

Unsatisfactory 3 2 1

formatted by jbmr

2 of 4

Percentage Rate Average User Interaction 25% 0 12.5 3. The language in the program and in the user's guide is clear to the intended audience 4. User materials are easy to use, appealing to users, and readily available 5. Prerequisites are identified and instruction is provided in the software or in the user guides so individuals can run the program and understand its results 6. The individual has the choice of going directly to desired information or using a structured search to identify relevant topics 7. The individual can operate the program independently, creating his or her own sequence of presentation and review 8. The program acknowledges input. Feedback on user responses is employed effectively 9. Invalid commands are handled constructively. The program tolerates variations in command formats (e.g., upper or lower case, extra spaces, etc.) 10. Individuals can easily start and exit the program. It is easy to back up, change answers, and give commands 11. If there are "help" and "hint" messages, they are easy to access 12. If the program contains tests of knowledge or skill, it reports which items were missed and which were correct 13. The program is attractive and interesting. It motivates users to continue using the program and exploring career options 14. The program is demonstrably effective with the intended audience, including people of varying abilities and experiences 15. The program can be used by various cultural groups 16. The program achieves its purpose Percentage Rate Average Technical Aspect of the Software and Materials 30% 0 15 1. The system uses standard equipment that is reliable, widely available, and applicable to a variety of uses 2. Computer capabilities such as graphics, color, or sound are used for appropriate instructional reasons 3. If the program requires special equipment, the requirements are minimal and clearly stated by the developer 4. The program is reliable in normal use. Software is at least 80% bug free 5. The program provides a copy or summary of its basic information to the user for future reference 6. Printouts are clear and well organized. The printouts are dated 7. Updates can be loaded easily into the system 8. If any processing in the program is based on assessment scores, course grades, or other client records, the program explains to the user how the records are being used

Outstanding 5 4

Unsatisfactory 3 2 1

Outstanding 5 4

Unsatisfactory 3 2 1

formatted by jbmr

3 of 4

Percentage Rate Average Technical Aspect of the Software and Materials 30% 0 15 9. If the program uses client records, it does not restrict an individual in exploring any of the information in the program 10. If the program creates a permanent record for a user, that record is secure and confidential. There is provision for erasing the record when the information is no longer valuable in providing services Percentage Rate Average Support Services 15% 0 7.5 1. The site coordinator's manual explains the content and process for updating information 2. Print or computer materials explain the content and effective use of the program to local site coordinators 3. Training on appropriate and effective use of the program is provided 4. There is a system of communication between user sites and the system developer which may include newsletters, telephone assistance, and annual evaluations 5. On-site technical assistance is available for effective program use 6. Evaluations of the program's effectiveness are available to site coordinators 7. The cost per user makes it feasible to serve most clients who can benefit from the program Percentage Rate Average 100% 0 50

Outstanding 5 4

Unsatisfactory 2 1

Outstanding 5 4

Unsatisfactory 3 2 1

Remarks

Summary Comments
Major Strengths:

Major Weaknesses:

Other Comments:

Evaluation prepared by: Date:

formatted by jbmr

4 of 4