resources

General Resources for Program Evaluation

III. Professional Organizations on Program Evaluation

I. How-to Books on Program Evaluation

GENERAL

Fetterman, D.M., & Wandersman, A. (2005). Empowerment evaluation principles in Practice. New York: Guilford Publications.

Herman, J. L. (Ed.). (1987). Program evaluation kit (2nd ed.). Thousand Oaks, CA: Sage Publications.

1. Herman, J. L., Morris, L. L., & Fitz-Gibbon, C. T. (1987). Evaluators handbook. Newbury Park, CA: Sage Publications.
2. Fitz-Gibbon, C.T. & Morris, L.L. (1987). How to analyze data. Newbury Park, CA: Sage Publications.
3. Stecher, B. M., & Davis, W. A. (1987). How to focus an evaluation. Newbury Park, CA: Sage Publications.
4. Fitz-gibbon, C. T., & Morris, L. L. (1987). How to design a program evaluation. Newbury Park, CA: Sage Publications.
5. Patton, M. Q. (1987). How to use qualitative methods in evaluation. Newbury Park, CA: Sage Publications.
6. King, J. A., Morris, L.L., & Fitz-Gibbons, C.T. (1987). How to assess program implementation. Newbury Park, CA: Sage Publications.
7. Fitz-Gibbon, C. T., & Morris, L. L. (1987). How to analyze data. Newbury Park, CA: Sage Publications.
8. Henerson, M. E., Morris, L. L., and Fitz-Gibbon, C. T. (1987). How to Measure Attitudes. Newbury Park, CA: Sage Publications.
9. Morris, L. H., Fitz-Gibbon, C. T., & Lindheim, E. (1987). How to measure performance and use tests. Newbury Park, CA: Sage Publications.
10. Morris, L. H., Fitz-Gibbon, C. and Freeman, M. (1987). How to communicate evaluation findings. Newbury Park, CA: Sage Publications.

Patton, M. Q. (1997). Utilization focused evaluation: The new century text. Thousand Oaks, CA: Sage.
NOTE: A very practical and theoretical book that offer novice evaluators guidelines to make ethical and user-focused choices throughout the evaluation process.

Posavac, E. J. & Carey, R. G. (2003). Program Evaluation: Methods and Case Studies. NY: Prentice Hall.

Rossi, P. H., Lipsey, M. W., Freeman, H. E. (2004). Evaluation: A systematic approach (7th ed.). Thousand Oaks, CA: Sage.

The Joint Committee on Standards for Educational Evaluation (1994). The program evaluation standards: How to assess evaluations of educational programs (2nd ed.). Newbury Park, CA: Sage.

Weiss, C. H. (1998). Evaluation (2nd ed). Upper Saddle River, NJ: Prentice Hall.

LANGUAGE

Alderson, J. C., & Beretta, A. (1992). Evaluating second language education. Cambridge: Cambridge University Press.

Birckbichler, D. (Ed.) (2006). Evaluating foreign language programs: Content, context, change. Columbus, OH: The Ohio State University Foreign Language Publications

Brown, J. D. (1994). The elements of language curriculum: A systematic approach to program development. Boston: Heinle & Heinle.

Kiely, R., & Rea-Dickins, P. (2005). Program evaluation in language education. New York: Palgrave Macmillan.

Lynch, B. K. (1996). Language program evaluation: Theory and practice. Cambridge: Cambridge University Press.

Lynch, B. K. (2003). Language assessment and programme evaluation. Edinburgh, UK: Edinburgh University Press.

Rea-Dickins, P., & Germaine, K. (1992). Evaluation. Oxford: Oxford University Press.

Rea-Dickins, P., & Germaine, K., P. (Eds.). (1998). Managing evaluation and innovation in language teaching: Building bridges. London: Longman.

Weir, C., & Roberts, J. (1994). Evaluation in ELT. Oxford: Blackwell.

II. Online Advice on Program Evaluation

RECOMMENDED HOW-TO-SITES

Introduction to Evaluation
http://www.socialresearchmethods.net/kb/intreval.htm
This is a comprehensive online textbook on program evaluation. Topics include general social science research methodologies and evaluation models and methods.

The Instructional Assessment Resources (IAR) Web Site
http://www.utexas.edu/academic/diia/assessment/iar/index.php
This site introduces various methodologies and best practices in assessing classroom instruction and learning, including applications to instructional technologies. This site answers whys and hows of assessment with lots of practical advice, and it includes sections on program evaluation and educational research.

Online Evaluation Resource Library
http://oerl.sri.com/instruments/cd/instrCD.html
This site contains a number of professional development modules, including designing evaluation and data collection plans, and developing written questionnaires, interviews, and observation instruments. Each evaluation module provides steps and strategies, a scenario, a case study, and references.

Program Development and Evaluation
http://www.uwex.edu/ces/pdande/index.html
This site provides a variety of learning resources. Practical suggestions and examples can be found under “quick tips” (e.g., planning evaluation, collecting information, analyzing data, communicating results, etc.).

Program Evaluation
http://www.extension.psu.edu/evaluation/category.html
Pennsylvania State University, College of Agricultural Sciences offers tools, tip sheets, examples, and resource lists. Tip sheets are organized by topics and are particularly useful.

The Evaluation Center
http://www.wmich.edu/evalctr/
The Evaluation Center (Western Michigan University) seeks to advance the theory, practice, and utilization of evaluation. The site provides extensive resources, such as check-lists for evaluators, glossaries, a searchable evaluation library database, and reports.

ELECTRONIC EVALUATION HANDBOOKS

User-Friendly Handbook for Mixed Method Evaluations
http://www.nsf.gov/pubs/1997/nsf97153/start.htm
The National Science Foundation aims to provide practical advice on evaluation methodology. Key evaluation concepts and various qualitative and quantitative methodologies are introduced.

Evaluation handbook
http://www.ncela.gwu.edu/files/rcd/BE020502/Evaluation_Handbook.pdf
This handbook is aimed for those who are involved in evaluation of educational programs (especially Title I programs). The handbook describes evaluation purposes, basic definitions of program evaluation, and how to plan, implement, and report program evaluation.

ELECTRONIC ETHICS AND STANDARDS

The American Evaluation Association has developed key ethical guidelines and principles for evaluators.

Guiding principles for evaluators
http://www.eval.org/Publications/GuidingPrinciplesPrintable.asp

The personnel evaluation standards
http://www.eval.org/EvaluationDocuments/perseval.html

The program evaluation standards
http://www.eval.org/EvaluationDocuments/progeval.html

III. Professional Organizations on Program Evaluation

American Evaluation Association
http://www.eval.org/
Note: The AEA lists numerous local affiliate organizations around the U.S.

International Organization for Cooperation in Evaluation
http://ioce.net/members/eval_associations.shtml
Note: The IOCE lists a large number of links to evaluation professional organizations around the globe.

IV. Journals on Program Evaluation

GENERAL

Below are listed a variety of professional journals dedicated to program evaluation for all types of programs. The journals with asterisks (*) indicate journals are highly practice-oriented.

· *American Journal of Evaluation
· American Educational Research Journal
· Assessment and Evaluation in Higher Education
· Canadian Journal of Program Evaluation
· Educational Evaluation and Policy Analysis
· Educational Research and Evaluation
· Evaluation Review
· Evaluation
· *New Directions for Evaluation
· *Practical Assessment, Research and Evaluation (free online journal) http://pareonline.net/

LANGUAGE

None of the journals above are specific to language programs. Most language program evaluation work has appeared in the following journals, although none makes a particular claim to be “the” journal on language program evaluation.

· ADFL Bulletin
· Applied Linguistics
· ELT journal
· English for Specific Purposes
· Foreign Language Annals
· Language Assessment Quarterly
· Language Teaching Research
· Language Testing
· Modern Language Journal
· TESOL Quarterly