The following are publications and presentations produced by staff and participants in conjunction with the Foreign Language Program Evaluation Project. Where possible, we will provide direct links to related web-based documents. This page is updated frequently.
Publications
Norris, J. M. (Ed.) (2008). Special issue: Understanding and improving language education through program evaluation. Language Teaching Research, 12(4).
Norris, J. M. (2008). Understanding and improving language education through program evaluation: Introduction to the special issue. Language Teaching Research, 12(4).
Norris, J. M. (2008). Validity evaluation in foreign language assessment. New York: Peter Lang.
Faculty Working Group on Foreign Language Program Evaluation. (2007). Developing useful evaluation practices in college foreign language programs: Showcase session. (NFLRC NetWork #48) [PDF document]. Honolulu: University of Hawaii, National Foreign Language Resource Center. http://nflrc.hawaii.edu/networks/NW48.pdf
Mackay, R. (2007). Foreign language program evaluation project: External evaluation report. Honolulu, HI: Foreign Language Program Evaluation Project, University of Hawaii at Manoa. [view report]
Sinicrope, C., Norris, J.M., and Watanabe, Y. (2007). Understanding and assessing intercultural competence: A summary of theory, research, and practice. Honolulu, HI: Technical report for the Foreign Language Program Evaluation Project. [view report]
Norris, J. M. (2006). Assessing foreign language learning and learners: From measurement constructs to educational uses. In H. Byrnes, H. Weger-Guntharp, & K. Sprang (Eds.), GURT 2005: Educating for Advanced Foreign Language Capacities: Constructs, Curriculum, Instruction, Assessment (pp. 167-187). Washington, DC: Georgetown University Press.
Norris, J. M. (2006). Development and evaluation of a curriculum-based German C-test for placement purposes. In R. Grotjahn (Ed.), Der C-Test: Theoretische Grundlagen und praktische Anwendungen (vol. 5) (pp. 45-83). New York: Peter Lang.
Norris, J. M. (2006). The why (and how) of student learning outcomes assessment in college FL education. Modern Language Journal, 90(4), 590-597.
Norris, J. M. (2006). [Review of B. Lynch (2003). Language assessment and programme evaluation.] Studies in Second Language acquisition, 28(3).
Watanabe, Y., & Norris, J. M. (2006). Foreign language program evaluation: An annotated bibliography of resources for foreign language educators. Honolulu: University of Hawai‘i, National Foreign Language Resource Center. http://www.nflrc.hawaii.edu/evaluation/biblio/index.cfm
Presentations
Norris, J. M. (2008, August). Evaluating task-based language teaching and learning (research) from an educational programs perspective. Paper presented at the refereed colloquium “Task-based language learning, and task-based teaching. How are they related”, at the 15th World Congress of Applied Linguistics (AILA), Essen, Germany (August 25, 2008).
Norris, J. M. (2008, April). Constructs and consequences: Toward useful assessment in the humanities. Invited presentation at the University of Notre Dame, South Bend, IN (April 3, 2008). [view handout]
Norris, J. M., & Ortega, L. (2008, April). Measurement for understanding: The case of complexity, accuracy, and fluency. Paper presented at the invited colloquium “Complexity, accuracy, and fluency in second language acquisition: Theoretical and methodological perspectives”, annual conference of the American Association of Applied Linguistics, Washington, DC (April 1, 2008).
Norris, J. M. (2008, March). Making the most of assessment and evaluation in college foreign language programs. Invited presentation at the Language Resource Center, Cornell University, Ithaca, NY (March 26, 2008).
Norris, J. M. (2008, March). Assessing intercultural (communication) learning: Indicators, methods, uses. Invited workshop at Duke University, Durham, NC (March 21, 2008). [view workbook]
Norris, J. M. (2008, March). Assessment and evaluation in the humanities: Retrospect and prospect. Invited presentation at Duke University, Durham, NC (March 20, 2008).
Watanabe, Y., & Sinicrope, C. (2008, March). Linking the how to the why: Methods decisions in foreign language program evaluation. Invited workshop at the Foreign Language Program Evaluation Summit, University of Hawaii, Honolulu, HI (March 13, 2008). [view powerpoint] [view handout] [view resources] [view worksheets]
Norris , J. M., & Watanabe, Y. (2007, November). Roles and responsibilities for evaluation in foreign language programs. Invited session delivered at the annual meeting of the Japan Association of Language Teachers, Tokyo, Japan (November 24, 2007). [view powerpoint] [view booklet]
Norris, J. M. (2007, November). Learning to value evaluation in language teaching. Plenary address delivered at the annual meeting of the Japan Association of Language Teachers, Tokyo, Japan (November 23, 2007). [view powerpoint] [view handout]
Norris, J. M. (2007, October). Using assessment for understanding and improving language education. Invited presentation at the Berkeley Language Center, University of California, Berkeley, CA (October 12, 2007). [view handout]
Norris, J. M. (2007, September). Making the most of assessment and evaluation in college foreign language programs. Invited presentation at the Language Institute, University of Wisconsin, Madison, WI (September 10, 2007). [view handout]
Norris, J. M. (2007, September). Use-oriented assessment and evaluation. Invited
workshop at the Language Institute, University of Wisconsin,
Madison, WI (September 10, 2007).
Watanabe, Y., & Hill, Y. (2007, September). User and use focused conference evaluation: Collaboration, negotiation, and action. Poster presented at the 2nd Annual Hawaii-Pacific Evaluation Conference, Honolulu, HI. [view poster pdf]
Norris, J. M. (2007, June). Understanding program evaluation in college foreign language education. Plenary address delivered on the invited panel “Toward useful program evaluation in college FL departments” at the annual summer meeting of the Association of Departments of Foreign Languages, University of Hawaii, Honolulu (June 8, 2007).
Norris, J. M. (2007, May). Making the most of assessment and evaluation in college foreign language programs. Invited presentation at the Department of Romance Languages, University of Notre Dame, South Bend, IN (May 4, 2007). [view handout]
Norris, J. M., & Liskin-Gasparro, J. (2007, May). Linking assessments to actions: Moving from doing to using assessments. Invited workshop at the Department of Romance Languages, University of Notre Dame, South Bend, IN (May 4, 2007). [view handout]
Norris, J. M., (2007, April). Educational context, epistemological competition, and the future of task-based research: A program evaluation perspective. Paper presented at the refereed colloquium “Towards and educational agenda for research into task-based language teaching”, Social and Cognitive Perspectives on Language Learning and Teaching conference, Auckland, New Zealand (April 13, 2007).
Watanabe, Y., & Pang, A. (2007, March). Program evaluation: Utilizing needs analysis for decision making. Paper presented at the 41st TESOL Annual Convention, Seattle, WA. [view handout]
Watanabe, Y., Gonzalez-Lloret, M., Hill, Y., & Yang, W. (2007, February). Putting Useful Program Evaluation into Practice. Invited presentation at the Second Lantuage Teaching & Curriculum Center, Demos & Discussion Workshop, University of Hawaii at Manoa, Honolulu, HI (February 9, 2007). [view handout]
Watanabe, Y. (2007, Februrary). Utilizing program evaluation for program improvement and articulation. Poster presented at the The 2007 Hawaii TESOL Conference, Honolulu, HI.
Norris, J. M. (2006, November). Assessment and evaluation in college foreign language programs: Past, present, and future tense. Invited presentation at the School of Foreign Languages, University of Maryland, College Park, MD (November 27, 2006).
Norris, J. M. (2006, November). The transformative potential of assessment in college foreign language education. Paper presented at the invited colloquium “The outcomes of collegiate FL programs: Specification, curricular implementation, assessment”, annual conference of the American Association of Teachers of German, Nashville, TN. [view handout]
Norris, J. M., Watanabe, Y., & González-Lloret, M. (2006, November). Program evaluation in college foreign language education: Need, capacity, development. Session presented at the annual convention of the American Council on the Teaching of Foreign Languages, Nashville, TN. [view brochure]
Watanabe, Y. (2006, November). Taking programmatic actions through program evaluation. Poster presented at the Dynamic Teacher Communities: Professional & Organizational Development Symposium, Saitama, Japan.
Norris, J., Gonzalez-Lloret, M., & Watanabe, Y. (2006, September). Identifying and responding to evaluation needs in college foreign language programs. Poster presented at the 1st Conference of the Hawaii-Pacific Evaluation Association, Honolulu, HI. [view poster pdf]
Norris, J. M. (2006, June). Using assessment for understanding and improving college FL curriculum. Paper presented in the invited colloquium "Assessing Student Competencies, the Curriculum, and Faculty Members in New Research Areas", at the annual summer meeting of the Association of Departments of Foreign Languages, University of Wisconsin, Madison (June 30, 2006). [view handout] [view powerpoint]
Norris, J. M. (2006, February). First things first: Why assess in the liberal arts? Paper presented in the invited colloquium "How to assess success in a liberal arts education", at the Arts and Sciences Symposium: The value/values of a liberal arts education, University of Hawai'i (February 7, 2006).
Norris, J. M., & Watanabe, Y. (2005, November). Responding to program evaluation demands in college foreign language education. Session presented at the annual convention of the American Council on the Teaching of Foreign Languages (ACTFL), Baltimore, MD (November 18, 2005). [view handout]
Norris, J. M. (2005, September). The essential roles of assessment, measurement, and evaluation in task-based language teaching. Plenary address presented at the First International Conference on Task-Based Language Teaching, University of Leuven, Belgium (September 23, 2005). [view powerpoint]
Norris, J. M. (2005, September). Invited discussant for the symposium "Taking text to task: Issues and choices in curriculum development", at the First International Conference on Task-Based Language Teaching, University of Leuven, Belgium (September 23, 2005).
Norris, J. M. (2005, March). Assessing advanced foreign language learning and learners: From measurement constructs to educational uses. Plenary address delivered at the 54th annual Georgetown University Round Table on Languages and Linguistics, Georgetown University, Washington, DC (March 12, 2005).
Norris, J. M. (2004, June). Meeting the diverse challenges of assessment in college foreign language programs. Plenary address delivered at the annual summer meeting of the Association of Departments of Foreign Languages, University of New Mexico, Albuquerque (June 11, 2004). [view handout]