Assessment Details
Academic Year: 2020-2021 Level: Graduate
Campus Department: Lynch School of Education & Human Development [UG and Grad]
Program Type: Major [UG] / Program [Grad]
Program Name: Research & Evaluation Methods MA (Link)
Description of Data Collection:
The department uses multiple sources of information to evaluate whether our graduates have met the achieved stated outcomes for the degree.
a. Formal assessment information: All MA students are required to pass the Comprehensive Exam prior to graduation. The exam allows faculty to evaluate whether students have mastered the formal learning outcomes. The exam consists of a comprehensive paper that requires students to use knowledge acquired across all their courses. This project, determined each year by the faculty, may be (among other possibilities) a critical review of a published article, or a detailed proposal for a quantitative research project, or an evaluation design proposal for a specific context. Students have their final month in the their program to complete the paper.
b. Exit Surveys: All graduates of the program complete an exit survey that asks them to self-report on how well the program prepared them to meet the formal learning outcomes.
Review Process:
The Department Chair, faculty, and coordinators, meet monthly to discuss issues such as curriculum coverage, student coursework deficiencies, etc. Changes are made when necessary.
Resulting Program Changes:
A). The original multiple choice exam was dropped in favor of the more applied paper. In addition, we realized that, based on feedback from the students, the paper could be used as a “demonstration of learning product” useful for future applications for employment or PhD programs. The students and faculty are very satisfied with this exam adaptation.
B). The survey responses have led to extensive curriculum modifications presently underway. These include reducing content redundancy, collapsing courses into more integrated offerings, and explicitly incorporating conversations of social justice and racial bias and inequities into our lectures and practice.
C). In addition, the MESA department has reviewed the data and has introduced new courses so that students can meet the formal learning goals of the program. Courses on multilevel regression modeling, technology-enhanced assessment methods, advanced psychometrics, and mixed methods have been introduced so that students are better prepared to understand research, evaluation, statistics, measurement and assessment methodology; critically analyze published quantitative and qualitative research; interpret and report quantitative and qualitative designs, procedures, and results; and communicate research findings effectively. Based on data we collected from the learning outcomes, the department also introduced opportunities for students to practice their applied research skills through consulting workshops and has set up specialized topic lectures so students can get additional knowledge that may not be discussed in class or coursework.
Date of Most Recent Program Review:
A). The original multiple choice exam was dropped in favor of the more applied paper. In addition, we realized that, based on feedback from the students, the paper could be used as a “demonstration of learning product” useful for future applications for employment or PhD programs. The students and faculty are very satisfied with this exam adaptation.
B). The survey responses have led to extensive curriculum modifications presently underway. These include reducing content redundancy, collapsing courses into more integrated offerings, and explicitly incorporating conversations of social justice and racial bias and inequities into our lectures and practice.
C). In addition, the MESA department has reviewed the data and has introduced new courses so that students can meet the formal learning goals of the program. Courses on multilevel regression modeling, technology-enhanced assessment methods, advanced psychometrics, and mixed methods have been introduced so that students are better prepared to understand research, evaluation, statistics, measurement and assessment methodology; critically analyze published quantitative and qualitative research; interpret and report quantitative and qualitative designs, procedures, and results; and communicate research findings effectively. Based on data we collected from the learning outcomes, the department also introduced opportunities for students to practice their applied research skills through consulting workshops and has set up specialized topic lectures so students can get additional knowledge that may not be discussed in class or coursework.
Attachments (if available)