Assessment Details
Academic Year: 2020-2021 Level: Graduate
Campus Department: School of Theology & Ministry [Grad]
Program Type: Major [UG] / Program [Grad]
Program Name: Theology & Ministry MDiv
Description of Data Collection:
– Direct evidence is collected: attached rubrics were created after the 2016 review and are now being used by faculty, associate director of spiritual formation, and ministry supervisors; see MDiv Direct Assessment Map
– Indirect evidence is collected: GSQ and other student surveys (for examples, see attached survey data)
– When presented for analysis, data collection methods are described with adequate detail (for example, # of participants, question or test scale): These are described at faculty meetings along with notes about the statistical significance of data presented
– Data collection method is appropriate (for example, thorough, valid, timely): Rubrics given by faculty to academic services specialist immediately after use; academic services specialist aggregates the data and faculty program director analyzes it for significance before presenting to the EF faculty
– Each outcome has an associated measure (i.e., each outcome is linked to some source of evidence): see MDiv Assessment Map
– Each outcome has clearly defined criteria and/or rubrics that describe different levels of achievement: See MDiv Assessment Map
Review Process:
– Individuals or groups designated responsibility for analyzing the data are identified: Program Director, then EF faculty (for assessment and review years), then EPC and dean ( for review years)
– An analysis plan is clearly described: in the STM Comprehensive Plan of Assessment
– A timeline for analysis and interpretation is specified: in Review and Assessment Cycle, except synthesis exams are reviewed annually as an instrument by EF department based on data from rubrics
– Recommendations for changes which may include how to address identified weaknesses are specified: in the 2016 review, survey data indicated the following student needs: (1) more opportunities to develop pastoral skills, (2) more electives with which to go deeper theologically and/or ministerially, and (3) giving credit for spiritual formation (which
had been a non-credit requirement). The Program Review committee came up with a new curriculum based on these changes; summer or program review and revised programs of study are attached. Meanwhile, the 2019 annual review of the rubric data from the synthesis exams revealed that students were doing less well on the pastoral application
questions. It was noted that, since students taking the synthesis exams in 2019 were on old curriculum, these results provided a baseline from which to evaluate effectiveness of curricular changes made in 2016 program review.
– Results of the analysis are summarized and presented to individuals or groups authorized to make changes: These changes were approved successively by the EF, the EPC, the Dean, and the EFBC Board on February 29, 2016. See attached materials presented and approved at that Board meeting.
Resulting Program Changes:
Timetable and individuals responsible for the implementation of the changes are determined: New curriculum required for Fall 2017 incoming class. Before then, Assessment Committee worked with Program Director to create rubrics, which are now in regular use. There has been some confusion regarding use of the Spiritual
Formation rubrics. The Associate Dean, Academic Affairs is working with the Associate Director, Spiritual Formation to standardize how these rubrics are used.
A process to evaluate the effectiveness of the changes is described (this should include who is responsible for the review and when the review will take place): According to Review and Assessment Cycle, these changes will be reviewed in Spring 2020. The MDiv Program Director will chair the Review Committee, which will include the Associate Dean, Academic Affairs, the Academic Services Specialist, and two additional EF faculty. Program director will present analysis of data and recommendations for any changes at an EF meeting in spring 2020. [See attachments]
Date of Most Recent Program Review:
Timetable and individuals responsible for the implementation of the changes are determined: New curriculum required for Fall 2017 incoming class. Before then, Assessment Committee worked with Program Director to create rubrics, which are now in regular use. There has been some confusion regarding use of the Spiritual
Formation rubrics. The Associate Dean, Academic Affairs is working with the Associate Director, Spiritual Formation to standardize how these rubrics are used.
A process to evaluate the effectiveness of the changes is described (this should include who is responsible for the review and when the review will take place): According to Review and Assessment Cycle, these changes will be reviewed in Spring 2020. The MDiv Program Director will chair the Review Committee, which will include the Associate Dean, Academic Affairs, the Academic Services Specialist, and two additional EF faculty. Program director will present analysis of data and recommendations for any changes at an EF meeting in spring 2020. [See attachments]
Attachments (if available)