Curricular Initiatives: College of Arts and Sciences
The College of Arts and Sciences is committed to a program of annual assessment to improve student learning. A yearly cycle of effective assessment of student learning outcomes is an iterative developmental process. The following examples represent academic programs at various stages of development of their annual program of student assessment.
Department of Biological Sciences
BS, BA, and Dual Degree Programs (PT, PA, AT)
Assessments are conducted annually using various methodologies. To better equip our
students to explore natural sciences, many of our undergraduate courses have a laboratory
component which complements the lecture content, reinforces lecture learning, improves
students’ technical skills, enhances investigative capabilities, helps to develop
critical thinking and problem-solving skills, and nurtures students’ scientific curiosities.
Primary literature, scientific investigations, and research methods are often incorporated
into lectures and laboratory exercises. Student knowledge may be assessed via exams,
quizzes, in-class response systems, and national/normed instruments. Grade distribution
and student retention are examined to identify the strength/weakness and areas that
need more resources. Self-perception assessment gives students the opportunity to
examine their own learning goals and outcomes and to provide feedback for the instructor
to enhance/update course related activities. Our capstone course not only exposes
our students to various cutting-edge studies presented by scientists from other institutions,
but also provides guidance on how to conduct primary literature search, critically
evaluate scientific studies, design experiments, analyze data, and present scientific
findings. Students’ writing, oral communication and critical thinking skills are also
assessed by an independent panel at our annual Biosymposium.
MS in Biology/Microbiology and PhD in Molecular Bioscience (MOBS Program)
Faculty and instructors of the Biology Department conducted several assessments based
on graduate programs learning goals and student learning outcomes during the 2012-2013
school year. Doctoral students in the MOBS program have certain "landmarks" of progress
to follow throughout the course of their program including completion of lab rotations,
preliminary exams, candidacy exams, paper publication, and thesis completion. An evaluation
of the progress attained by students has led to some modifications in the program
and PhD guidelines to account for recognized difficulties students have faced. Critical
Thinking was the common student learning outcome chosen for direct assessment this
year. To assess MS and MOBS students' ability to think critically in the field of
biological sciences, faculty used a rubric to assess the poster presentations of 18
graduate students during the biological sciences symposium at the annual Petersheim
Academic Exposition. The presentation included background information, hypotheses,
results, and conclusions. The students' poster presentations earned an overall average
of 85% with the strongest performance on organization and the weakest performance
in the results. Indirect assessment of student outcomes were also initiated with the
development of new satisfaction surveys that will be fully implement in the coming
years.
Department of Chemistry and Biochemistry
The Department of Chemistry and Biochemistry used standardized subject tests from the American Chemical Society to assess undergraduate students' knowledge in General Chemistry, Organic Chemistry, Biochemistry, Physical Chemistry, Analytical Chemistry, and Inorganic Chemistry which correlated with specific courses in the program. Students graduating with a B.S. in Chemistry scored well within the range of the national scores and fell within the 30-40 percentile. An important measure of outcomes for graduate students in the MS and PHD programs includes publications in co-authored peer-reviewed publications and presentations. The department is currently analyzing this data over several years to assess trends in outcomes.
Department of English
B.A. in English
The Department of the English has been engaged in a yearly cycle of student assessment
for several years. Goals for students graduating with a B.A. in English include: providing
all students with linguistic and literary competency, providing majors with a broad
knowledge and critical understanding of literatures in English, and developing student
ability to think analytically, read close, and write well. Twelve student learning
outcomes (SLOs) have been identified that address these goals, organized into 4 categories:
Content, Rhetoric & Style, Research Methodology & Critical Acumen, and Mechanics.
For the last two years the department has assessed the SLOs by evaluating student
portfolios. The portfolios are scored by four faculty using a common rubric including
the four categories. An effort was made to evaluate inter-rater reliability. Although
improvement in inter-rater correlations improved this year, the reason for improvement
was not clear. Benchmark essays from these initial assessments will be used for norming.
No significant difference in total score performance were observed when the scores
of successive years were compared. In addition to the total rating scores, the number
of positive and negative reviewer comments was coded for each SLO. Analysis of the
specific outcomes indicated that certain outcomes appear to receive greater emphasis
in the portfolios than others. One category, Mechanics, received comments disproportionately
in the negative. Comments in all other categories were more positive than negative.
The results of the assessment report are shared at the department's annual retreat.
At the 2013 retreat the decision was made to have a workshop in the fall for faculty
teaching upper-level literature classes on best practices for having students use
research materials: identifying good sources, understanding them, and using them effectively
in papers.
M.A in English
Student learning outcomes for students graduating with a M.A. in English included
developing students' abilities as graduate level readers, writers, and researchers,
introducing students to traditional and contemporary modes of literary theory, assisting
students' development as scholars and writers, expanding students' knowledge of schools
of theory, historical periods, and literary genres, and developing students' abilities
to do complex close reading. The program assessed students using a Comprehensive Exam,
testing their knowledge, as well as their writing and analytical ability.
Department of History
B.A. in History
The student learning outcomes that were assessed in History Majors (B.A.) for 2012-2013
included: demonstrating "historical fluency", recognizing the significance of available
primary and secondary source material, and demonstrating knowledge of how and why
societies have changed over time. The department implemented a longitudinal study
to compare student proficiency in historical research, writing, and analysis based
on papers submitted in HIST 2180 (Intro to Historical Research) and HIST 5199 (Senior
Seminar). Within these courses the department analyzed research, argument, historiography,
writing mechanics, and citation. Data revealed solid improvement among history majors
in their acquisition of "historical fluency".
Russian and East European Studies (REES)
Faculty and instructors of the Department of History conducted a program assessment
based on program learning goals in the 2012-2013 school year. The Russian and East
European Studies program aims to provide rigorous and comprehensive liberal arts training,
preparing students for continuing engagement with Russia and Eastern Europe throughout
their careers. To assess this target, students had to submit a research project on
a relevant topic.
Department of Language, Literature and Cultures
For the year of 2018-2019, the following programs of LLC (i.e., Asian Studies BA Program (including Chinese and Japanese), Asian Studies MA Program, Classical Studies, German, and Italian Studies submitted an assessment report. A high level summary of each program is given below.
Asian Studies BA Program
For Asian Studies BA Program, Chinese Program continued to administer HSK (i.e., a
standardized Chinese proficiency test) as an exit test among all the students of Chinese.
The passing rate is 83.9% for the students at the introductory level, 90% for the
intermediate levels, 100% for the students in the Advanced Chinese level, and 66.5%
for those in the 4th year of Chinese class. Meeting the learning outcomes, we recommend
students to study abroad so as to achieve a high proficiency. Japanese Program continued
to use JLPT (i.e., Japanese-Language Proficiency Test) and an ACTFL (American Council
of Teaching of Foreign Languages)-based questionnaire to assess student learning of
Japanese language.
Chinese and Japanese
Both Chinese and Japanese will continue to focus on developing students' proficiency
in listening, speaking, reading and writing.
Graduate Program in Asian Studies
Asian Studies in Graduate Program continued to use portfolios and research presentations
for assessment. The results show that students satisfactorily met the two student
learning outcomes set for the year of 2018-2019.
The report suggests that students should participate in more activities, such as academic conference, volunteer, internship, and assistant teacher programs. And the Program is in an urgent need of a tenure line faculty to teach courses and advise MA theses.
German
German Program did an independent Avant Testing, with the test administered during
the 3rd week of Fall 2018, and re-administered during the 3rd week of Spring 2019,
with reading assignments every other week. Based on the results, an evaluation is
planned for Fall 2019.
Italian
Italian Program identified three major specific Student Learning Outcomes for this
year’s assessment: (i). Comprehension and Grammar; (ii). Oral Communication; and (iii).
Linguistic knowledge. Analysis and Actions are forthcoming.
Latin Studies
Latin students in the Classical Studies Program took the National Latin Exam and 50%
of Intermediate Latin II students earned awards.
Department of Mathematics and Computer Sciences
Math
Student learning outcomes for the B.S. in Mathematics are based on the standards of
the NCTM (National Council of Teachers of Mathematics) as well as CUPM (Collegiate
Undergraduate Programs in Mathematics). During the 2012-2013 school year two of the
eleven student learning outcomes were chosen for assessment:
SLO 2. Knowledge of Reasoning and Proof -Students reason, construct, and evaluate mathematical arguments and develop as appreciation for mathematical rigor and inquiry.
SLO 3. Knowledge of Mathematical Communication. - Students communicate their mathematical thinking orally and in writing to peers, faculty and others.
The SLOs were assessed in two courses required for the major (MATH 3912-Junior Seminar and MATH 3515-Analysis I) and one course required for Departmental Honors (MATH 4912-Senior Project). For the junior and senior seminar courses poster and oral presentations, respectively, were assessed at the Petersheim Academic Exposition with a common rubric. For the Analysis I course, the faculty were furnished with a sample of students' final exams and student performance on this exam was discussed at the annual faculty retreat. Department of Mathematics and Computer Science faculty concluded that the student learning objectives are being addressed in an exemplary fashion and that student performance of the two standards was entirely satisfactory. While high-achieving students performed as expected, the department was particularly impressed by the improvement in the students who had not previously distinguished themselves. A paper written by the MATH 3912 class was accepted and published by Graph Theory Notes of New York LXV, 27-32 (2013).
Master of Healthcare Administration Program
Student learning outcomes for the Master of Healthcare Administration (MHA) included students' ability to lead and manage in the healthcare environment, critically think in a complex and competitive environment, develop politics and community in the healthcare environment, communicate, and display professionalism and ethics. The assessment plan for the MHA student competencies included the development of a MHA Competency Self-Assessment Survey, the inclusion of the competency domains in the regular course evaluation form, and the continued use of the American College of Healthcare Executives' (ACHE) Leadership Competency self-assessment as a comparison benchmark. During the 2012-2013 school year the department chose to develop a solid baseline so that the department could then target those learning domains that showed gaps in student learning outcomes. As part of the final set of Graduation Exit surveys, students completed the MHA Competency Self-assessment Survey that asks them to identify which of the six competency domains were of most value to them. Students reported that they were strongest on the "Communication within a Diverse Healthcare Environment" competence and most weak on the "Political and Community Development within the Healthcare Environment" competence. At least 94% of students reported themselves as either competent, proficient, or expert in all six of the MHA Learning Domains.
Department of Philosophy
Philosophy
Student learning outcomes for students in the Philosophy program included student
identification and commenting on the thesis, argument, and conclusions presented in
a text, development of an argument or disagreement with conclusions presented in the
original article, and articulation of the evidence and reasons for one's position.
Faculty focused on indirect measures of assessment for the 2012-2013 academic year
by conducting and reviewing senior surveys. Going forward, the department Curriculum
Committee will provide more guidelines for writing a philosophy paper.
Department of Physics
Physics
For the 2012-2013 academic year the Department of Physics identified one student learning
outcome for assessment of the undergraduate Physics program. The student learning
outcome "Implementation of theoretical concepts of physics to analyze scientific problems"
was assessed in the subject matter of geometrical optics. The Department conducted
pre- and post-tests in three courses covering this subject: PHYS 1702 General Physics
II, PHYS 1706 Principle of Physics II, and PHYS 3217 Modern Optics.
Department of Political Science
Political Science
The Political Science Department administers an exit survey to its majors as they
complete Senior Seminar. This survey asks about student's learning experiences in
the political science curriculum and their preparedness as they approach graduation.
We will continue to use this survey instrument, but we will modify certain questions
to improve its usefulness. The department also developed a new assessment instrument
,an (ungraded) pre- and post-test that asks students to respond to an op-ed piece
related to a political science topic. The test consists of four questions:
- What are the key points the writer makes ?
- What evidence does the writer use to support his/her argument?
- What debate (or debates) within political science scholarship are relevant to the article?
- What political science terminology is used (or could be used) to discuss the topic?
The rubric for evaluating this test will include the four questions above, and will add an additional (5 th) evaluation component focusing on the student's writing: mechanics, logic, organization and clarity. These five test questions track the assessment outcomes listed on our department website. The instrument is administered to incoming first-year students, and to seniors. Comparing the two results will allow us to measure what students have learned over the course of completing the major.
Department of Psychology
Psychology B.A. & B.S & Honors
The Psychology Department adopted the undergraduate learning goals and related outcomes
recommended by the American Psychological Association as the Student Learning Outcomes (SLOs) for the BA, BS, BA/BS-Honors Psychology programs.
The department includes all Goals and Outcomes on the course syllabi with the specific
SLOs that are covered by a course explicitly marked. The syllabi were used to identify
the SLOs addressed by psychology courses and to create a curriculum map. A review
of the curriculum map confirmed that all learning goals are covered in the curriculum,
although to different degrees. The most frequently covered goal was Goal 3 - Critical Thinking Skills in Psychology (82.4%); the least covered was Goal 4- Application of Psychology (39.5%). During the 2012-2013 academic year the department decided to directly measure
critical thinking skills in four target courses with a common rubric. The rubric was
used to score student essays assigned in the courses. At the annual department assessment
meeting the faculty discussed the appropriateness of the rubric as a direct measure
of critical thinking and reviewed the students' performance. The faculty concluded
that two of the six categories of the rubric items did not directly address critical
thinking and skeptical enquiry and should be deleted. It was clear from the results
that students are not proficient in critical thinking skills despite the fact that
critical thinking was the most frequently covered goal in the curriculum map. Interestingly,
the results of the senior survey indicated that compared to all other goals the critical
thinking goal was identified as "thoroughly addressed" by the fewest number of students
(the department administers an annual senior survey as an indirect measure of student
attitudes and experiences). It was concluded that students must be given explicit
and repeated instructions to engage in critical thinking. The next step is to identify
consistent "places" throughout the curriculum that might lend themselves to explicit
"teaching" of critical thinking skills. The department also initiated a pilot project
to evaluate the feasibility of an ePortfolio requirement for future assessment activities.The
purpose of the pilot was to determine 1) the ease with which students can learn to
use WordPress to post artifacts, 2) the interest in, and facility with, going beyond
the basic features of the WordPress ePortfolio template, and 3) student's motivation
to develop the ePortfolio beyond the basic course requirements.
M.S. in Experimental Psychology
During the 2012-2013 academic year the Psychology Department decided to assess the
presentation skills of graduate students in the MS Program in Experimental Psychology.
Student's oral presentations were evaluated in two graduate courses and during the
Petersheim Academic Exposition. At the 2013 Academic Exposition 12 students gave oral
presentations, 8 graduate students and 4 undergraduate Psychology Honors students.
The full-time faculty in attendance at the symposium (n = 5) rated the student presenters
with the Oral Presentation rubric that was provided by the University Assessment Center.
The same rubric was used to assess oral presentations in the two graduate courses.
The results were compiled and discussed at the Psychology Department's annual assessment
meeting. The main goal of this initial assessment was to evaluate the usefulness of
the rubric for assessing student oral presentation skills and to determine how students
performed in their oral presentations. Because some faculty gave consistently lower
scores than others the raw scores were standardized for each faculty rater by converting
them into Z-scores. In general, there was consistency in how faculty rated the performance
of most students. For example, the same 6 students were identified as at or above
average by all faculty and 2 students were consistently identified as the lowest performers.
However there was disagreement with some of the remaining students. Some items in
the rubric were edited in an attempt to improve inter-rater reliability for next year's
assessment activities. Overall the students did well with their presentations with
graduate students scoring slightly higher than undergraduate honors students, although
this difference was not statistically significant. The department also developed a
graduate student survey (using SurveyMonkey) for indirect measures of student experiences
and attitude. Generally, the M.S. program received very positive reviews by the students.
Department of Religion
Religion
Student learning outcomes for students a program in the Department of Religion included
student demonstration of 1) knowledge of Christian and non-Christian religions, 2)
understanding of contemporary debates that effect human flourishing in relation to
and in light of religious texts, 3) an ability to interpret contemporary issues in
the light of the theological and ethical commitments, and 4) an ability to offer an
analysis of topics in religion. Faculty reviewed and discussed course artifacts brought
to a department assessment meeting. Each faculty member shared examples of excellent,
good, and poor artifacts (exams, presentation reports, and papers). The most prominent
student learning outcomes covered in the artifacts were outcomes #1 and #4. The department
covers outcome #1 (knowledge base) quite well and the departmental artifacts show
this. Even at the poorer levels, students show a basic knowledge base. Student ability
to apply moral principles to a particular contemporary issue (outcome #3) in a nuanced
and intelligent manner was mixed. Faculty decided to experiment with alternatives
to the research paper (e.g., intensive analysis of faculty-chosen material rather
than extensive research). The goal is to support class learning/material with more
pedagogically useful assignments than, to this point, the research paper has proven
to be.
Department of Sociology, Anthropology and Social Work
Sociology & Anthropology
Student learning outcomes for students in the Sociology & Anthropology program included
student familiarity with sociological and anthropological theories, exposure to a
range of substantive concentrations within the two disciplines, training in the logic
of research methodology, and development of the capacity to analyze contemporary issues
and controversies. Two exit interviews were conducted in the senior seminar course
to assess the sociology and anthropology programs.
Social Work
The Social Work program has been engaged in several years of extensive assessment
of program level goals and student learning outcomes for accreditation requirements
of the Council of Social Work Education. Student learning outcomes have been assessed in numerous courses and field work.
Assessments were conducted by classroom faculty as well as field instructors and included
evaluation of specific assignments and performance in the field. The observation of
improved student scores for Senior Field II compared to Senior Field I, for example,
demonstrates an efficacious paradigm of incremental, integrated, and cumulative preparation
for professional practice. In the 2013 "Reaffirmation of Accreditation Progress Report"
that was submitted to the Council of Social Work Education the authors of the report summarized their assessment activities during the accreditation
process, "…the data affirmed how diligent our faculty and students are. We all not
only learned from this process that will continue, but have internalized it."