Academic Rigor White Paper 1: A Comprehensive Definition

Authored by Andria F. Schwegler, Associate Professor of Psychology in the Counseling and Psychology Department at Texas A&M University - Central Texas

Andria teaches a range of fully online courses at the graduate and undergraduate levels, including statistics, research methods, history of psychology, and social psychology in addition to courses in the psychology of learning and educational technology. She is the Graduate Coordinator for the Master of Science in Educational Psychology program.

Given the absence of a widely accepted definition of academic rigor, an erosion of academic expectations in the learning context is a threat to student learning. An objective, measurable definition of academic rigor can facilitate high expectations by prompting a review and implementation of research-based practices. Evidential support for decisions made in crafting and maintaining the learning context provides a rationale for educators to uphold standards even when confronted with resistance or pressure to lower expectations. The first in a three-part series (Paper 2 and Paper 3) from this invited author, this QM white paper provides the reader with background on the concept and use of the term academic rigor, along with a comprehensive definition of the term.


The Role of Learning in Higher Education

Discussions of academic rigor assume that the purpose of obtaining a higher education is to advance student learning, and academic rigor is a mechanism to do so. Today, however, learning as the primary goal of higher education is being questioned as many struggle to identify what the purpose of higher education is or how it applies to real world and work contexts (Francis, 2018; Jaschik & Lederman, 2018; Labaree, 1997). Concerns are supported by evidence revealing that institutions of higher education are marketing experiences unrelated to learning (Hartley & Morphew, 2008; Saichaie & Morphew, 2014) and that most adults report attending college to get credentials for jobs instead of to learn or gain knowledge (Strada-Gallup Education Consumer Survey, 2018, January). These perceptions suggest that higher education serves a social and job credentialing function instead of promoting student learning, undermining the value of academic rigor in the learning context.


Empirical Evidence on Student Learning

Recent research evidence indicates that students accrue small learning gains in the first two years of college (Arum & Roksa, 2011; Blaich & Wise, 2011; Roohr, Liu, & Liu, 2016) and continue on this trajectory of small gains during the last two years of college (Arum & Roksa, 2014; Blaich & Wise, 2011; Roohr et al., 2016). These results are based on measures assessing general proficiencies (e.g., writing, critical thinking) on standardized assessments. Larger estimates of student learning have been obtained when assessments are based directly on the curriculum to which students have been exposed (Hathcoat, Sundre, & Johnston, 2015; Mathers, Finney, & Hathcoat, 2018). However, gains in learning that can be attributed to the college academic curriculum remain clouded by a lack of comparison groups and a lack of clarity in curriculum alignment. Assessments that are not aligned with the curriculum weaken the ability to document student learning, and poor curricular planning may undermine strategies to support rigor.


Academic Rigor As a Negotiable Standard

Utilizing heuristics (e.g., an institution’s prestige or selectivity) as a proxy measure for determining what a college graduate learned and believing that a college degree is sufficient regardless of the learning underlying it (Labaree, 1997) pose threats to academic rigor in the learning context, making it appear as an unnecessary impediment of students’ progress. This perception is supported by evidence of pressure from students to lower academic expectations and teachers’ compliance (Schnee, 2008). Definitions of rigor that are based on comparisons to idiosyncratic personal experiences (Schnee, 2008) and reports of educators assigning higher grades than students earned (Schutz, Drake, & Lessner, 2013) support the concern that what is considered academically rigorous is highly malleable. In a social context in which lowering academic expectations may be rewarded (i.e., an emphasis on completion instead of learning, Jaschik & Lederman, 2018), a wide variety of activities could be considered academically rigorous depending on the unique individuals in — and circumstances that surround — a learning context, qualities that are highly variable. Such definitions of rigor lack generalizability and create conditions to perpetuate educational inequalities (Keller, 2018; Schnee, 2008). While students’ life experiences are integral in learning (Choy, 2014; Keller, 2018), these characteristics should not limit the learning context; they should be used to interpret the curriculum, not replace it (Schnee, 2008). A definition of academic rigor is needed that is based on elements of the learning context that are crafted to foster learning, a definition that can be substantiated by research and generalized across contexts. Valuing students’ experiences but relying on research evidence regarding teaching and learning in crafting the educational context prioritizes learning for all students, a shared value across institutional mission statements (Morphew & Harley, 2006). 


Qualities of Rigor Derived from Experience with Teaching and Learning

Despite the widely shared goal of providing a liberal arts education via rigorous educational experiences, finding consensus on a definition of academic rigor and its application has been problematic (e.g., Hechinger Institute, 2009). A review of existing descriptions based on experience with teaching and learning reveals important characteristics for defining academic rigor. Common themes include setting and enforcing high expectations and standards for academic performance (Draeger et al., 2013; Graham & Essex, 2001; Schnee, 2008; Whitaker, 2016); crafting learning experiences that require active cognitive engagement (Draeger et al., 2013; Graham & Essex, 2001; Schnee, 2008; Whitaker, 2016; Wraga, 2010); grounding learning experiences in the knowledge, skills, and abilities that learners will need in their personal and professional lives (Draeger et al., 2013; Whitaker, 2016; Wraga, 2010); requiring learners to spend time engaging with academic content beyond time spent in class (Draeger et al., 2013; Draeger et al., 2015); and providing academic support for learners as they engage with content and in learning experiences (Graham & Essex, 2001; Schnee, 2008; Whitaker, 2016). These characteristics provide insight into setting and assessing the conditions for academic rigor and situate it in a context that extends beyond the physical and/or virtual walls of a classroom.


Qualities of Rigor Derived from Psychological Research on Human Learning

In addition to the insights of educators and learners, psychological research on human learning must be integrated into our understanding of academic rigor. As Bjork and Bjork (2011) argued, “we can be misled by our subjective impressions” when we seek to identify ways that we learn best (p. 57). Though counterintuitive, difficulties imposed in the learning context that hamper initial learning can promote long-term learning (Bjork & Bjork, 2011). Desirable difficulties demonstrated through empirical research to improve learning include varying the context in which learning occurs (Smith & Vela, 2001), spreading learning activities out over time (Donovan & Radosevich, 1999), simultaneously learning information on separate concepts (Taylor & Rohrer, 2010), and testing frequently (Roediger & Karpicke, 2006). Because these elements may slow initial learning, our perceptions may lead us to erroneously conclude that they should be avoided. But, in doing so, we are not setting the conditions to promote learning, and we are not likely to realize it. Subjective judgements of ability (Kruger & Dunning, 1999) and the degree memory can change due to studying (Kornell & Bjork, 2009) are not objectively accurate. As such, empirical research on human learning can reveal techniques to improve learning that our perceptions and experiences cannot. 

 

An Integrated Definition of Academic Rigor

Research on human learning provides recommendations that are not fully captured by faculty members’ and students’ descriptions of academic rigor. Each type of information provides unique insights. Thus, to best facilitate learning, an interdisciplinary approach that is open to new information as it develops is needed. As our knowledge of how to facilitate learning expands, the conditions to promote rigor will increase as well. As such, academic rigor is an ongoing process of setting the conditions to promote learning. Though it is associated with desirable difficulties, cognitive effort, and time dedicated to academic tasks, academic rigor is a positive quality of the learning environment because its goal is to promote student learning, the purpose of higher education. Conceptualized as conditions that are set to facilitate learning allows these conditions to be objectively observed and evaluated along with their relationship to artifacts students produce as evidence of learning. Further, these conditions apply to any learning context; they are not limited to only higher-level courses or elite student samples (e.g., graduate work or other advanced study). Though higher-level courses will differ in curriculum and the types of cognitive effort e