higher education

Select an item by clicking its checkbox

The cactus can be a metaphor for our institutions; institutions whose pasts may seem dead, yet there may still be new growth emerging. The cactus grows around its historical center. The flowers are new life, distinct from and arising out of the present – in all its steadfastness, stability, and prickliness. ...

I was not happy to see the headlights of an approaching dune buggy – its presence would ruin the unspoiled beauty of the beach. Yet when the dune buggy (labeled the “Turtle Patrol”) got close, I realized that the very friendly driver was actually removing a lot of plastic and other ...

Walking along the long stretch of beach, the cross-section of the dunes revealed the stringy roots of the foliage penetrating and crisscrossing below the surface. This suggests that despite the shifting of the sands comprising the dunes, the roots help anchor the plants and enable them to continue thriving. Similarly, ...

The 2017-18 Deans’ Colloquy was constituted by a diverse group of deans representing 11 schools in the USA and Canada. Drs. Deborah Krause (Eden Theological Seminary), Luis R. Rivera (Garrett-Evangelical Theological School), and Paul Myhre (Wabash Center for Teaching and Learning in Theology and Religion) were the facilitators. The group met ...

Cover image

Measurements in Distance Education: A Compendium of Instruments, Scales, and Measures for Evaluating Online Learning

Catalano, Amy J.
Routledge, Taylor & Francis Group, 2018

Book Review

Tags: assessment   |   distance education   |   evaluation   |   higher education
icon

Reviewed by: Israel Galindo, Columbia Theological Seminary
Date Reviewed: July 18, 2018
Arguably, due to suspicion, skepticism, and the entrenchment of classroom teaching practices, the most scrutinized, assessed, and evaluated pedagogy in theological schools in the last two decades has been online learning (“distance education”). Fortunately, the skepticism that fueled a demand for more rigorous evaluation of student learning in the online environment has yielded hard evidence that online learning is as effective, and sometimes more effective, than traditional classroom teaching. The ...

Arguably, due to suspicion, skepticism, and the entrenchment of classroom teaching practices, the most scrutinized, assessed, and evaluated pedagogy in theological schools in the last two decades has been online learning (“distance education”). Fortunately, the skepticism that fueled a demand for more rigorous evaluation of student learning in the online environment has yielded hard evidence that online learning is as effective, and sometimes more effective, than traditional classroom teaching.

The goal of this work by Catalano, an associate professor of teaching and learning at Hofstra University, is “to assist researchers of distance education, both novice and expert, in finding well-developed and value measures to suit their research questions” (2). The focus of the book is “on properly validated measures, thereby relieving the researcher from having to develop his or her own instrument” (2).    

Catelano provides a concise guide to seventy selected assessment instruments (surveys, scales, and methods) that have been used to evaluate the effectiveness of online learning programs. The instruments can be applied to evaluate key metrics and pedagogical, as well as programmatic, elements such as: student engagement, student and faculty satisfaction, information retention, self-efficacy, student and teacher readiness, the online learning environment, cooperative learning, competencies for online learning, student attitudes, student retention and attrition, critical thinking, and achievement. Several instruments focus on specific pedagogical approaches such as constructivism and andragogy.

Five chapters provide nine categories of evaluations. Specifically, Chapter 1 provides eleven instruments on student engagement and satisfaction. Chapter 2 contains sixteen instruments on student readiness to learn and self-efficacy. Chapter 3 offers a selection of seventeen instruments focusing on the online teaching and learning environment. Chapter 4 provides twelve instruments on student learning behaviors. Chapter 5 contains five instruments to assess student achievement, retention, and attrition. Obviously, there are enough offerings in these chapters to meet just about any evaluation need an assessor may have. Each chapter includes a brief overview of each instrument covered. Each instrument entry includes a summary of the tool, a description of how the measure is used, and a description of its development and validity.        

Some of the instruments described are complete tools (for example, a fully developed satisfaction questionnaire, a complete survey on student evaluation of online web-based instruction, and one on the online learning environment. Other instruments are described with information about their sources should an assessor wish to use them.         

In the Introduction Catalano provides helpful background on the criteria for inclusion of the instruments selected for the compendium. The author describes the search process used in identifying the instruments, including applying the criteria of ensuring reliability and validity.

For those needing to continue to assess online learning through disciplined and rigorous evaluations, whether as part of formative curricular assessment or to satisfy accreditation requirements, Amy Catalano’s brief compendium of assessment instruments, scales, and approaches is a handy and accessible tool. Indeed, it should be on every evaluator’s desk.

Wabash Center