THE EFFECTIVENESS OF ANDRAGOGICAL INSTRUCTION
AS COMPARED WITH TRADITIONAL INSTRUCTION
IN PHILOSOPHY COURSES
Gregg Strawbridge, Ph.D.
[The author may be contacted via email: email@example.com]
[Published in the PAACE, February 1999]
Andragogy has been of conceptual, theoretical,
and practical importance in the field of adult education for more than
25 years. Though debate regarding the status and role of andragogy fills
the pages of professional journals, a dearth of empirical investigations
document the superiority or inferiority of andragogy as a methodology.
The present research is set within evening Introduction to Philosophy courses
(PHI 201) in a private liberal arts college. By means of a pretest-posttest-control-group
design, the researcher aims to investigate the effectiveness of andragogy
as compared with traditional instruction. Instructional effectiveness is
assessed by course achievement (controlling for cumulative grade point
average and pretest achievement scores) and student attitudes as measured
by the course evaluation instrument. The findings indicate no statistically
significant difference (p = .05) between the experimental (n
= 19) and control (n = 21) groups on achievement as measured
by the composite posttest made up of objective and essay sections and no
statistically significant difference (p = .05) between the attitudes
of the students toward the method of instruction.
Enrollment patterns in American colleges and universities call for serious consideration of adult teaching methodologies in those contexts. U. S. Department of Education statistics indicate that in the 1990s 42% of all college students are 25 years of age or older and 68% of all part-time students are 25 years of age or older. The median age of college students in the 1990s is over 34 (Aslanian, 1993). "Inevitably, nontraditional adult degree programs, pioneered by private liberal arts colleges, will proliferate, and postsecondary institutions must seek other ways to accommodate older students--not so much out of altruism as out of economic necessity" (Rachal, 1989, p. 5).
Andragogy, a well-worn term in the lexicon of adult education, is one proposal for an effective and learner-appropriate methodology for the growing non-traditional population in the college classroom. Malcolm Knowles, the chief proponent of andragogy, describes it as a learner-centered model of assumptions (Knowles, 1973, 1984, 1980) contrasted with teacher-directed learning (traditional schooling). Despite earlier American uses of the term andragogy (Lindeman, 1927a, 1927b), Knowles' (1980, 1984) concept of andragogy is most recognized in contemporary adult education. Over time, Knowles (1993) has allowed his view the flexibility to emerge from conceiving of andragogy as a dichotomous contrast with traditional schooling (pedagogy) to viewing it as a set of educational assumptions existing on a continuum. Andragogy in theory and practice is based on the differences in learning in adulthood as opposed to childhood. Knowles' (1993) well-rehearsed assumptions distinguish important educational qualities in adult learners in four or sometimes five areas: Adult learners have (a) an increasingly self-directed concept of themselves, (b) a reservoir of experience as a resource in learning, (c) a readiness to learn due to developmental life-tasks, (d) a problem-centered orientation in learning, and (e) intrinsic incentives for educational development.
Debate about the status of andragogy as a theory, a set of assumptions, a definition of adult education, or a philosophy has continued since Knowles' initial development of the term. Particularly in the 1980s, pages of criticisms, clarifications and promotions of andragogy mounted. These debates were chronicled by those offering even further clarifications of the concept of andragogy (Davenport & Davenport, 1985; Davenport, 1987). In the midst of this, some believed that the status of andragogy as a theory would be resolved by empirical research (Davenport and Davenport, 1985) while others questioned whether it was even falsifiable (Cross, 1981). Still others analyze andragogy in light of authority and social structures (Pratt, 1993). With postmodern reactions to a positivistic view of research in the 1990s, it is nevertheless true that responsible treatments of andragogy "should include the growing empirical base" (Davenport and Davenport, 1985, p. 158).
EXPERIMENTAL RESEARCH ON THE EFFECTIVENESS OF ANDRAGOGY
In experimental research related to learner achievement, studies are mixed, though more results show no statistical significance in comparative approaches. Beder and Carrea (1988), Saxe (1986), Madriz (1987), McCann (1988) and Ogles (1990) generally support the effectiveness of andragogical instruction as opposed to traditional instruction. Rosenblum and Darkenwald (1983), Anaemena (1985), Stevens (1985), Black (1986), Langston (1989), Farrar (1990), Familoni (1991), and Barta (1989) (on achievement) found no statistically significant differences between the instructional approaches measured. White (1988), Barta (1989) (on formatting and attrition) and Clark (1990) generally support the effectiveness of traditional instruction as opposed to andragogical instruction.
There are, however, limitations and weaknesses of the foregoing experimental studies of andragogy. Three criticisms are relevant to the present research. First, since the andragogy is more than any one isolated technique (Knowles, 1980; Caughan, 1989), any generalizations made from isolated technique studies to other contexts in which a more robust andragogy is used are unwarranted. For example, in Anaemena's (1985) study programmed instruction sheets in three lessons were the extent to which andragogy was employed. Not only is this an isolated technique, but it is a rather limited amount of instruction which is more closely associated with the behaviorist's theoretical framework than the humanist's, upon which andragogy is based. Likewise, in Familoni's (1991) work, collaboration alone is simply an insufficient representation of andragogy. In the same way, White (1988) merely compared small group discussion and lecture in the context of a mandatory recertification program for pesticide licensure. Again, comparing an andragogical technique with a traditional technique is inadequate as an evaluation of the efficacy of andragogy.
Second, since many or most learners are only familiar with traditional schooling, in experimental studies the andragogical method should comprise a large portion of the educational time to properly acclimate the learners to the andragogical approach. Langston (1989), for example, studied one project as self-directed or teacher directed within the context of two political science courses. Since the self-direction variable did not cover the instruction of the entire course, any generalization about andragogy is duly limited. Similarly, in a mathematics course, Black (1989) limited the use of learning contracts to having students decide a minimum grade and agree to participate in interviews with a teacher about progress.
Third, studies which have involved college students in for-credit academic courses are more directly related to the present study, more pertinent to the larger concern of adult learners in higher education, and more helpful in aiding practitioners in instructional effectiveness in collegiate settings. Stevens' (1985) study, pertaining to dental hygiene skills, Barta's (1989) study of keyboarding instruction, and even Clark's (1990) study of clinical nursing skills, are sufficiently unrelated in their contexts or content to severely weaken their predictive value of outcomes in a college philosophy course, or more generally, a liberal arts course.
These difficulties pinpoint a critical problem in experimentally researching the effectiveness of andragogy. In an effort to control variables, the researcher almost of necessity has to focus on instructional techniques. As noted earlier, however, if one compares an andragogical technique with a traditional technique in the same class, the result is something less than a robust andragogical instructional atmosphere. Andragogy includes a variety of techniques to be sure, but a sound conclusion about the efficacy of andragogy cannot be reached by merely comparing one technique with another, especially when there has been no uniform presentation of andragogy as an instructional context (Knowles, 1980). Seemingly, the best way to avoid these problems is to instruct an entire course andragogically in comparison to an entire course taught traditionally. For this reason, the present research compared an andragogically instructed class with a more traditionally instructed class.
It may also be concluded that there is a dearth of research which has studied andragogical instruction in the full context of a college course, especially in liberal arts courses. Since there is a large and growing population of non-traditional students in academic settings, more research directed to this context is certainly warranted. Finally, no researcher in the scope of the foregoing review has applied andragogical instruction to a liberal arts course such as philosophy. Therefore, the crucial elements of the present research are not well represented in previous studies.
APPLES AND ORANGES IN ANDRAGOGICAL RESEARCH
One unique difficulty in studying the effectiveness of andragogy is comparing achievement in the course content. Two classes which are teacher-directed could easily cover exactly the same content and therefore, the measurement instrument could be exactly the same. On the other hand, an andragogical class by definition involves allowing the learners to determine, at least in part, the content. The learners must choose, at least in some measure, their own objectives. The problem thus arises--how can one class in which each student determines his or her own objectives be fairly compared against another class in which the teacher determines the content? This dilemma of "comparing apples with oranges" is, no doubt, one reason for the paucity of comparative studies. The compromise reached in the present study was to specify a list of objectives applying to all the learners, from which the andragogical learners may pursue self-directed educational objectives as specified in their learning contract. One may argue that this decreases the purity of the andragogical approach, but such a list of objectives does allow for a relatively fair basis for evaluation. Hence, the present study was designed to compare the effectiveness of andragogical and traditional instructional approaches in introductory philosophy courses. Specifically, the present study compared the content achievement (posttest) and affective assessment (course evaluation) of a class taught with traditional techniques and a class taught with andragogical techniques.
Setting and Participants
The setting of the present study was two Introduction to Philosophy courses (PHI 201) at a private liberal arts college. Having been the instructor of the course prior to the study, the researcher taught one course, in one term, with traditional teaching methodology and one course, in the following term, andragogically. Each course met ten weeks on Monday evenings. Students participating in the present study were enrolled in Introduction to Philosophy (PHI 201) courses during the fall and winter trimesters. The students who participated in the present study did so through informed consent; because of the voluntary non-participation of four students and the missing pretest data of two students because of absences, there were 40 final participants in the study.
A pretest, objective in format, based on the content of the course (PHI 201) was used to establish the learner's prior familiarity with certain introductory concepts in philosophy. The evaluation of achievement at the end of the course was based on posttests forming two parts of the final examination drawn from the objectives of the course. One posttest was 30 items, 25 multiple choice and five true-false. The other posttest was a group of three essay questions. In the nature of the case, the content validity of the objective and essay posttests primarily rested on their relationship to the course objectives. To ensure the content and face validity of the testing instruments, a panel of three experts with teaching experience in similar courses and graduate degrees in philosophy was consulted. The panel of experts also graded the essay posttests in order to guard against instructor bias. A detailed outline of the course content pertaining to the essay questions was provided for each panelist.
The instrument used to collect the affective data was the college's course evaluation. The course evaluation instrument was analyzed in order to provide evidence of its reliability and validity for the purposes of this research. The sample was taken from a group of courses which represent the college's academic classes. A Cronbach alpha analysis was performed on the data as the indicator of internal consistency reliability. The results confirm the reliability (.9665) of the instrument as it pertains to the present study. A Factor Analysis using a saliency criterion of 0.6 confirmed the validity of the instrument, yielding three factors relevant to the affective dimension of this research.
Andragogical Instructional Techniques: While the course objectives were determined by the instructor as denoted in the course syllabus, projects, presentations, and evaluations (of accomplishing the learning objectives) were determined mutually by the students and the instructor as denoted in each student's learning contract. In the learning contract the students specified learning objectives, indicating the resources used in meeting those objectives, defining the evidence to demonstrate meeting the objective and formulating criteria for evaluation of that evidence, including the exams. The teaching format involved many student and group presentations, lectures by the instructor, assigned readings, opportunities for question and answer and discussion sessions.
Traditional Instructional Techniques. The content and objectives of the course was solely determined by the instructor as denoted in the course syllabus. The classroom teaching techniques involved primarily instructor dominated class-time via lectures, and limited opportunities for question and answer periods following the lectures, as well as discussions at appropriate times. The students had no part in planning the classroom presentation of the material or objectives for the course. The specific evaluation of each student involved attendance, objective tests, essay tests, and a project, such as a paper or a presentation of a philosophical topic or issue or participation in a class debate.
Data were collected for the covariates of GPA and pretest achievement scores and the dependent variables of objective posttest, essay posttest, and the composite posttest. The composite posttest was calculated from the average of the objective and essay posttests. The composite posttest was scaled at 100 points. The fall trimester class served as the control group and was treated with traditional teaching methodology. Of the 26 students on the final roster, 21 students participated in the study. Of the 21 participants, 18 were female, making up 86% of the class and three were male, making up 14% of the class. The mean age of the students was 25 with a standard deviation of 6.52 years. The winter trimester class served as the experimental group and was treated with andragogical teaching methodology. Of the 20 students on the final roster, 19 students participated in the study. Of the 19 participants involved in the study, nine were male, making up 47% of the class and 10 were female, making up 53% of the students. The mean age of the students was 27 with a standard deviation of 6.87 years. The cumulative GPA for the traditional group was slightly higher (2.93) than that of the andragogical group (2.89) while the pretest achievement score for the andragogical group (7.00) was higher than that of the traditional group (5.67). Though the traditional group (23.57) scored higher on the objective posttest than did the andragogical group (21.63), the essay posttest scores were virtually identical. On the composite posttest, the traditional group (70.10) scored higher than the andragogical group (66.58) by a small margin.
Affective outcomes of the course were measured via student evaluations of the classes on a scale of 26 continuous items. The affective data for each course were analyzed as a composite mean and composite standard deviation. The fall term (traditional group) had a mean of 4.319 and standard deviation of .325 based on 21 students' completion of the evaluation instrument. The winter term (andragogical group) had a mean of 4.331 and a standard deviation of .221 based on 17 students' completion of the evaluation instrument.
Tests of Hypotheses
Two research hypotheses were tested, one regarding achievement, the second regarding attitude toward the course. These were tested with the statistical techniques of the analysis of covariance (ANCOVA) (for achievement) and the t-test (for attitude). For the purpose of assuring the appropriateness of using the analysis of covariance, a homogeneity of regression test was performed. The results suggested that performance of the participants was relatively similar across levels of the independent variable (F = .62; df = 2, 34; p = .54); hence, justifying use of analysis of covariance. The F ratio for the achievement hypothesis was .924 (df = 1, 36; p = .343). The effect size (.0194) was very small, with less than 2% of the variance explained. Based on these data, the researcher found no statistically significant difference in achievement between the andragogical group and the traditional group while holding constant pretest scores and GPA. The t ratio for the attitude hypothesis was -.1333 with 1 and 36 degrees of freedom and thus, was not statistically significant. Based on these data the researcher determined that there were no statistically significant differences in attitudes of the andragogical group and the traditional group.
The findings of the present study indicated no statistically significant difference in achievement or attitude between the methodologies. Therefore, the andragogical methodology used proved to be neither more nor less effective than the traditional methodology in the present study. Hence, the decision to use andragogical methods is not unequivocally warranted if one considers the experimental research (see the previous empirical literature review). It might be added too that when research findings indicate the superiority of andragogy the effect sizes and margins of difference are small. So, any boasts about the superiority of andragogy in the areas of achievement or even learner satisfaction are clearly not warranted from the consensus of experimental research.
However, this is not to say there are no convincing reasons to employ andragogical methodology. Andragogy will, no doubt, survive empirical examinations of its effectiveness by virtue of the fact that its primary assumption of self-direction is a normative judgment, and therefore, cannot be empirically falsified (Brookfield, 1986). The other assumptions rest on common sense (i.e., experience as a resource), strong anecdotal evidence (Knowles, 1984, 1993), and psychological frameworks (Knowles, 1973); and thus, will not be easily defeated by statistical significance tests. Perhaps then the justification of andragogy as a methodology rests on the ability of future researchers and practitioners to formulate connections between the course content, the maturity of the learners, and the desired outcomes of the learning experience. After such considerations, appropriate applications of andragogy, as well as traditional techniques can be made to the specific learning situation.
Anaemena, E. I. (1985). A comparison of andragogy and pedagogy as instructional methodologies toward cognitive achievement in basic electronics in technical colleges of Anambra state of Nigeria. (Doctoral dissertation, University of Missouri-Columbia, 1985). Dissertation Abstracts International, 47, 874A.
Anderson, M. L., & Lindeman, E. C. (1927a). Education through experience. New York: Workers Education Bureau.
Anderson, M. L., & Lindeman, E. C. (1927b). Education through experience. Workers Education: A Quarterly Journal, 4, 33-34.
Aslanian, C. (1993, Spring). Trends in adult learning. The Admission Strategist, 15-19.
Barta, R. J. (1989). A comparison of teacher-directed and self-directed instruction in keyboarding for college students. Business Education Forum, 43(7), 12-14.
Beder, H., & Carrea, N. (1988). The effects of andragogical teacher training on adult students' attendance and evaluation of their teachers. Adult Education Quarterly, 38, 75-87.
Black, G. A. (1989). Effects of using learning contracts on student achievement in a college laboratory fundamentals of mathematics course. (Doctoral dissertation, Texas A&M University, 1989). Dissertation Abstracts International, 51, 63A.
Brookfield, S. (1986). Understanding and facilitating adult learning. San Francisco: Jossey-Bass.
Caughan, W. T. (1989). Facilitating adult learning through continuing education: A case study of the University of Alaska Anchorage. (Doctoral dissertation, Columbia University Teachers College, 1989). Dissertation Abstracts International, 50, 2353A.
Clark, J. A. K. (1990). Self-directed learning skills and clinical performance: A comparison of traditionally taught and learning contract-taught nursing students. (Doctoral dissertation, University of Southern Mississippi, 1990). Dissertation Abstracts International, 51, 2236A.
Cross, K. P. (1981). Adults as learners. San Francisco: Jossey-Bass.
Darkenwald, G. G., & Merriam, S. B. (1982). Adult education: Foundations of practice. New York: Harper and Row.
Davenport, J., & Davenport, J. A. (1985). A chronology and analysis of the andragogy debate. Adult EducationQuarterly, 35, 152-159.
Davenport, J. (1987). Is there any way out of the andragogy morass? Lifelong Learning: An Omnibus of Practice and Research, 11(3), 17-20.
Familoni, P. A. (1991). The effects of non-collaborative versus collaborative vocabulary instruction on female adult beginning readers. (Doctoral dissertation, University of Pittsburgh, 1991). Dissertation Abstracts International, 52, 3502A.
Farrar, E. W. (1990). Effects of selected teaching strategies on the visual art products of community college students. (Doctoral dissertation, Arizona State University, 1990). Dissertation Abstracts International, 52, 400A.
Hartree, A. (1984). Malcolm Knowles' theory of andragogy: A critique. International Journal of Lifelong Education, 3, 203-210.
Knowles, M. S. (1973). The adult learner: A neglected species. Houston: Gulf.
Knowles, M. S. (1980). The modern practice of adult education: From pedagogy to andragogy. Englewood Cliffs, NJ: Prentice Hall Regents.
Knowles, M. S. (1984). Andragogy in action. San Francisco: Jossey-Bass.
Knowles, M. S. (1993). Contributions of Malcolm Knowles. In K. O. Gangel & J. C. Wilhoit (Eds.), The Christian educator's handbook on adult education (pp. 91-103). Wheaton, IL: Victor Books.
Langston, L. C. (1989). Self-directed learning, achievement, and satisfaction. (Doctoral dissertation, University of Georgia, 1989). Dissertation Abstracts International, 50, 3824A.
Lawson, K. H. (1991). Philosophical foundations. In J. M. Peters, P. Jarvis & Associates (Eds.), Adult education (pp. 283-300). San Francisco: Jossey-Bass.
Lindeman, E. C. (1926). The meaning of adult education. New York: New Republic, Inc., (Reissued Montreal: Harvest House, Ltd., 1961: and Oklahoma Research Center for Continuing and Higher Education, University of Oklahoma, Norman, Oklahoma, 1989).
Madriz, L. (1987). The relative effectiveness of two different approaches to inservice training of primary teachers in Venezuela. (Doctoral dissertation, Florida State University, 1987). Dissertation Abstracts International, 48, 539A.
McCann, R. T. (1988). Academic achievement as a function of instructor teaching orientation among nontraditional university students. (Doctoral dissertation, University of Southern Mississippi, 1988). Dissertation Abstracts International, 50, 2353A.
Merriam, S. B., & Simpson, E. L. (1989). A guide to research for educators and trainers of adults. Malabar, FL: Krieger.
Merriam, S. B., & Caffarella, R. S. (1991). Learning in adulthood. San Francisco: Jossey-Bass.
Ogles, M. T. P. (1990). The outcomes of using "learning contracts" with adult beginning readers in a one-on-one literacy program. (Doctoral dissertation, University of Colorado at Boulder, 1990). Dissertation Abstracts International, 51, 1875A.
Podeschi, R. L. (1987). Andragogy: Proofs or premises. Lifelong Learning: An Omnibus of Practice and Research, 11(3), 14-16.
Pratt, D.D. (1993). Andragogy after twenty-five years. In Sharan Merriam (Ed.), Adult Learning Theory: An Update. San Francisco: Jossey-Bass. 15-23.
Rachal, J. R. (1989). The social context of adult and continuing education. In S. B. Merriam & P. M. Cunningham (Eds.), Handbook of adult and continuing education (pp. 3-14). San Francisco: Jossey-Bass.
Rosenblum, S., & Darkenwald, G. G. (1983). Effects of adult learner participation in course planning on achievement and satisfaction. Adult Education Quarterly, 33, 147-153.
Saxe, S. (1986). The effect of peer interaction and incentive on adult learner achievement. (Doctoral dissertation, University of San Francisco, 1986). Dissertation Abstracts International, 47, 2421A.
Stevens, M. M. (1985). Oral hygiene instruction: Assessment of andragogical and pedagogical methods of adult patient instruction. (Doctoral dissertation, Kansas State University, 1985). Dissertation Abstracts International, 46, 2576A.
White, B. A. (1988). Selected instructional strategies, learner outcome, and attitudes of adult learners in a mandatory education setting. (Doctoral dissertation, Montana State University, 1988). Dissertation Abstracts International, 49, 2074A.
© Gregg Strawbridge. All Rights