|
Sign In to gain access to subscriptions and/or personal tools.
|
Educational Evaluation and Policy Analysis, Vol. 11, No. 3,
255-274 (1989)
DOI: 10.3102/01623737011003255
Toward a Conceptual Framework for Mixed-Method Evaluation Designs
Jennifer C. Greene,
Valerie J. Caracelli and
Wendy F. Graham
Cornell University
In recent years evaluators of educational and social programs have expanded their methodological repertoire with designs that include the use of both qualitative and quantitative methods. Such practice, however, needs to be grounded in a theory that can meaningfully guide the design and implementation of mixed-method evaluations. In this study, a mixed-method conceptual framework was developed from the theoretical literature and then refined through an analysis of 57 empirical mixed-method evaluations. Five purposes for mixed-method evaluations are identified in this conceptual framework: triangulation, complementarity, development, initiation, and expansion. For each of the five purposes, a recommended design is also presented in terms of seven relevant design characteristics. These design elements encompass issues about methods, the phenomena under investigation, paradigmatic framework, and criteria for implementation. In the empirical review, common misuse of the term triangulation was apparent in evaluations that stated such a purpose but did not employ an appropriate design. In addition, relatively few evaluations in this review integrated the different method types at the level of data analysis. Strategies for integrated data analysis are among the issues identified as priorities for further mixed-method work.

CiteULike Connotea Del.icio.us Digg Reddit Technorati What's this?
This article has been cited by other articles:

|
 |

|
 |
 
B. Hall and K. Howard
A Synergistic Approach: Conducting Mixed Methods Research With Typological and Systemic Design Considerations
Journal of Mixed Methods Research,
July 1, 2008;
2(3):
248 - 269.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
E. E. Jang, D. E. McDougall, D. Pollon, M. Herbert, and P. Russell
Integrative Mixed Methods Data Analytic Strategies in Research on School Success in Challenging Circumstances
Journal of Mixed Methods Research,
July 1, 2008;
2(3):
221 - 247.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
M. Denscombe
Communities of Practice: A Research Paradigm for the Mixed Methods Approach
Journal of Mixed Methods Research,
July 1, 2008;
2(3):
270 - 283.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
A. Westhues, J. Ochocka, N. Jacobson, L. Simich, S. Maiter, R. Janzen, and A. Fleras
Developing Theory From Complexity: Reflections on a Collaborative Mixed Method Participatory Action Research Study
Qual Health Res,
May 1, 2008;
18(5):
701 - 717.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
W. M. Trochim, S. E. Marcus, L. C. Masse, R. P. Moser, and P. C. Weld
The Evaluation of Large Research Initiatives: A Participatory Integrative Mixed-Methods Approach
American Journal of Evaluation,
March 1, 2008;
29(1):
8 - 28.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
S. Mendlinger and J. Cwikel
Spiraling Between Qualitative and Quantitative Data on Women's Health Behaviors: A Double Helix Model for Mixed Methods
Qual Health Res,
February 1, 2008;
18(2):
280 - 293.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
J. C. Greene
Is Mixed Methods Social Inquiry a Distinctive Methodology?
Journal of Mixed Methods Research,
January 1, 2008;
2(1):
7 - 22.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
K. M. Yount and J. Gittelsohn
Comparing Reports of Health-Seeking Behavior From the Integrated Illness History and a Standard Child Morbidity Survey
Journal of Mixed Methods Research,
January 1, 2008;
2(1):
23 - 62.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
D. C. Vitale, A. A. Armenakis, and H. S. Feild
Integrating Qualitative and Quantitative Methods for Organizational Diagnosis: Possible Priming Effects?
Journal of Mixed Methods Research,
January 1, 2008;
2(1):
87 - 105.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
J. W. Creswell and A. Tashakkori
Editorial: Differing Perspectives on Mixed Methods Research
Journal of Mixed Methods Research,
October 1, 2007;
1(4):
303 - 308.
[PDF]
|
 |
|

|
 |

|
 |
 
Y.-J. Lee and J. Greene
The Predictive Validity of an ESL Placement Test: A Mixed Methods Approach
Journal of Mixed Methods Research,
October 1, 2007;
1(4):
366 - 389.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
T. W. Christ
A Recursive Approach to Mixed Methods Research in a Longitudinal Study of Postsecondary Education Disability Support Services
Journal of Mixed Methods Research,
July 1, 2007;
1(3):
226 - 241.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
K. M. T. Collins, A. J. Onwuegbuzie, and Q. G. Jiao
A Mixed Methods Investigation of Mixed Methods Sampling Designs in Social and Health Science Research
Journal of Mixed Methods Research,
July 1, 2007;
1(3):
267 - 294.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
E. A. L. Stine-Morrow, J. M. Parisi, D. G. Morrow, J. Greene, and D. C. Park
An Engagement Model of Cognitive Optimization Through Adulthood
J. Gerontol. B. Psychol. Sci. Soc. Sci.,
June 1, 2007;
62(suppl_Special_Issue_1):
62 - 69.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. J. Onwuegbuzie, A. E. Witcher, K. M. T. Collins, J. D. Filer, C. D. Wiedmaier, and C. W. Moore
Students' Perceptions of Characteristics of Effective College Teachers: A Validity Study of a Teaching Evaluation Form Using a Mixed-Methods Analysis
American Educational Research Journal,
March 1, 2007;
44(1):
113 - 160.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. Bryman
Barriers to Integrating Quantitative and Qualitative Research
Journal of Mixed Methods Research,
January 1, 2007;
1(1):
8 - 22.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
S. C. Yanchar and D. D. Williams
Reconsidering the Compatibility Thesis and Eclecticism: Five Proposed Guidelines for Method Use
Educational Researcher,
December 1, 2006;
35(9):
3 - 12.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
C. Massey, F. Alpass, R. Flett, K. Lewis, S. Morriss, and F. Sligo
Crossing fields: the case of a multi-disciplinary research team
Qualitative Research,
May 1, 2006;
6(2):
131 - 147.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
N. V. Ivankova, J. W. Creswell, and S. L. Stick
Using Mixed-Methods Sequential Explanatory Design: From Theory to Practice
Field Methods,
February 1, 2006;
18(1):
3 - 20.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
J. Moran-Ellis, V. D. Alexander, A. Cronin, M. Dickinson, J. Fielding, J. Sleney, and H. Thomas
Triangulation and integration: processes, claims and implications
Qualitative Research,
February 1, 2006;
6(1):
45 - 59.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
A. Bryman
Integrating quantitative and qualitative research: how is it done?
Qualitative Research,
February 1, 2006;
6(1):
97 - 113.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
P. Clarke and S. E. Black
Quality of Life Following Stroke: Negotiating Disability, Identity, and Resources
Journal of Applied Gerontology,
August 1, 2005;
24(4):
319 - 336.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
M. Mitrany and D. Stokols
Gauging the Transdisciplinary Qualities and Outcomes of Doctoral Training Programs
Journal of Planning Education and Research,
June 1, 2005;
24(4):
437 - 449.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
R. B. Johnson and A. J. Onwuegbuzie
Mixed Methods Research: A Research Paradigm Whose Time Has Come
Educational Researcher,
October 1, 2004;
33(7):
14 - 26.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
C. A. Yauch and H. J. Steudel
Complementary Use of Qualitative and Quantitative Cultural Assessment Methods
Organizational Research Methods,
October 1, 2003;
6(4):
465 - 481.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
R. E. Crew Jr. and M. R. Anderson
Accountability and Performance in Charter Schools in Florida: A Theory-Based Evaluation
American Journal of Evaluation,
June 1, 2003;
24(2):
189 - 212.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
A. McConney, A. Rudd, and R. Ayres
Getting to the Bottom Line: A Method for Synthesizing Findings Within Mixed-method Program Evaluations
American Journal of Evaluation,
June 1, 2002;
23(2):
121 - 140.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
B. R. Worthen
Whither Evaluation? That All Depends
American Journal of Evaluation,
September 1, 2001;
22(3):
409 - 418.
[PDF]
|
 |
|

|
 |

|
 |
 
L. Manderson, M. Kelaher, and N. Woelz-Stirling
Developing Qualitative Databases for Multiple Users
Qual Health Res,
March 1, 2001;
11(2):
149 - 160.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
S. Li, J. M. Marquart, and C. Zercher
Conceptual Issues and Analytic Strategies in Mixed-Method Studies of Preschool Inclusion
Journal of Early Intervention,
April 1, 2000;
23(2):
116 - 132.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
T. C. Russo
Organizational and Professional Identification: A Case of Newspaper Journalists
Management Communication Quarterly,
August 1, 1998;
12(1):
72 - 111.
[Abstract]
|
 |
|

|
 |

|
 |
 
D. L. Morgan
Practical Strategies for Combining Qualitative and Quantitative Methods: Applications to Health Research
Qual Health Res,
May 1, 1998;
8(3):
362 - 376.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
J. Gaber and S. L. Gaber
Utilizing Mixed-Method Research Designs in Planning: The Case of 14th Street, New York City
Journal of Planning Education and Research,
December 1, 1997;
17(2):
95 - 103.
[Abstract]
|
 |
|

|
 |

|
 |
 
R. T. Torres, H. S. Preskill, and M. E. Piontek
Communicating and Reporting: Practices and Concerns of Internal and External Evaluators
American Journal of Evaluation,
February 1, 1997;
18(1):
105 - 125.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
M. Waysman and R. Savaya
Mixed Method Evaluation: A Case Study
American Journal of Evaluation,
February 1, 1997;
18(1):
227 - 237.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
References
Current Sociology,
December 1, 1996;
44(3):
291 - 306.
|
 |
|

|
 |

|
 |
 
E. R. House
The Future Perfect of Evaluation
American Journal of Evaluation,
October 1, 1994;
15(3):
239 - 247.
[PDF]
|
 |
|

|
 |

|
 |
 
B. T. Harrison
Applying Critical Ethics to Educational Management
Educational Management Administration Leadership,
July 1, 1994;
22(3):
175 - 183.
[Abstract]
|
 |
|

|
 |

|
 |
 
Mixed-Method Evaluation: Developing Quality Criteria through Concept Mapping
American Journal of Evaluation,
January 1, 1994;
15(2):
139 - 152.
[PDF]
|
 |
|

|
 |

|
 |
 
Z. A. Barley and M. Jenness
Cluster Evaluation: A Method to Strengthen Evaluation in Smaller Programs with Similar Purposes
American Journal of Evaluation,
June 1, 1993;
14(2):
141 - 147.
[PDF]
|
 |
|

|
 |

|
 |
 
V. J. Caracelli and J. C. Greene
Data Analysis Strategies for Mixed-Method Evaluation Designs
Educational Evaluation and Policy Analysis,
January 1, 1993;
15(2):
195 - 207.
[Abstract]
[PDF]
|
 |
|
|