Mixed Methods
BPSY 75 - Field Methods
in Psychology
Ms. Shaine C. Hayag
AGENDA
01 02 03 04
FORMULATION
DATA DATA
AND
COLLECTION ANALYSIS
TYPES
STATEMENT
OF
HYPOTHESIS
QUALITATIVE QUANTITATIVE
TEXT DATA NUMERIC DATA
This is a sample of a text 2342523112342
file of words that might 33211153421421
be collected on
54222311324511
interview transcripts,
observation fieldnotes,
5532422145152
or optically-scanned
documents
FRAMEWORK
Quantitative Data Qualitative Data
Mixed Methods
Method Methodology
Paradigm
Perspective Use of mixed methods
in other designs
A MIXED METHODS RESEARCHER
● Collects both quantitative and qualitative
data
● “mixes” them at the same time
(concurrently) or one after the other
(sequentially)
● Emphasizes both equally or unequally
Mixed Methods
Mixed methods research is both a method and methodology for
conducting research that involves collecting, analyzing, and integrating
quantitative and qualitative research in a single study or a longitudinal
program of inquiry.
Mixed Methods
The purpose of this form of research is that both qualitative and
quantitative research, in combination, provide a better understanding of
a research problem or issue than either research approach alone.
WHY MIXED METHODS?
Quantitative data can reveal generalizable information for a large group
of people
○ These data often fail to provide specific answers, reasons, explanations
or examples
Qualitative research provides data about meaning and context regarding
the people and environments of study
○ Findings are often not generalizable because of the small numbers &
narrow range of participants
Both methods have strengths and weaknesses
○ When used together, these methods can be complimentary
TYPES OF RESEARCH DESIGN
Quantitative Qualitative Mixed Methods
research Methods research Methods Research Methods
• Experimental • Narratives • Sequential
designs •Phenomenology •Concurrent
•Non- Experimental •Ethnographies •Transformative
designs, such as •Grounded theory
survey •Case Studies
CRITERIA FOR CHOOSING A STRATEGY
Theoretical
Implementation Priority Integration
Perspective
No Sequence
Equal At data
Concurrent
collection
Explicit
At data
Sequential- analysis
Qualitative At data
Qualitative first
interpretation
Sequential- Implicit
Quantitative With some
Qualitative first combination
CRITERIA FOR CHOOSING A STRATEGY
What is implementation sequence of the quantitative and
qualitative data collection in the proposed study?
What priority will be given to the quantitative and qualitative data
collection and analysis?
At what stage in the research project will the quantitative and
qualitative data and finding be integrated?
Will an overall theoretical perspective (e.g., gender, race/ ethnicity,
lifestyle, class) be used in the study?
MIXING OR LINKING THE DATA
MIXED METHODS IS USED…
● To compare results from quantitative and qualitative
research
● To use qualitative research to help explain quantitative
findings
● To explore using qualitative research and then to
generalize findings to a large population using
quantitative research
● To develop an instrument because none are available
or useful
● To augment an experiment with qualitative data
REASONS TO USE MIXED METHODS
● The insufficient argument – either quantitative or
qualitative may be insufficient by itself
● Multiple angles argument – quantitative and
qualitative approaches provide different “pictures”
● The more-evidence-the-better argument – combined
quantitative and qualitative provides more evidence
REASONS TO USE MIXED METHODS
● Community of practice argument – mixed methods
may be the preferred approach within a scholarly
community
● Eager-to-learn argument – it is the latest methodology
● “Its intuitive” argument – it mirrors “real life”
DESIGNING A MIXED METHODS
● Preliminary considerations
● Creating a title
● Posing a general question
● Listing the types of data collection and analysis
● Making explicit your worldview
● Identifying your research design
● Drawing a figure of your design
● Writing a purpose statement
● Writing research questions
● Completing a research plan
PRELIMINARY CONSIDERATIONS
• Research problem
• Content – any topics
• Fit the problem to mixed methods (arguments)
• Access to both qualitative and quantitative data
• Background and resources
• Receptive audience
CREATE A WORKING TITLE
● Writing the title
○ Short
○ Topic
○ Participants
○ Include the words “Mixed methods”
○ Neutral –neither quan or qual
POSE THE GENERAL QUESTION TO BE
ANSWERED
● Write it as a question
● Look to see how it is phrased
● Make sure that it is specific enough and
focused (an answerable question)
● Ask yourself, “when I end the study, what
question would like to have answered?”
DETERMINE YOUR OVERVIEW
Postpositivism Constructivism
•Determination •Understanding
•Reductionism •Multiple participant
•Empirical observation meanings
and measurement •Social and historical
•Theory verification construction
•Theory generation
Advocacy/Participatory Pragmatism
•Political •Consequences of
•Empowerment issue- actions
oriented •Problem-centered
•Collaborative •Pluralistic
•Change-oriented •Real-world practice
oriented
STATE YOUR PROCEDURES (METHODS)
● Procedures for handling your qualitative and
quantitative data
● Sequence – concurrent or sequential or both
● Emphasis – emphasis on qualitative or quantitative
● Sometimes both concurrent and sequential phases are
used
● Designs may include more than two phases
● Think about using a simple, elegant design
DESIGN OPTIONS
Design Name Equal priority QUAN emphasis QUAL emphasis
Concurrent, triangulation QUAL+QUAN QUAN+qual QUAL+quan
Concurrent, embedded n/a QUAN(qual) QUAL(quan)
Explanatory, sequential, QUANàQUAL QUANàqual quanàQUAL
quan first
Exploratory sequential, QUALàQUAN qualàQUAN QUALàquan
qual first
Sequential, embedded n/a (qual) QUAN (quan) QUAL
QUAN (qual) QUAL (quan)
MIXING THE QUAN AND QUAL DATA
Type of Mixing Type of Design Why Mixing Occurs Where Mixing
Occurs in Research
Process
Connecting Sequential One phase builds on Between data analysis
the other (Phase 1) and data
collection (Phase 2)
Merging Concurrent Bring results together After analysis of both
quan and qual –
typically in discussion
Embedding Sequential or Either building or Either between phases
Concurrent bringing results or in discussion after
together analysis
METHODOLOGICAL ISSUES
CONCURRENT DESIGNS SEQUENTIAL DESIGNS
Use strategies to In Explanatory Design,
explore contradictory select qual sub-sample
findings from quan sample
Use parallel questions In Explanatory Design,
Select sub-sample of consider alternatives for
quantitative for follow-up qual sampling
qualitative In Exploratory Design,
Be sensitive to bias samples can differ
from one data In Exploratory Instrument
collection to the other Design, consider qual data
analysis approaches for
developing instrument
QUALITATIVE RESEARCH QUESTIONS
● Qualitative central question
○ Begin with “what” or “how”
○ Focus on single phenomenon
○ Use exploratory verbs (discover, understand,
explore)
○ Non-directional language
○ A general question (allowing participants’
perspectives to emerge)
QUANTITATIVE RESEARCH QUESTIONS
● Can be hypotheses or questions
● State variables – independent, dependent, mediating,
covariates
● Develop from theory
● Use distinct measures for independent and dependent
variables
● Order variables from independent to dependent
WRITING RESEARCH QUESTIONS/HYPOTHESIS
● Write qualitative research questions and write
quantitative research questions/hypotheses
● Also write a mixed methods research question
● Write these questions separately
WRITING RESEARCH QUESTIONS/HYPOTHESIS
Three ways to write this question:
Methodologically-focused:
○ To what extent do the qualitative results confirm the quantitative
results?
Content-focused:
○ How do the interviews with adolescent boys support the
quantitative results that their self-esteem changes during the
middle school years?
Hybrid of quantitative and qualitative elements:
○ What results emerge from comparing the exploratory qualitative
data about boy’s self-esteem with outcome quantitative
instrument data measured on a self-esteem instrument?
ORDER THE TOPICS FOR YOUR PLAN
Title
Introduction
(Problem)
Worldview/theoretical lens
Audience
Purpose Statement
Research Questions
(Literature Review)
Methods
Type of Mixed Methods Design (also add definition of mixed methods)
Types of Data Collection
Types of Data Analysis
Sequence/Emphasis/ Mixing Procedures
Figure of procedures
Anticipated methodological issues
Ethical issues anticipated
Validity issues
Researcher resources and skills
References, Appendices
DATA COLLECTION
QUANTITATIVE DATA QUALITATIVE DATA
Instruments Interviews
Checklists Observations
Records Documents
Audio-visual materials
DATA COLLECTION PROCEDURES
Identify and be specific about the type of data. Some forms of data
such as interviews and observations can be either quantitative or
qualitative. Although reduction information to numbers is the
approach used in quantitative research, it is also used in qual.
Research.
Recognize that quantitative data often involve random sampling, so
that everyone has no equal probability of being selected and the
sample can be generalized to the larger population. In qualitative
data collection, purposeful sampling is used to that individuals are
selected because they have experienced the central phenomenon.
DATA COLLECTION PROCEDURES
Relate the procedures specifically to the visual model. For e.g,
in a sequential explanatory model, the general procedures can
be detailed even further. A discussion of this approach might
include describing the use of survey data collection followed by
both descriptive and inferential data analysis in the first phase.
Then qualitative observations and coding and thematic analysis
within an ethnographic design might be mentioned for the
second phase.
DATA ANALYSIS
QUANTITATIVE ANALYSIS QUALITATIVE ANALYSIS
Use statistical analysis for Use text and images for
description, comparing coding, theme
groups and relating development and
variables relating themes
DATA ANALYSIS & VALIDATION PROCEDURES
It’s related to the type of research strategy chosen for the procedures.
Some of the more popular approaches:
Data transformation: In the concurrent strategies involve creating
codes and themes qualitatively, then counting the number of times
they occur in the text data. This quantification of qualitative data
enables a researcher to compare quantitative results with the
qualitative data. For instance, in a factor analysis of data from a scale
on an instrument, the researcher may create factors or themes that
then can be compared with themes from the qualitative database.
DATA ANALYSIS & VALIDATION PROCEDURES
Explore outliers: In a sequential model, an analysis of
quantitative data in the first phase can yield extreme or
outlier cases. Follow-up qualitative interviews with these
outlier cases can provide insight about why they diverged
from the quantitative sample.
DATA ANALYSIS & VALIDATION PROCEDURES
Instrument development: In a sequential approach,
obtain themes and specific statements from participants
in an initial qualitative data collection. In the next phase,
use these statements as specific items and the themes
for scales to create a survey instrument that is grounded
in the views of the participants. A third, final phase might
be to validate the instrument with large sample
representative of a population.
DATA ANALYSIS & VALIDATION PROCEDURES
Examine multiple levels: in a concurrent nested model,
conduct a survey at one level (e.g. with families) to gather
quantitative results about a sample. At the same time,
collect qualitative interviews (e.g., with individuals) to
explore the phenomenon with specific individuals in
families.
DATA ANALYSIS & VALIDATION PROCEDURES
It is necessary the validation of both qualitative and
quantitative phases of study. Each of methods has the
specific ways, for the qualitative data, the strategies that
will be used to check the accuracy of the findings need to
be mentioned.
REPORT PRESENTATION STRUCTURE
For a sequential study, mixed method researcher typically organize
the report of procedures into quantitative data collection and
qualitative data analysis followed by qualitative data and collection
and analysis. Then, in the conclusions or interpretation phase of the
study, the researcher comments on how the qualitative findings
helped to elaborate on or extend the quantitative results.
Alternatively, the qualitative data collection and analysis could come
first followed by the quantitative data collection and analysis. In either
structure, the writer typically will present the project as two distinct
phases, with separate headings of each.
REPORT PRESENTATION STRUCTURE
In concurrent study. The quantitative and qualitative
data collection may be presented in separate section, but
the analysis and interpretation combines the two forms
of data to seek convergence among the results. The
structure of this type of mixed methods study does not as
clearly make a distinction between the quantitative and
qualitative phases.
REPORT PRESENTATION STRUCTURE
In a transformative study, the structure typically involves
advancing the advocacy issue in the beginning of the
study and then using either the sequential or concurrent
structure as a means of organizing the content of the
study. In the end of the study, a separate section may
advance an agenda for change or reform that has
developed as a result of the research.
COMMUNICATION PLATFORMS
Shaine C. Hayag
Instructor I, Department of Psychology
Hangouts E-mail Google Classroom
Shaine Hayag
[email protected] [email protected]