Focus Group Analysis
Focus Group Analysis
7
Analyzing Focus Group Data
The analysis and interpretation of focus group data require a great deal of
judgment and care, just as any other scientific approach, and regardless of
whether the analysis relies on quantitative or qualitative procedures. A great
deal of the skepticism about the value of focus groups probably arises from the
perception that focus group data are subjective and difficult to interpret.
However, the analysis and interpretation of focus group data can be as rigor-
ous as that generated by any other method. It can even be quantified and sub-
mitted to sophisticated mathematical analyses, though the purposes of focus
group interviews seldom require this type of analysis. Indeed, there is no one
best or correct approach to the analysis of focus group data. As with other
types of data, the nature of the analyses of focus group interview data should
be determined by the research question and the purpose for which the data are
collected.
The most common purpose of a focus group interview is to provide an in-
depth exploration of a topic about which little is known. For such exploratory
research, a simple descriptive narrative is quite appropriate and often all that
is necessary. More detailed analyses are simply neither an efficient or produc-
tive use of time, unless they serve a particular research objective. However,
there are additional methods of analysis that may be appropriate for certain
purposes. In this chapter, we consider the methods of data analysis that are
most frequently used with focus group data. We begin this discussion by con-
sidering the question of how much analysis is appropriate.
Like most types of research, the amount of analysis required varies with the
purpose of the research, the complexity of the research design, and the extent
to which conclusions can be reached easily based on simple analyses. The
most common analyses of focus group results involve a transcript of the dis-
cussion and a summary of the conclusions that can be drawn. There are occa-
sions, however, when a transcript is unnecessary. When decisions must be
made quickly (which is common in marketing studies) and the conclusions of
109
07-Stewart-5002.qxd 6/6/2006 11:46 AM Page 110
the research are rather straightforward, a brief summary may be all that is
necessary. In some cases, there may be time or budget constraints that prevent
more detailed analysis. In other cases, all interested parties and decision makers
may be able to observe or participate in the group, so there may be little need
for a detailed analysis or report. Nevertheless, some type of report is almost
always helpful, if only to document what was done for historical and auditing
purposes.
When the results of a focus group are so obvious as to require little sup-
porting documentation, detailed analysis is probably not worthwhile. One of
the authors was involved in a series of focus groups on a new government pro-
gram that was so clearly unacceptable and elicited so many objections that fur-
ther analysis of any kind seemed unwarranted. In this case, the decision about
the program was made quite clear by the focus group discussions. This is, in
fact, a good example of how useful focus groups can be as evaluative tools. It
is often the case that government planners, product design engineers, and other
professionals who design products and services believe that they understand
what their clients or customers need or should want. Focus groups provide a
tool for testing the reality of assumptions that go into the design of services,
programs, and products. On the other hand, if the researchers in this example
were interested in more than making a simple go/no go decision about a prod-
uct or program and instead wished to explore in detail the reasons the program
was unacceptable and the types of programs that might be acceptable, more
detailed analyses would be needed. Thus, the amount of analysis and the level
of detail and rigor ultimately depend on the purpose for which the research is
carried out and the cost-benefit of carrying out an analysis at a given level.
Aside from the few occasions when only a short summary of focus group
discussions is required, all analytic techniques for focus group data require
transcription of the interview as a first step. Thus we consider the issues sur-
rounding the transcription process and then turn our attention to some of the
more common tools for analysis of focus group data.
The first step in many approaches to the analysis of focus group data is to have
the entire interview transcribed. Transcription services are readily available in
most cities and are generally able to provide relatively rapid turnaround at
modest cost. Transcription not only facilitates further analysis, but also it estab-
lishes a permanent written record of the group discussion that can be shared with
other interested parties. On the other hand, in research situations that are time
07-Stewart-5002.qxd 6/6/2006 11:46 AM Page 111
Epistemological Orientation
Disciplinary Focus
As discussed in Chapter 1, the ways in which the earliest focus groups were
designed, fielded, and analyzed were strongly influenced by their parent disci-
plines, particularly social and clinical psychology and marketing research. These
influences remain strong today, although much cross-disciplinary evolution has
blurred some of the original differences. Newer intellectual currents have also
affected how researchers analyze focus group data. The field of hermeneutics
migrated from Europe to the American consumer research community in the
1980s. It values consumer stories, or narratives, as a powerful tool for under-
standing consumer motivation, meaning, and decision making. Consumers’ ver-
bal expressions are conceptualized as “text” and interpreted through an iterative
process of reading, analyzing, and rereading the text. For a review of the hermeneu-
tic approach, see Thompson (1997). The field of semiotics also focuses on
textual data but interprets this more broadly as including not only verbal expres-
sions but pictures, sounds, products, and advertisements (Sayre, 2001, p. 210).
Semiotic analyses commonly deconstruct textual data to uncover unintended or
hidden messages, which has proved particularly useful in the field of advertising
and communications research (McQuarrie & Mick, 1996; Stern, 1995). More
broadly, semiotic analyses of qualitative consumer data have helped identify the
signs and symbols that are embedded in textual data (Umiker-Sebeok, 1987).
Finally, some approaches to analyzing focus group data are, in comparison with
hermeneutics and semiotics, relatively atheoretical. This is particularly true of
marketing studies that seek to discover the major ideas and themes that emerge
from the group discussion. This approach also serves marketers’ frequent need
to quantify, statistically analyze, and generalize the findings from small-sample
qualitative studies.
Workbench Issues
Issue Order
Most analyses of focus group data seek to find meaning in the nature of
participants’ verbal or written responses to the questions in the discussion
guide. This is logical and necessary, but exclusive emphasis on what is said or
written may provide only a partial picture of the situation. Things that go
unsaid or are not raised in the discussion may be equally important. Some
issues that participants don’t address may simply represent things that are
taken for granted (e.g., clean restrooms in restaurants). Others may represent
socially sensitive topics that individuals would prefer to avoid (e.g., retirement
savings activities and strategies). Finally, other issues may not materialize in
the discussion because they are simply not important. Interpreting the signifi-
cance of things that go unsaid requires considerable skills on the part of both
the moderator and the analyst(s).
This tends to frustrate the moderator, but more important, it provides clues to
how much the participants care about a particular issue. It may be misleading
to focus only on the responses to different questions without also considering
the amount of time the participants chose to spend on each one.
Intensity of Expression
Often related to the issue of time are the moods and emotions that arise as var-
ious topics are covered. A focus group can be like an emotional roller coaster
that veers from the dull formality of a committee meeting to moments of group
hilarity to mildly hostile silence. Such situations challenge the moderator to get
things going or calm them down. They also challenge the analyst to interpret the
nature and sources of participants’ emotional reactions and expressions. The
field of marketing today places a strong emphasis on the theory and practice of
customer relationship management (CRM). The role of consumers’ emotional
connections to products and brands is increasingly seen as a key link in the rela-
tionship. This orientation has contributed to the growing use in focus groups of
emotional elicitation techniques such as projective methods.
One central theme in the current criticism of focus group research is that
participants say one thing and do another. This problem is not unique to focus
groups and also arises in survey research. Focus group moderators and ana-
lysts need to be sensitive to situations in which participants’ expressions may
07-Stewart-5002.qxd 6/6/2006 11:46 AM Page 116
The analysis of focus group data often seeks to generalize findings in terms
of the group using terms such as most, very few, and the majority. In groups
that are extremely homogeneous (e.g., upper-middle-class widows between 65
and 75 years old who still live independently), this may make sense. On the
other hand, it represents a subtle intrusion of inappropriate quantitative analy-
sis. In most studies, focus group research involves small samples that are
imperfectly representative of a larger population. This makes group level gen-
eralizations questionable on both statistical and sampling criteria. An alterna-
tive approach is to view each individual in the group as representing a
particular demographic, lifestyle, or attitudinal segment, which encourages a
within-person rather than an across-person analysis.
Once the coding process is complete, the coded copy of the transcribed interview
may be cut apart (the scissors part of the technique). Each piece of coded mater-
ial can be cut out and sorted so that all material relevant to a particular topic is
placed together. This cutting and sorting process may also be readily carried out
on any computer with a word-processing program. Whether scissors or a personal
computer is employed in the process, both yield a set of sorted materials that pro-
vides the basis for developing a summary report. Each topic is treated in turn with
a brief introduction. The various pieces of transcribed text are used as supporting
materials and incorporated within an interpretative analysis.
The scissor-and-sort technique is a very useful and efficient approach to
analysis, but it does tend to rely very heavily on the judgment of a single ana-
lyst. This analyst determines which segments of the transcript are important,
develops a categorization system for the topics discussed by the group, selects
representative statements regarding these topics from the transcript, and devel-
ops an interpretation of what it all means. There is obviously much opportu-
nity for subjectivity and potential bias in this approach. Yet, it shares many of
the characteristics of more sophisticated and time-consuming approaches.
In some cases, it may be desirable to have two or more analysts indepen-
dently code the focus group transcript. The use of multiple analysts provides
an opportunity to assess the reliability of coding, at least with respect to major
themes and issues. When determining the reliability of more detailed types of
codes such as the intensity of positive and negative emotion associated with
various institutions and organizations, more sophisticated coding procedures
are required. All are types of content analysis, a topic to which we now turn.
Content Analysis
The meaning of a focus group discussion, or for that matter any set of
words, does not leap out complete with interpretation and insight. Rather, the
content of the discussion must be examined and the meaning and its particular
implications for the research question at hand discovered. Every effort to inter-
pret a focus group represents analysis of content. There are, however, rigorous
approaches to the analysis of content, approaches that emphasize the reliabil-
ity and replicability of observations and subsequent interpretation. These
approaches include a variety of specific methods and techniques that are col-
lectively known as content analysis (Krippendorf, 2004). There are frequent
occasions when the use of this more rigorous approach is appropriate for the
analysis of data generated by focus groups. This may even be necessary when
numerous focus groups are fielded, yielding a large volume of data.
The literature on content analysis provides the foundation for computer-
assisted approaches to the analysis of focus group data. Computer-assisted
07-Stewart-5002.qxd 6/6/2006 11:46 AM Page 118
Any technique (a) for the classification of the sign-vehicles (b) which relies solely
upon the judgments (which theoretically may range from perceptual discrimina-
tion to sheer guesses) of an analyst or group of analysts as to which sign-vehicles
fall into which categories, (c) provided that the analyst’s judgments are regarded
as the report of a scientific observer. (p. 55)
are generally representative of the types of formal content analysis scales that
are in use.
Janis (1965) identified three distinct types of content analysis based on the
purpose of the investigation:
• Data making
• Data reduction
• Inference
• Analysis
• Validation
• Testing for correspondence with other methods
• Testing hypotheses regarding other data
TABLE 7.1
Approaches to Defining Content Units
• Physical units divide the content of a medium by such physical properties as size,
place, time, and length. For example, a book, a billboard, and a single issue of a
magazine would all be examples of physical units. The boundaries of these units
are defined by time and space.
• Syntactical units divide the content of a medium based on its natural grammar.
Words, individual television programs or news items, and chapters within books
are examples. These units tend to be defined by the source of the communication.
• Categorical units are defined in terms of a referent, an expression, regardless of
length, that refers to or describes the same person, object, or event.
• Propositional units (also called kernels) are referential units that possess a
particular structure and offer a particular thought about the referent object or
person. Thus, the statement, “He is a bright, but dishonest man,” includes two
propositions: (a) the man is bright and (b) the man is dishonest.
• Thematic units include more global interpretative or explanatory sets of
statements. Recurring systems of beliefs or explanations represent thematic units.
Thus, one might find that in a focus group there is a recurring theme that
salespeople are dishonest. Alternatively, analysis of the morning news over time
might reveal themes related to significant economic changes or political conflict.
The final stage of data making is the recording of the data in such a way as
to ensure their reliability and meaningfulness. The recording phase of content
analysis is not simply the rewriting of the statements of one or more respon-
dents. Rather, it is the use of the defined units of analysis to classify the con-
tent of the discussion into categories such that the meaning of the discussions
is maintained and explicated. It is only after this latter stage has been accom-
plished that one can claim to actually have data for purposes of analysis and
interpretation.
The recording phase of content analysis requires the execution of an explicit
set of recording instructions. These instructions represent the rules for assign-
ing units (words, phrases, sentences, gestures, etc.) to categories. These
instructions must address at least four different aspects of the recording
process (Krippendorf, 2004):
1. The nature of the raw data from which the recording is to be done (transcript,
tape recording, film, etc.)
2. The characteristics of coders (recorders), including any special skills such as
familiarity with the subject matter and scientific research
3. The training that coders will need in order to do the recording
4. The specific rules for placing units into categories
These rules are critical to establishing the reliability of the recording exer-
cise and the entire data-making process. Further, it is necessary that these rules
be made explicit and that they are demonstrated to produce reliable results
when used by individuals other than those who developed them in the first
place. The common practice of reporting high interrater reliability coefficients
when they are based solely on the agreement of individuals who have worked
closely together to develop a coding system does not provide a fair and rea-
sonable measure of reliability (Lorr & McNair, 1966). Rather, the minimum
requirement for establishing the reliability of a coding system should be a
demonstration that judges exhibit substantial agreement when using only the
coding rules.
Once a set of recording rules has been defined and demonstrated to produce
reliable results, the data-making process can be completed by applying the
recording rules to the full content of the material of interest. Under ideal cir-
cumstances, recording will involve more than one judge so that the coding of
each specific unit can be examined for reliability and sources of disagreement
can be identified and corrected. This is because there is a difference between
developing a generally reliable set of recording rules and ensuring that an indi-
vidual element in a transcript is reliably coded.
07-Stewart-5002.qxd 6/6/2006 11:46 AM Page 124
research and all types of research, but it occurs prior to observation. In content
analysis, data making occurs after observation. The emphasis on reliability is
clearly important in studies with scientific, theoretical purposes. On the other
hand, these procedures are used less frequently in the time-pressured and prag-
matic focus groups that are conducted in the marketing research field.
QUANTITATIVE ANALYSIS
Content analysts were quick to recognize the value of the computer as an ana-
lytical tool. The time-consuming and tedious task of data making can be
greatly facilitated through use of the computer. Computers can be programmed
07-Stewart-5002.qxd 6/6/2006 11:46 AM Page 126
Revision Necessary?
revise categories/
yes no
key word list
no
ILLEGA
EXP
S
POS NSION
BATTERIES
ITIE
A
O SU
CANON PLANE
R
L IMPO
ME
EXPERTS
SIBIL
RE
CA
Y
EXP
ET
TIM
RT
ET
PI
E
W
RI
Y
CT
SIZ
IN
IT
Y
CK
E
UR D
VA
DE IT
IL
E 19 15 IV AR
PO
B
QU R 24 16 D
NS
T
TI
14 SI AN
PA
AL
ST
LE
IT 25 12 N
SE
M
AL
ES
Y
CO
11 T C
ID
32 H NI
SL
APER
TURE 9 LI
G CH H US
9 TE AS OC
34
9 FL T OF
6 3 AU
HANDLING 44 2
1 SHUTTER
TEST RESULT 55 33 FREQUENC
Y
70 25 MA
GTH CRO-P
L LEN ICTUR
FOCA 93 26 V ES
GTH ACA
LEN 115 TIO
ECT N
OBJ E RA 123 125 130 5 P
EO
C AM C PL
X I 5 E
FLE AT
HT
PRICE
RE M HO
BB
WEIG
TO 5 Y
AU 3 MO
2 TI
VE
SP
OUT
EC
IA
-IND
LP
IC
OOR
TU
IC
RE
AT
S
BA
TO
TT
ER
AU
IES
24 20
DEL
ED MO
CO NTINU
CANON PLANE ROBUSTNESS 30 16 DIS
LAYPERSONS
32 44
RE
L T 34 PU
SU TA
RE
PRICE
TI
ST O
N
TE
Figure 7.3 Graphic Representation of the Canon Plane for Experts and
Laypersons
SOURCE: Grunert and Goder (1986). Reprinted with permission.
extremely useful tool for data reduction. It can also be used for uncovering
relationships that might otherwise go unnoticed. Thus, like most of the research
tools in the social sciences, the focus group interview has benefited from the
advent of the computer. Users of focus group interviews have also become
increasingly facile in the use of the computer as an aid to the analysis and
interpretation of focus group data.
CONCLUSION
The analysis of focus group data can take a wide variety of forms. These may
range from very rapid, highly subjective impressionistic analyses to very
sophisticated computer-assisted analyses. There is no best approach. Rather,
the approach selected should be consistent with the original purpose of the
research and the information needs that gave rise to it. It is unfair to suggest
that all focus group research involves highly subjective analysis. This is cer-
tainly the case in many applications, but there exist an array of sound proce-
dures for ensuring reliable and objective results and for quantifying outcomes.
07-Stewart-5002.qxd 6/6/2006 11:46 AM Page 133
REVIEW QUESTIONS