Universität Bremen

Academic and Professional Practice

Welcome to
„Academic and
Professional Practice“ ☺
We‘ll start at 10:15 am!

1
 Universität Bremen
FB07 | Prof. Dr. Julia Kensbock
[email protected]

Academic and Professional Practice

Session 5 – Data Collection

Bremen, May 2, 2024

 Universität Bremen

Academic and Professional Practice

Time Schedule
 Universität Bremen

Academic and Professional Practice

Learning goals and agenda for today

After today‘s session, you will… Agenda for today‘s session:

… be able to prepare your data collection.

I. Short presentations & feedback
…be able to calculate sample size.

…know different sampling methods II. Input on data collection

... be able to conduct quantitative surveys.

…Understand some ethical considerations when

conducting research

…be able to conduct interview

4
 Universität Bremen

Academic and Professional Practice

Academic and Professional Practice

Part II: Short Presentations

5
 Universität Bremen

Academic and Professional Practice

Short presentations: Feedback
While the other team presents their research question, please pay attention to:
• Aspects that were great:
What were the things that you liked about the team’s research question? Keep these
things.
• Aspects that could be improved:
What were the things that could be improved? Give concrete advice on how these
aspects could be improved.
• Aspects that you didn’t like:
What were the things that you didn’t like about the team’s research question? Should
they consider leaving out these aspects or fundamentally changing them? If yes, how?
• Aspects that you will take with you:
What were the things that you learn from the team’s research question? How will this
help you improve your own research question?
• Aspects that came up short:
What were the things that were missing or that you think came up too short? Give
concrete advice on which aspects you lacked information on.
6
 Universität Bremen

Academic and Professional Practice

Reminder: What constitutes a good research question?

Two or more plausible answers are possible.

Answering the question advances our knowledge.

The answer to the question is relevant ("So what?").

The question is "on point" and focuses on the primary research interest.

Not too big (unfeasible) and not too small (insignificant).

7
Van de Ven, 2007; Clough & Nutbrown, 2002)
 Universität Bremen

Academic and Professional Practice

Reminder: Planning a (research) project

Planning a project in detail

Project
Work Dates and Mile- Communi-
Structure Resources
Packages Processes stones cation
Plan

(Projektmanagement-Handbuch für Projekt der LUH, 2009) 8

 Universität Bremen

Academic and Professional Practice

Academic and Professional Practice

Part II: Data Collection

9
 Universität Bremen

Academic and Professional Practice

Research question – and now?

• Who?
• When?
• Where?
• What?
• How?

• Adhering to guidelines of good research practice:

https://www.bigsss-bremen.de/static/uploads/Documents/Ethics/DFG_code_of_conduct_dfg.1.1.pdf

10
 Universität Bremen

Academic and Professional Practice

Research question – The WHO

• Target population → sample

• Where can you find subjects from this population?

• How many do you need or want to include?

• Do you have / How can you get access to them?

• What should the sample represent (homogeneity vs. heterogeneity)?

11
 Universität Bremen

Academic and Professional Practice

Research question – The WHO

In which type of research is the generalization of findings highly important to researchers? And

which type of sample is necessary for this purpose (homogeneous or heterogeneous)? Example?

• Heterogeneity is related to maximum variation of perspectives and theoretical sampling in qualitative research

• Homogeneity is associated with representativeness in quantitative research

12
 Universität Bremen

Academic and Professional Practice

Information system Journals

In information system journals, which methods

were predominantly published between 2007 and

2018?

13
Recker (2021, p. 88)
 Universität Bremen

Academic and Professional Practice

Research question – and now?

Data Collection
in Quantitative
Research

© rawpixelcom via freepik

14
 Universität Bremen

Academic and Professional Practice

Research question – and now?
Reminder: Quantitative Research Approach
• Experimental Methods • Social survey method
➢ Represent the (experimental or qausi-
➢ Used for large-scale population data collection.
experimental designs)
➢ It is called: ➢ Primarily in quantitative research designs.
➢ Main characteristics:
➢ Examines relationships between variables.
- Manipulation
- Control ➢ Utilizes standardized questionnaires.
- Randomization (not necessary for quasi-experiment)
➢ Essential for hypothesis testing and generalization via
- Internal Validity: Control confounding variables within the experiment.
- External Validity: Generalize the findings sampling.

15
 Universität Bremen

Academic and Professional Practice

Research question – The WHO
Important factors for determining sample size:

✓Population Variability For quantitative data analysis you can use G*Power
(statistical software package)
✓Effect Size
✓Confidence Level (1-α) https://www.psychologie.hhu.de/arbeitsgruppen/allgemeine-
psychologie-und-arbeitspsychologie/gpower
✓Statistical Power ((1 - β)
✓Margin of Error
✓Study Design Rule of thumb:
• In regression analysis, 10 observations per predictor
✓Resource Constraints Or

✓Expected Dropout • 50 + 8* (number of predictors)

16
 Universität Bremen

Academic and Professional Practice

Research question – The WHO

✓Probibility
1) Simple Random Sampling: Selecting individuals from a population randomly and without replacement, ensuring every
member has an equal chance of being chosen.

2) Systematic Sampling: Choosing every nth element from a population list after selecting a random starting point,
offering a structured approach with evenly spaced selections.

3) Stratified Sampling: Dividing a population into homogeneous groups, then randomly selecting samples from each group
proportionally, ensuring representation of diverse subgroups.

4) Cluster Sampling: Dividing a population into clusters, randomly selecting clusters, and then sampling all individuals
within the chosen clusters, facilitating practicality in large-scale studies. 17
 Universität Bremen

Academic and Professional Practice

Research question – The WHO

✓Non-probability
1) Convenience Sampling: Regarding accessibility

2) Purposive Sampling: Selecting participants based on specific criteria relevant to the research objectives, allowing
for targeted inclusion of individuals with desired characteristics.

3) Judgmental Sampling: Choosing participants based on the researcher's judgment and expertise, focusing on
individuals who are deemed most informative or representative.

4) Quota Sampling: Selecting participants based on pre-defined quotas for certain characteristics, ensuring
representation of key demographic groups.

5) Snowball Sampling: Recruiting participants through existing contacts or referrals, allowing for access to hard-to-
reach populations by leveraging social networks.
18
 Universität Bremen

Academic and Professional Practice

Research question – The WHEN and WHERE

• When?
• Time period: when will data collection take place?
• What do you need to consider to decide on a period? (e.g., holidays)

• Where?
• Location: where will data collection take place (in the case of in person interactions)?
• Interviews: quiet, undisturbed room → confidentiality!

19
 Universität Bremen

Academic and Professional Practice

Research question – The WHAT

• Formulating hypotheses

• Identifying central concepts and constructs

• Operationalization of constructs as scales

• Informed consent form and data privacy statement, e.g.,

https://www.eui.eu/documents/servicesadmin/deanofstudies/researchethics/guide-data-
protection-research.pdf

• Documentation (→ project logbook)

• Pretest

20
 Universität Bremen

Academic and Professional Practice

Research question – The WHAT
Quantitative Research Approach

• Social survey method

Criteria for Questionnaire Quality:

(Scale/measurements)

➢ Validity: Reflects the empirical manifestation of ➢ Reliability: Consistent and precise over time.
the theoretical background.

Valid
Valid ✓ Valid ✓ Valid 21
Reliable Reliable ✓ Reliable
✓ Reliable Recker (2021, p. 93)
 Universität Bremen

Academic and Professional Practice

Research question – The HOW
Steps for implementation phase
• Prepare materials

Preparing Questionnaires/scales/ measurements, and Information (e.g., flyer, social media post, email with survey link)

• Title of the survey: use comprehensible terms, do not reveal aim of the study

• Welcome and instructions: basic information (e.g., duration), data protection, active (!) informed consent (include
in survey), data protection statement (email attachment or link in survey)

• Screening questions: make sure participants meet inclusion criteria

• Socio-demographic data: be parsimonious!

22
Döring & Bortz (2016)
 Universität Bremen

Academic and Professional Practice

Research question – The HOW
Sequence of action in preparing a questionnaire
• Scales: logical order, well-structured, brief instructions,
provide anchor

• Search for <construct> + “scale” / “survey” /

“measure”
• Look at the measures in papers’ Methods section
• Final scale with all items in papers’ appendix
Scales

• Farewell: thank for participation, provide contact details

23
 Universität Bremen

Academic and Professional Practice

Research question – The How
Ethical consideration for scientific conduct

• All behaviours involve in the research process are subject to ethical considerations.

• Information systems research is a social science, so the ethical principle in

conducting research should be followed.

Information Consent Form Essentials:

✓ Anonymity: Participant identities kept confidential.

✓ Data Confidentiality: Secure storage and limited access.
✓ Voluntary Participation: Right to withdraw at any time.
✓ Risk Disclosure: Clear explanation of potential risks.
24
 Universität Bremen

Academic and Professional Practice

Research question – The HOW
Steps for implementation phase
• Determin how to recruit
✓ Contact persons as a gatekeeper
✓ Participants for snowballing
✓ Cold calling (e.g., lists of companies)

• Determin the survey administration methods

✓ Interview surveys
✓ Self-administered surveys
✓ Telephone surveys
✓ Mail surveys
✓ Online surveys

• Determine roles and responsibilities (team roles)

• Document recruiting process (incl. contact person, dates, notes, reminder) 25

 Universität Bremen

Academic and Professional Practice

Research question – The HOW
Guidelines to Prepare a Survey Questionnaire

© soscisurvey. Lamapoll, Hadley Wickham (Rstudio), theanalysisfactor

• Avoid jargon and abbreviations.

• Avoid confusion and vagueness.

• Avoid emotional language and prestige bias.

• Avoid double-barrelled questions.

• Avoid leading questions.

• Avoid double negatives

• Avoid overlapping or unbalanced response categories.

26
 Universität Bremen

Academic and Professional Practice

Quantitative data collection: Bad examples

Survey about how remote work increases job satisfaction

What do you think,

© https://www.genroe.com/blog/are-these-the-worst-real-customer-survey-questions-
youve-seen/8360
© https://cs3240team18.wordpress.com/2012/09/21/questionnaires-good-and-bad-
examples/

Sullivan & Artino (2017)

27
 Universität Bremen

Academic and Professional Practice

Research question – and now?

Data Collection
and Analysis in
Qualitative
Research

28
 Universität Bremen

Academic and Professional Practice

Research question – The WHAT

• Identifying central concepts and constructs

• Operationalization as open-ended questions → interview guide
• Informed consent form and data privacy statement, e.g.,
https://www.eui.eu/documents/servicesadmin/deanofstudies/researchethics/gu
ide-data-protection-research.pdf
• Audio tape
• Field notes (→ basic information about interview situation)
• Documentation (→ project logbook)
• Pretest
29
 Universität Bremen

Academic and Professional Practice

Research question – The HOW: Types of interviews

• Unstructured
+ Allows interviewees to talk freely about what is important to them
- Requires that interviewee is talkative
• Structured
+ Secures consistency and reliability
- Cannot follow emergent new lines of inquiry
• Semi-structured
+ Combines strengths of both
- Combines weaknesses of both

(Recker, 2021) 30
 Universität Bremen

Academic and Professional Practice

Research question – The HOW: Types of questions

• Miracle questions
“Suppose a miracle would happen overnight and the problem you described is
solved, how would you know that the problem was solved?”
• Exception questions
“When is the situation different / better?”
• Circular questions
“What would XY say?”
• Paradox questions
“What do you need to do to make the problem worse?”
• Hypothetical questions
“Let’s assume ….” 31
(Vogt & Werner, 2014)
 Universität Bremen

Academic and Professional Practice

Research question – The HOW: Conducting interviews

• Carl R. Rogers’ person-centered approach (“non-

directive or client-centered therapy”)
• Active listening in interviews:
• Listen attentively
• Give space to interviewees
• Non-verbal signs of listening (e.g., “hmm”, nodding)
• Be authentic
• Do not criticize what’s being said
• Paraphrase and ask questions to understand what’s
being said
© Didius / Dutch Wikipedia
(Misoch, 2019) 32
 Universität Bremen

Academic and Professional Practice

Qualitative studies: First steps to an interview guide

• Developing an interview guide

• Collect questions: as many aspects of the research interest as possible
• Check questions: are they open-ended, comprehensible, and purposeful?
• Sort questions: based on content or chronologically
• Subsume questions: create question bundles with subordinated questions
• Structuring the interview guide
• Beginning and end of the interview: introduction, socio-demographics, etc.
• Middle part: order of questions bundles and keywords
(Helfferich, 2019; Vogt & Werner, 2014) 33
 Universität Bremen

Academic and Professional Practice

Qualitative studies: First steps to an interview guide

• Beginning: introduce yourself, the topic of study, its aim, outline what happens
with the data

Guiding questions Memo Concretization /

maintaining / steering
Middle part

questions
What comes to mind first Aspect A, Can you give me an
when you hear …? Aspect B, example for …?
Aspect C …
Tell me, why/how/…? Can you elaborate on that
a little bit?

• End: ask if interviewee would like to add anything, answer questions, thank,
debrief, and goodbye
(Vogt & Werner, 2014) 34
 Universität Bremen

Academic and Professional Practice

Next steps
• Choose the collect data methods and prepare the material

• Work in your teams and start to collect data

• Don’t forget about the project logbook ☺

• Next session in class: May 16, 2024, 10:15 am (SFG 1020)

• Midterm feedback: Your participation is voluntary and anonymous ☺

Scan the code or go to the link https://forms.gle/waC5STnu4FRt6RYk9

35
 Universität Bremen

Academic and Professional Practice

Questions?

Fateme Rezaei Badafshani

Research Associate
Management and Organisation in a Digitized Society

WiWi2 Building, Room F2340

Max-von-Laue-Str. 1
28359 Bremen

[email protected]

Office hours by appointment

36