QUALINET white papers definition of QoE

The degree of delight or annoyance of the user of an application or service. It results from the fulfilment of his or her expectations with respect to the utility and / or enjoyment of the application or service in the light of the user’s personality and current state."

• Social psychology
• Cognitive science
• Economics
• Engineering service

Focuses on understanding overall human quality requirements.

• Human (HIF)
  • Low Level: age, physical, emotional, mental constitution
  • High Level: previous knowledge, prior
• System (SIF)
  • Content
  • Media
    • Enconding, resolution, sample rate
  • Network
    • Bandwidth, delay, jitter
  • Device
    • Screen size, resolution, frame rate, audio
• Context (CIF)
  • Physical
    • Location and space
  • Social
    • Inter-personal relations during experience
  • Task
    • Multitasking, interruptions, task type
  • Temporal
    • Time of day, frequency of use
  • Technical
    • Relationship between systems

Widely used for quality of media signals. Usefullness of MOS is often debated due to inherent limitation of measurements in a single scalar value.

Subjective quality evaluation requires a lot of human resources and can be time consuming. Objective ecaluation methods gives faster results, but require dedicated computing resources.

Prone to misuse or misinterpretation

• Design of subjective experiments on media quality have important influence
• Objective media quality metrics rely oon data from the subjective experiments for tuning and validation
• Can be challeging to make meaningful measurements and interpret the results correctly

• Non-verbal pictorial assessment technique
  • Therefore not language dependent and suited for children and people with language disorders
• Measures pleasure, arousal and dominance
• Persons affective reaction
• Can be used as a replacement for the Semantic Differential scale (18 ratings vs only 3)
  • Gave similar results for pleasure and arousal
  • Dominance response suggest that SAM may better track personal response
• Inexpensive and easy

Will gather information about the participant before the experiment (form)

• Age
• Gender
• Occupation
• Previous experience

Will gather information about the participants experience after the experiment (form)

• User emotions: Self Assesment Manikin scale, paper
• Immersion: Presence and engagement
• Usability: System Usability Scale, paper, website