INTERACTION WITH AI –
MODULE 2
Session 1
Asbjørn Følstad, SINTEF
My background:
Human-Chatbot
Interaction Design
How to design chatbots?
Supported by IKTPLUSS, Research
Council of Norway
2
My background:
SINTEF, HCI group
Psychology (!?!)
3
Session 1 & 2:
The user and
interaction design
perspective
Interaction with AI – on interaction with AI
module 2 Asbjørn Følstad
Interaction design
Session 3 & 4:
Four sessions The machine learning
perspective
on interaction with AI
Morten Goodwin
4
1
Interaction with AI - overview
2
User-centred design of AI
Chatbots – interacting with AI i
3&4
natural language
Themes Intelligent agents - AI system as
partner
Interaction with AI in social contexts
Platforms and frameworks for
interaction with AI
Machine learning
Explainable AI
5
Luger, E., & Sellen, A. (2016, May). Like having a really bad PA: the gulf between
user expectation and experience of conversational agents. In Proceedings of the
2016 CHI Conference on Human Factors in Computing Systems (pp. 5286-5297).
ACM.
Følstad, A., & Brandtzæg, P. B. (2017). Chatbots and the new world of
HCI. interactions, 24(4), 38-42.
Carter, S., & Nielsen, M. (2017). Using artificial intelligence to augment human
intelligence. Distill, 2(12), e9.
Litera- Vinyals, O., & Le, Q. (2015). A neural conversational model. arXiv
preprint:1506.05869
Frey, C. B., & Osborne, M. A. (2017). The future of employment: how susceptible
ture
are jobs to computerisation?. Technological forecasting and social change, 114,
254-280.
Bessi, A., & Ferrara, E. (2016). Social bots distort the 2016 US Presidential
election online discussion. First Monday, 21(11)
Noessel, C. (2017). Designing Agentive technology: AI that works for people.
Rosenfeld Media.
Hall, E. (2018). Conversational design. A Book Apart
6 McAfee, A., & Brynjulfsson, E. (2016). Machine, Platform, Crowd. Harnessing Our
Digital Future. Norton & Company.
1. Search and find three definitions of AI, describe these briefly. Make
references.
• Discuss definitions relative to discussions of AI in the course
2. Search and find three definitions of Robotics, describe these briefly.
3. Search and find three definitions of Machine Learning, describe
these briefly.
• Discuss definitions relative to discussions of Machine Learning
Individual in the course
4. Write in three to five sentences the relationship between AI and
Robotics as you understand this.
assignment 5. Make a text to describe your own definition of AI. Explain briefly
this definition.
• Expand on this text to explain the relation between AI and
Machine Learning
6. Make a drawing of an interaction with an AI - something that you
imagine. Describe with some sentences your drawing.
• Summarize key characteristics of interaction design for AI-
based systems (challenges, principles, trends)
• Sketch a user interface illustrating one or more of these
7
characteristics
7. Read the article: "On the Subject of Objects: Four Views on
Object Perception and Tool Use" by Tarja Susi / Tom Ziemke.
Write in your own words one page about the different
perspectives on the human relationship with tools.
8. Select one of the perspectives from the article, and go into detail
when you describe it.
Individual 9. Select one other article from module 1, and write with your own
words what this article is about.
10.Select one documentary or a fictional film, book or
assignment game: describe with your own word how interaction with AI is
portrayed in this work.
11.Describe what you understand by autonomy; both human
autonomy and machine autonomy.
12.When was the term "AI" first coined? Please make a reference.
13.Articulate one question for the article "What we talk about when
we talk about context" by Paul Dourish in the curriculum.
14.Articulate one question for any other article in the curriculum.
8
15. Read the article: "Like Having a Really Bad PA" by Luger & Sellen.
Summarize in your own words key lessons learnt for interaction
design with dialogue systems. Discuss the relevance of these
lessons learnt for interaction with AI-based systems in general
(1/2-1 page)
Individual 16. Read the article: "Using Artificial Intelligence to Augment Human
Intelligence" by Carter & Nielsen. Summarize in your own words
the articles discussion of different views on computers, and on
assignment how AI may augment human intelligence (1/2-1 page)
9
Mid-term report. Building on, and expanding, the wonder document
• a description of the group, who you are - names.
• a description of what area of “interaction with AI” you are
interested in working with.
• Background section: Position your work relative to existing
knowledge and practice
Group
• minimum 1 maximum 2 questions that you want to address. Please
write some sentences about the questions. These questions can be
changed and evolved later in the mid term report and in the final
assignment •
report - as you go about investigating your questions.
Method section – overall approach, design process (optional, but
encouraged), data collection methods
• Sketches and/or prototypes (optional, but encouraged)
• Findings (progress, initial outcomes)
• Minimum five references to literature.
• Five to seven pages.
---
• Appendix 1: Report on conversational interaction assignment
(lesson 1 & 2)
10
• Appendix 2: Report on machine learning assignment (lesson 3 & 4)
Interaction with AI - overview
11
AI?
12
Artificial super
intelligence
AI? Artificial general
intelligence
Artificial narrow
intelligence
Noessel, C. (2017). Designing
Agentive technology: AI that works
13
for people. Rosenfeld Media.
Artificial super
intelligence
Artificial general
intelligence
Artificial narrow
intelligence
Person of Interest (2011 -)
Noessel, C. (2017). Designing
Agentive technology: AI that works
14
for people. Rosenfeld Media.
Artificial super
intelligence
Artificial general
intelligence
Artificial narrow
intelligence
Ex Machina (2014)
Noessel, C. (2017). Designing
Agentive technology: AI that works
15
for people. Rosenfeld Media.
Artificial super
intelligence
Artificial general
intelligence
Artificial narrow
intelligence
Noessel, C. (2017). Designing
Agentive technology: AI that works
16
for people. Rosenfeld Media.
Artificial super
intelligence
Interaction with AI, and
designing for interactions Artificial general
with AI, concerns artificial
intelligence
narrow intelligence
(narrow AI)
Artificial narrow
intelligence
Noessel, C. (2017). Designing
Agentive technology: AI that works
17
for people. Rosenfeld Media.
Need to know:
Interaction with AI, and
designing for interactions • Characteristics of narrow AI
with AI, concerns artificial • Opportunities and limitations of
narrow intelligence narrow AI
(narrow AI) … from now on, when talking about AI
we mean narrow AI
18
Artificial
intelligence
AI with incredible
advances due to progress Machine
in machine learning learning
Deep
learning
19
Two drivers:
AI with incredible
advances due to progress Large datasets
in machine learning
Computational power
20
A current understanding
AI with incredible of AI may be:
advances due to progress
in machine learning Computer systems
learning and improving
on the basis of large data
sources
21
22
https://experiments.withgoogle.com/collection/ai
23
Learn | Improve | Fuelled by large data sets
Tentative definition:
AI-based Interactive systems where important
interactive components are powered by AI.
systems
These systems are tyically set up for
learning and improvement on the
basis of large datasets and gathering
of new data
24
User-centred design of AI
25
?
26
27
28
Learn | Improve | Fuelled by large data sets
From a user perspective –
how does AI-based
interactive systems differ
from other computer
systems?
29
Learn | Improve | Fuelled by large data sets
Dynamic Mistakes inevitable Data gathering through
interaction
VS.
30
Chatbots – interacting with AI
in natural language
31
One definition:
… machine agents that serve as
natural language user interfaces
to data and services through text
or voice.
… allow users to ask questions or
make commands in their
everyday language and to get the
needed content or service in a
conversational style.
32
Meaning of term evolving
Social chatter
Tasks
33
Chatbot channels
• Webpages
• Messaging platforms
• Apps
• Operating systems
• Smart home devices
34
Chatbot channels
• Webpages
• Messaging platforms
• Apps
• Operating systems
• Smart home devices
35
Chatbot channels
• Webpages
• Messaging platforms
• Apps
• Operating systems
• Smart home devices
36
Chatbot channels
• Webpages
• Messaging platforms
• Apps
• Operating systems
• Smart home devices
37
Chatbot channels
• Webpages
• Messaging platforms
• Apps
• Operating systems
• Smart home devices
38
Chatbot modalities
• Text-based
• Voice-based
• Text and voice
… and often supporting other
modalities such as menues, set
answer alternatives, images,
video
39
Chatbot
development
platforms
• DIY
• Platform and assistance
40
Chatbot
development
platforms
• DIY
• Platform and assistance
41
Vinyals, O., & Le, Q. (2015). A neural conversational
model. arXiv preprint:1506.05869.
Different types of
chatbots
• Generative
• Intents and actions
• Scripted
42
Different types of
chatbots
• Generative
• Intents and actions
• Scripted
43
Different types of
chatbots
• Generative
• Intents and actions
• Scripted
44
Interaction design
and training
• Generative
• Intents and actions
• Scripted
45
Interaction design
and training
• Generative
• Intents and actions
• Scripted
46
Interaction design
and training
• Generative
• Intents and actions
• Scripted
47
Group assignment for next week
(Appendix 1 in mid-term report)
Decide on purpose
Prototype a chatbot for a self-decided
purpose
Identify key tasks
… using Chatfuel
(… or Dialogflow if you want vastly more
flexibility and slightly more challenge) Design flows, intents and actions
Keep it simple and early-phase (4-8 hours
work?)
Test and refine
Make brief (approx 1 minute) video
48 capture of dialogue?
If you use Chatfuel:
- Your actions will
typically be in the blocks
(choose automate in left
hand meny, then add
block)
- You assign intents to
blocks by AI-rules
(choose Set up AI in left
hand meny, then add AI-
rule, set rule to "bot
replies with Block")
- You test the chatbot
directly in Messenger
- Try out, have fun :-) https://chatfuel.com
End session 1
50
