Lecture 1 – Information processing ........................................................................................................ 2
Lecture 2 – Perception ............................................................................................................................ 2
Lecture 3 – Attention .............................................................................................................................. 6
Lecture 3 - Cognitive control ................................................................................................................... 7
Lecture 4 – Motivation ............................................................................................................................ 7
Lecture 4 – learning ................................................................................................................................ 9
Lecture 4 – memory .............................................................................................................................. 10
Paper week 1 - theme 1 - consumer consciousness in multisensory extended reality ........................ 11
Paper week 1 – theme 1 (in-depth) - Does media multitasking always hurt… ..................................... 12
Paper week 1 - theme 2 – the power of sensory marketing in advertising .......................................... 12
Paper week 1 - theme 2 (in-depth)– Sensitive to the digital touch? Exploring sensory…. .................. 13
Paper week 1 – theme 2 – the power of sensory marketing in advertising ......................................... 14
Paper week 2 – theme 3 (in-depth) – Memory failure predicted by attention..................................... 14
paper week 2 - theme 3 - Visual Selection: Usually Fast and automatic …........................................... 14
Paper week 2 - theme 4 (in-depth) - How students’ self-control and smartphone-use… ................... 15
Paper week 2- theme 4 - “Cognitive Control in Media Multitaskers” Ten Years On: A meta-analysis .. 15
Paper week 3 – theme 5 (in-depth) – Value-based routing of delayed intentions into brain-based…. 16
Paper week 3 – theme 5 – media technology, and the sins of memory ............................................... 16
Paper week 3 - theme 6 (in-depth) – A computational reward learning account of social media en.. 18
Paper week 3 - theme 6 – A review of theories and models applied in studies of social media… ....... 18
,Lecture 1 – Information processing
Information processing
Information processing model = cognitive psychology traditionally considered the individual as a
processor of information …. (simplistic but common model of human cognition)
Cognitive psychology = traditionally considered the individual as a processor of
information, in much the same way that a computer takes in information and follows a
program to produce an output.
All about information processing
- Attention filters for perception
- Attention needs to be monitored, maintained, and (if needed) adjusted during a task
(cognitive control) and this is costly in terms of mental effort.
- Motivation determines if and how much of cognitive control (effort) is invested
- (Working) memory and learning influence cognitive decisions – among which actual
responses
Conscious perception = working or short-term memory
- Working memory content influences ongoing perception
Lecture 2 – Perception
Perception
Sensation ------------------------------------------------> Perception
Conversion of physical energy into the neural Processes beyond sensation: making sense of
codes the sensation
Sensation is the initial step of gathering Processing and organizing the raw information:
stimulus information combining sensory input with prior knowledge
We are not consciously aware of all sensory Forming a coherent representation of the world
input
- Attention
- Saliency
Using these representations to solve problems
Bottum-up input:
, - input gated through by attentional systems
Top-down influences during perception:
- Context effects
- The influence of prior knowledge, memory e.g. seeing face mask inside and outside as the
same
Perception in design
Role of top-down perception in design
- Filling in of information (a lot can be left out)
- Context matters
- Expectations can shape perception
Multi-sensory perception
Multi-sensory perception = “Stimuli are perceived through several sensory modalities (e.g., seeing,
hearing, touching) rather than through only one modality”
- E.g. taste is a strongly multisensory experience
- Aspects →
o Visual e.g. pink is more sweet
o
McGurk effect = shape of the mouth and what you here ( so with eyes close you can hear something
different)
Multi sensory integration
- Audio visual integration
o Localization of sounds
o Understanding of speech
- Tactile-visual integration, taste-sound, etc.
- Faster detection of stimuli
- Vision is more important for localization, but auditory information is more important for
knowing when something happens in time.
Multi-sensory perception and digital media use = Digital media use can leas to media multitasking,
with detrimental effects on selective attention, task switching, etc.
- But multitasking exposes users to multiple simultaneous sensory inputs and can actually
enhance multisensory integration
Crossmodal correspondences
Pitch and brightness (music and colour)
Crossmodal correspondences = a tendency for a sensory feature, or attribute, in one modality,
either physically present or merely imagined, to be matched (or associated) with a sensory feature in
another sensory modality
- In easy words: the idea that people tend to naturally link certain qualities from one sense
(like taste) with qualities from another sense (like sound or color). In simple words, it’s when
Lecture 2 – Perception ............................................................................................................................ 2
Lecture 3 – Attention .............................................................................................................................. 6
Lecture 3 - Cognitive control ................................................................................................................... 7
Lecture 4 – Motivation ............................................................................................................................ 7
Lecture 4 – learning ................................................................................................................................ 9
Lecture 4 – memory .............................................................................................................................. 10
Paper week 1 - theme 1 - consumer consciousness in multisensory extended reality ........................ 11
Paper week 1 – theme 1 (in-depth) - Does media multitasking always hurt… ..................................... 12
Paper week 1 - theme 2 – the power of sensory marketing in advertising .......................................... 12
Paper week 1 - theme 2 (in-depth)– Sensitive to the digital touch? Exploring sensory…. .................. 13
Paper week 1 – theme 2 – the power of sensory marketing in advertising ......................................... 14
Paper week 2 – theme 3 (in-depth) – Memory failure predicted by attention..................................... 14
paper week 2 - theme 3 - Visual Selection: Usually Fast and automatic …........................................... 14
Paper week 2 - theme 4 (in-depth) - How students’ self-control and smartphone-use… ................... 15
Paper week 2- theme 4 - “Cognitive Control in Media Multitaskers” Ten Years On: A meta-analysis .. 15
Paper week 3 – theme 5 (in-depth) – Value-based routing of delayed intentions into brain-based…. 16
Paper week 3 – theme 5 – media technology, and the sins of memory ............................................... 16
Paper week 3 - theme 6 (in-depth) – A computational reward learning account of social media en.. 18
Paper week 3 - theme 6 – A review of theories and models applied in studies of social media… ....... 18
,Lecture 1 – Information processing
Information processing
Information processing model = cognitive psychology traditionally considered the individual as a
processor of information …. (simplistic but common model of human cognition)
Cognitive psychology = traditionally considered the individual as a processor of
information, in much the same way that a computer takes in information and follows a
program to produce an output.
All about information processing
- Attention filters for perception
- Attention needs to be monitored, maintained, and (if needed) adjusted during a task
(cognitive control) and this is costly in terms of mental effort.
- Motivation determines if and how much of cognitive control (effort) is invested
- (Working) memory and learning influence cognitive decisions – among which actual
responses
Conscious perception = working or short-term memory
- Working memory content influences ongoing perception
Lecture 2 – Perception
Perception
Sensation ------------------------------------------------> Perception
Conversion of physical energy into the neural Processes beyond sensation: making sense of
codes the sensation
Sensation is the initial step of gathering Processing and organizing the raw information:
stimulus information combining sensory input with prior knowledge
We are not consciously aware of all sensory Forming a coherent representation of the world
input
- Attention
- Saliency
Using these representations to solve problems
Bottum-up input:
, - input gated through by attentional systems
Top-down influences during perception:
- Context effects
- The influence of prior knowledge, memory e.g. seeing face mask inside and outside as the
same
Perception in design
Role of top-down perception in design
- Filling in of information (a lot can be left out)
- Context matters
- Expectations can shape perception
Multi-sensory perception
Multi-sensory perception = “Stimuli are perceived through several sensory modalities (e.g., seeing,
hearing, touching) rather than through only one modality”
- E.g. taste is a strongly multisensory experience
- Aspects →
o Visual e.g. pink is more sweet
o
McGurk effect = shape of the mouth and what you here ( so with eyes close you can hear something
different)
Multi sensory integration
- Audio visual integration
o Localization of sounds
o Understanding of speech
- Tactile-visual integration, taste-sound, etc.
- Faster detection of stimuli
- Vision is more important for localization, but auditory information is more important for
knowing when something happens in time.
Multi-sensory perception and digital media use = Digital media use can leas to media multitasking,
with detrimental effects on selective attention, task switching, etc.
- But multitasking exposes users to multiple simultaneous sensory inputs and can actually
enhance multisensory integration
Crossmodal correspondences
Pitch and brightness (music and colour)
Crossmodal correspondences = a tendency for a sensory feature, or attribute, in one modality,
either physically present or merely imagined, to be matched (or associated) with a sensory feature in
another sensory modality
- In easy words: the idea that people tend to naturally link certain qualities from one sense
(like taste) with qualities from another sense (like sound or color). In simple words, it’s when
