Chapter 3.

Mobile Interaction
Styles

1
Aim
To equip the students with the skills of Mobile
interactions styles so that they can apply UI/UX
concepts while developing mobile interactive
applications

2
 Instructional Objectives
Objectives of this chapter are:
• Explain the need of UI design in mobile application development.

• Elaborate layouts for keypads and touchpad for mobile interaction.

• Classify different types of gesture styles in context on human computer

interaction

• Describe the usage of disruptive innovation

3
3
Mobile Interaction Styles
• The concept of interaction styles gives various ways how user can communicate or
interact with the computer system.
• Mobile interaction is all about the interaction between mobile user and the mobile.
• Mobile interaction is also based on human computer interaction.
• Mainly six interaction styles are used. They are
• Command line
• Question and answer
• Menus
• Form filling
• Function keys
• Graphical direct manipulation

4
Non Perceptual Technologies

5
Non Perceptual Technologies
(i) Keypads
• Keypad is the main factor in interaction with
mobile devices.
• The push button is used in mobile for dialling
the number.
• Generally alpha-numeric keypad is used.
• The star (*) is assigned in a lower left button
and (#) key is assigned in lower right button.
• Today‘s smart phone use the virtual keypad.

Keypads

6
Non Perceptual Technologies
(ii) Touchpad
• It is the hardware used as display screen in mobile
devices.
• Touch screen technology are of three types namely,
resistive, surface wave, and capacitive.
• A touchpad is a gadget having sensors.
• Touchpad is a pressure-sensitive pointing device.
• Touchpad is also called as track pad.
• Touchpad additionally has two buttons.
• Touch Pad is regularly utilised with portable
workstations.
• Touch screen increases the speed of tasks.
Internal Structure of a Touchpad
7
Quiz / Assessment
1) Which one is not the part of interaction style?
a) Menu
b) Command line
c) Question answer
d) Icon

2) Touchscreen contain a flexi top layer which is made of __________.

e) Polyethylene
f) Plastic
g) Iron
h) Copper

8
Gesture: Classification of
Gesture based HCI

9
Application Domains: Multimodal interactions, Desktop,
Virtual and Augmented Reality – Communication
Multimodal interaction:
• Multimodal interaction gives various ways to user to communicate with a system.
• A multimodal interface provides various tool for input and output of data.
• The main goal of multimodal interaction is to develop technologies, interaction methods, and
interfaces towards the full use of human communication and interaction.

HCI:
• HCI always focus on improving the efficiency and effectiveness of human-computer interfaces.
• Improvements in HCI technology can lead to enhanced virtual reality (VR) and augmented reality
(AR).

10
Application Domains: Multimodal interactions, Desktop,
Virtual and Augmented Reality – Communication
Augmented reality:
• Augmented reality is a live or true environment whose components are expanded by PC
produced tangible info.
• It is also known as intervened reality, in which the perspective of truth is changed by a PC.
• It has the capacity to improve one's present view of reality.
Virtual Reality:
• Virtual Reality is used to provide sensory input to an individual.
• It replicates being present in a real or imagined environment.
• Mostly sensory input is limited to sight and sound, but it is capable to include other senses like
touch.

11
Gesture Styles – Deictic, Gesticulation, Manipulation, Semaphores,
Sign Language.
Gesture:
• Gesture is the movement of arms and hands, which is different from other body languages where they tend to have
greater association with speech and language.

Deictic:
• Deictic signals are those that refer to something around the youngster like directing, demonstrating a protest, or
going after something.
• Deictic gestures are very easy and simple to implement.

Manipulation:
• Manipulation gestures have very strong relationship between actual movements of the gesturing fingers, hand, or
arm with the object being manipulated.
• Manipulation includes two dimensional or three dimensional movement based on user interface.

12
Gesture Styles – Deictic, Gesticulation, Manipulation, Semaphores,
Sign Language
Gesticulation
• Gesticulation gestures start from non-verbal communication by human that accompany
or substitute speech.

Semaphores
• Semaphores style is available in any gesturing system that handles a stylized dictionary
of static or dynamic hand or arm gestures.

Sign language
• Sign language gestures are considered linguistic-based.
• Sign language gestures are independent from other gesturing styles.

13
Quiz / Assessment
3) _________ gestures start from non-verbal communication by human that accompany or
substitute speech.
a) Gesticulation
b) Manipulation
c) Semaphores
d) Sign language

4) ___________reality is a live or true environment whose components are expanded by PC

produced tangible info.
a) Augmented
b) Virtual
c) HCI
d) Multi-model

14
Disruptive Innovation

15
Disruptive Innovation

• A disruptive technology or disruptive innovation is an innovation.

• It aids to create a new market and value network, and ultimately go on to
disrupt a prevailing market and value network.
• Disruptive innovation seems a more appropriate term for disruptive
technology in many contexts.
• Few technologies are fundamentally disruptive.
• It is mainly the business model where technology enables and creates
disruptive impact.

16
Disruptive Innovation
Few examples of disruptive technologies:
• The personal computer replaced the typewriter and totally transformed the way we
work and communicate.
• The Windows operating system introduced affordability and a user-friendly interface.
• Email has totally converted the method of communicating, largely changing the
letter-writing and dissolving the postal and greeting card industries.
• Cell phones created an era which made it possible for people to call us anywhere and
which totally disrupted the telecom industry.
• The laptop computer and mobile computing created a mobile workforce.
• Cloud computing is a fast growing technology in the business world.

17
Disruptive Innovation
Recent innovations
• Sustaining technology believes in incremental improvements to an already established
technology.
• Disruptive technology is newly developed and lacks of modification.
• The design innovation utilizes design thinking as the base concept of any industry.
• Design thinking is defined as making things look gorgeous or trendy.
• New technologies can expand the universe with its possible design solutions, and can leads to
great design and disruptive innovation.
• The real innovation falls in the advancement in battery life, sensors given, and more.
• The device manufacturers are confused to be identified with disruptive innovations.

18
Quiz / Assessment
5) A ___________ technology is one that change the current technology and shakes up the
industry or a ground-breaking product that creates a completely new industry.
a) Disruptive
b) Innovative
c) Mobile
d) Hardware

6) __________converted the way of communicating, largely changing the letter-writing

and dissolving the postal and greeting card industries.
e) INTERNET
f) Email
g) Protocol
h) Outlook

19
Activity - I
Brief description of activity

Write a note on multimodal

Classroom
interactions and gesture styles.
Activity
(20 minutes)

20
 Summary
✔ Multimodal interfaces talks about interactive systems which try to leverage natural human capabilities like
speech, gesture, touch, facial expression, and other modalities, to human–computer interaction.
✔ Multimodal interaction gives various ways to user to communicate with a system.
✔ A multimodal interface provides various tool for input and output of data.
✔ Augmented reality is a live or true environment whose components are expanded by PC produced tangible info.
✔ Virtual Reality is used to provide sensory input to an individual which replicates being present in a real or
imagined environment.
✔ Semaphores style is available in any gesturing system that handles a stylized dictionary of static or dynamic
hand or arm gestures.
✔ Gesture is the movement of arms and hands, which is different from other body languages where they tend to
have greater association with speech and language.
✔ Disruptive technology is newly developed and lacks of modification.

21
e-References

• Karam, M. &m.c., S. A taxonomy of Gestures in Human Computer Interaction (1st ed.). University of
Southampton. Retrieved from http://eprints.soton.ac.uk/261149/1/GestureTaxonomyJuly21.pdf

• User interface design for the mobile web (1st ed.). Retrieved
from https://www.ibm.com/developerworks/library/wa-interface/

• Kratz, S., Hemmert, F., &Rohs, M. Natural User Interfaces in Mobile Phone Interaction (1st ed.). Uni
Hannover. Retrieved from http://hci.uni-hannover.de/papers/kratz2010naturaluiphone.pdf

• Human Computer Interaction Diversity - 7 Devices that AREN'T a mouse and keyboard (1st ed.). Retrieved
from http://www.hanselman.com/blog/HumanComputerInteractionDiversity7DevicesThatARENTAMou
seAndKeyboard.aspx

• MacKenzie, I. &Oniszczak, A. A Comparison of Three Selection Techniques for Touchpads (1st ed.). Yorku.
Retrieved from http://www.yorku.ca/mack/CHI98.html

22
 External Resources

• Preece, J., Rogers, Y., & Sharp, H. (2002). Interaction design (1st
ed.). New York, NY: J. Wiley & Sons.

• Banga, C. &Weinhold, J. Essential mobile interaction design (1st

ed.), Wesley.

23