poster

A Framework for Attention-Based Implicit Interaction on Mobile Screens

Authors:

Ioannis GiannopoulosAuthors Info & Claims

MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

Pages 1088 - 1093

https://doi.org/10.1145/2786567.2794339

Published: 24 August 2015 Publication History

Abstract

We propose to keep track of the user's attention during interaction with a small display screen, and use that attention history for later interface adaptation. A framework for attention-based implicit interaction is described that consists of attention measuring, mapping, logging, aggregation, interpretation, and interface adaptation. The framework is exemplified by an interaction method described in previous work: the GeoGazemarks approach.

References

[1]

Thomas Bader, Matthias Vogelgesang, and Edmund Klaus. 2009. Multimodal integration of natural gaze behavior for intention recognition during object manipulation. In Proceedings of the 2009 international conference on Multimodal interfaces. ACM, 199--206.

Digital Library

[2]

Jörg Baus, Antonio Krüger, and Wolfgang Wahlster. 2002. A resource-adaptive mobile navigation system. In Proceedings of the 7th international conference on Intelligent user interfaces. ACM, 15--22.

Digital Library

[3]

Roman Bednarik, Hana Vrzakova, and Michal Hradis. 2012. What do you want to do next: a novel approach for intent prediction in gaze-based interaction. In Proceedings of the symposium on eye tracking research and applications. ACM, 83--90.

Digital Library

[4]

Mark Billinghurst and Thad Starner. 1999. Wearable devices: new ways to manage information. Computer 32, 1 (1999), 57--64.

Digital Library

[5]

Ali Borji, Dicky N Sihite, and Laurent Itti. 2014. What/where to look next? Modeling top-down visual attention in complex interactive environments. Systems, Man, and Cybernetics: Systems, IEEE Transactions on 44, 5 (2014), 523--538.

[6]

Andreas Bulling, Jamie A Ward, Hans Gellersen, and Gerhard Troster. 2011. Eye movement analysis for activity recognition using electrooculography. Pattern Analysis and Machine Intelligence, IEEE Transactions on 33, 4 (2011), 741--753.

Digital Library

[7]

Mon Chu Chen, John R Anderson, and Myeong Ho Sohn. 2001. What can a mouse cursor tell us more?: correlation of eye/mouse movements on web browsing. In CHI'01 extended abstracts on Human factors in computing systems. ACM, 281--282.

Digital Library

[8]

Shiwei Cheng, Zhiqiang Sun, Lingyun Sun, Kirsten Yee, and Anind K Dey. 2015. Gaze-Based Annotations for Reading Comprehension. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 1569--1572.

Digital Library

[9]

Florian Frische, Jan-Patrick Osterloh, and Andreas Lüdtke. 2011. Modelling and Validating Pilots' Visual Attention Allocation During the Interaction with an Advanced Flight Management System. In Human Modelling in Assisted Transportation. Springer, 165--172.

[10]

Ioannis Giannopoulos, Peter Kiefer, and Martin Raubal. 2012. GeoGazemarks: Providing Gaze History for the Orientation on Small Display Maps. In Proceedings of the 14th International Conference on Multimodal Interaction (ICMI '12). ACM, New York, NY, USA, 165--172.

Digital Library

[11]

Ioannis Giannopoulos, Peter Kiefer, and Martin Raubal. 2015a. GazeNav: Gaze-Based Pedestrian Navigation. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM. to appear.

Digital Library

[12]

Ioannis Giannopoulos, Peter Kiefer, and Martin Raubal. 2015b. Watch What I Am Looking At! Eye Gaze and Head-Mounted Displays. In Mobile Collocated Interactions, Workshop at CHI 2015.

[13]

Rachel Harrison, Derek Flood, and David Duce. 2013. Usability of mobile applications: literature review and rationale for a new usability model. Journal of Interaction Science 1, 1 (2013), 1--16.

[14]

Wilko Heuten, Niels Henze, Susanne Boll, and Martin Pielot. 2008. Tactile wayfinder: a non-visual support system for wayfinding. In Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges. ACM, 172--181.

Digital Library

[15]

Eric Horvitz, Andy Jacobs, and David Hovel. 1999. Attention-sensitive alerting. In Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence. Morgan Kaufmann Publishers Inc., 305--313.

Digital Library

[16]

Anthony Jameson. 2009. Adaptive interfaces and agents. Human-Computer Interaction: Design Issues, Solutions, and Applications 105 (2009).

[17]

Dagmar Kern, Paul Marshall, and Albrecht Schmidt. 2010. Gazemarks: gaze-based visual placeholders to ease attention switching. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2093--2102.

Digital Library

[18]

Peter Kiefer and Ioannis Giannopoulos. 2012. Gaze Map Matching: Mapping Eye Tracking Data to Geographic Vector Features. In Proceedings of the 20th SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, New York, NY, USA, 359--368.

Digital Library

[19]

Peter Kiefer, Ioannis Giannopoulos, and Martin Raubal. 2013. Using Eye Movements to Recognize Activities on Cartographic Maps. In Proceedings of the 21st SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, New York, NY, USA, 488--491.

Digital Library

[20]

Emiliano Miluzzo, Tianyu Wang, and Andrew T Campbell. 2010. EyePhone: activating mobile phones with your eyes. In Proceedings of the second ACM SIGCOMM workshop on Networking, systems, and applications on mobile handhelds. ACM, 15--20.

Digital Library

[21]

Jakob Nielsen and Raluca Budiu. 2013. Designing for the small screen. In Mobile usability. MITP-Verlags GmbH & Co. KG, Chapter 3.

[22]

Lucas Paletta, Helmut Neuschmied, Michael Schwarz, Gerald Lodron, Martin Pszeida, Patrick Luley, Stefan Ladstätter, Stephanie M Deutsch, Jan Bobeth, and Manfred Tscheligi. 2014. Attention in mobile interactions: gaze recovery for large scale studies. In CHI'14 Extended Abstracts on Human Factors in Computing Systems. ACM, 1717--1722.

Digital Library

[23]

Martin Raubal and Ilija Panov. 2009. A formal model for mobile map adaptation. In Location Based Services and TeleCartography II. Springer, 11--34.

[24]

Thad Starner. 2013. Project glass: An extension of the self. Pervasive Computing, IEEE 12, 2 (2013), 14--16.

Digital Library

[25]

Roel Vertegaal. 2002. Designing attentive interfaces. In Proceedings of the 2002 symposium on Eye tracking research & applications. ACM, 23--30.

Digital Library

Cited By

Amin ZAli NSmeaton A(2021)Attention-Based Design and User Decisions on Information Sharing: A Thematic Literature ReviewIEEE Access10.1109/ACCESS.2021.30877409(83285-83297)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3087740
Cheng SFan JDey A(2018)Smooth GazePersonal and Ubiquitous Computing10.1007/s00779-018-1115-822:3(489-501)Online publication date: 1-Jun-2018
https://dl.acm.org/doi/10.1007/s00779-018-1115-8
Konkol MKray COstkamp M(2017)Follow the Signs—Countering Disengagement from the Real World During City ExplorationSocietal Geo-innovation10.1007/978-3-319-56759-4_6(93-109)Online publication date: 5-Apr-2017
https://doi.org/10.1007/978-3-319-56759-4_6
Show More Cited By

Index Terms

A Framework for Attention-Based Implicit Interaction on Mobile Screens
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Mobile gaze-based screen interaction in 3D environments
NGCA '11: Proceedings of the 1st Conference on Novel Gaze-Controlled Applications

Head-mounted eye trackers can be used for mobile interaction as well as gaze estimation purposes. This paper presents a method that enables the user to interact with any planar digital display in a 3D environment using a head-mounted eye tracker. An ...
Interaction Techniques for Wall-Sized Screens
ITS '15: Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces

Large screen displays are part of many future visions, such as i-LAND that describes the possible workspace of the future. Research showed that wall-sized screens provide clear benefits for data exploration, collaboration and organizing work in office ...
Collaborative Newspaper Demo: Exploring an adaptive Scrolling Algorithm in a Multi-user Reading Scenario
PerDis '15: Proceedings of the 4th International Symposium on Pervasive Displays

We present the Collaborative Newspaper, a prototype that manages scrolling of the same content on a public display for several users simultaneously. Usually it is not possible for passers-by to conveniently interact with public displays, as content is ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

August 2015

697 pages

ISBN:9781450336536

DOI:10.1145/2786567

General Chairs:
Sebastian Boring
University of Copenhagen, Denmark
,
Enrico Rukzio
University of Ulm, Germany
,
Program Chairs:
Hans Gellersen
Lancaster University, UK
,
Ken Hinckley
Microsoft Research Redmond, USA

Copyright © 2015 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 August 2015

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Conference

MobileHCI '15

Sponsor:

SIGCHI

MobileHCI '15: 17th International Conference on Human-Computer Interaction with Mobile Devices and Services

August 24 - 27, 2015

Copenhagen, Denmark

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Upcoming Conference

MobileHCI '24

Sponsor:
sigchi

26th International Conference on Mobile Human-Computer Interaction

September 30 - October 3, 2024

Melbourne , VIC , Australia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
244
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)1

Reflects downloads up to 04 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Amin ZAli NSmeaton A(2021)Attention-Based Design and User Decisions on Information Sharing: A Thematic Literature ReviewIEEE Access10.1109/ACCESS.2021.30877409(83285-83297)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3087740
Cheng SFan JDey A(2018)Smooth GazePersonal and Ubiquitous Computing10.1007/s00779-018-1115-822:3(489-501)Online publication date: 1-Jun-2018
https://dl.acm.org/doi/10.1007/s00779-018-1115-8
Konkol MKray COstkamp M(2017)Follow the Signs—Countering Disengagement from the Real World During City ExplorationSocietal Geo-innovation10.1007/978-3-319-56759-4_6(93-109)Online publication date: 5-Apr-2017
https://doi.org/10.1007/978-3-319-56759-4_6
Göbel FGiannopoulos IRaubal MPaternò FVäänänen KChurch KHäkkilä JKrüger ASerrano M(2016)The importance of visual attention for adaptive interfacesProceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct10.1145/2957265.2962659(930-935)Online publication date: 6-Sep-2016
https://dl.acm.org/doi/10.1145/2957265.2962659

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents