Article

Distant freehand pointing and clicking on very large, high resolution displays

Authors:

Ravin BalakrishnanAuthors Info & Claims

UIST '05: Proceedings of the 18th annual ACM symposium on User interface software and technology

Pages 33 - 42

https://doi.org/10.1145/1095034.1095041

Published: 23 October 2005 Publication History

Abstract

We explore the design space of freehand pointing and clicking interaction with very large high resolution displays from a distance. Three techniques for gestural pointing and two for clicking are developed and evaluated. In addition, we present subtle auditory and visual feedback techniques to compensate for the lack of kinesthetic feedback in freehand interaction, and to promote learning and use of appropriate postures.

References

[1]

Bolt, R. (1980). Put-that-there: Voice and gesture at the graphics interface. Computer Graphics, 14(3). p. 262--270.

Digital Library

[2]

Bolt, R. (1981). Gaze-orchestrated dynamic windows. Computer Graphics, 15(3). p. 109--119.

Digital Library

[3]

Bowman, D. and Hodges, L. (1997). An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments. ACM Symposium on Interactive 3D Graphics. p. 35--38.

Digital Library

[4]

Corradini, A. and Cohen, P. (2002). Multimodal speech-gesture interface for hands-free painting on virtual paper using partial recurrent neural networks for gesture recognition. International Joint Conference on Neural Networks. p. 2293--2298.

[5]

Fitts, P.M. (1954). The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology, 47. p. 381--391.

[6]

Fono, D. and Vertegaal, R. (2005). EyeWindows: Evaluation of eye-controlled zooming windows for focus selection. ACM CHI Conference. p. 151--160.

Digital Library

[7]

Grossman, T., Wigdor, D., and Balakrishnan, R. (2004). Multi finger gestural interaction with 3D volumetric displays. ACM UIST Symposium. p. 61--70.

Digital Library

[8]

Hansen, J., Andersen, A., and Roed, P. (1995). Eye-gaze control of multimedia systems. ACM Symposium on Eye Tracking Research & Applications. p. 115--122.

[9]

Hinckley, K., Pausch, R., Goble, J.C., and Kassell, N. (1994). A survey of design issues in spatial input. ACM UIST Symposium. p. 213--222.

Digital Library

[10]

Kendon, A. (2004). Gesture: visible action as utterance. 2004: Cambridge University Press.

[11]

Krueger, M. (1991). VIDEOPLACE and the interface of the future, in The art of human computer interface design, B. Laurel, Editor. Addison Wesley. p. 417--422.

[12]

MacKenzie, I. and Jusoh, D. (2001). An evaluation of two input devices for remote pointing. Eighth IFIP Working Conference on Engineering for Human-Computer Interaction. p. 235--249.

Digital Library

[13]

MacKenzie, S. (1992). Fitts' law as a research and design tool in human-computer interaction. Human-Computer Interaction, 7. p. 91-139.

[14]

Matveyev, S. and Göbel, M. (2003). The Optical Tweezers: multiple-point interaction technique. Virtual Reality Software and Technology. p. 184--188.

Digital Library

[15]

Matveyev, S., Göbel, M., and Frolov, P. (2003). Laser pointer interaction with hand tremor elimination. HCI International. p. 376-740.

[16]

Microsoft. (2005). Pointer ballistics for Windows XP. Accessed on 14 Feb 2005, www.microsoft.com/whdc/device/input/pointer-bal.mspx.

[17]

Millodot, M. (1997). Dictionary of Optometry and Visual Science. Butterworth-Heinemann. p. 8, 44.

[18]

Myers, B., Bhatnagar, R., Nichols, J., Peck, C.H., Kong, D., Miller, R., and Long, C. (2002). Interacting at a distance: measuring the performance of laser pointers and other devices. ACM CHI Conference. p. 33--40.

Digital Library

[19]

Nickel, K. and Stiefelhagen, R. (2003). Pointing gesture recognition based on 3D-tracking of face, hands and head orientation. International Conference on Multimodal Interfaces. p. 140--146.

Digital Library

[20]

Oh, J.-Y. and Stuerzlinger, W. (2002). Laser pointers as collaborative pointing devices. Graphics Interface. p. 141--149.

[21]

Olsen, D.R. and Nielsen, T. (2001). Laser pointer interaction. ACM CHI Conference. p. 17-22.

Digital Library

[22]

Parker, J.K., Mandryk, R.L., and Inkpen, K.M. (2005). TractorBeam: Seamless integration of remote and local pointing for tabletop displays. Graphics Interface. p. 33--40.

Digital Library

[23]

Peck, C. (2001). Useful parameters for the design of laser pointer interaction techniques. Extended Abstracts of the ACM CHI Conference. p. 461-462.

Digital Library

[24]

Pierce, J., Forsberg, A., Conway, M., Hong, S., and Zeleznik, R. (1997). Image plane interaction techniques in 3D immersive environments. ACM Symposium on Interactive 3D Graphics. p. 39--43.

Digital Library

[25]

Pierce, J., Stearns, B., and Pausch, R. (1999). Two handed manipulation of voodoo dolls in virtual environments. ACM Symposium on Interactive 3D Graphics. p. 141--145.

Digital Library

[26]

Poupyrev, I. and Ichikawa, T. (1999). Manipulating objects in virtual worlds: categorization and empirical evaluation of interaction techniques. Journal of Visual Languages and Computing, 10. p. 19--35.

Digital Library

[27]

Skaburskis, A., Vertegaal, R., and Shell, J. (2004). Auramirror: Reflections on attention. ACM Symposium on Eye Tracking Research & Applications. p. 101--108.

Digital Library

[28]

Vogel, D. and Balakrishnan, R. (2004). Interactive public ambient displays: Transitioning from implicit to explicit, public to personal, interaction with multiple users. ACM UIST Symposium. p. 137--146.

Digital Library

[29]

Wang, Y. and MacKenzie, C. (2000). The role of contextual haptic and visual constraints on object manipulation in virtual environments. ACM CHI Conference. p. 532--539.

Digital Library

[30]

Ware, C. and Balakrishnan, R. (1994). Reaching for objects in VR displays: Lag and frame rate. ACM Tranactions on Computer-Human Interaction, 1(4). p. 331--356.

Digital Library

[31]

Wilson, A. and Pham, H. (2003). Pointing in intelligent environments with the World Cursor. INTERACT 2003.

[32]

Zhai, S. (1998). User performance in relation to 3D input device design. Computer Graphics, 32(4). p. 50--54.

Digital Library

[33]

Zhai, S., Morimoto, C., and Ihde, S. (1999). Manual and gaze input cascaded (MAGIC) pointing. ACM CHI Conference. p. 246--253.

Digital Library

Cited By

Cordeil MServais ATruong GDwyer TVyas DHurter C(2025)The Presenter in the Browser: Design and Evaluation of Human Interactive Overlays with Web ContentMultimodal Technologies and Interaction10.3390/mti90200109:2(10)Online publication date: 27-Jan-2025
https://doi.org/10.3390/mti9020010
Coppens AMaquil V(2025)Skeletal Data Matching and Merging from Multiple RGB-D Sensors for Room-Scale Distant Interaction with Multiple SurfacesElectronics10.3390/electronics1404079014:4(790)Online publication date: 18-Feb-2025
https://doi.org/10.3390/electronics14040790
Kim WXiong S(2024)TouchView: Mid-Air Touch on Zoomable 2D View for Distant Freehand Selection on a Virtual Reality User InterfaceSensors10.3390/s2422720224:22(7202)Online publication date: 11-Nov-2024
https://doi.org/10.3390/s24227202
Show More Cited By

Index Terms

Distant freehand pointing and clicking on very large, high resolution displays
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Graphics input devices
    2. Interaction paradigms

Recommendations

High-precision pointing on large wall displays using small handheld devices
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Rich interaction with high-resolution wall displays is not limited to remotely pointing at targets. Other relevant types of interaction include virtual navigation, text entry, and direct manipulation of control widgets. However, most techniques for ...
3D Freehand Gestural Navigation for Interactive Public Displays

Users increasingly expect more-interactive experiences with public displays for applications including learning, gaming, urban visualization, and planning. However, user interaction with applications on public displays is challenging and often doesn't ...
Understanding pointing for workspace tasks on large high-resolution displays
MUM '19: Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia

Navigating on large high-resolution displays (LHRDs) using devices built for traditional desktop computers can be strenuous and negatively impact user experience. As LHRDs transition to everyday use, new user-friendly interaction techniques need to be ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '05: Proceedings of the 18th annual ACM symposium on User interface software and technology

October 2005

270 pages

ISBN:1595932712

DOI:10.1145/1095034

General Chairs:
Patrick Baudisch
Microsoft Research
,
Mary Czerwinski
Microsoft Research
,
Program Chair:
Dan Olsen
Brigham Young University, Provo, UT

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

UIST05

Sponsor:

UIST05: The 18th Annual ACM Symposium on User Interface Software and Technology

October 23 - 26, 2005

WA, Seattle, USA

Acceptance Rates

UIST '05 Paper Acceptance Rate 31 of 159 submissions, 19%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

338
Total Citations
View Citations
4,299
Total Downloads

Downloads (Last 12 months)105
Downloads (Last 6 weeks)15

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cordeil MServais ATruong GDwyer TVyas DHurter C(2025)The Presenter in the Browser: Design and Evaluation of Human Interactive Overlays with Web ContentMultimodal Technologies and Interaction10.3390/mti90200109:2(10)Online publication date: 27-Jan-2025
https://doi.org/10.3390/mti9020010
Coppens AMaquil V(2025)Skeletal Data Matching and Merging from Multiple RGB-D Sensors for Room-Scale Distant Interaction with Multiple SurfacesElectronics10.3390/electronics1404079014:4(790)Online publication date: 18-Feb-2025
https://doi.org/10.3390/electronics14040790
Kim WXiong S(2024)TouchView: Mid-Air Touch on Zoomable 2D View for Distant Freehand Selection on a Virtual Reality User InterfaceSensors10.3390/s2422720224:22(7202)Online publication date: 11-Nov-2024
https://doi.org/10.3390/s24227202
Bihani DUllah ADufresne-Camaro CDelamare WIrani PHasan K(2024)Exploring Pointer Enhancement Techniques for Target Selection on Large Curved DisplayProceedings of the ACM on Human-Computer Interaction10.1145/36981358:ISS(214-235)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698135
Aghel Manesh SZhang TOnishi YHara KBateman SLi JTang A(2024)How People Prompt Generative AI to Create Interactive VR ScenesProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661547(2319-2340)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661547
Shen XYu CWang XLiang CChen HShi Y(2024)MouseRing: Always-available Touchpad Interaction with IMU RingsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642225(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642225
Belkacem ITominski CMédoc NKnudsen SDachselt RGhoniem M(2024)Interactive Visualization on Large High‐Resolution Displays: A SurveyComputer Graphics Forum10.1111/cgf.1500143:6Online publication date: 30-Apr-2024
https://doi.org/10.1111/cgf.15001
Benda BRheault BLin YRagan E(2024)Examining Effects of Technique Awareness on the Detection of Remapped Hands in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337205430:5(2651-2661)Online publication date: 4-Mar-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372054
Xiao YLiu L(2024)User-Defined Interactions for Visual Data Exploration With the Combination of Smartwatch and Large DisplayIEEE Access10.1109/ACCESS.2024.340487612(78657-78679)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3404876
Perelman GDubois ESerrano M(2024)Dual-Thumb pointing and command selection techniques for tabletsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103203184:COnline publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103203
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten