WO2017102844A1 - Drag and release navigation - Google Patents
Drag and release navigation Download PDFInfo
- Publication number
- WO2017102844A1 WO2017102844A1 PCT/EP2016/081004 EP2016081004W WO2017102844A1 WO 2017102844 A1 WO2017102844 A1 WO 2017102844A1 EP 2016081004 W EP2016081004 W EP 2016081004W WO 2017102844 A1 WO2017102844 A1 WO 2017102844A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- contact
- portable electronic
- electronic device
- touch
- sensitive display
- Prior art date
Links
- 238000000034 method Methods 0.000 claims abstract description 54
- 230000004044 response Effects 0.000 claims abstract description 48
- 230000008859 change Effects 0.000 claims description 44
- 238000001514 detection method Methods 0.000 claims description 17
- 238000004590 computer program Methods 0.000 claims description 4
- 230000000007 visual effect Effects 0.000 abstract description 10
- 230000006870 function Effects 0.000 description 12
- 230000008569 process Effects 0.000 description 12
- 210000003811 finger Anatomy 0.000 description 9
- 210000003205 muscle Anatomy 0.000 description 9
- 210000004556 brain Anatomy 0.000 description 3
- 230000000903 blocking effect Effects 0.000 description 2
- 230000001771 impaired effect Effects 0.000 description 2
- 238000011835 investigation Methods 0.000 description 2
- 210000003813 thumb Anatomy 0.000 description 2
- 241000895680 Stylosanthes guianensis Species 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000000926 neurological effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/0485—Scrolling or panning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/014—Force feedback applied to GUI
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04803—Split screen, i.e. subdividing the display area or the window area into separate subareas
Definitions
- the present invention relates to a user interface for navigating portable electronic devices comprising a touch-sensitive display.
- the user To launch an application, the user generally tabs the icon corresponding to a particular application. As more applications are installed, the number of icons representing applications may exceed the number of icons that fit into the touch-sensitive display of the portable electronic device at one time. To enable navigation of more applications, many portable electronic devices allow the user to navigate among several pages of icons by swiping across the touch-sensitive display. In this way, to launch an application on a different page than the one currently presented to the user, the user first swipes the touch-sensitive display to reach the page containing the relevant icon and then tabs the icon, thereby launching the application represented by the icon.
- icons and their associated applications may be arranged in categories or groups. These categories or groups may be represented by category icons.
- categories or groups may be represented by category icons.
- the user may initially have to reach the page containing the category icon, tab the category icon, and finally tab the icon representing the desired application.
- the increase in number of categories and pages available to the user complicates the process of launching a particular application.
- it takes time to navigate the pages and categories and it may be hard to remember on which page and in which category an application is launched from.
- search options are available on some portable electronic devices, they require writing at least part of the name of the desired application, which may also be a time consuming process.
- WO 2007/076210 Al discloses a device with a touch-sensitive display which may be unlocked via gestures performed on the touch-sensitive display.
- the device is unlocked if contact with the display corresponds to a predefined gesture for unlocking the device.
- the device displays one or more unlock images with respect to which the predefined gesture is to be performed in order to unlock the device.
- the performance of the predefined gesture with respect to the unlock image may include moving the unlock image to a predefined location and/or moving the unlock image along a predefined path.
- US 2011/0296351 Al discloses a user interface presenting a plurality of items configured as a stack in a display of a device.
- the stack is scrollable in a direction oblique to a plane of the display for successively viewing the items in the stack.
- Multiple stacks of items may be provided, which are laterally navigable into a viewable area of the display.
- EP 2 503 444 A2 discloses a system and a method for crossing navigation for use in an electronic terminal.
- a touch screen that is capable of receiving touch inputs from a user includes a crossing navigation input that uses two directional input to move through content within different content groups.
- the touch screen includes a graphical user interface that is configured to receive, through the touch screen, a first input to access different content groups and a second input to access content within the same group.
- the first input includes a touch input in first direction and the second input includes a touch input in a second direction.
- US 2014/0082554 Al discloses a method including displaying, on a display screen of an electronic device, a plurality of categories, the plurality of categories being displayed in a first direction.
- a selection of a category from the plurality of categories is detected by a processor.
- An arrangement in which the plurality of categories are displayed in modified, and a plurality of elements of the selected category are displayed on the display screen in a second direction that is different from the first direction.
- a portable electronic device comprising a touch-sensitive display, which can be controlled in a time efficient and convenient manner. It is an even further object of embodiments of the invention to provide a portable electronic device comprising a touch-sensitive display, which can be controlled without visual contact with the touch-sensitive display.
- the invention provides a computer-implemented method of controlling a portable electronic device comprising a touch-sensitive display, the method comprising the steps of:
- the portable electronic device consecutively presenting a sequence of graphical representations of categories of elements on the touch-sensitive display
- the portable electronic device selecting a currently presented category of elements, and consecutively presenting a sequence of graphical representations of elements of the selected category on the touch-sensitive display, wherein the method further comprises the step of the portable electronic device providing tactile feedback in response to continuous movement of the contact along the first direction and/or along the second direction.
- the computer-implemented method according to the first aspect of the invention is for controlling a portable electronic device comprising a touch-sensitive display.
- portable electronic device should be interpreted to mean any electronic device which is portable. Examples of common portable electronic devices comprising a touch-sensitive display are smartphones, tablets, watches and laptops. However, here portable should be interpreted in the broadest possible sense so that the invention may also apply to other kinds of electronic devices, such as remote controls, car user interfaces, etc., comprising a touch-sensitive display.
- touch-sensitive display should be interpreted to mean a display which allows navigation by means of a user touching the display.
- the touch-sensitive display may apply a capacitive technology.
- contact with the touch-sensitive display is initially detected.
- a user is touching the touch- sensitive display, e.g. by means of a finger, or by means of a suitable input device, such as a stylo.
- a continuous movement of the contact along a first direction is detected.
- continuous movement of the contact should be interpreted to mean that the user moves the point of contact with the touch-sensitive display, e.g. a finger, across the touch-sensitive display, without interrupting the contact with the touch-sensitive display, i.e. without removing, e.g., the finger from the touch-sensitive display.
- the first direction is a direction along the touch-sensitive display, i.e. relative to the outline of the touch-sensitive display, which has been defined previously. Accordingly, when the user moves, e.g. a finger, substantially along this predefined direction, while contacting the touch- sensitive display, the portable electronic device recognises this as a continuous movement of a contact along the first direction.
- the portable electronic device In response to detecting continuous movement of a contact along the first direction, the portable electronic device consecutively presents a sequence of graphical representations of categories of elements on the touch-sensitive display.
- graphical representations of a number of categories of elements are presented on the touch-sensitive display, one after the other.
- the graphical representations of the categories may be presented one at a time, in a predefined order.
- the graphical representations of the categories may be presented in such a manner that they move across the touch-sensitive display, e.g. linearly, along a circle or in any other suitable pattern.
- the graphical representations of the categories may advantageously be highlighted and/or enlarged consecutively, i.e.
- the sequence of categories of elements continues to be presented as long as the contact is moved along the first direction. Thereby the categories of elements may be browsed by the user as the user continuously moves, e.g., a finger across the touch-sensitive display along the first direction.
- the graphical representations of the categories of elements may, e.g., be or comprise icons and/or written names associated with the respective categories.
- At least some of the categories of elements may be user defined and/or at least some of the categories of elements may be predefined and/or at least some of the categories of elements may be defined by the portable electronic device.
- the term "define” should be interpreted to mean assigning one or more elements to a given category of elements. For instance, a given category may have a number of elements of the same or similar kind assigned thereto. Alternatively or additionally, one of the categories may have a number of elements which have been accessed or activated most recently assigned thereto.
- the elements of the categories may, e.g., be applications or functions available on the portable electronic device.
- the elements may be settings of the portable electronic device, programs available on the portable electronic device, a list of contacts, content, such as photos, videos, files, etc., or any other suitable kind of elements.
- the elements may be in the form of data, symbols or the like to be input on the portable electronic device. For instance, emojis may be grouped into categories, or the alphabet may be divided into categories to provide easy access to a dictionary.
- the second direction may, e.g., be substantially perpendicular to the first direction. However, an angle defined between the first direction and the second direction may differ from 90°.
- the portable electronic device selects the currently presented category of elements, i.e. the category of elements which is presented or highlighted on the touch-sensitive display when the change in direction of the continuous movement of the contact is detected, is selected.
- the category of elements has been selected, the portable electronic device
- the elements of the selected category of element may be browsed by a user as the user moves, e.g., a finger across the touch- sensitive display along the second direction.
- a given element may be reached by moving the contact with the touch-sensitive display in a specific moving pattern.
- the graphical representations of elements may, e.g., be or comprise icons and/or written names associated with the respective elements.
- a portable electronic device may be controlled by the touch of, e.g., a finger.
- the portable electronic device consecutively presents a sequence of graphical representations of categories of elements on the touch-sensitive display, and the consecutive presentation of the categories continues as long as the contact is moved along the first direction.
- the contact is moved, different graphical representations of categories are presented. In this way, many categories may be browsed with a single contact in a time efficient manner.
- Continuous movement of contact along the first direction associated with consecutive presentation of categories may also be referred to as category mode. In this case the portable electronic device is in category mode.
- the portable electronic device selects a currently presented category and consecutively presents a sequence of graphical representations of elements of the selected category.
- the detection of a change in direction implies that no loss of contact is detected between the steps.
- the portable electronic device selects the currently presented category. Further continuous movement in the second direction causes the portable electronic device to consecutively present graphical user interface.
- representations of elements of the selected category Again, as the contact is moved, different elements are presented. Continuous movement of contact along the second direction associated with consecutive presentation of elements may also be referred to as element mode. In this case the portable electronic device is in element mode.
- the method according to present invention thus, allows for navigation among numerous categories and elements with a single contact on the touch-sensitive display. Accordingly, it is not necessary to apply a series of gestures including, e.g., swipes and taps to navigate categories and elements on a portable electronic device. This saves time for the user and adds to the convenience associated with navigating the portable electronic device.
- all categories and associated elements may be navigated by use of only a part of the touch-sensitive display. For instance, movement of the contact along the first and second direction may be done in, e.g., the lower part of the touch-sensitive display which is easily accessible by the thumb of the user. This is particularly useful for touch-sensitive displays with dimensions exceeding the reach of the thumb.
- navigation on the portable electronic devices may have necessitated change of grip on the portable electronic device and/or use of more than one hand. Such change of grip and/or use of more than one hand may be inconvenient and time consuming for the user.
- the method according to the first aspect of the present invention may even further save time and add to the convenience in relation to navigating the portable electronic device.
- the computer-implemented method further comprises the step of the portable electronic device providing tactile feedback in response to continuous movement of the contact along the first direction and/or along the second direction.
- the portable electronic device provides tactile feedback in response to movement of the contact in category mode and/or in element mode.
- the portable electronic device is able to indicate receipt of user input by other means than visual output on the touch-sensitive display.
- This is particularly advantageous as the user is then able to get a sense of what input the portable electronic device receives without the user needing to have visual contact with the touch-sensitive display. This is, e.g., relevant in the case that the user is visually impaired or in the case that the user needs to have or her attention elsewhere.
- the user may also be able to associate a given user input with the received tactile feedback. This may allow the user to build up so-called “muscle memory”.
- Muscle memory is a term used to describe the brain's and thus muscles' ability to react to tactile feedback in a swift manner without the need to "think”. An in depth neurological explanation for muscle memory will not be presented here. A simple example will be given, though. When learning how to ride a bicycle it is necessary to think about how to keep balanced, going forward, braking, etc. However, once riding a bicycle has been familiarized there is no longer a need to think about how to keep balanced, going forward, braking, etc. The brain and body will
- the tactile feedback may, e.g., be in the form of a vibration. This is particularly
- the tactile feedback may be in the form of changes in the shape and/or in the texture of the touch-sensitive display.
- the computer-implemented method may further comprise the steps of detecting end of continuous contact following detection of continuous movement of contact along the second direction, and in response to the detected end of continuous contact, the portable electronic device selecting a currently presented element.
- the portable electronic device selects the currently presented element when continuous contact with the touch-sensitive display is ended following detection of movement of the contact along the second direction.
- the portable electronic device selects the presented element when contact is ended in element mode.
- selecting an element entails to simply end the continuous contact by, e.g., removing the finger from the touch-sensitive display when the portable electronic device is in element mode, and when the desired element is presented.
- selection of an element may be done by first continuously moving the contact in the first direction until the desired category is presented by the portable electronic device, at which point the contact is continuously moved in the second direction until the desired element is presented, followed by end of the contact to select the currently presented element. This allows a user to select a specific element in a specific category with a single contact in a highly time efficient and convenient manner.
- an element may be selected by moving the contact with the touch-sensitive display in a specific moving pattern along the touch-sensitive display.
- the selection of an element may result in the portable electronic device executing, launching and/or presenting the application or function.
- the element is a piece of content, such as a photo, a video, a document, a file, etc.
- the selection of an element may result in the portable electronic device displaying and/or opening the piece of content.
- the selection of an element may result in the selected data, symbol or the like being input.
- a predefined time period may be allowed to elapse from the detection of the end of continuous contact until the currently presented element is selected. Furthermore, according to this embodiment, if contact with the touch-sensitive display and continued movement along the second direction is once again detected within the predefined time period, this will be considered as if the continuous contact with the touch-sensitive display was never ended. This allows the user to briefly interrupt the continuous contact with the touch-sensitive display, without causing an element to be selected. This may, e.g., be relevant in the case that the point of contact with the touch-sensitive display reaches an edge of the touch- sensitive display before a desired element has been reached.
- the user is able to interrupt the continuous contact and move the point of contact to a new position on the touch-sensitive display which allows further movement along the second direction, thereby allowing continued browsing of elements in order to reach and select the desired element.
- This also allows an initial point of contact with the touch-sensitive display to be selected without considering how much space is required for movement of the point of contact in order to reach a desired element.
- the predefined time period may be a fixed time period in the sense that it is predefined by the portable electronic device.
- the predefined time period may be defined by the user, in order to meet specific needs of the user, e.g. in terms of navigation speed of the individual user. It has been found that a time period within the interval of 0.4-1.0 seconds, such as within the interval of 0.5-0.8 seconds, such as approximately 0.6 seconds is suitable in order to allow a user to move the point of contact without causing unnecessary delays in selecting an element during normal operation of the portable electronic device.
- the currently presented element may be selected immediately upon detection of the end of continuous contact.
- the computer-implemented method may further comprise the steps of detecting end of continuous contact following detection of continuous movement of contact along the first direction, and in response to the detected end of continuous contact, the portable electronic device selecting a currently presented category and presenting graphical representations of the elements of the selected category on the touch-sensitive display.
- continuous movement of contact along the first direction followed by end of contact causes the portable electronic device to select the category presented at the time when continuous contact is ended. Furthermore, the portable electronic device presents graphical representations of the elements of the selected category. In other words, the portable electronic device selects the presented category and presents graphical
- representations of the elements assigned thereto when contact is ended in category mode This allows the user to select a category and gain an overview of the elements in the category by use of just one contact. This may be particularly advantageous if the user has forgotten the name of the element and/or the appearance of the graphical representation of the element and thus may benefit from having time to scrutinize an overview of graphical representations of the elements of a given category.
- a predefined time period may be allowed to elapse from the detection of the end of continuous contact until the currently presented category is selected. This is similar to the situation described above with respect to detecting the end of continuous contact along the second direction. The remarks set forth above are therefore equally applicable here.
- the computer-implemented method may further comprise the steps of detecting a change in direction of the continuous movement of the contact from the second direction to the first, and in response to the detected change in direction of the continuous movement of the contact, the portable electronic device consecutively presenting a sequence of graphical representations of categories of elements on the touch-sensitive display.
- continuous movement of contact along the second direction followed by continuous movement of contact along the first direction causes the portable electronic device to consecutively present a sequence of graphical representations of categories of elements on the touch-sensitive display. That is, the portable electronic device changes from element mode to category mode when the direction of movement of contact changes from the second to the first direction.
- the portable electronic device is able to quickly activate category mode after having been in element mode, by the user changing direction of movement of contact. If the user desires to browse a category different from the currently selected, the user may reach the desired category by returning to category mode. The user can, thus, quickly and conveniently change between selected categories in order to browse the categories and/or select a specific element belonging to a specific category.
- the computer-implemented method may further comprise the step of the portable electronic device providing tactile feedback in response to a change in currently presented category and/or element.
- the portable electronic device uses tactile feedback to inform the user of a change in presented category and/or presented element.
- This provides the user with a simple way of registering each time the presented category and/or element is changed.
- the user may then count the number of tactile feedbacks in category mode to reach the desired category, change to element mode and count the number of tactile feedbacks in element mode to reach the desired element.
- it may also be possible for the user to build up muscle memory as described above.
- the brain then may be able to, e.g., automatically change from category mode to element mode when the correct number of tactile feedbacks has been sensed.
- the tactile feedback may, alternatively or additionally, directly reflect the category and/or element being presented.
- repeated vibrations may be provided in response to change in category and/or element, the number of vibrations and/or the frequency of the repeated vibrations may reflect the category and/or element being presented.
- the computer-implemented method may further comprise the step of providing tactile feedback in response to change of direction of movement of contact from the first direction to the second direction and/or in response to change of direction of movement of contact from the second direction to the first direction.
- the tactile feedback provided in response to a change in direction of movement of contact may be distinguishable from the tactile feedback provided in response to a change in presented category or element, thereby allowing the user to determine, based on the received tactile feedback, whether a change in presented category or element, or a change in mode has occurred.
- the invention provides a portable electronic device comprising a touch-sensitive display, one or more processors, memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the program(s) including instructions for: detecting contact with the touch-sensitive display, detecting continuous movement of the contact along a first direction, in response to the detected continuous movement of the contact along the first direction, consecutively presenting a sequence of graphical representations of categories of elements on the touch-sensitive display, detecting a change in direction of the continuous movement of the contact from the first direction to a second direction being different from the first direction, in response to the detected change in direction of the continuous movement of the contact, selecting a currently presented category of elements, and consecutively presenting a sequence of graphical representations of elements of the selected category on the touch-sensitive display, and - providing tactile feedback in response to continuous movement of the contact along the first direction and/or along the second direction.
- a portable electronic device is provided with one or more programs that are stored in a memory and may be executed by one or more processors of the portable electronic device.
- the program(s) include(s) instructions for detecting contact made with the touch-sensitive display and performing tasks in response to movement of the contact.
- the portable electronic device is configured to detect contact with the touch-sensitive display, further detect continuous movement of the contact along the first direction and process the information and load instructions from the program(s) stored in the memory.
- the loaded instructions in this case, cause the portable electronic device to consecutively present a sequence of graphical representations of categories on the touch- sensitive display. As the contact is moved, different graphical representations of categories are presented and the portable electronic device may be regarded as being in category mode. In this way, many categories may be browsed with a single contact in a time efficient manner.
- the portable electronic device is further configured to detect change in direction of the continuous movement of the contact from the first direction to a second direction, being different from the first direction.
- instructions loaded from the program(s) in the memory of the portable electronic device cause the portable electronic device to select the currently presented category, and consecutively present graphical representations of elements in the selected category on the touch-sensitive display.
- the portable electronic device may, thus, be regarded as being in element mode.
- the portable electronic device is further adapted to provide tactile feedback in response to movement of the contact along the first direction and/or along the second direction, as described above with reference to the first aspect of the invention.
- the portable electronic device may provide tactile feedback in response to change of direction of movement of contact from the first direction to the second direction and/or in response to change of direction of movement of contact from the second direction to the first direction.
- the portable electronic device may further provide tactile feedback in response to a change in presented category and/or presented element.
- the portable electronic device By adapting the portable electronic device to provide tactile feedback, it is able to indicate receipt of user input by other means than visual output on the touch-sensitive display. This is particularly advantageous as the user can obtain feedback from the portable electronic device without the need to have visual contact with the touch-sensitive display.
- the user may also be able to associate the given user input with the received tactile feedback. This may allow the user to build up muscle memory, as described above.
- the user Once the user is familiarized with the combination of tactile feedback in response to particular user input, the user may be able to operate the portable electronic device in a somewhat automatic manner in which categories and elements may be browsed and selected in an even more time efficient and convenient manner.
- the invention since there is no need for visual contact with the touch- sensitive display, the invention is particularly advantageous in the case that the user is visually impaired and/or in the case that the user needs to have his or her attention elsewhere.
- the tactile feedback may be in the form of a vibration. This is particularly advantageous as many of the portable electronic devices today already comprise vibrators. Accordingly, it is a cost effective way of enabling tactile feedback. Furthermore, because vibrators are already used to provide tactical feedback in response to e.g. incoming phone calls and messages it may be relatively easy for the user to build up muscle memory in response to receipt of vibrational signals. As an alternative, the tactile feedback may be in the form of changes in the shape and/or in the texture of the touch-sensitive display.
- the programs of the portable electronic device according to the second aspect of the invention when executed, cause the method according to the first aspect of the invention to be performed.
- the portable electronic device according to the second aspect of the invention can be controlled by means of the method according to the first aspect of the invention.
- the portable electronic device allows browsing the categories and elements on the portable electronic device in a highly time efficient and convenient manner, as described above with reference to the first aspect of the invention. Furthermore, the portable electronic device can be operated without requiring visual contact with the touch-sensitive display.
- the portable electronic device may be a multifunctional portable electronic device.
- the portable electronic device has many functions in that it may comprise, e.g., a global positioning system (GPS) unit, a compass, a calendar, an internet browser, a training logger, games, etc.
- GPS global positioning system
- the portable electronic device may be a dedicated device having only a single function.
- the portable electronic device may be a cell phone.
- the portable electronic device comprises an antenna and means to record and emit sound in order to enable it to perform and receive phone calls, send and receive messages, etc.
- at least one category may be dedicated to include elements representing cell phone functions.
- the portable electronic device may be a tablet, a watch, a laptop, a remote control, a car user interface, or any other suitable kind of portable electronic device comprising a touch-sensitive display.
- the portable electronic device may comprise a touch-sensitive display which is divided into a content area for presenting content and a gesture area for performing continuous movement of a contact.
- the content area may present content, e.g. in the form of graphical representations of categories and/or elements.
- the gesture area may detect the contact, continuous movement of the contact and possibly the end of the contact. Accordingly, the touch-sensitive display may present content in an area different from the area used to register gestures in the form of contact on the touch-sensitive display. This is particularly advantageous in that areas may be arranged so that the user may perform gestures in the gesture area without blocking the content area.
- the content area and the gesture area may be separate or non-overlapping, in which case the content area and the gesture area are arranged adjacent to each other or with a distance there between.
- the invention provides a computer program product with instructions configured for execution by one or more processors, which when executed by a portable electronic device with a touch-sensitive display causes the portable electronic device to perform the method according to the first aspect of the invention.
- a computer program product that includes instructions for a portable electronic device to perform the method according to the first aspect of the invention is provided. This is particularly advantageous as such a computer program product may be distributed in itself in order to be installed on portable electronic devices.
- Fig. 1 is a flow chart illustrating a method according to an embodiment of the invention
- Fig. 2 is a schematic view of a portable electronic device according to an embodiment of the invention, illustrating change in presented category
- Fig. 3 is a schematic view of a portable electronic device according to an embodiment of the invention, illustrating presentation of a category
- Fig. 4 is a schematic view of a portable electronic device according to an embodiment of the invention, illustrating change in presented element
- Fig. 5 is a schematic view of a portable electronic device according to an embodiment of the invention, illustrating selection of an element
- Fig. 6 is a schematic view of a portable electronic device according to an embodiment of the invention, illustrating different areas of a touch-sensitive display.
- Fig. 1 is a flow chart illustrating a method according to an embodiment of the invention.
- the method is performed on a portable electronic device comprising a touch-sensitive display.
- the process is started at step 1.
- the portable electronic device investigates whether or not contact with the touch-sensitive display is detected, at step 3, i.e. it is determined whether or not a user is contacting the touch-sensitive display.
- step 3 reveals that there is no contact with the touch-sensitive display, the process is returned to step 3 for continued investigation of whether or not a user contacts the touch-sensitive display.
- step 3 reveals that contact with the touch-sensitive display is detected
- the process is forwarded to step 5, in which the portable electronic device investigates whether or not continuous movement of the contact along a first direction is detected. If not, the process is returned to step 3 for continued investigation of whether or not a user contacts the touch-sensitive display.
- step 7 the portable electronic device consecutively presents a sequence of graphical representations of categories, while provided tactile feedback. Moreover, at step 7, the portable electronic device presents different categories as the contact is moved along the first direction.
- the portable electronic device may be regarded as being in category mode.
- step 9 it is investigated whether or not a change in direction of the continuous movement of the contact from the first direction to a second direction is detected.
- the second direction is different from the first direction.
- step 9 reveals that a change in direction has not been detected, it is determined that the movement of the contact is still performed along the first direction, and the process is returned to step 7, where the consecutive presentation of categories of elements continues.
- step 9 reveals that a change in direction has been detected
- the process is forwarded to step 11.
- the portable electronic device selects the currently presented category and consecutively presents a sequence of graphical representations of elements belonging to the selected category, while providing tactile feedback.
- the portable electronic device presents different elements as the contact is moved along the second direction.
- the portable electronic device may be regarded as being in element mode.
- it is investigated whether or not the contact with the touch-sensitive display has ended. If not, the process is returned to step 11, where the consecutive presentation of elements is continued.
- step 13 reveals that the continuous contact with the touch-sensitive display has ended
- the portable electronic device selects the currently presented element at step 15.
- the currently presented element may be selected immediately upon detection of end of continuous contact with the touch-sensitive display.
- a predefined time period may be allowed to elapse from the detection of end of continuous contact with the touch-sensitive display until the element is selected. This will allow a user to briefly interrupt the continuous contact with the touch-sensitive display without causing an element to be selected. For instance, the movement along the second direction may have reached an edge of the touch-sensitive display before a desired element has been reached.
- the user may briefly interrupt the continuous contact with the touch-sensitive display in order to move the point of contact to a position which allows further movement along the second direction. Thereby the desired element can be reached and selected.
- the portable electronic device executes, launches and/or presents that application or function.
- the computer implemented method allows the portable electronic device to execute, launch and/or present a specific application or function with just one contact on the touch-sensitive display.
- the portable electronic device may thereby be operated in a highly time efficient and convenient manner.
- the portable electronic device may be operated without requiring visual contact with the touch-sensitive display.
- Fig. 2 is a schematic view of a portable electronic device according to an embodiment of the invention, comprising a touch-sensitive display 19 consecutively presenting a sequence of graphical representations of categories 21 of elements.
- the schematic view of Fig. 1 corresponds to a snap shot of the touch-sensitive display 19 during step 7 of the method described with reference to Fig. 1.
- continuous movement of contact is detected along a first direction, indicated by the arrow 25.
- the portable electronic device consecutively presents different categories 21.
- the touch- sensitive display 19 is in an intermediate state between presenting two different categories 21.
- Arrows 26 illustrate the direction of movement of the displayed categories 21 across the touch-sensitive display 19, in response to the detected movement of the contact along the first direction 25.
- Fig. 3 is a schematic view of a portable electronic device according to an embodiment of the invention.
- Fig. 3 illustrates selection of a category 21 by the portable electronic device.
- the situation corresponds to a snap shot of step 11 of the method described with reference to Fig. 1, in which a category 21 is selected in response to a detected change in direction of movement of contact from a first to a second direction.
- the second direction may, e.g., be an upwards direction of the touch-sensitive display 19, i.e. substantially perpendicular to the first direction illustrated in Fig. 2.
- a graphical representation of the category 21 is presented surrounded by graphical representations of elements 23 belonging to the category 21.
- the graphical representations of the elements 23 are arranged in a circular pattern.
- a written name 27 associated with the presented category 21 is presented along with written names 27 of the previous and subsequent categories.
- Fig. 4 is a schematic view of a portable electronic device according to an embodiment of the invention.
- Fig. 4 illustrates a touch-sensitive display 19 consecutively presenting a sequence of graphical representations of elements 23.
- the illustrated situation corresponds to a snap shot of the touch-sensitive display 19 during step 11 of the method described with reference to Fig. 1, in which the portable electronic device is in element mode.
- the portable electronic device In response to detected continuous movement of the contact along the second direction, the portable electronic device consecutively presents graphical representations of elements 23 belonging to the selected category. The currently presented element is highlighted by magnifying the graphical representation of the presented element 29.
- Detection of continuous movement of the contact in the second direction, indicated by arrow 31, causes the portable electronic device to circulate the graphical representations of elements 23 in the direction of the arrows 33. As graphical representations of elements 23 are circulated, different elements 23 will be presented and thus different graphical representations of elements 23 will become magnified or enlarged.
- Fig. 5 is a schematic view of a portable electronic device according to an embodiment of the invention.
- Fig. 5 illustrates a touch-sensitive display 19 with the currently presented graphical representation of an element 29 highlighted by magnification or enlargement.
- the currently presented graphical representation of an element 29 is presented along with a written name associated with the element 29 at the position marked by a circle 35.
- Fig. 6 is a schematic view of a portable electronic device according to an embodiment of the invention.
- Fig. 6 illustrates a touch-sensitive display 19 divided into a gesture area 37 and a content area 39.
- the content area 39 presents content, e.g. in the form of graphical representations of categories and/or elements.
- the gesture area 37 detects the contact, continuous movement of the contact and possibly the end of the contact.
- the gesture area 37 and the content area 39 are separate, i.e. non- overlapping.
- the touch-sensitive display 19 may present content in an area different from the area used to register gestures in the form of contact on the touch-sensitive display 19. This is particularly advantageous in that areas may be arranged so that the user may perform gestures in the gesture area 37 without blocking the content area 39.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
A computer-implemented method for controlling a portable electronic device comprising a touch-sensitive display (19) is disclosed. The computer-implemented method allows the portable electronic device to detect contact and movement of contact on the touch-sensitive display (19), and in response to the detected contact and movement of content to browse and select categories (21) of elements (23) and elements (23). Accordingly, a user may be allowed to select a specific element (23) belonging to a specific category (21) by use of only one contact with the touch-sensitive display (19). The portable electronic device provides a tactile feedback in response to the movement of the contact, thereby allowing a user to browse and select a specific element (23) without visual contact with the device.
Description
DRAG AND RELEASE NAVIGATION FIELD OF THE INVENTION
The present invention relates to a user interface for navigating portable electronic devices comprising a touch-sensitive display. BACKGROUND OF THE INVENTION
User interaction and navigation is generally different on modern day portable electronic devices with touch-sensitive displays than it is on computers with user interfaces comprising mouse and keyboard. The birth of smartphones and tablets with touch-sensitive displays also paved the way for rethinking the way an operating system is designed. All major label present day smartphones and tablets rely on program or application icons and widgets that may be brought about and rearranged by contact between the touch-sensitive screen and, e.g., the finger of a user.
To launch an application, the user generally tabs the icon corresponding to a particular application. As more applications are installed, the number of icons representing applications may exceed the number of icons that fit into the touch-sensitive display of the portable electronic device at one time. To enable navigation of more applications, many portable electronic devices allow the user to navigate among several pages of icons by swiping across the touch-sensitive display. In this way, to launch an application on a different page than the one currently presented to the user, the user first swipes the touch-sensitive display to reach the page containing the relevant icon and then tabs the icon, thereby launching the application represented by the icon.
As an alternative or additionally to arranging icons on several pages, icons and their associated applications may be arranged in categories or groups. These categories or groups may be represented by category icons. To launch an application associated with a particular category, the user may initially have to reach the page containing the category icon, tab the category icon, and finally tab the icon representing the desired application. As the number of applications installed on portable electronic devices grows, the increase in number of categories and pages available to the user complicates the process of launching a particular application. Moreover, it takes time to navigate the pages and categories and it may be hard to remember on which page and in which category an application is launched from. While search options are available on some portable electronic devices, they require writing at least part of the name of the desired application, which may also be a time consuming process.
WO 2007/076210 Al discloses a device with a touch-sensitive display which may be unlocked via gestures performed on the touch-sensitive display. The device is unlocked if contact with the display corresponds to a predefined gesture for unlocking the device. The device displays one or more unlock images with respect to which the predefined gesture is to be performed in order to unlock the device. The performance of the predefined gesture with respect to the unlock image may include moving the unlock image to a predefined location and/or moving the unlock image along a predefined path.
US 2011/0296351 Al discloses a user interface presenting a plurality of items configured as a stack in a display of a device. The stack is scrollable in a direction oblique to a plane of the display for successively viewing the items in the stack. Multiple stacks of items may be provided, which are laterally navigable into a viewable area of the display.
EP 2 503 444 A2 discloses a system and a method for crossing navigation for use in an electronic terminal. A touch screen that is capable of receiving touch inputs from a user includes a crossing navigation input that uses two directional input to move through content within different content groups. The touch screen includes a graphical user interface that is configured to receive, through the touch screen, a first input to access different content groups and a second input to access content within the same group. The first input includes a touch input in first direction and the second input includes a touch input in a second direction. US 2014/0082554 Al discloses a method including displaying, on a display screen of an electronic device, a plurality of categories, the plurality of categories being displayed in a first direction. A selection of a category from the plurality of categories is detected by a processor. An arrangement in which the plurality of categories are displayed in modified, and a plurality of elements of the selected category are displayed on the display screen in a second direction that is different from the first direction.
DESCRIPTION OF THE INVENTION
It is an object of embodiments of the invention to provide a computer-implemented method of controlling a portable electronic device comprising a touch-sensitive display in a time efficient and convenient manner. It is a further object of embodiments of the invention to provide a computer-implemented method of controlling a portable electronic device comprising a touch-sensitive display in a
manner which enables navigating a sequence of categories and elements contained therein by movement of a contact on the touch-sensitive display.
It is an even further object of embodiments of the invention to provide a computer- implemented method of controlling a portable electronic device comprising a touch-sensitive display, allowing an element to be selected without visual contact with the touch-sensitive display.
It is an even further object of embodiments of the invention to provide a portable electronic device comprising a touch-sensitive display, which can be controlled in a time efficient and convenient manner. It is an even further object of embodiments of the invention to provide a portable electronic device comprising a touch-sensitive display, which can be controlled without visual contact with the touch-sensitive display.
According to a first aspect the invention provides a computer-implemented method of controlling a portable electronic device comprising a touch-sensitive display, the method comprising the steps of:
- detecting contact with the touch-sensitive display,
- detecting continuous movement of the contact along a first direction, in response to the detected continuous movement of the contact along the first direction, the portable electronic device consecutively presenting a sequence of graphical representations of categories of elements on the touch-sensitive display,
- detecting a change in direction of the continuous movement of the contact from the first direction to a second direction being different from the first direction, in response to the detected change in direction of the continuous movement of the contact, the portable electronic device selecting a currently presented category of elements, and consecutively presenting a sequence of graphical representations of elements of the selected category on the touch-sensitive display,
wherein the method further comprises the step of the portable electronic device providing tactile feedback in response to continuous movement of the contact along the first direction and/or along the second direction.
The computer-implemented method according to the first aspect of the invention is for controlling a portable electronic device comprising a touch-sensitive display. In the present context the term "portable electronic device" should be interpreted to mean any electronic device which is portable. Examples of common portable electronic devices comprising a touch-sensitive display are smartphones, tablets, watches and laptops. However, here portable should be interpreted in the broadest possible sense so that the invention may also apply to other kinds of electronic devices, such as remote controls, car user interfaces, etc., comprising a touch-sensitive display.
In the present context the term "touch-sensitive display" should be interpreted to mean a display which allows navigation by means of a user touching the display. For instance, the touch-sensitive display may apply a capacitive technology. According to the method of the first aspect of the invention, contact with the touch-sensitive display is initially detected. Thus, it is initially detected that a user is touching the touch- sensitive display, e.g. by means of a finger, or by means of a suitable input device, such as a stylo.
Subsequently, a continuous movement of the contact along a first direction is detected. In the present context the term "continuous movement of the contact" should be interpreted to mean that the user moves the point of contact with the touch-sensitive display, e.g. a finger, across the touch-sensitive display, without interrupting the contact with the touch-sensitive display, i.e. without removing, e.g., the finger from the touch-sensitive display.
The first direction is a direction along the touch-sensitive display, i.e. relative to the outline of the touch-sensitive display, which has been defined previously. Accordingly, when the user moves, e.g. a finger, substantially along this predefined direction, while contacting the touch- sensitive display, the portable electronic device recognises this as a continuous movement of a contact along the first direction.
In response to detecting continuous movement of a contact along the first direction, the portable electronic device consecutively presents a sequence of graphical representations of categories of elements on the touch-sensitive display. Thus, graphical representations of a number of categories of elements are presented on the touch-sensitive display, one after the other. For instance, the graphical representations of the categories may be presented one at
a time, in a predefined order. As an alternative, the graphical representations of the categories may be presented in such a manner that they move across the touch-sensitive display, e.g. linearly, along a circle or in any other suitable pattern. In this case the graphical representations of the categories may advantageously be highlighted and/or enlarged consecutively, i.e. only one of the categories is highlighted and/or enlarged at a given time, even though graphical representations of two or more categories are presented on the touch- sensitive display. The sequence of categories of elements continues to be presented as long as the contact is moved along the first direction. Thereby the categories of elements may be browsed by the user as the user continuously moves, e.g., a finger across the touch-sensitive display along the first direction.
The graphical representations of the categories of elements may, e.g., be or comprise icons and/or written names associated with the respective categories.
At least some of the categories of elements may be user defined and/or at least some of the categories of elements may be predefined and/or at least some of the categories of elements may be defined by the portable electronic device. In the present context the term "define" should be interpreted to mean assigning one or more elements to a given category of elements. For instance, a given category may have a number of elements of the same or similar kind assigned thereto. Alternatively or additionally, one of the categories may have a number of elements which have been accessed or activated most recently assigned thereto. The elements of the categories may, e.g., be applications or functions available on the portable electronic device. As an alternative, at least some of the elements may be settings of the portable electronic device, programs available on the portable electronic device, a list of contacts, content, such as photos, videos, files, etc., or any other suitable kind of elements. Furthermore, the elements may be in the form of data, symbols or the like to be input on the portable electronic device. For instance, emojis may be grouped into categories, or the alphabet may be divided into categories to provide easy access to a dictionary.
Next, a change in direction of the continuous movement of the contact from the first direction to a second direction being different from the first direction is detected. The second direction may, e.g., be substantially perpendicular to the first direction. However, an angle defined between the first direction and the second direction may differ from 90°.
In response to the detected change in direction of the continuous movement of the contact, the portable electronic device selects the currently presented category of elements, i.e. the category of elements which is presented or highlighted on the touch-sensitive display when the change in direction of the continuous movement of the contact is detected, is selected.
When the category of elements has been selected, the portable electronic device
consecutively presents a sequence of graphical representations of elements of the selected category on the touch-sensitive display. This is similar to the situation described above with respect to the graphical representations of the categories of elements, except in this case the elements of the selected category are presented. Thus, the elements of the selected category of element may be browsed by a user as the user moves, e.g., a finger across the touch- sensitive display along the second direction.
Accordingly, a given element may be reached by moving the contact with the touch-sensitive display in a specific moving pattern. The graphical representations of elements may, e.g., be or comprise icons and/or written names associated with the respective elements.
In summary, according to the computer implemented method of to the first aspect of the invention, a portable electronic device may be controlled by the touch of, e.g., a finger. In response to detection of a contact followed by continuous movement along the first direction, the portable electronic device consecutively presents a sequence of graphical representations of categories of elements on the touch-sensitive display, and the consecutive presentation of the categories continues as long as the contact is moved along the first direction. As the contact is moved, different graphical representations of categories are presented. In this way, many categories may be browsed with a single contact in a time efficient manner. Continuous movement of contact along the first direction associated with consecutive presentation of categories may also be referred to as category mode. In this case the portable electronic device is in category mode.
Furthermore, in response to detection of change in direction of the continuous movement of the contact from the first direction to a second direction, the portable electronic device selects a currently presented category and consecutively presents a sequence of graphical representations of elements of the selected category. The detection of a change in direction implies that no loss of contact is detected between the steps. As the direction of continuous movement changes from the first to the second direction, the portable electronic device selects the currently presented category. Further continuous movement in the second direction causes the portable electronic device to consecutively present graphical
representations of elements of the selected category. Again, as the contact is moved, different elements are presented. Continuous movement of contact along the second direction associated with consecutive presentation of elements may also be referred to as element mode. In this case the portable electronic device is in element mode.
The method according to present invention, thus, allows for navigation among numerous categories and elements with a single contact on the touch-sensitive display. Accordingly, it is not necessary to apply a series of gestures including, e.g., swipes and taps to navigate categories and elements on a portable electronic device. This saves time for the user and adds to the convenience associated with navigating the portable electronic device.
Furthermore, all categories and associated elements may be navigated by use of only a part of the touch-sensitive display. For instance, movement of the contact along the first and second direction may be done in, e.g., the lower part of the touch-sensitive display which is easily accessible by the thumb of the user. This is particularly useful for touch-sensitive displays with dimensions exceeding the reach of the thumb. Previously, for such large displays, navigation on the portable electronic devices may have necessitated change of grip on the portable electronic device and/or use of more than one hand. Such change of grip and/or use of more than one hand may be inconvenient and time consuming for the user. Thus the method according to the first aspect of the present invention may even further save time and add to the convenience in relation to navigating the portable electronic device.
The computer-implemented method further comprises the step of the portable electronic device providing tactile feedback in response to continuous movement of the contact along the first direction and/or along the second direction.
Accordingly, the portable electronic device provides tactile feedback in response to movement of the contact in category mode and/or in element mode. In this way the portable electronic device is able to indicate receipt of user input by other means than visual output on the touch-sensitive display. This is particularly advantageous as the user is then able to get a sense of what input the portable electronic device receives without the user needing to have visual contact with the touch-sensitive display. This is, e.g., relevant in the case that the user is visually impaired or in the case that the user needs to have or her attention elsewhere.
The user may also be able to associate a given user input with the received tactile feedback. This may allow the user to build up so-called "muscle memory". Muscle memory is a term used to describe the brain's and thus muscles' ability to react to tactile feedback in a swift manner without the need to "think". An in depth neurological explanation for muscle memory will not be presented here. A simple example will be given, though. When learning how to ride a bicycle it is necessary to think about how to keep balanced, going forward, braking, etc. However, once riding a bicycle has been familiarized there is no longer a need to think about how to keep balanced, going forward, braking, etc. The brain and body will
automatically react to feedback received by the body and perform necessary measures in order to ride the bicycle. This is the kind of muscle memory being referred to here, and the
kind which may become possible to achieve when the portable electronic device gives tactile feedback in response to movement of the contact along the first direction and/or along the second direction.
The tactile feedback may, e.g., be in the form of a vibration. This is particularly
advantageous as implementing a vibrator in a portable electronic device is known in the art and already present in many of the portable electronic devices existing today. Accordingly, it is a cost effective way of enabling tactile feedback. Furthermore, because vibrators are already used to provide tactical feedback in response to, e.g., incoming phone calls, messages and/or notifications it may be relatively easy for the user to build up muscle memory in response to receipt of vibrational signals. As an alternative, the tactile feedback may be in the form of changes in the shape and/or in the texture of the touch-sensitive display.
The computer-implemented method may further comprise the steps of detecting end of continuous contact following detection of continuous movement of contact along the second direction, and in response to the detected end of continuous contact, the portable electronic device selecting a currently presented element.
In this case, the portable electronic device selects the currently presented element when continuous contact with the touch-sensitive display is ended following detection of movement of the contact along the second direction. In other words, the portable electronic device selects the presented element when contact is ended in element mode. Thus, for the user, selecting an element entails to simply end the continuous contact by, e.g., removing the finger from the touch-sensitive display when the portable electronic device is in element mode, and when the desired element is presented. Moreover, selection of an element may be done by first continuously moving the contact in the first direction until the desired category is presented by the portable electronic device, at which point the contact is continuously moved in the second direction until the desired element is presented, followed by end of the contact to select the currently presented element. This allows a user to select a specific element in a specific category with a single contact in a highly time efficient and convenient manner. Thus, an element may be selected by moving the contact with the touch-sensitive display in a specific moving pattern along the touch-sensitive display.
In the case that the element is an application or function available on the portable electronic device, the selection of an element may result in the portable electronic device executing, launching and/or presenting the application or function. In the case that the element is a piece of content, such as a photo, a video, a document, a file, etc., the selection of an element may result in the portable electronic device displaying and/or opening the piece of
content. In the case that the element is input data, the selection of an element may result in the selected data, symbol or the like being input.
A predefined time period may be allowed to elapse from the detection of the end of continuous contact until the currently presented element is selected. Furthermore, according to this embodiment, if contact with the touch-sensitive display and continued movement along the second direction is once again detected within the predefined time period, this will be considered as if the continuous contact with the touch-sensitive display was never ended. This allows the user to briefly interrupt the continuous contact with the touch-sensitive display, without causing an element to be selected. This may, e.g., be relevant in the case that the point of contact with the touch-sensitive display reaches an edge of the touch- sensitive display before a desired element has been reached. In this case the user is able to interrupt the continuous contact and move the point of contact to a new position on the touch-sensitive display which allows further movement along the second direction, thereby allowing continued browsing of elements in order to reach and select the desired element. This also allows an initial point of contact with the touch-sensitive display to be selected without considering how much space is required for movement of the point of contact in order to reach a desired element.
The predefined time period may be a fixed time period in the sense that it is predefined by the portable electronic device. As an alternative, the predefined time period may be defined by the user, in order to meet specific needs of the user, e.g. in terms of navigation speed of the individual user. It has been found that a time period within the interval of 0.4-1.0 seconds, such as within the interval of 0.5-0.8 seconds, such as approximately 0.6 seconds is suitable in order to allow a user to move the point of contact without causing unnecessary delays in selecting an element during normal operation of the portable electronic device. As an alternative, the currently presented element may be selected immediately upon detection of the end of continuous contact.
The computer-implemented method may further comprise the steps of detecting end of continuous contact following detection of continuous movement of contact along the first direction, and in response to the detected end of continuous contact, the portable electronic device selecting a currently presented category and presenting graphical representations of the elements of the selected category on the touch-sensitive display.
In this case, continuous movement of contact along the first direction followed by end of contact causes the portable electronic device to select the category presented at the time when continuous contact is ended. Furthermore, the portable electronic device presents
graphical representations of the elements of the selected category. In other words, the portable electronic device selects the presented category and presents graphical
representations of the elements assigned thereto when contact is ended in category mode. This allows the user to select a category and gain an overview of the elements in the category by use of just one contact. This may be particularly advantageous if the user has forgotten the name of the element and/or the appearance of the graphical representation of the element and thus may benefit from having time to scrutinize an overview of graphical representations of the elements of a given category.
A predefined time period may be allowed to elapse from the detection of the end of continuous contact until the currently presented category is selected. This is similar to the situation described above with respect to detecting the end of continuous contact along the second direction. The remarks set forth above are therefore equally applicable here.
However, in this case continued browsing of categories is allowed instead of continued browsing of elements. The computer-implemented method may further comprise the steps of detecting a change in direction of the continuous movement of the contact from the second direction to the first, and in response to the detected change in direction of the continuous movement of the contact, the portable electronic device consecutively presenting a sequence of graphical representations of categories of elements on the touch-sensitive display. In this case, continuous movement of contact along the second direction followed by continuous movement of contact along the first direction causes the portable electronic device to consecutively present a sequence of graphical representations of categories of elements on the touch-sensitive display. That is, the portable electronic device changes from element mode to category mode when the direction of movement of contact changes from the second to the first direction. This is particularly advantageous as the portable electronic device is able to quickly activate category mode after having been in element mode, by the user changing direction of movement of contact. If the user desires to browse a category different from the currently selected, the user may reach the desired category by returning to category mode. The user can, thus, quickly and conveniently change between selected categories in order to browse the categories and/or select a specific element belonging to a specific category.
The computer-implemented method may further comprise the step of the portable electronic device providing tactile feedback in response to a change in currently presented category and/or element.
In this case, the portable electronic device uses tactile feedback to inform the user of a change in presented category and/or presented element. This provides the user with a simple way of registering each time the presented category and/or element is changed. The user may then count the number of tactile feedbacks in category mode to reach the desired category, change to element mode and count the number of tactile feedbacks in element mode to reach the desired element. In time, it may also be possible for the user to build up muscle memory as described above. The brain then may be able to, e.g., automatically change from category mode to element mode when the correct number of tactile feedbacks has been sensed.
The tactile feedback may, alternatively or additionally, directly reflect the category and/or element being presented. For instance, repeated vibrations may be provided in response to change in category and/or element, the number of vibrations and/or the frequency of the repeated vibrations may reflect the category and/or element being presented.
The computer-implemented method may further comprise the step of providing tactile feedback in response to change of direction of movement of contact from the first direction to the second direction and/or in response to change of direction of movement of contact from the second direction to the first direction. In this way the user is able to sense change from category mode to element mode and/or change from element mode to category mode. The tactile feedback provided in response to a change in direction of movement of contact may be distinguishable from the tactile feedback provided in response to a change in presented category or element, thereby allowing the user to determine, based on the received tactile feedback, whether a change in presented category or element, or a change in mode has occurred.
According to a second aspect the invention provides a portable electronic device comprising a touch-sensitive display, one or more processors, memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the program(s) including instructions for: detecting contact with the touch-sensitive display, detecting continuous movement of the contact along a first direction,
in response to the detected continuous movement of the contact along the first direction, consecutively presenting a sequence of graphical representations of categories of elements on the touch-sensitive display, detecting a change in direction of the continuous movement of the contact from the first direction to a second direction being different from the first direction, in response to the detected change in direction of the continuous movement of the contact, selecting a currently presented category of elements, and consecutively presenting a sequence of graphical representations of elements of the selected category on the touch-sensitive display, and - providing tactile feedback in response to continuous movement of the contact along the first direction and/or along the second direction.
It should be noted that a person skilled in the art would readily recognise that any feature described in combination with the first aspect of the invention could also be combined with the second aspect of the invention, and vice versa. The remarks set forth above are therefore equally applicable here.
According to this aspect of the invention, a portable electronic device is provided with one or more programs that are stored in a memory and may be executed by one or more processors of the portable electronic device. The program(s) include(s) instructions for detecting contact made with the touch-sensitive display and performing tasks in response to movement of the contact. Accordingly, the portable electronic device is configured to detect contact with the touch-sensitive display, further detect continuous movement of the contact along the first direction and process the information and load instructions from the program(s) stored in the memory. The loaded instructions, in this case, cause the portable electronic device to consecutively present a sequence of graphical representations of categories on the touch- sensitive display. As the contact is moved, different graphical representations of categories are presented and the portable electronic device may be regarded as being in category mode. In this way, many categories may be browsed with a single contact in a time efficient manner.
The portable electronic device is further configured to detect change in direction of the continuous movement of the contact from the first direction to a second direction, being different from the first direction. When this happens, instructions loaded from the program(s) in the memory of the portable electronic device, cause the portable electronic device to select the currently presented category, and consecutively present graphical representations of
elements in the selected category on the touch-sensitive display. The portable electronic device may, thus, be regarded as being in element mode.
The portable electronic device is further adapted to provide tactile feedback in response to movement of the contact along the first direction and/or along the second direction, as described above with reference to the first aspect of the invention.
The portable electronic device may provide tactile feedback in response to change of direction of movement of contact from the first direction to the second direction and/or in response to change of direction of movement of contact from the second direction to the first direction.
The portable electronic device may further provide tactile feedback in response to a change in presented category and/or presented element.
By adapting the portable electronic device to provide tactile feedback, it is able to indicate receipt of user input by other means than visual output on the touch-sensitive display. This is particularly advantageous as the user can obtain feedback from the portable electronic device without the need to have visual contact with the touch-sensitive display. The user may also be able to associate the given user input with the received tactile feedback. This may allow the user to build up muscle memory, as described above. Once the user is familiarized with the combination of tactile feedback in response to particular user input, the user may be able to operate the portable electronic device in a somewhat automatic manner in which categories and elements may be browsed and selected in an even more time efficient and convenient manner. Furthermore, since there is no need for visual contact with the touch- sensitive display, the invention is particularly advantageous in the case that the user is visually impaired and/or in the case that the user needs to have his or her attention elsewhere.
The tactile feedback may be in the form of a vibration. This is particularly advantageous as many of the portable electronic devices today already comprise vibrators. Accordingly, it is a cost effective way of enabling tactile feedback. Furthermore, because vibrators are already used to provide tactical feedback in response to e.g. incoming phone calls and messages it may be relatively easy for the user to build up muscle memory in response to receipt of vibrational signals. As an alternative, the tactile feedback may be in the form of changes in the shape and/or in the texture of the touch-sensitive display.
In summary, the programs of the portable electronic device according to the second aspect of the invention, when executed, cause the method according to the first aspect of the invention to be performed. Thus, the portable electronic device according to the second aspect of the
invention can be controlled by means of the method according to the first aspect of the invention.
Thus, the portable electronic device allows browsing the categories and elements on the portable electronic device in a highly time efficient and convenient manner, as described above with reference to the first aspect of the invention. Furthermore, the portable electronic device can be operated without requiring visual contact with the touch-sensitive display.
The portable electronic device may be a multifunctional portable electronic device.
In this case the portable electronic device has many functions in that it may comprise, e.g., a global positioning system (GPS) unit, a compass, a calendar, an internet browser, a training logger, games, etc. This is particularly advantageous as a portable electronic device according to the second aspect of the invention allows for time efficient and convenient navigation between a multitude of applications and functions.
As an alternative, the portable electronic device may be a dedicated device having only a single function.
The portable electronic device may be a cell phone.
In this case, the portable electronic device comprises an antenna and means to record and emit sound in order to enable it to perform and receive phone calls, send and receive messages, etc. In order to allow time efficient and convenient use of cell phone functions, at least one category may be dedicated to include elements representing cell phone functions.
As an alternative, the portable electronic device may be a tablet, a watch, a laptop, a remote control, a car user interface, or any other suitable kind of portable electronic device comprising a touch-sensitive display.
The portable electronic device may comprise a touch-sensitive display which is divided into a content area for presenting content and a gesture area for performing continuous movement of a contact.
In this case, individual areas of the touch-sensitive display have individual functions. The content area may present content, e.g. in the form of graphical representations of categories and/or elements. The gesture area may detect the contact, continuous movement of the contact and possibly the end of the contact.
Accordingly, the touch-sensitive display may present content in an area different from the area used to register gestures in the form of contact on the touch-sensitive display. This is particularly advantageous in that areas may be arranged so that the user may perform gestures in the gesture area without blocking the content area. The content area and the gesture area may be separate or non-overlapping, in which case the content area and the gesture area are arranged adjacent to each other or with a distance there between. As an alternative, the content area and the gesture area may be partly overlapping, in which case a part of the content area forms part of the gesture area, and vice versa. According to a third aspect, the invention provides a computer program product with instructions configured for execution by one or more processors, which when executed by a portable electronic device with a touch-sensitive display causes the portable electronic device to perform the method according to the first aspect of the invention.
Accordingly, the remarks set forth above with reference to the first and second aspects of the invention are equally applicable here.
According to the third aspect of the invention, a computer program product that includes instructions for a portable electronic device to perform the method according to the first aspect of the invention is provided. This is particularly advantageous as such a computer program product may be distributed in itself in order to be installed on portable electronic devices.
BRIEF DESCRIPTION OF THE DRAWINGS
The invention will now be described in further detail with reference to the accompanying drawings in which
Fig. 1 is a flow chart illustrating a method according to an embodiment of the invention, Fig. 2 is a schematic view of a portable electronic device according to an embodiment of the invention, illustrating change in presented category,
Fig. 3 is a schematic view of a portable electronic device according to an embodiment of the invention, illustrating presentation of a category,
Fig. 4 is a schematic view of a portable electronic device according to an embodiment of the invention, illustrating change in presented element,
Fig. 5 is a schematic view of a portable electronic device according to an embodiment of the invention, illustrating selection of an element, and Fig. 6 is a schematic view of a portable electronic device according to an embodiment of the invention, illustrating different areas of a touch-sensitive display.
DETAILED DESCRIPTION OF THE DRAWINGS
Fig. 1 is a flow chart illustrating a method according to an embodiment of the invention. The method is performed on a portable electronic device comprising a touch-sensitive display. The process is started at step 1. Next, the portable electronic device investigates whether or not contact with the touch-sensitive display is detected, at step 3, i.e. it is determined whether or not a user is contacting the touch-sensitive display. In the case that step 3 reveals that there is no contact with the touch-sensitive display, the process is returned to step 3 for continued investigation of whether or not a user contacts the touch-sensitive display.
In the case that step 3 reveals that contact with the touch-sensitive display is detected, the process is forwarded to step 5, in which the portable electronic device investigates whether or not continuous movement of the contact along a first direction is detected. If not, the process is returned to step 3 for continued investigation of whether or not a user contacts the touch-sensitive display.
In the case that step 5 reveals that continuous movement of the contact along a first direction is detected, the process is forwarded to step 7. At step 7, the portable electronic device consecutively presents a sequence of graphical representations of categories, while provided tactile feedback. Moreover, at step 7, the portable electronic device presents different categories as the contact is moved along the first direction. The portable electronic device may be regarded as being in category mode.
Then, at step 9, it is investigated whether or not a change in direction of the continuous movement of the contact from the first direction to a second direction is detected. The second direction is different from the first direction. In the case that step 9 reveals that a change in direction has not been detected, it is determined that the movement of the contact
is still performed along the first direction, and the process is returned to step 7, where the consecutive presentation of categories of elements continues.
In the case that step 9 reveals that a change in direction has been detected, the process is forwarded to step 11. At step 11, the portable electronic device selects the currently presented category and consecutively presents a sequence of graphical representations of elements belonging to the selected category, while providing tactile feedback. Moreover, at step 11, the portable electronic device presents different elements as the contact is moved along the second direction. The portable electronic device may be regarded as being in element mode. Then, at step 13, it is investigated whether or not the contact with the touch-sensitive display has ended. If not, the process is returned to step 11, where the consecutive presentation of elements is continued.
In the case that step 13 reveals that the continuous contact with the touch-sensitive display has ended, the portable electronic device selects the currently presented element at step 15. The currently presented element may be selected immediately upon detection of end of continuous contact with the touch-sensitive display. As an alternative, a predefined time period may be allowed to elapse from the detection of end of continuous contact with the touch-sensitive display until the element is selected. This will allow a user to briefly interrupt the continuous contact with the touch-sensitive display without causing an element to be selected. For instance, the movement along the second direction may have reached an edge of the touch-sensitive display before a desired element has been reached. When a predefined time period is allowed to elapse from the detection of end of continuous contact until the presented element is selected, the user may briefly interrupt the continuous contact with the touch-sensitive display in order to move the point of contact to a position which allows further movement along the second direction. Thereby the desired element can be reached and selected.
Finally, the process is ended at step 17.
In the case when the element selected at step 15 is an application or function, the portable electronic device executes, launches and/or presents that application or function. Thus, according to this embodiment, the computer implemented method allows the portable electronic device to execute, launch and/or present a specific application or function with just one contact on the touch-sensitive display. The portable electronic device may thereby be operated in a highly time efficient and convenient manner. Furthermore, due the tactile
feedback, the portable electronic device may be operated without requiring visual contact with the touch-sensitive display.
Fig. 2 is a schematic view of a portable electronic device according to an embodiment of the invention, comprising a touch-sensitive display 19 consecutively presenting a sequence of graphical representations of categories 21 of elements. The schematic view of Fig. 1 corresponds to a snap shot of the touch-sensitive display 19 during step 7 of the method described with reference to Fig. 1. In Fig. 2 continuous movement of contact is detected along a first direction, indicated by the arrow 25. In response to the detected movement, the portable electronic device consecutively presents different categories 21. In Fig. 2 the touch- sensitive display 19 is in an intermediate state between presenting two different categories 21. Arrows 26 illustrate the direction of movement of the displayed categories 21 across the touch-sensitive display 19, in response to the detected movement of the contact along the first direction 25.
Fig. 3 is a schematic view of a portable electronic device according to an embodiment of the invention. Fig. 3 illustrates selection of a category 21 by the portable electronic device. The situation corresponds to a snap shot of step 11 of the method described with reference to Fig. 1, in which a category 21 is selected in response to a detected change in direction of movement of contact from a first to a second direction. The second direction may, e.g., be an upwards direction of the touch-sensitive display 19, i.e. substantially perpendicular to the first direction illustrated in Fig. 2. A graphical representation of the category 21 is presented surrounded by graphical representations of elements 23 belonging to the category 21.
Accordingly, the graphical representations of the elements 23 are arranged in a circular pattern. Below the graphical representation of the presented category 21, a written name 27 associated with the presented category 21 is presented along with written names 27 of the previous and subsequent categories.
Fig. 4 is a schematic view of a portable electronic device according to an embodiment of the invention. Fig. 4 illustrates a touch-sensitive display 19 consecutively presenting a sequence of graphical representations of elements 23. The illustrated situation corresponds to a snap shot of the touch-sensitive display 19 during step 11 of the method described with reference to Fig. 1, in which the portable electronic device is in element mode. In response to detected continuous movement of the contact along the second direction, the portable electronic device consecutively presents graphical representations of elements 23 belonging to the selected category. The currently presented element is highlighted by magnifying the graphical representation of the presented element 29. Detection of continuous movement of the contact in the second direction, indicated by arrow 31, causes the portable electronic device to circulate the graphical representations of elements 23 in the direction of the arrows
33. As graphical representations of elements 23 are circulated, different elements 23 will be presented and thus different graphical representations of elements 23 will become magnified or enlarged.
Fig. 5 is a schematic view of a portable electronic device according to an embodiment of the invention. Fig. 5 illustrates a touch-sensitive display 19 with the currently presented graphical representation of an element 29 highlighted by magnification or enlargement. The currently presented graphical representation of an element 29 is presented along with a written name associated with the element 29 at the position marked by a circle 35.
Fig. 6 is a schematic view of a portable electronic device according to an embodiment of the invention. Fig. 6 illustrates a touch-sensitive display 19 divided into a gesture area 37 and a content area 39. The content area 39 presents content, e.g. in the form of graphical representations of categories and/or elements. The gesture area 37 detects the contact, continuous movement of the contact and possibly the end of the contact. In the embodiment illustrated in Fig. 6, the gesture area 37 and the content area 39 are separate, i.e. non- overlapping.
Accordingly, the touch-sensitive display 19 may present content in an area different from the area used to register gestures in the form of contact on the touch-sensitive display 19. This is particularly advantageous in that areas may be arranged so that the user may perform gestures in the gesture area 37 without blocking the content area 39.
Claims
1. A computer-implemented method of controlling a portable electronic device comprising a touch-sensitive display, the method comprising the steps of: detecting contact with the touch-sensitive display, - detecting continuous movement of the contact along a first direction, in response to the detected continuous movement of the contact along the first direction, the portable electronic device consecutively presenting a sequence of graphical representations of categories of elements on the touch-sensitive display,
- detecting a change in direction of the continuous movement of the contact from the first direction to a second direction being different from the first direction, in response to the detected change in direction of the continuous movement of the contact, the portable electronic device selecting a currently presented category of elements, and consecutively presenting a sequence of graphical representations of elements of the selected category on the touch-sensitive display, wherein the method further comprises the step of the portable electronic device providing tactile feedback in response to continuous movement of the contact along the first direction and/or along the second direction.
2. A computer-implemented method according to claim 1, further comprising the steps of detecting end of continuous contact following detection of continuous movement of contact along the second direction, and in response to the detected end of continuous contact, the portable electronic device selecting a currently presented element.
3. A computer-implemented method according to claim 2, wherein a predefined time period is allowed to elapse from the detection of the end of continuous contact until the currently presented element is selected.
4. A computer-implemented method according to any of the preceding claims, further comprising the steps of detecting end of continuous contact following detection of continuous movement of contact along the first direction, and in response to the detected end of continuous contact, the portable electronic device selecting a currently presented category
and presenting graphical representations of the elements of the selected category on the touch-sensitive display.
5. A computer-implemented method according to claim 4, wherein a predefined time period is allowed to elapse from the detection of the end of continuous contact until the currently presented category is selected.
6. A computer-implemented method according to any of the preceding claims, further comprising the steps of detecting a change in direction of the continuous movement of the contact from the second direction to the first, and in response to the detected change in direction of the continuous movement of the contact, the portable electronic device consecutively presenting a sequence of graphical representations of categories of elements on the touch-sensitive display.
7. A computer-implemented method according to any of the preceding claims, wherein the portable electronic device provides tactile feedback in response to a change in currently presented category and/or element.
8. A portable electronic device comprising a touch-sensitive display, one or more processors, memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the program(s) including instructions for: detecting contact with the touch-sensitive display, - detecting continuous movement of the contact along a first direction, in response to the detected continuous movement of the contact along the first direction, consecutively presenting a sequence of graphical representations of categories of elements on the touch-sensitive display,
- detecting a change in direction of the continuous movement of the contact from the first direction to a second direction being different from the first direction, in response to the detected change in direction of the continuous movement of the contact, selecting a currently presented category of elements, and consecutively presenting a sequence of graphical representations of elements of the selected category on the touch-sensitive display, and
providing tactile feedback in response to continuous movement of the contact along the first direction and/or along the second direction.
9. A portable electronic device according to claim 8, wherein the portable electronic device is a multifunctional portable electronic device.
10. A portable electronic device according to claim 8 or 9, wherein the portable electronic device is a cell phone.
11. A portable electronic device according to any of claims 8-10, wherein the touch-sensitive display is divided into a content area for presenting content and a gesture area for performing continuous movement of a contact.
12. A computer program product with instructions configured for execution by one or more processors, which when executed by a portable electronic device with a touch-sensitive display causes the portable electronic device to perform the method of any of claims 1 to 5.
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP15200049.3 | 2015-12-15 | ||
EP15200049 | 2015-12-15 | ||
US14/969,425 | 2015-12-15 | ||
US14/969,425 US9940001B2 (en) | 2015-12-15 | 2015-12-15 | Drag and release navigation |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017102844A1 true WO2017102844A1 (en) | 2017-06-22 |
Family
ID=57543050
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2016/081004 WO2017102844A1 (en) | 2015-12-15 | 2016-12-14 | Drag and release navigation |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2017102844A1 (en) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110296351A1 (en) * | 2010-05-26 | 2011-12-01 | T-Mobile Usa, Inc. | User Interface with Z-axis Interaction and Multiple Stacks |
EP2503444A2 (en) * | 2011-03-25 | 2012-09-26 | Samsung Electronics Co., Ltd. | System and method for crossing navigation for use in an electronic terminal |
US20130024808A1 (en) * | 2011-07-21 | 2013-01-24 | Nokia Corporation | Methods, Apparatus, Computer-Readable Storage Mediums and Computer Programs |
US20130176298A1 (en) * | 2012-01-10 | 2013-07-11 | Kunwoo Lee | Mobile terminal and method of controlling the same |
US20140082554A1 (en) * | 2012-09-17 | 2014-03-20 | Samsung Electronics Co., Ltd. | Method and electronic device for displaying categories |
-
2016
- 2016-12-14 WO PCT/EP2016/081004 patent/WO2017102844A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110296351A1 (en) * | 2010-05-26 | 2011-12-01 | T-Mobile Usa, Inc. | User Interface with Z-axis Interaction and Multiple Stacks |
EP2503444A2 (en) * | 2011-03-25 | 2012-09-26 | Samsung Electronics Co., Ltd. | System and method for crossing navigation for use in an electronic terminal |
US20130024808A1 (en) * | 2011-07-21 | 2013-01-24 | Nokia Corporation | Methods, Apparatus, Computer-Readable Storage Mediums and Computer Programs |
US20130176298A1 (en) * | 2012-01-10 | 2013-07-11 | Kunwoo Lee | Mobile terminal and method of controlling the same |
US20140082554A1 (en) * | 2012-09-17 | 2014-03-20 | Samsung Electronics Co., Ltd. | Method and electronic device for displaying categories |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10102010B2 (en) | Layer-based user interface | |
JP5708644B2 (en) | Information processing terminal and control method thereof | |
JP6433915B2 (en) | User interface for computing devices | |
EP2847660B1 (en) | Device, method, and graphical user interface for selecting user interface objects | |
EP2225628B1 (en) | Method and system for moving a cursor and selecting objects on a touchscreen using a finger pointer | |
US20170329511A1 (en) | Input device, wearable terminal, mobile terminal, method of controlling input device, and control program for controlling operation of input device | |
US20100245268A1 (en) | User-friendly process for interacting with informational content on touchscreen devices | |
US9280265B2 (en) | Input control device, input control method, and input control program for controlling display target upon receiving input on display screen of display device | |
US20140096083A1 (en) | Method and electronic device for running application | |
US20130100051A1 (en) | Input control device, input control method, and input control program for controlling display target upon receiving input on display screen of display device | |
US20140306898A1 (en) | Key swipe gestures for touch sensitive ui virtual keyboard | |
EP1969450A1 (en) | Mobile device and operation method control available for using touch and drag | |
US20110283212A1 (en) | User Interface | |
US20140082555A1 (en) | Device and method for using a trackball to select items from a display | |
WO2015017174A1 (en) | Method and apparatus for generating customized menus for accessing application functionality | |
US20140071049A1 (en) | Method and apparatus for providing one-handed user interface in mobile device having touch screen | |
EP2016483A1 (en) | Multi-function key with scrolling | |
US20140143688A1 (en) | Enhanced navigation for touch-surface device | |
WO2011157527A1 (en) | Contextual hierarchical menu system on touch screens | |
US20110302534A1 (en) | Information processing apparatus, information processing method, and program | |
CN104346088A (en) | Page switching method and device | |
US9747002B2 (en) | Display apparatus and image representation method using the same | |
US20130100050A1 (en) | Input control device, input control method, and input control program for controlling display target upon receiving input on display screen of display device | |
KR101154137B1 (en) | User interface for controlling media using one finger gesture on touch pad | |
US9940001B2 (en) | Drag and release navigation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16809823 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 16809823 Country of ref document: EP Kind code of ref document: A1 |