RU2421777C2 - Improved pocket computer and associated method - Google Patents

Abstract

FIELD: information technology.

SUBSTANCE: user interface management method involves providing on a display a plurality of selected user interface elements, detecting selection of a specific element among said user interface elements, for the selected element, displaying on said display a plurality of selected and problem-oriented options, wherein each such option is associated with a defined function of a defined application, wherein at least one option is associated with a second application, and said display of a plurality of options is performed without launching said second application; detecting selection by said user of a specific option among said options, and calling the function associated with said specific option. The invention also relates to other user interface management methods for a pocket computer and a pocket computer implementing said methods.

EFFECT: high ergonomics of the pocket computer user interface and efficiency of the work of the user using the pocket computer.

25 cl, 45 dwg

Description

Technical field

The present invention generally relates to portable electronic equipment, and more particularly to a handheld computer having a graphical user interface. The invention also relates to various methods of working with a user interface.

State of the art

In recent years, handheld computers with graphical user interfaces are gaining more and more popularity. Perhaps the most common example of a handheld computer is a personal digital assistant (PDA), which can be implemented in various forms. Some handheld computers resemble portable personal computers, but in a miniature implementation, that is, they contain a graphic display and a small keyboard in the form of a special device. The graphic display is usually touch-sensitive (triggered by touch) and can be operated with a sharp pointer, such as a stylus, pen, or user's finger. Other handheld computers are more focused on using the touch screen as the main input device and, thus, do not need a keyboard in the form of a special device. Some of these handheld computers are actually mobile terminals, that is, in addition to providing features peculiar to a handheld computer, such as a calendar, word processing device and a gaming device, they can be used for voice communication, fax transmission, after connecting to a mobile communication system, sending electronic messages, browsing the Internet, etc.

It is well known that due to the markedly limited resources of handheld computers, i.e. physical dimensions, display size, processing power and input device compared to a laptop or desktop computers, solutions designed for user interfaces of a laptop or desktop computers, in general case not applicable or simply not suitable for handheld computers.

In the General case, it is desirable to improve the user interfaces for such handheld computers in order to increase user friendliness and increase the efficiency of the user using the handheld computer.

In computers in general and in handheld computers in particular, there is a need to navigate content that exceeds the size displayed on the current display. This is especially true when using a web browser application in a handheld computer, since web pages are usually designed to display on normal computer displays, which are significantly larger than displays for handheld computers.

The traditional way to solve this problem is to create horizontal and vertical scroll bars that allow the user to move the displayed content among existing content either by using the scroll keys on the scroll bar or by moving the scroll bar that indicates where the displayed content is located in the existing content. On computers with a full-sized keyboard, you can also move the cursor over the content using special direction keys, such as up, down, left, right, page up and page down, which also leads to move or scroll the highlighted content on the display.

A more intuitive way to navigate among high-volume content is to use the so-called panning, which is used, for example, in Adobe Acrobat Reader® 7.0. This method resembles a user moving a sheet of paper on a table in front of him. The user simply “drags” the content by pressing the mouse button and moving the mouse while holding down the button, and releases the mouse button when the content is in the desired position.

Another useful feature in computers is the selection of data, such as text. Once the text is selected, the user can, for example, copy it to the clipboard, and then paste it into the same or another document.

A known method for selecting data consists in “dragging” the mouse cursor over the selected text by clicking the mouse button, moving the mouse with the mouse button pressed over the selected text and releasing the mouse button as soon as the desired text is selected.

Thus, the problem is how to provide the user with the ability to pan and select data in the same document, since in both cases drag and drop is used.

The usual solution to this problem is to have different modes: one pan mode and one text selection mode. This solution is available in Adobe Acrobat Reader ® 7.0. Here, in the application area of the display, there are keys that allow the user to switch these modes. However, this method is cumbersome and inconvenient, forcing the user to constantly remember or find out which mode is currently active, whenever the user wants to perform either a text selection operation or a panning operation.

Therefore, there is a problem how to provide the user with a simple and intuitive way to select data, but different from the usual "drag and drop".

Due to the size and limited capabilities of the user interface in handheld computers, the latter generally have restrictions on the graphical user interface and the method by which it is possible to make multiple selections, in particular, of items from a list.

Two attempts to solve this problem are known.

The first option is a combination of discrete and continuous multiple selection. It works as follows: the user can perform single selections by touching the list items. If the user wants to make a discrete multiple choice, he can press the key of certain technical means and touch any items from the list that will become either selected or unselected depending on their initial state. If the user wants to make continuous multiple selections, he can do this by pressing the stylus on the display and stretching it to the desired items, which at the same time change their state; in this case, the item will be “selected” if its initial state was “not selected”, and “not selected” if the initial state was “selected”. This method allows the user to perform the drag and drop operation, but the user must be very careful not to release the pressed hardware key during the operation.

Another option applies only to continuous multiple selection. It works as follows: the user can perform single selections by touching a list item. If the user wants to make continuous multiple selections, he can do this by pressing the stylus on the display and dragging it along the desired items, which at the same time change their state to either selected or unselected according to their initial state. Discrete multiple selection in this method is not possible. This method does not allow the user to perform a drag-and-drop operation, since all pull operations with respect to the list are interpreted as selection.

Therefore, there is a need for such an invention that will allow the user to conveniently and efficiently select both single list items and discrete list items.

In graphical user interfaces with windows, such as Microsoft Windows or Mac OS X, there is often a situation where the user wants to move the active window located on top of other windows to see the content of the passive window below. The same basic need is present in all portable devices that have windowed graphical user interfaces.

On desktop computers, overlapping windows is not a big problem, because the available space on the display is large and you can simply use the mouse to drag the window to another accessible area of the display.

However, on portable devices, available display space is limited, and more often than not there is no free space where you can drag a window. In addition, in most portable devices, the window system is designed so that dialog boxes can neither be dragged nor hidden. This makes it impossible to perform some important use cases (for example, checking the phone number located in the underlying application window to enter it in the active window).

In a number of user interface designs of the Nokia 90 series, the problem of overlapping windows was solved by the fact that the user can drag dialog boxes around the display and return them to the center of the display automatically when the stylus is lifted. This approach as such works, but has two major inconveniences. Firstly, moving the dialog box adversely affects performance. Secondly, if the dialog box is too large, that is, it occupies most of the visible area of the display, dragging the window may be inconvenient for the user, because he may have to drag the window across a large part of the entire display.

In the Microsoft environment for handheld computers, the user can drag and drop dialog boxes freely using the stylus. This can lead to a situation where the user drags the dialog box out of the visible area of the display, which immediately stops further interaction with the dialog box. Therefore, the user cannot close the dialog box and is likely to be forced to restart the application, which may result in data loss.

In the Matchbox X11 portable window manager, developed by Mr. Matthew Allum (http://freshmeat.net/projects/matchbox/), in particular for the environment of a pocket personal computer, the problem is solved because the user can drag active dialogs to any place on the display.

Therefore, there is a need for an invention that allows the user to conveniently and reliably temporarily hide the currently active window.

In window-based graphical user interfaces, such as Microsoft Windows or Mac OS X, there is often a situation where the size of the visible content (such as a text document or a web page) exceeds the physical size of the display or the size of the graphical user interface window. In most cases, this is eliminated by demonstrating the scroll keys on one or more sides of the window visible on the screen, and with this key the user can scroll through the content.

The same basic need is even more evident for all portable devices that have windowed graphical user interfaces with limited available screen space.

In portable devices that use the stylus, the usual interaction required to scroll through the content, that is, pressing the scroll key with the stylus and dragging it in the horizontal or vertical directions, causes severe fatigue of the hand, since the scroll keys can be located in any place on display without providing any physical support to facilitate scrolling. In addition, in a portable device, due to the limited display space, the scroll keys are usually very small (thin), and therefore it can be difficult to access them with a stylus, especially if the portable device is used in a moving environment.

This does not allow to achieve the full ergonomics of technical means during the scrolling process and can annoy the user.

In window-based graphical user interfaces, such as Microsoft Windows or Mac OS X, the user often has a basic need to switch between running applications. The same basic need exists for portable devices that have windowed graphical user interfaces.

On desktop computers, windows can be scaled and moved using the mouse so that the underlying windows can be seen behind the active window. In addition, there are other ways on desktop computers to display running applications and switch between them. An example is the Windows and Mac OS X Dock taskbar. Another common way is to create a list of applications that can be shown in the middle of the display. The list is shown when the user presses a key combination (Alt + Tab for Windows and Linux, Cmd + Tab for Macintosh).

Most portable devices do not support multiple windows, nor do they involve closing applications. Therefore, such portable devices do not have to deal with the switching problem. Instead, devices with operating systems such as the Nokia 7710 Communicator, Symbian, PC, Microsoft Pocket PC, or Palm OS provide the user with a list of recently running applications.

The Windows CE operating system for handheld computers has a taskbar similar to that found in the Windows desktop environment. When the application is launched, its image (and name) is displayed on the taskbar. If another application is running, its image is displayed next to the previous one. If the user wants to switch to the first application, he can touch his icon on the taskbar. These icons do not change their relative position when the user switches between applications.

So, the problem of well-known technical solutions lies in the efficient and intuitive switching between running applications in a portable device such as a handheld computer.

SUMMARY OF THE INVENTION

In view of the foregoing, the purpose of the invention is to solve or at least partially solve the above and other problems and disadvantages of the known technical solutions and to improve a handheld computer.

In General, the above objectives are achieved in the methods, handheld computers and user interfaces according to the independent claims.

A first aspect of the invention relates to a method for controlling a user interface in a handheld computer, the handheld computer being adapted to execute various software applications, and each application having a plurality of functions, each function being designed to provide certain functionalities to a handheld computer user, and the method includes :

ensuring the presence on the display of said handheld computer of a plurality of selectable user interface elements, wherein each user interface element represents a specific aspect of the use of said handheld computer, and this specified specific use aspect is associated with certain functions of some applications;

detecting a selection by a specified user of a particular element among the specified user interface elements;

for a selected specific element, the presentation on the indicated display of a plurality of selectable and problem-oriented options, each such option being associated with a specific function of a certain application;

detecting a selection by a user of a particular option among the specified options; and

calling the function associated with the specified specific option.

The specified display can be touch (triggered by touch), and the user makes these selections by touching the touch display. Said selectable user interface elements are pictograms located in stationary positions on said display. Problem-oriented options can be presented as menu items. The first aspect of using said handheld computer may be viewing information, and the second aspect of using said handheld computer may be the transmission of electronic messages.

Another expression of the first aspect of the present invention is a handheld computer having a user interface that includes a display and is designed to execute various software applications, each application having many functions, and each function is designed to provide some functionality for a user of a handheld computer, while the computer is capable of implementing the method according to the first aspect of the present invention.

A second aspect of the present invention relates to a data input method for selecting data items displayed on a touch screen of a handheld computer, further comprising a writing instrument, the method comprising the following steps:

detecting the first touch of the specified writing instrument in the first position and at the first time point,

determining that data selection should be initiated by detecting a second touch of the specified writing instrument at a position that is less than a threshold distance from the specified first position within a predetermined time from the specified first time point, and

if it is determined that the data selection should be started, after detecting the movement of the specified writing instrument to the second position, the selection of data elements between the indicated first position and the specified second position.

These data elements may represent a subset of the available content, and if it is not determined that the data selection should be started, this method may include additional steps:

determining that panning should begin by detecting the fact that said writing instrument has moved after said touching of said writing instrument, and

if it is determined that the panning should be started, detecting the second position of the specified writing instrument and performing the panning operation of the indicated available content to display the data elements in a position shifted by the difference between the specified first position and the specified second position.

The specified content and data elements may belong to a web browser application running on the specified handheld computer.

Another expression for the second aspect of the present invention is a handheld computer adapted to implement the method according to the second aspect of the present invention.

Another expression of the second aspect of the present invention is an input method for panning content and selecting data items displayed on a touch screen of a handheld computer further comprising a writing instrument, said data items being a subset of available content, the method comprising the following steps:

detecting the touch of the specified writing instrument in the first position and at the first time point,

determining that panning should be initiated by detecting a second touch of the specified writing instrument at a position that is less than a threshold distance from the specified first position and within a predetermined time from the first time point,

if it is determined that the panning should be started, detecting the second position of the specified writing instrument and performing the panning operation of the indicated available content to display the data elements in a position shifted by the difference between the specified first position and the specified second position,

if it is not determined that the panning should be started, determining that the data selection should be started by detecting that said writing instrument has moved after said touching this writing instrument, and

if it is determined that a data selection should be started, after detecting the movement of the specified writing instrument to the second position, the selection of data elements between the specified first position and the specified second position.

A third aspect of the present invention relates to a handheld computer comprising a zoom key, zoom out key, a writing tool for entering data, and capable of displaying content on a display, the displayed content being a subset of the available content, wherein

the specified computer is able to zoom in on the displayed content on the specified display in response to pressing the specified zoom key,

the specified computer is capable of zooming out the displayed content on the specified display in response to pressing the specified zoom out button, and

said computer is capable of panning available content on a screen of said display in response to touching said writing instrument in a first position on said display, moving said writing instrument and lifting said writing instrument from a second position on said display.

A fourth aspect of the present invention relates to a method for navigating among hyperlinks displayed on a handheld computer display, comprising the following steps:

receiving input to move the focus to the subsequent hyperlink,

determining which hyperlink is subsequent solely on the basis of the geometrical position of said hyperlinks displayed on the indicated display, and

focus shift to the specified hyperlink, which is defined as the next one.

The subsequent hyperlink indicated may be a hyperlink located before or after any hyperlink currently in focus.

Another expression of the fourth aspect of the present invention is a handheld computer adapted to implement the method according to the fourth aspect of the invention.

A fifth aspect of the present invention relates to a method for changing the scaling factor of content displayed on a PDA display, and this method includes the following steps:

receiving input to display the menu at some target position on the specified display,

displaying the specified menu containing at least one menu item for changing the specified scaling factor,

receiving input to change the specified scaling factor by detecting a menu item with a new selected scaling factor, and

rendering said content using said new scaling factor around said target position.

Said display may be a touch-sensitive touch display, and said data entry for displaying a menu may be a press on said touchscreen for a time period exceeding a predetermined threshold value, or a double touch of said touchscreen.

The specified content may belong to a web browser application running on the specified handheld computer. The specified menu may be a context-sensitive menu.

Another expression of the fifth aspect of the present invention is a handheld computer adapted to implement the method according to the fifth aspect of the present invention.

A sixth aspect of the present invention relates to a method for viewing previously visited web pages in a web browser application running on a handheld computer containing a display, the method comprising the following steps:

visualization of the first web page on the specified display,

first data entry to change the scaling factor for the specified first web page to a new one,

visualization of the specified first web page using the specified new zoom factor,

second data entry to render the second web page,

rendering the second web page using a zoom factor different from the specified new zoom factor for the specified first web page,

a third data entry for re-rendering said first web page, and

visualization of the specified first web page using the specified new zoom factor.

The specified third input may be input for navigating "back" or "forward" on the history of the browser.

Another expression of the sixth aspect of the present invention is a handheld computer adapted to implement the method according to the sixth aspect of the present invention.

A seventh aspect of the present invention relates to a data entry method for selecting at least one item from a list in a list user interface element, said element operating in a single select mode or in a multiple separate selection mode and displayed on a touch screen of a PDA, further comprising a written tool, while the specified method includes the following steps:

determining whether the specified item is running in the specified single-select mode,

determining whether the specified item is in multiple individual selection mode,

detecting the touch of the specified writing instrument in the first position,

selection of the first item in the list corresponding to the specified first position,

detecting the first lift of the specified writing instrument in the second position, which may coincide with the specified first position,

detection of the second touch of the specified writing instrument in the third position,

if it is determined that the specified item is in single-select mode, deselecting the first item in the list, and

selection of the list item corresponding to the specified third position.

The specified element may additionally work in the range selection mode, and this method may include the following additional steps up to the indicated step of detecting the second touch:

determining whether the specified item is operating in the specified range selection mode, and

if it is determined that the specified item is in range selection mode and the specified first list item is not equal to the second list item corresponding to the specified second position, select all list items from the specified first list item to the specified second list item.

An additional step to the specified step of selecting the second list item may include:

if it is determined that the specified item is operating in the specified range selection mode, deselecting previously selected list items.

Optional steps may include:

detecting a third touch at the position corresponding to the selected list item,

detecting a third lift at a position corresponding to a second user interface element, and,

if it is found that the specified item is operating in single-selection mode or in range-selection mode, transferring data representing the selected list items to the second user interface element.

Optional steps may include:

if it is found that the indicated item is operating in multiple separate selection mode, visualization of the selection indicator next to each selected list item.

The indicated selection indicator may be a check mark.

Optional steps may include:

if it is determined that the specified item operates in multiple separate selection mode, detecting the third touch and the third lift of the specified writing instrument in the position corresponding to the previously selected list item, and deselecting the previously selected list item.

Another expression of the seventh aspect of the present invention is a handheld computer adapted to implement the method according to the seventh aspect of the present invention.

An eighth aspect of the present invention relates to a method for temporarily hiding a window including a main area displayed at a touch point of a touch screen of a handheld computer further comprising a writing instrument, said method comprising the following steps:

detection of touching the specified writing instrument in a position corresponding to the specified main area of the specified window,

hiding the content of the specified window and, thus, displaying any content previously closed by the specified window,

detecting a rise in said writing instrument, and

repeated image of the content of the specified window in the specified location.

An additional step after the specified hide step may include:

draws the outline of a rectangle denoting the specified location of the specified window.

The specified window may be a dialog box.

Another expression of the eighth aspect of the present invention is a handheld computer adapted to implement the method according to the eighth aspect of the present invention.

A ninth aspect of the present invention relates to a method for scrolling content in a window displayed on a touch screen of a handheld computer, said display additionally displaying a remote scroll element, the method comprising the following steps:

detecting the touch of a writing instrument in the first position on the specified remote scroll element,

based on the position of the specified touch, determining the direction of scrolling content,

based on this touch position, determining the scroll distance of the content, and

Scrolling the specified content by the specified distance in the specified direction to the new position.

The specified remote scroll may include a bitmap. Alternatively or additionally, the area on the specified touch screen, which lies under the specified remote scroll element, can be used to display data, for example at least one non-selectable indicator.

The specified window may include a scroll bar containing a scroll slider, and the method may include an additional step:

moving the specified scroll bar in accordance with the specified new content position.

Said remote scroll element may be located adjacent to said window and / or along one edge of said display. The specified window may be located separately from the specified remote scroll element.

Another expression of the ninth aspect of the present invention is a handheld computer adapted to implement the method according to the ninth aspect of the present invention.

A tenth aspect of the present invention relates to a method for scrolling content in a window displayed on a touch screen of a handheld computer, said display further showing a scroll bar comprising a scroll slider that moves in a recess, the method comprising the following steps:

detection of a touch of a writing instrument at a certain touch position in the specified recess,

scrolling the specified content, including updating the position of the specified scroll slider in the specified recess by moving the specified scroll slider in the specified recess,

detecting a rise in said writing instrument, and

as soon as the rise of the specified writing instrument is detected, stopping the specified scroll of content,

moreover, in the indicated scroll step, the specified scroll is performed so that the specified position of the scroll slider moves to the specified touch position in the specified recess.

The specified content scrolling step allows you to scroll content one page at a time. The indicated position may differ from the indicated scroll slider.

Another expression of the tenth aspect of the present invention is a handheld computer adapted to implement the method according to the tenth aspect of the present invention.

An eleventh aspect of the present invention relates to a graphical user interface for a handheld computer comprising a display and adapted to run various software applications, the user interface comprising an application switching panel allowing a plurality of icons to be displayed on said display, each of which is associated with a corresponding application executed in the specified handheld computer, and can be selected by the user, causing launch a sotsiirovannogo applications and icons are arranged on the panel switching applications and the order depends on the order in which the associated applications have been active before, namely, so that the icon is associated with the last active application, it occupies the first position in the application switching panel.

In addition, the graphical user interface can be adapted to insert, after starting a new application, the icon associated with the specified new application into the indicated first position on the application switching panel by moving the present icons on the application switching panel one position back.

In one embodiment of the present invention, only a predetermined maximum number of positions for icons can be placed on said application switching panel, while for an icon that is moved outside the application switching panel, the application associated with this icon can be launched by selecting a menu item on indicated display.

Another expression of the eleventh aspect of the present invention is a handheld computer having the graphical user interface described above.

A twelfth aspect of the present invention relates to a handheld computer comprising a display with a user interface and a controller, the controller being designed to execute various service applications, each service application providing the user with some nominal functionality in the specified user interface when executed as an active application, the handheld the computer has a basic application designed for simultaneous submission to a decree a display of a plurality of restricted application windows for respective applications from said service applications, each such limited application window allowing the user to access a limited part of the nominal functionality of the corresponding service application without executing this service application as an active application.

A thirteenth aspect of the present invention relates to a handheld computer, comprising:

device body;

a touch screen available on a first side surface of said device body;

at least one key for viewing content displayed on the specified display; and

at least one key for zooming the content displayed on the specified display,

moreover, one of the specified at least one key for navigation and the specified at least one key for zooming is located on the specified first side surface of the specified housing of the device, while the other of the specified at least one key for navigation and the specified at least one key for zooming, it is located on the second side surface of the specified case of the device, not parallel to the specified first side surface, while the location of these keys is such that both keys cha are within the reach of the hands of an ordinary user holding the device casing with one hand and not shifting the grip.

A fourteenth aspect of the present invention relates to a method for displaying previously visited hypermedia pages using a hypermedia browser application executed in a mobile terminal containing a display, the method comprising the following steps:

visualization of the first page of hypermedia on the specified display,

first data input to modify the visualization of the specified first page of hypermedia according to the first new content display mode,

rendering the specified first page of hypermedia according to the specified first new content display mode,

second data entry to render the second page of hypermedia,

visualization of the second page of hypermedia,

a third data entry for re-visualizing the specified first page of hypermedia and

rendering the specified first page of hypermedia according to the specified first new content display mode.

This provides a method in which modifications made by the user for the content display mode are saved, which reduces the need for re-modification of the display of content on the page when the page is visited again.

The specified content display mode may include a scaling factor. Said content display mode may further include a frame display mode. The specified content display mode may further include a mode in which the text of the specified first page of hypermedia is selected. Said content display mode may further include a page layout mode. Saving one or a combination of these specific modes for the content of the browsing history provides the user with the best viewing quality.

The specified step of rendering the second page of hypermedia may include rendering of the specified second page of hypermedia according to the specified first new content display mode.

Preferably, this will allow a situation in which any modification of the content presentation mode made by the user to become the default mode when moving to another page.

After the indicated step of visualizing the second page of hypermedia and before the indicated step of the third data entry, the method may include the following additional steps:

a fourth data entry for modifying a visualization of said second hypermedia page according to a second new content display mode, and

rendering the specified second page of hypermedia according to the specified second new content display mode.

In other words, modifications to the content display modes for subsequent pages are possible without affecting the content display modes stored in conjunction with history change elements.

The specified third input may be an input for navigating backward through the browser history.

The specified third input may be an input for navigating "forward in the browser history.

These hypermedia pages can represent at least one type of content selected from the following group: html content (in the Hypertext Markup Language, Hypertext Mark-up Language), wml content (in the Markup Language, Wireless Markup Language), sgml content (in the standard language generalized markup language, Standard Generalized Markup Language) and xml content (in extensible markup language, Extensible Markup Language).

A second expression of the fourteenth aspect of the present invention is a mobile communication terminal capable of executing a hypermedia browser application, wherein the hypermedia browser application renders the hypermedia pages on a display of said mobile communication terminal, and this mobile communication terminal comprises:

means for visualizing on the specified display the first page of hypermedia,

means for first inputting data intended to modify the visualization of the specified first page of hypermedia according to the first new content display mode,

means for rendering said first hypermedia page according to said first new content display mode,

means for the second input of data intended for visualization of the second page of hypermedia,

means for visualizing the second page of hypermedia,

means for the third input of data intended for re-visualization of the specified first page of hypermedia, and

means for rendering said first hypermedia page according to said first new content display mode.

The result is the creation of a terminal for mobile communication, in which user modifications of the content display modes are saved, which reduces the need for re-modification of the content display when you visit the specified page again.

The third expression of the fourteenth aspect of the present invention is a computer program product directly loaded into the memory of a digital computer and including portions of codes for implementing the method according to the first expression of the fourteenth aspect of the present invention. As a result, a computer software product is created in which user modifications of the content display modes are saved, which reduces the need for re-modification of the content display when the user visits the specified page again.

These first and second hypermedia pages are preferably, but not necessarily, web pages (www) and / or wap pages, i.e. digital content expressed in html or wml language, suitable for working with web and / or wap the browser. Other markup languages can be used to represent digital content, such as sgml, xml, or any other suitable markup language. The term "page" refers to digital content, at least a portion of which is displayed on a display viewed by a user.

Throughout this document, the term “writing instrument” refers to an object used to enter on a touch screen not only in the form of a letter (for example, in the form of characters and text), but also in the form of control actions, for example, pointing, touching (“click "), clicking and dragging. Thus, a “writing instrument” can be a stylus, pen, finger of a user, or any other physical object suitable for interacting with a touch screen.

A fifteenth aspect of the present invention relates to a portable electronic device, comprising: a device body; a touch screen located on the first side surface of the device for use with a writing tool for data entry; a zoom key located on the second side surface, wherein the second side surface is not parallel to the first side surface; a zoom out key located on the second side surface; and a controller, wherein: a portable electronic device is capable of displaying content on a touch screen, wherein the displayed content is a subset of the available content; the controller is designed to zoom in on the displayed content on the touch screen in response to activating the zoom key; the controller is designed to reduce the scale of the displayed content on the touch screen in response to the activation of the zoom out key; and the controller is for panning the available content on the touch screen in response to a combination of touching the writing instrument in a first position on the touch screen and moving the writing tool to a second position on the touch screen.

Available content may be associated with a web browser application in a portable electronic device.

The portable electronic device may be a handheld computer.

The portable electronic device may be a device selected from the group including a mobile communication terminal, a portable gaming device, and a personal digital assistant.

A second expression of the fifteenth aspect of the present invention is a method for operating a user interface in a portable electronic device comprising a device body, a controller, a touch screen located on a first side surface of the device body for use with a writing tool for data input; a zoom key located on the second side surface, wherein the second side surface is not parallel to the first side surface; a zoom out key located on the second side surface; moreover, the controller is capable of displaying content on a touch screen, and the displayed content is a subset of the available content; the method includes: zooming out the content on the touch screen in response to activating the zoom key, zooming out the content on the touch screen in response to the zooming key, and panning the available content on the touch screen in response to a combination of touching the writing tool in the first position on the touch screen and moving the writing tool to the second position on the touch screen.

The third expression of the fifteenth aspect of the present invention is a computer program product directly loaded into the memory of a portable electronic device and including portions of codes for implementing the method according to the second expression of the fifteenth aspect of the present invention.

A sixteenth aspect of the present invention relates to a portable electronic device, comprising: a device body; a touch screen located on the first side surface of the device; a first input device driven by a first finger of a typical user; a second input device driven by a second finger of a typical user, which allows a typical user to control at least the first input device and the second input device without changing the capture; and a controller associated with the touch screen, wherein the first input device, the second input device, and the controller display content on the touch screen; wherein the controller is capable of influencing the display of content on the touch screen in the first way when the first input device is activated, and affecting the display of content on the touch screen in the second way when the second input device is activated.

The controller may be able to move content on the touch screen when the first input device is activated, and change the zoom ratio of the content when the second input device is activated.

The first input device and the second input device may be adapted to hold the portable electronic device with the hand of a typical user.

The first input device may be a key located on the first side surface of the device body, and the second input device may be located on the second side surface of the device body not parallel to the first side surface.

The first input device may be operated by the thumb of a typical user, the first input device being located at least at a threshold distance from the edge of the first side, which is the edge of the first side closest to the place where the thumb is connected to the rest of the hand .

The second side surface may be substantially perpendicular to the first side surface.

When a touch has been detected by the writing tool on the touch screen, the controller may affect the display of content on the touch screen in a third way.

The third method can be selected from the group including panning, text selection, and activating a user interface element to display new content.

The portable electronic device may be a handheld computer.

The portable electronic device may be selected from the group including a mobile communication terminal, a portable gaming device, and a personal digital assistant.

The second expression of the sixteenth aspect of the invention is a method of operating a user interface in a portable electronic device comprising a device body and a touch screen located on a first side surface of the device body, the method including: first inputting data detected by the first input device when the first input device is brought into action with the first finger of the user's hand; as a reaction to the first data entry - the effect on the display of content on the touch screen in the first way; a second data input detected by the second input device when the second input device is powered by the second finger of the user's hand; and in response to the second data input, the effect on the display of content on the touch screen in a second way.

The first data entry and the second data entry can be performed by the user without an intermediate hand interception.

The first method may relate to moving content, and the second method may relate to scaling the display of content.

Furthermore, the user interface operation method may include a third data input detected by the touch screen when the user actuates the third input device with a writing tool; and in response to a third data input, the effect of displaying content on a touch screen in a third way.

The third method can be selected from the group including panning, text selection, and activating a user interface element to display new content.

A third expression of the sixteenth aspect of the present invention is a computer program product directly loaded into the memory of a portable electronic device and including portions of codes for implementing the method according to the second expression of the sixteenth aspect of the present invention.

In the General case, each of the methods according to the aspects of the invention listed in this document can be implemented using the appropriate computer program product, that is, a computer program product directly loaded into the memory of a digital computer and including portions of codes intended for implementing the method in question.

Used in the present description, the term "handheld computer" refers to a small portable device with limited resources, for example in terms of display size, processing power and input means. In one embodiment of the present invention, the handheld computer is a mobile terminal, in particular for viewing and transmitting electronic messages.

Other objectives, features and advantages of the present invention will become apparent from its subsequent detailed disclosure, claims and drawings.

Brief Description of the Drawings

Embodiments of the present invention are described in detail below with respect to various aspects of the invention and with reference to the accompanying drawings.

Figure 1 shows a perspective view of a handheld computer according to one embodiment of the present invention in a typical operating position in the hands of the user.

Figure 2 and 3 show other perspective views of the handheld computer shown in figure 1,

Figure 4 illustrates a computer network in which the handheld computer shown in figures 1-3, can preferably be used to provide wireless user access to network resources and remote services.

Figure 5 shows a block diagram of a handheld computer depicted in the previous drawing.

6 shows a front view of a handheld computer and shows a typical arrangement of a display screen and user interface.

7 illustrates a typical arrangement of the display screen, including the original image.

On Fig-12 illustrates a problem-oriented approach when working with the user interface, and also shows the image on the display screen for some typical applications running in a handheld computer.

On Fig-14 illustrates the image on the screen during operation of the application "bookmark manager".

FIGS. 15A and 15B illustrate how a user can pan content in one embodiment of an aspect of the present invention.

16A and 16B illustrate how a user can select text in one embodiment of an aspect of the present invention.

17A and 17B illustrate how a user can zoom in and out on text in one embodiment of an aspect of the present invention.

FIG. 18 is a flowchart illustrating a method for selecting data in one embodiment of an aspect of the present invention.

FIG. 19 is a flowchart illustrating both a data selection method and a panning method in one embodiment of an aspect of the present invention.

FIG. 20 shows a state diagram for one embodiment of an aspect of the present invention, allowing both data selection and panning.

21 illustrates a web browser and shows hyperlinked content.

22A and 22B illustrate one embodiment of an aspect of the present invention before and after local scaling.

23 illustrates new content downloaded to a web browser.

24 is a flowchart illustrating a method for operating a list item in accordance with one aspect of the present invention.

25 is a flowchart illustrating a drag-and-drop operation for list items in accordance with one aspect of the present invention.

26A-C illustrate a list item among other user interface elements.

On figa and 27B illustrates the operation of the method of hiding a window according to one aspect of the present invention.

On figa and 28B illustrates a remote scroll element according to one aspect of the present invention.

29A, 29B, 29C, and 29D illustrate various settings for a content display mode, which is a frame display mode and a page layout mode in one embodiment of the present invention.

On figa and 30B shows a display when displaying the browser hypermedia in the form of a web browser that renders the first web page in two different modes of displaying content, in this case related to the change in zoom.

FIGS. 31A and 31B show a display image of a web browser displaying a second web page in two different content display modes that differ in scaling factors and page layout mode.

FIG. 32 shows an example of a data table including historical data according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

A handheld computer 1 according to an illustrated embodiment of the present invention includes a device body 2 and a large touch screen 3 located on the surface of the front side 2 _f of the device body 2. Near the display 3, there are many hardware keys 5a-d, as well as a speaker 6.

More specifically, the key 5a is a navigation key with five degrees of freedom, that is, a key that can be pressed in four different extreme positions to navigate in the corresponding orthogonal directions ("up", "down", "left", "right") among the information shown on display 3, and can also be pressed in the center position to select among the information displayed on display 3. Key 5b is the cancel key, key 5c is the menu or option key, and key 5d is the reset key (Note) .

In addition, on the surface of the first short side 2 _u of the device body 2, there is a second plurality of hardware keys 4a-c. Key 4a is the power on / off key, key 4b is the zoom in / out key, and key 4c is for switching between full screen and normal screen size on display 3.

On the surface of the second short side 2 ₁ of the device body 2, opposite the specified first short side 2 _u , there is a connector 7a for connecting audio headphones, a main connector 7b for power supply and a wired data interface 7c in the form of a USB serial port (Universal Serial Bus, universal serial tire).

The touch screen 3 acts both as a visual output device 52 and as an input device 33, both of which are part of the user interface 51 for user 9 (see FIG. 5). More specifically, as shown in FIG. 1, a user 9 can control a handheld computer 1 by touching / clicking / dragging a stylus 9 held in one hand 9a on the surface of the touch screen 3 and / or by performing any action with hardware 4a-c 5a-d (which are also part of the input device in the user interface 51) with the thumb and forefinger of the other hand 9b. In one embodiment of the present invention, some keys 5a-d are mounted substantially parallel to the touch screen 3 and can be easily reached with the thumb, as seen in FIG. In addition, the thumb acts as a support, allowing the user to easily hold the PDA in one hand 9b. The distance between the keys 5a-d and the edge closest to the place where the thumb connects to the rest of the hand 9b is large enough to allow the user to place the thumb as a support without actuating any of the keys 5a-d as possible see in figure 1. Alternatively, if this distance is very small, the keys 5a-d may be placed so that the user can place the thumb somewhere near the keys 5a-d for support. The position of the thumb on the front side 2 _f increases stability when holding the PDA in one hand 9b. Moreover, some keys 4a-c are located on the first short side 2 _u and can be easily reached with the index finger, as can be seen in figure 1.

In other words, the hardware keys are arranged so that they can be actuated with the fingers of the hand of the user who is holding the PDA 1, while the other hand can be used for manipulation with the stylus 9c on the touch screen 3.

In addition, the hardware keys 4a-c, 5a-d, which are reachable with one hand 9b, are sufficient for the user to perform all typical actions. For example, when working in a browser, the navigation key 5a allows the user to navigate the page, and the zoom key 4b allows the user to change the zoom factor. The functionality of the other keys 4a, 4c, 5b-d is described in more detail elsewhere in this document.

Although such a key arrangement is described in an embodiment of the present invention for a handheld computer for ease of presentation, it can equally be used in personal digital assistants (PDAs), mobile terminals, handheld gaming devices, or any suitable handheld electronic device with a touch screen.

As can be seen in FIG. 5, the handheld computer 1 also has a controller 50 with connected memory 54. The controller is responsible for the entire operation of the handheld computer 1 and can be implemented using any commercially available central processing unit (CPU, Central Processing Unit), a digital signal processor (DSP, Digital Signal Processor) or any other electronic programmable logic device. The connected memory may be internal and / or external to the controller 50 and may be a random access memory (RAM, Random Access Memory), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM , Electrically Erasable Programmable Read-Only Memory), flash memory, hard drive, or any combination thereof.

The memory 54 is used by the controller 50 for various purposes, one of which is the storage of data and program instructions for various pieces of software in a handheld computer 1. The software may include a real-time operating system, drivers, for example, for the user interface 51, and also various applications 57.

Many, if not all, of these applications interact with the user 9 and receive input from him, for example, text entered by the input device 53, and provide output to the user, for example, visual output in the form of text and graphic information displayed on the display 52. Non-limiting examples of such applications are the following: Internet / WWW / WAP browser, contact application, transmitter (e-mail, SMS, MMS), calendar, organizer, video games, calculator, sound alert omitel, alarm clock, text processor, spreadsheet organizer, encoder records, music player, media playback device and a control flow. Some applications are described in more detail below. The graphical user interface (GUI) unit 56 in the user interface 51 controls the interaction between the applications 57, the user 9, and the user interface elements 52, 53.

Entering text into a handheld computer 1 can be performed in different ways. One way is to use the virtual keyboard shown on the display. By clicking on the individual keys or keys of the virtual keyboard with the stylus 9c, the user 9 can enter consecutive characters that are combined into the input text displayed in the text input area on the display. Another way is to enter handwritten text on the touch screen using stylus 9c and a handwriting recognition program. There may be a word prediction / completion function.

For portable use, the Pocket PC 1 has a rechargeable battery.

In addition, the handheld computer has at least one interface 55 for wireless access to network resources for at least one digital network. More detailed examples of such access are given in FIG. Here, the PDA 1 can connect to a data network 32 by establishing a wireless line through a network access point 30, such as a wireless local area network (WLAN) router. The data network 32 may be a wide area network (WAN), for example, the Internet or some part thereof, a local area network (LAN, Local Area Network), etc. A plurality of network resources 40-44 may be associated with the data network 32, which are thus accessible to the user 9 via the handheld computer 1. For example, network resources may include servers 40 with associated content 42, for example www data, wap data, ftp data, email data, audio data, video data, etc. Network resources may also include other end-user devices 44, such as personal computers.

The second digital network 26 is shown in FIG. 4 as a mobile communication network compatible with any existing mobile communication standard, such as GSM, UMTS, D-AMPS or CDMA2000. In the shown embodiment of the present invention, the user 9 can access the network resources 28 of the mobile communication network 26 by means of the handheld computer 1 by establishing a wireless communication line 10b with the mobile terminal 20, which, in turn, has effective access to the mobile communication network 26 via wireless communication lines 22 and to base station 24, which is well known in the art. Wireless lines 10a, 10b may, for example, be compatible with the Bluetooth ™ standard, WLAN (Wireless LAN), for example, as defined in IEEE 802.11), HomeRF, or HIPERLAN. Thus, the interface (s) 55 contains all the hardware and software necessary to establish such communication lines, which is obvious to experts in this field of technology.

6 shows a front view of a handheld computer and shows a typical structure of a display screen and user interface. In more detail, a typical structure of the display screen, which shows the operation of the initial (home) application (that is, the initial or basic view to which the user can return as desired at any time), is shown in Fig.7. 6, the hardware keys 5a-d are shown at their actual location to the left of the display 3 on the front side surface 2 _f of the device body 2, while for clarity, the hardware keys 4a-c are shown above the display 3 on the front side surface 2 _f even despite the fact that they are actually located on the above first short side surface 2 _u (Fig.2).

7, the display screen 3 is divided into four main areas: a task navigator 60, a title area 70, a status indicator area 74, and an application area 80.

The application area 80 is used by the currently active application to present any relevant information (content) and to provide user interface controls such as push buttons, scrollable scroll boxes, control windows, selection buttons, hyperlinks, etc. that allow the user to interact with currently active application with the stylus 9c. One example of how the currently active web browser application uses the application area 80 is shown in FIG. 9. The name or other short description of the currently active application (for example, a web browser), and the current file or data item (for example, the current web page) is displayed 72 in the title area 70 (for example, "Web-Nokia"). In addition, as can be seen in FIG. 10, by tapping in the name area 70, the user can access the application menu 73 of the currently active application.

The status indicator area 74 contains a plurality of icons 76 that provide information about events in the system and its status that are usually not associated with any particular active application. As can be seen in Fig. 7, the icons 76 may include a battery charge indicator, a display brightness control, a volume control, as well as icons that relate to the network interface (s) 55 and the methods by which the handheld computer connects to the network (s) 32, 26.

The task navigator 60, the name region 70 and the status indicator region 74 always remain on the screen in the corresponding positions, unless a command to switch to full-screen mode has been issued by pressing the hardware key 4c. In this case, the currently active application will use the entire display area 3 for the application area 80, while the areas 60, 70 and 74 will be hidden.

The task navigator 60 has an upper part 62 and a lower part 66. The upper part 62 contains icons 63-65, which, when selected, open a problem-oriented context-sensitive menu 90 to the right of the selected icon (see Fig. 8, Fig. 11). The context-sensitive menu 90 contains many problem-oriented menu items 91, and the user can navigate among these menu items and select the desired item either with the navigation key 5a or by touching the display 3. Menu 90 may be hierarchical. The lower portion 66 is an application switcher panel with corresponding icons 61 for each of the plurality of running applications.

The upper part 62 of the task navigator 60 is described in detail below. The topmost icon 63 is used to access tasks related to viewing information. Available tasks are presented as menu items 91 in menu 90, as seen in FIG. More specifically, user 9 can choose between opening a new browser window (FIG. 9) or working with bookmarks. Selecting any of these menu items 91 leads to the launch of the associated application (the browser application shown in Fig. 9 or the bookmark manager, as shown in Figs. 13-14) or to switching to such an application if it is already among the active ones. , and also to request appropriate functionality. In addition, menu 90 contains a set of direct links 92 to specific web pages. In the disclosed embodiment of the present invention, this set includes bookmarks defined by the user 9 in advance, but in other embodiments of the present invention, it may include websites visited during the last session.

The second icon 64 is used to access tasks related to the transmission of electronic messages, as shown in FIGS. 11 and 12.

Thus, the icons 63 and 64 allow the user 9 to control the handheld computer as part of a problem-oriented approach. By simply clicking on the desired icon, which is a normal aspect of use, the user, instead of the usual list of available applications as such, receives a list of various tasks that can be performed for this aspect of use. This facilitates the management of the PDA 1, since the typical user 9 is most often focused on managing tasks, rather than applications. For example, if the user understands that he should exchange information with someone, it is more natural to click on the icon 64, which relates to this aspect of use (namely, the transmission of electronic messages) and have 90 in the selected menu (Fig. 11) various tasks available 91 than navigating in the normal application menu (or clicking on one of the group of quick access icons representing the corresponding applications), decide which application is better than others, select this application and run it, then We call up the application menu of the running application and navigate in this application menu in order to finally reach the corresponding menu item, which will lead to the implementation of what the user needed from the very beginning. If, for example, the user needs a new message for e-mail, he can simply click on the icon 64, as shown in Fig. 11, and immediately select the second menu item 93 shown in the problem-oriented menu 90, after which it will automatically start / open an email sending application and corresponding functionality was requested with opening dialog boxes for creating a new email message 72, as shown in FIG.

Selecting the third image 65 will lead to the display of the menu 90 with links to other available tasks, for example, various applications 57 that are not related to viewing information or transmitting electronic messages.

Since the pictograms 63-65 represent aspects of use that are likely to be often needed by the user 9, they remain at the top 62 of the task navigator 60 all the time and are therefore always available.

The lower part 66 of the task navigator 60 is described in detail below. As mentioned above, it is an application switch panel with corresponding icons 67 for each of the many launched, that is, working, applications that are executed by the controller 50.

Among these running applications, each is active in the sense that it controls an area of 80 applications on display 3.

User 9 can conveniently use the application switch panel 66 to switch to the desired application by touching the corresponding icon 67 with the stylus 9c. Help text, preferably containing the application name, current file name, etc., if any, can be displayed 3 next to the selectable icon, prompting the user for further actions. When the user lifts the stylus 9c, there is a transition to the application corresponding to the selected icon.

In contrast to the icons 63-65 in the upper part 62, the icons 67 in the application switching panel 66 are dynamic; icons can change their order of appearance, appear and disappear with time. More specifically, in the disclosed embodiment of the present invention, a maximum of four different running applications can be represented by corresponding icons 67 on the application switching panel 66. The order of the icons 67 is such that the icon for the last active application will be shown at the very top, while the icon for the application that was actively the last but one will be shown one position lower, etc.

It often turns out that it is the last active application, represented by the topmost icon, that controls the area of 80 applications. This is shown, for example, in FIG. 11 (the uppermost icon 67a containing the browser symbol represents the currently active web browser application). In this case, the uppermost icon 67a is shown “pressed”, as again seen in FIG. 11. However, when the original (home, Home) application is currently active, then, as can be seen in FIG. 6, none of the icons 67 represents the current active application, and therefore, none of the icons are shown pressed.

As follows from the above, the vertical order from top to bottom for the icons on the application switcher represents the background to the order in which the four applications used by the latter were active. When the switch is transferred from the currently active application to another, the order of the icons will be updated accordingly. This is shown in FIGS. 11 and 12. In FIG. 11, the web browser application is active and thus represented by the topmost icon 67a. The second icon 67b represents the audio player application that was active before the web browser application was launched, while the third and fourth icons 67c and 67d represent the icon of the file manager application and the icon of the image viewer, respectively, which were active even earlier.

Now, when user 9 calls up the messaging application by selecting menu item 93 in the previously described problem-oriented menu 90, the messaging application becomes active and its icon occupies the highest position 67a, as shown in FIG. 12. At the same time, the existing icons 67a-c in FIG. 11 are shifted one position down vertically, so that the web browser icon (previously at position 67a) occupies the second position 67b, the audio player icon moves to the third position 67c, and the file manager icon goes to the lowest position 67d. The previously visible “image viewer” icon disappears from the application switching panel 66, but the “image viewer” application itself is still working.

When you touch the menu key 68 of the application selector (or the "more" key), the application selector menu appears in the pop-up window of display 3. This application selector menu contains menu items for all running applications, including four new ones, which are also represented by icons 67a-d in the application switching panel 66, as well as older applications whose icons have been removed from the application switching panel 66 (for example, the " viewing images "in the above example). Selecting any desired menu item in the application switch menu, user 9 forces the switch to switch to the corresponding application. The application switcher menu may also include a menu item for the original (Nome) application, as well as certain relevant application management commands, such as “close all applications”.

If the user closes the active application, the topmost icon 67a will be removed from the application switching panel 66, and the rest of the icons 67b-d will be moved up one position in the panel. This will switch to the application whose icon has now taken the highest position.

Some aspects of the present invention relate to the drag and drop function, as described in more detail in subsequent sections of this document. But it should be noted already here that the taskbar panel 66 is particularly well suited for use with drag-and-drop functionality. Thus, when using the stylus 9c, the user 9 can select the content presented in the application area 80 for the first application that is currently active and drag the selected content to the desired icon 67 in the application switching panel 66. This will activate the associated second application, which will take control of the application area 80 and replace the first application in place of the currently active application. Then, the user can continue and drag the stylus to the desired input area of this second application in the application area 80, and finally raise the stylus 9c, while the selected content of the first application will be transferred to the second application.

The details and functionality of the above application switching panel 66 make switching between applications both quick and intuitive, as well as clearly informing the user about the applications that are currently running and the order in which they were launched.

The source (home, home) application 72 in FIG. 7 is described in more detail below. As a rule, the initial application starts at the start of the operation of the pocket computer 1. During the subsequent use of the pocket computer 1, regardless of the fact that another application is currently active, user 9 can always return to the original application by pressing key 5d of the source application on the front surface 2f enclosures 2 devices. Another way to call the source application is to use the application switch menu key 68, as described above.

As shown in FIG. 7, in this embodiment of the present invention, the initial application includes three application windows 82, 83 and 84 on the display 3. Each application window is a reduced version of the application window of another application 57. Thus, among other functionalities, nominally given such other application 57, the application window in the original application will provide access only to limited parts of it. For example, application window 82 of FIG. 7 is a news application (eg, Usenet network news), and provides a limited window for this application, highlighting the number of unread messages along with several of the most recent messages. Touching any of these most recent messages will display the content of the message in question. If the user wants to access the full functionality of the news application, he can go to this application, for example, using the application switch menu key 68 (as described above) or the others icon 65 at the top 62 of the task navigator 60. In another embodiment of the present invention, touching a message in application window 82 may directly trigger a launch (if the application is not already running) or a switch to the news application.

Application window 83 represents the Internet Radio application and demonstrates some of its capabilities. By touching the "Manage" key, the user can call up the actual Internet Radio application to gain access to all its functionalities. Application window 84 corresponds to the Clock application.

The interaction between such a limited application window 82, 83, 84 and the actual application that corresponds to it, can be carried out using the “push” technique, as is obvious to those skilled in the art.

In one embodiment of the present invention, the user can decide for himself which application windows to include in the original application, and set some of its properties.

Using only limited resources in terms of memory, CPU utilization, and display screen space, the original application provides user 9 with a very convenient overview of some applications that he is likely to access frequently.

The bookmark manager 72 mentioned above is described in more detail below. As can be seen in FIGS. 13 and 14, the bookmark manager divides the application area into three parts 510, 520 and 530. Part 510 is a storage hierarchy window that shows the current folder structure 512 for bookmarks in Pocket PC 1. User 9 can select any of these folders, touching it with the stylus 9c, the contents of this folder will open in the second part 520, which stores a list of 522 all bookmarks in the current folder 512. User 9 can also create or delete such folders by touching the corresponding icon 532b, 532e in the third part 530.

When you touch the desired bookmark 522, the web browser application starts and the web page specified by this bookmark opens. In addition, by touching the control window 524 located to the right of each bookmark 522, the user can select one or more bookmarks 522. For such a selected bookmark (s), further operations can be selected, for example, by touching the bookmark editing icon 532a, the bookmark icon 532e or the icon 532c moving bookmarks. If the bookmark moving icon 532c is pressed, the “Move to folder] dialog box 540 will appear, as shown in FIG.

Thus, the “bookmark manager” provides the user 9c with many options for conveniently managing the selection of bookmarks.

Whenever the terms “pressing” and “lifting” are used in the present description, it should be understood that these actions can be carried out using the stylus 9c with respect to the touch screen 3, with a mouse, trackball (ball trackball) or any other device for operation with a pointer.

FIGS. 15A and 15B illustrate how a user can pan content in an embodiment of one aspect of the present invention. The content 302 or data available for display exceeds the window 301 that the handheld computer 1 can physically provide. As is well known to specialists in this field of technology, in this case, a window 301 shows a subset of the content 302 that can fit into the space defined by the display window 301.

As shown in FIG. 15A, to pan the content, the user presses the stylus 9c on the screen at the first position 303 and, while holding the stylus 9c pressed, moves the stylus 9c to the second position 304, in which he lifts the stylus 9c. This leads to the movement of content according to the movement of the stylus 9c. So, in this example, since the stylus moves to the left, the available content below it moves to the left, creating a resultant window 301, as seen in Fig. 15B. In other words, panning can be done by touching and dragging.

FIGS. 16A and 16B illustrate how a user can select text in embodiments of one aspect of the present invention. As in the situation discussed in connection with FIGS. 15A and 15B, the content 302 or data available for display exceeds the window 301 that the palmtop 1 can physically provide. As is known to those skilled in the art, in this case, a portion of the content 302 that can fit into the space defined by the display window 301 is displayed in the window 301.

To select a part of the displayed data, the user double-tapes at the first position 305 and, holding the stylus 9c pressed after the second touch, moves the stylus 9c to the second position 306, where he lifts the stylus 9c. In other words, the user lowers the stylus 9c, raises the stylus 9c, secondarily lowers the stylus 9c, moves the stylus 9c, and finally lifts the stylus 9c.

As is well known to those skilled in the art, a threshold time can be used for a double touch, that is, in order for a touch to be considered double, it is necessary that the time difference between the first press and the second press is less than the threshold time.

In addition, it is known that in order for a touch to be considered double, it is necessary that the spatial displacement between the first press and the second press is less than the specific threshold distance. That is, data selection is performed using double-click and drag.

The above data selection method is different from conventional data selection methods. The most common way to select data is to press the stylus 9c, move the stylus 9c, and raise the stylus 9c. However, as explained above in the discussion of FIGS. 15A and 15B, this method is used to pan content.

Therefore, using the new data selection method according to this aspect of the present invention, the user can select text or pan as desired, and the user is not required to switch to a specific text or pan mode.

In addition, it should be noted that within this aspect of the present invention is the implementation of panning using double-tap and drag, and the selection of data using one-touch and drag.

17A and 17B illustrate how a user can zoom in or out on a text in one aspect of the present invention.

On figa displays the initial state in which the window 301 displays the content, which is a subset of the available content 302. The user presses the zoom key 4b, after which the image on the display is updated with zooms for the available content, as shown in figv. Due to the enlargement of the selected data elements, for example text, when zooming in, less content is displayed on the display than before.

Similarly, if the initial state is as shown in FIG. 16B, and the user presses the zoom out button 4b, the image on the display is updated with the zoom out of the available content, for example as shown in FIG. 17A. Therefore, when zooming out, more data items, such as text, will appear on the display. You can use any input type that is suitable for the user to zoom in and out. For example, you can use the jog dial, in which two directions of rotation correspond to the increase or decrease of scale, respectively. Similarly, you can use the navigation key or joystick with 4-5 degrees of freedom. Alternatively, separate input devices can be used to zoom in or out, for example, the zoom key and the zoom key described above.

The above zoom function is particularly useful in combination with the pan function described above in the discussion of FIG. This combination provides the user with an exceptionally effective way of navigating content that is larger than the physical display, which is often the case, for example, when using a web browser.

Although such a combination of zooming and panning is described in an embodiment of a handheld computer, it can equally well be used in personal digital assistants (PDAs), mobile terminals, handheld gaming devices, or in any suitable handheld electronic device with a touch screen.

18 is a flowchart illustrating a data selection method in an embodiment of one aspect of the present invention. In this embodiment of the present invention, the method is implemented as instructions in program codes executed on the handheld computer 1. In this method, a plurality of data elements for available content 302 are displayed in a display window 301, the data elements being, for example, text and / or images. However, the display can display any data items that can be displayed.

In a first touch detection step 331, the PDA 1 detects a touch of the touch screen of the PDA 1 by means of a stylus 9c.

In step 332, with the conditional jump "start data selection?" determine whether to start data selection. If a second touch of the stylus 9c is detected, which, in combination with the touch detected in the first step 331, forms a double touch, it is determined that data selection should be started. However, the time difference between the first and second touches must be less than a predetermined time. This predetermined time is preferably set by the user. In addition, the position of the second touch should be located from the position of the first touch at a distance less than a certain threshold distance. The use of such a relative threshold distance is preferable to the requirement of a coincidence of positions, since it is very likely that the second touch in the alleged double touch by the user will actually be not in the same position as the first touch.

If it is determined in the previous step, this should start the data selection, the method proceeds to the selection of data elements corresponding to the move step 333. Any movement after a second touch is detected, provided that the stylus 9c is still pressed, and the current position of the stylus 9c is determined. Then it can be determined that all data elements between the first touch position and the current position of the stylus 9c are selected by the user. This information is updated in the memory 54 of the PDA 1 for further processing, and is also displayed on the display 3. As soon as the user lifts the stylus 9c from the display, the selection is considered made, and the procedure for this method is completed.

If it is not determined at the start of the data selection in step 332 that the data selection should be started, the procedure for this method is completed.

If the selection of data elements is made, the user, as is well known to specialists in this field of technology, can perform various tasks associated with the selected data elements. For example, a user can copy selected data items to a clipboard and paste these data items into the same or different document. Alternatively, if the selected data items are text, the selected text can be formatted in various ways.

FIG. 19 is a flowchart illustrating a method of both selecting data and panning in an embodiment of one aspect of the present invention. In this embodiment of the present invention, the method is implemented as instructions in program codes executed in a handheld computer 1. In this method, a plurality of data elements for available content 302 are displayed in a display window 301, the data elements being, for example, text and / or images. This method is essentially an extension of the method illustrated in FIG.

Touch detection step 331, data selection start step 332, and selected data items corresponding to move step 333 in this embodiment of the present invention are identical to those described in the embodiment of the present invention illustrated in FIG. 18.

However, in this embodiment of the present invention, if it is determined in step 332 to start the data selection that the data selection should not be started, the procedure proceeds to step 334 with the conditional transition "start panning". At step 334, the start of panning determines whether to begin panning. If it is detected that the stylus 9c used in step 331 of detecting a touch is still pressed and moved with respect to a first position detected in step 331 of detecting a touch, it is determined that panning should be started. Perhaps it should be envisaged that the movement relative to the first position exceeds a certain threshold distance in order to avoid unintentional panning.

If it is determined at the start of panning step 334 that the panning should be started, the process proceeds to the content panning corresponding to the move step 335. While the stylus 9c is still pressed at this step, the content on the display moves according to the movement of the stylus 9c. For example, if the stylus 9c moves to the left, the below accessible content moves to the left, as seen in FIGS. 15A and 15B, where FIG. 15A shows a window 301 before moving the stylus 9c to the left, and FIG. 15B shows a window 301 after stylus 9c is already moved to the left. This is a classic way to implement panning. However, since it may be preferable that the window rather than the content move in the same direction as the stylus 9c, in an alternative embodiment of the present invention, when the stylus 9c is moved to the left, the display window can move to the left. This alternative is often called scrolling rather than panning. Once it is detected that the user has lifted the stylus 9c, the panning and the procedure for this method is completed.

If it is not determined at the start of panning at step 334 that the panning should be started, the procedure for this method is completed.

20 is a state diagram for an embodiment of one aspect of the present invention that provides both data selection and panning. This diagram illustrates various states and transitions between states in an embodiment of the present invention, allowing a user to select data and pan without individually changing modes. This embodiment of the present invention is implemented as executing instructions in program codes in a handheld computer 1.

Ready state 350 represents a mode in which the handheld computer 1 is ready to receive data input from a user to either start a panning procedure or start a text selection procedure.

From the ready state 350, if the user touches 371 with the stylus 9c in the first position, the computer enters the first touch state 351.

From the first touch state 351, if the user performs a lift 372 of the stylus 9c, the computer enters the first lift state 352. On the other hand, from the first touch state 351, if the user still presses the stylus 9c and moves the stylus 9c 380, the computer proceeds to the panning state 355.

From the first lift state 352, if the user touches 379 with the stylus 9c in a new position, the computer returns to the first touch state 351. The new position may need to be more than a certain threshold distance from the first position, since within the framework of a double touch, the user can make a second touch not in the same position as the first touch. If in state 352 of the first recovery, the computer fixes a timeout of 377, the computer returns to ready state 350. If, in the first lift state 352, the user makes a second touch 373 at the same position with the stylus 9c, the computer enters the second touch state 353.

From the second touch state 353, if the user lifts the stylus 378 37c, the computer enters the ready state 350. On the other hand, from the second touch state 353, if the user is still pressing the stylus 9c and moving the stylus 9c 374, the computer enters the data selection state 354.

After transitioning to the data selection state 354, the computer updates the display image, indicating the data on the display between the first position and the current position as selected. A memory update 54 also occurs to indicate which data items are currently selected. From the data selection state 354, if the user moves the stylus 375 37c, the computer returns to the data selection state 354 with the new current position of the stylus 9c. On the other hand, from the data selection state 354, if the user performs a stylus elevation 376 of the stylus 9c, the computer enters the ready state 350, but stores the currently selected data elements in the memory 54 for further processing. In addition, any selection indication is stored on the display.

When the computer enters the panning state 355 after the user moves 380 from the first touch state 351, the computer updates the display image by moving the available content in accordance with the distance between the current position and the first position. From the panning state 355, if the user moves 381 of the stylus 9c, the computer returns to the panning state 355 with the new current position. On the other hand, from the panning state 355, if the user lifts the stylus 382 382, the computer enters the ready state 350.

On Fig shows a web browser showing content with hyperlinks. In this example, a web browser application running on a handheld computer 1 renders text in a display window 301, including a plurality of hyperlinks 310-313. As is known to those skilled in the art, if a user touches one of the links on the touch screen 3 using the stylus 9c, the web browser application displays a new web page to which the hyperlink refers.

Alternatively, to view the available hyperlinks 310-313, you can use hardware keys, such as the right key and the left key of the navigation key 5a, and at a given moment you can select only one hyperlink, for example, hyperlink 311. In the known technical solution for viewing available hyperlinks you can use the tab key in the computer keyboard. The author of a web page can add information about the relative order of hyperlinks using the so-called tab order. This tab navigation order is usually determined by the author of the web page in order to increase the usability when the web page is displayed on a full-screen computer display. Thus, when a web page is displayed on a handheld computer, in which the pixel resolution is often much lower than on a full-screen computer, the initial tab order may not be optimal.

In an embodiment of one aspect of the present invention, the tab key transition order set by the web page author is ignored. Instead, the relative order of the hyperlinks is determined by their geometric location on the display. 21, a situation is possible in which the hyperlink 310 has an order of 3 tabs, the hyperlink 311 has an order of 2 tabs, the hyperlink 312 has an order of 5 tabs, and the hyperlink 313 has an order of 4 tabs. If now the user wants to go to the subsequent hyperlink after the currently selected hyperlink 311, in the well-known technical solution, it was hyperlink 310 that should have been the subsequent hyperlink after hyperlink 311, since hyperlink 310 has order 3 of tabulation and hyperlink 311 has order of 2 tabs. However, in this embodiment, an aspect of the present invention, since the geometric position takes precedence over the order of transition to the hyperlink by the tab key, the hyperlink 312 becomes the next hyperlink after the hyperlink 311.

This approach works in two directions: for example, if hyperlink 311 is selected and the user wants to select as the next hyperlink that goes before hyperlink 311, then hyperlink 310 will be selected.

22A and 22B illustrate an embodiment of an aspect of the present invention before and after local scaling.

On figa shows the window 301 of the touch screen 3 of the PDA 1, which shows the content with a zoom ratio of 100%. In this example, the content is a web page displayed by a web browser application that is running on the handheld computer 1. However, any application can be executed in which the user can benefit from the zoom function. In this example, the user holds the stylus 9c in contact with the touch display 3 at position 314 for a period of time longer than a predetermined time, which causes the context-sensitive menu 315 to appear. In this example, the menu shows only different scaling factors, but it may contain any relevant menu items are presented, such as forward and backward navigation, properties, etc. In addition, although only menu items of the same level are shown in this example, menu items can have a hierarchical structure, forming a structured menu in case there are more menu items available that can be combined into logical subgroups.

In this example, the user selects menu item 316 to change the scale by 200%.

After the user has selected the scaling factor, the application continues to re-display the same content, but now with a new scaling factor, in this case 200%, as shown in FIG. 22B. Reference numeral 314 in FIG. 22A now becomes the center of content re-presented in a web browser application.

23 shows new content uploaded to a web browser. 22A and 22B may also be used in conjunction with FIG. 23 to illustrate an embodiment of an aspect of the present invention in which scaling factor information is stored. An example of such a method is disclosed below.

As shown in FIG. 22A, a user can navigate to a first page containing content that is displayed on a display 301 with an initial zoom ratio of 100%. The user can, for example, change the scaling factor for the first page to a new scaling factor of 200% using the context-sensitive menu 315, as discussed above. The web browser redisplays content with a new zoom ratio of 200% for the first page, as can be seen in FIG.

Then the user can go to the second page using the link on the first page, entering a uniform resource locator (URL, uniform resource locator) or any other means. As shown in FIG. 23, the second page is displayed with an initial scaling factor of 100%.

The user can then return to the first page, for example, using the 317 back key in a web browser application. After the user presses the back key 317, the web browser repeatedly displays the first page using the new zoom factor of 200% for the first page. In other words, the browser stores information about the scaling factor in the memory 54 as part of the browser history, which has a beneficial effect on the viewing quality of the user. This information is stored in such a way that it can be used when re-visiting an already visited page, or when moving forward and backward using the back key 317 or the forward key 318, respectively, typically found in web browsers.

24 is a flowchart illustrating a method for implementing a list item in accordance with an aspect of the present invention. 26A-C are a graphical illustration of a list item. The method provides the user with a user interface element representing a list, hereinafter referred to as list element 420, and there are several ways in which list items 421a-d can be selected. In this example, list item 420 operates in three modes: single select mode, multiple single select mode, and range select mode. The flowchart illustrates a method by which a selection can be made in various modes of a list item. In this example, the method is implemented in a handheld computer 1 with a touch screen 3.

In a first touch detection step 401, a first touch is detected by the touch screen stylus 9c in a first position.

In step 402, the selection of the first list item selects the first list item corresponding to the first position in the list item 420. The selection may, for example, be shown on the display by changing the background color of the selected item and / or displaying a border around the selected item. In addition, information about the selected item is stored in memory 54 so that it is available for further processing.

At a first lift detection step 403, a first rise of the stylus 9c in the second position is detected. This second position may be the same or different from the first position detected in the first touch detection step 401 discussed above. In other words, the user can move the stylus 9c between the first touch and the first lift.

In step 404, with the conditional jump "range selection mode & other items?", Firstly, it is determined whether the list item 420 is configured to be in the range selection mode. Secondly, it is determined which first list item corresponded to the first position when a touch was detected, and which second list item corresponded to the second position when a rise was detected. If the first list item and the second list item coincide and it is found that the list item 420 is in the range selection mode, the answer to the question for this step with a conditional jump is considered positive, and execution proceeds to step 405 of selecting the list items between the first touch and the first lift. Otherwise, execution proceeds to step 406 of detecting a second touch.

In step 405 of selecting list items between the first touch and the first lift, all items between the first item in the list and the second item in the list are selected. Preferably, the first and second items of the list are also selected. For the user, this means that after dragging through several list items, they will all be selected, provided that the list item 420 is in range selection mode.

In a second touch detection step 406, a second touch is detected at a position on the touch screen.

At step 407, with the conditional transition "single selection / range selection?" determining whether the list item 420 is in single selection or range selection mode. If the answer to the question is yes, execution proceeds to step 408 of canceling any previously selected list items. Otherwise, execution proceeds to step 409 of selecting the second list item.

At step 408, deselecting any previously selected list items deselects any previously selected list items.

In step 409, the selection of the second list item selects a list item corresponding to the position detected in the second touch detection step 406. Due to the result of step 408, deselecting any previously selected list items, multiple separate selection is only possible if the list item 420 is in multiple separate selection mode.

25 is a flowchart illustrating a drag and drop function in an embodiment of a list item according to one aspect of the present invention. The drawing illustrates how a selection made in a list item 420 can be “drag and drop” with respect to another user interface element.

At a selection detection step 410, a selection of one or more list items 420 is detected. Details of such a selection are disclosed above in the discussion of FIG. 24.

In step 411, touch detection detects a touch on the touch screen. The position of this touch corresponds to the list item that is currently selected as a result of the selection detection step 410.

In step 412, the lift detection on the second element detects the rise of the stylus 9c in the position corresponding to the second element of the user interface. This corresponds to the actions called drag and drop, known in the art.

At step 413 of the conditional transition "Range selection / single selection?" determining whether the list item 420 is in a range selection mode or a single selection mode. If the answer to this question is yes, execution proceeds to step 414 of transmitting the selection data to the second element. Otherwise, the procedure for this method ends.

At step 414, transferring the selection data to the second element, data corresponding to the list item or list items that are currently selected are passed to the second user interface element. If, for example, the second user interface element is a text area 426, text data corresponding to the selected list item / s can be added to the text field.

FIGS. 26A-C illustrate a list item in an embodiment of the present invention in context with other user interface elements, the list item 420 being in single select mode, multiple single select mode, and range select mode, respectively.

First, refer to FIG. 26A, which illustrates a single-select list item 420. On the touch screen 3 of the PDA 1, a plurality of user interface elements are shown in window 301.

List item 420 includes four list items 421a-d. A text area 426 is also shown. First, the user presses with stylus 9c at position 423 corresponding to a specific list item 421b, activating the selection of the list item 421b. The user then presses with stylus 9c at position 424, activating the selection of the second list item 421d. When the second list item 421d is selected, the selection of the first list item 421b is canceled.

Finally, the user performs the drag-and-drop operation by touching the stylus 9c with the display in the position corresponding to the second list item 421d and holding the stylus 9c pressed, moves the stylus 9c to position 427 in the text area 426 and lifts the stylus 9c. Since a single list item 420 is selected, a drag-and-drop operation is possible, and information about the selected list item 421d in the list item 420 is transferred to the text area 426, whereby text corresponding to the selected list item 421d can be added to the text area 426 . It should be noted that the text area 426 may refer to the same application as the list item 420, or to a completely different application 57.

Now, with reference to FIG. 26B, we will explain the case where the list item 420 is in multiple separate selection mode. First, the user presses with stylus 9c at position 423 corresponding to a specific list item 421b, activating the selection of the list item 421b. With this type of list item 420, the selected list item is indicated by a “tick” 422 next to the list item. The user then presses with stylus 9c at position 424, activating the selection of the second list item 421d. When the second list item 421d is selected, the first list item 421b is still selected. Finally, the user attempts to perform the drag-and-drop operation by touching the display stylus 9c in the position corresponding to the second list item 421d, then, holding the stylus 9c pressed, moves the stylus 9c to position 427 in the text area 426 and lifts the stylus 9c. Since we are dealing with a multiple individual list item 420, a drag-and-drop operation is not possible, and no information can be transmitted to the text area 426. Instead, a second tap at 424 deselects the second list item 421d.

Now, with reference to FIG. 26C, we will explain the case where the list item 420 is in a range selection mode. The user presses with stylus 9c at position 423 corresponding to a specific list item 421b, activating the selection of list item 421b. Then, while still pressing the stylus 9c against the display, the user moves the stylus 9c to another position and lifts the stylus 9c. With such a pull, items 421b-421d of the list are selected. Then, the user performs the drag-and-drop operation by touching the display stylus 9c in the position corresponding to the second list item 421d, then, while holding the stylus 9c pressed, moves the stylus 9c to position 427 in the text area 426 and lifts the stylus 9c. Since we are dealing with an element of the range selection list 420, a drag-and-drop operation is possible, and information about the selected list item 421d in the list element 420 is transferred to the text area 426, as a result of which the text corresponding to the selected list items 421b-d can be added to text area 426.

27A and 27B illustrate the operation of a method for hiding a window in an embodiment of an aspect of the present invention.

On figa in handheld computer 1 has a touch screen 3, on which there is a viewing window 301. Window 450 is shown on top of other currently displayed windows. The window may be a full window or a dialog box, as shown in the drawing. The window includes a main area 451. The user touches with a stylus 9c at position 452 on the touch screen 3 corresponding to the main area 451 of the window 450.

As a result, window 450 and its content are hidden, as seen in FIG. 27B, and any content previously closed by window 450 is displayed. Preferably, a rectangular frame 453 is displayed showing the location of the hidden window.

As soon as the user lifts the stylus 9c, the window 450 is shown again, and the viewing window 301 takes the form, as in figa.

28A is a diagram illustrating a remote scroll element 463 in an embodiment of an aspect of the present invention. The handheld computer includes a display 3 with a visible area 460. The web browser 461 currently uses the entire space of the window 461 available for the application, leaving room for the remote scroll element 463. The web browser has a vertical scroll bar 462 including a scroll slider 464. Since the scroll bar 462 is vertical, the remote scroll element 463 is also vertical. If the scroll bar 462 were arranged horizontally, the remote scroll element 463 would be placed along the base of the display 460, having a predominantly horizontal shape. If the user presses with the stylus 9c at some position on the remote scroll element 463, the application responds as if the user clicked on the scroll bar 462 with the same vertical coordinate. For example, if a user clicks with a stylus on police 465 on a remote scroll element 463 that has the same vertical coordinate as arrow 466 on scroll bar 462, the effect is the same as if the user clicked on arrow 466 itself, i.e. Scroll up the screen. All actions that can be performed with the scroll bar 463 itself, for example, scrolling up and down using the arrow keys, scrolling when you drag the scroll slider 464, or when you click the scroll bar below or above to scroll the whole page at a time, you can , thus, performed by appropriately pressing the deleted scroll element 463.

28B is a diagram illustrating a separated remote scroll element 463 in an embodiment of an aspect of the present invention. The handheld computer 1 contains a display 3 with a visible area 460. A web browser 461 containing a scroll bar 462 does not occupy the entire available viewing window 461, but only partially overlaps another application 468. In this case, the deleted scroll element 463 is located along the right side of the screen and is not in direct contact with web browser 461. However, if the user presses the stylus 9c at some position on the remote scroll element 463, the application responds in exactly the same way as if the user clicks on the scroll bar 462 and with the same coordinate vertically. The remote scroll element 463 is located along the right side of the viewing window 460 for convenience and can be used for the currently active application regardless of the position of the application in the window 460.

In one embodiment of the present invention, the position of the remote scroll element 463 is visually indicated, for example, including a bitmap on the remote scroll element 463. In another embodiment of the present invention, the remote scroll element 463 is partially or completely transparent, and the area on the display that lies beneath the remote scroll element 463 can be used to provide data, for example, non-selectable indicators (for example, a battery indicator or other status indicator).

FIG. 28A can also be used to illustrate another aspect of the invention related to the scroll bar, wherein the scroll bar further includes an upper recess portion 467a and a lower recess portion 467b. When the user presses with a stylus 9c in the recess, for example, at the bottom of the recess 467b, the content starts to scroll. Scrolling of the content continues until either the end of the content is reached or the user lifts the stylus 9c. Thus, the content can continue beyond the position in which the user touched with the stylus. This makes the position of the stylus less important when scrolling, which greatly simplifies the scrolling procedure when the user is moving, for example, on a bus or train, or when walking.

Scrolling consists of scrolling steps, with each step scrolling the content one page. Preferably, there is a pause after the first scroll step, allowing the user to stop scrolling after the first scroll page.

The following is a description of content display modes. It should be noted that in this example, hypermedia pages are represented by web pages. In order for the user to view web pages that were originally intended for viewing on a personal computer on the mobile terminal, he may need to change the display mode of the content. For example, the scaling factor, page layout mode, or frame display mode may need to be adjusted so that the user is able to customize the content display settings.

Page layout mode is the ability for the user to choose whether to have a normal presentation or an optimized presentation. In a normal view, the page content is potentially displayed so that the content may go to the right of the window. In an optimized view, the content is horizontally rearranged so that no content is outside the window in the horizontal direction.

29A, 29B, 29C, and 29D illustrate various settings of a content display mode, which is, in an embodiment of the present invention, a frame display mode and a page layout mode. When the frame display mode is within the frame merge mode, the frames are combined into a single frame, as can be seen in FIGS. 29C and 29D. When the page layout mode is optimized, the text in the frame is placed horizontally so that it fits into the visible part of the frame. The page layout mode is set optimized in FIGS. 29B and 29D. Each of FIGS. 29A, 29B, 29C and 29D is described in detail below.

On figa in the browser is not involved in the optimization of display and merging frames. The content page is displayed with a first frame 571 on the left side of the viewing window 561 and a second frame 572 on the right. In this example, the author of the web page indicated in the code of the content page, for example HTML, that the first frame 571 should be displayed on the left and the second frame 572 should be displayed on the right. As can be seen in FIG. 29A, this first display mode takes into account the instructions of the author of the content page on how to display frames 571 and 572. The frames 571 and 572 have vertical scroll keys 581 and 582, respectively, and horizontal scroll keys 583 and 584, respectively. If the user wants to scroll through the content using, for example, the navigation key 5a, the frame of frames 571 and 572 that is currently active will scroll through the content. Only one frame can be active at any time, and if the user, not knowing for sure which frame is active, scrolls the content, this can lead to unpredictable consequences.

On figv in the browser is allowed to optimize the display of content and is prohibited from merging frames. In this case, there are still two frames 571 and 572, in each of which there are scroll keys 581 and 582, respectively. However, compared to FIG. 29A, there is no content to the right of the viewing window 561. The content was rearranged horizontally to fit within the physical boundaries of the right frame 572.

On figs in the browser the optimization of the display of content is prohibited and the merging of frames is allowed. In this case, the contents of frames 571 and 572 are merged into one combined frame 573, which occupies the entire space of the viewing window 561. Although this frame does not follow strictly the code instructions of the web page, this display mode of the frame has the advantage of providing the user one frame with scrollable content. which may be preferable to the user when navigating content. This is especially useful in mobile communication terminals with limited user interfaces. For example, in this frame display mode, the user can use the navigation key 5a to unambiguously scroll through all the content currently displayed in the viewing window 561. Since the page layout mode is not optimized, the content, as is the case in this example, may be to the right of the viewing window 561. In this case, frame 573 has one vertical scroll panel 582 and one horizontal scroll panel 584.

In FIG. 290, the optimization of content display is enabled in the browser and frame merging is enabled. As in FIG. 29C, the contents of frames 571 and 572 are merged into one combined frame 573, which occupies the entire space of the viewing window 561. In addition, the page layout mode is optimized, as a result of which no content is available to the right of the viewing window 561. In this case frame 573 has only one vertical scroll panel 582.

FIGS. 30A and 30B and FIGS. 31A and 31B illustrate a method for storing content display modes with respect to web pages.

On figa and 30B shows the display on the display of a web browser showing the first web page in two different modes of displaying content, which in this case differ in scaling factors. On figa and 31B shows the display on the display of a web browser showing the first web page in two different modes of displaying content, which in this case differ in scaling factors and layout modes of the page.

Although the following example uses content display modes that differ in zoom ratio and page layout mode, any content display mode can be used. For example, alternatively or additionally, content display modes associated with frame display and text selection modes may also be used.

30A-B and 31A-B are disclosed a process illustrating how, in an embodiment of the present invention, content display modes associated with web pages are stored.

As shown in FIG. 30A, the user navigated to the first page with the content displayed in the viewing window 561 with an initial zoom ratio of 100%. The page layout mode is normal, as a result of which both the menu bar 561 and the key panel 563 are visible. The keypad contains a 567 back key and a 568 forward key. The user can then, for example, modify the content display mode by modifying the zoom factor to a new zoom factor of 200% using the context-sensitive menu 565. This causes the web browser to redisplay the content in the new content display mode with a zoom factor of 200 %, as seen in figv. The page layout mode remains the same as before, i.e. normal.

The user can then go to the second page using the link on the first page, using a bookmark, by entering a unified resource locator (URL), or using any other means. On figa shows a viewing window 561, in which the browser displays a second page with an initial zoom factor of 200% and in normal mode page layout. In other words, the last active content display mode is also used for the subsequent presentation of pages, for example, in this example, the second page. If the user wants to change the content display mode, for example, by changing the zoom factor to 100% and changing the page layout mode to optimized, the second content page will be displayed again according to the new content display mode. In this case, this includes the image of the second page with a zoom ratio of 100% and the organization of the content so that no content is available to the right of the viewing window 561, as shown in Fig. 318.

Now for these two pages there are two elements of history saved by the browser, with a zoom factor of 200% and normal page layout mode associated with the first page. The second page is associated with a zoom factor of 100% and an optimized page layout mode.

The user may then wish to return to the first page, for example, using a combination of hardware keys (not shown). After the user presses a combination of hardware keys, the web browser re-displays the first page according to the content display mode associated with the history item for the first page, i.e. using a zoom factor of 200% and normal page layout mode. In other words, the display will look like that shown in FIG. 30B. By storing information about the mode of displaying content in the memory 554, as part of the browser history, the browser allows the user to use the experience of previous work with the browser. The stored content display information can be used when re-visiting an already visited page or using paging back and forth using the 567 back button or the 568 forward button, respectively, which are commonly found in well-known web browsers.

FIG. 32 shows an example of a table 590 with data including historical data according to one embodiment of the present invention.

A data table 590 is used to store historical items. The data table 590 is preferably stored in the memory 554 in a place accessible to the controller 550. The table includes many columns, with each column containing one data type for each record. Records are arranged vertically, with each transition in table 590 corresponding to a new record.

Column 591 URLs contain URL addresses for historical items. Page layout column 592 contains page layout mode information for each background item. Frame mode column 593 contains frame display mode information for each history item. The scaling factor column 594 contains a scaling factor for each history item. Column 595 text selection contain information about any selection of text for each element of history. In this illustrative example, the text selection is presented with two values corresponding to the beginning and end of the text selection in terms of character numbers. Although not shown in the drawing, preferably additional information may be included in the text selection, for example, links to a frame with selected text, etc. In addition, “0,0” here simply means that no selection of text was made in the historical element under consideration. If necessary, additional columns 596 relating to display modes of content or other information about a history item may be added.

The above aspects of the present invention have been described mainly in relation to many options for its implementation. However, as is apparent to those skilled in the art, embodiments of the present invention that differ from those disclosed above are also possible within the scope of the aspects of the present invention that are defined in the claims.

Claims (25)

1. The way to control the user interface in a handheld computer, adapted to run various software applications, where each application has many functions, each function is designed to provide, when it is called, certain functionality for a handheld computer user, including
ensuring the presence on the display of said handheld computer of a plurality of selectable user interface elements, wherein each user interface element represents a certain aspect of using said handheld computer associated with certain functions of certain applications, wherein at least two of said aspects of using a handheld computer are associated with at least one of the specified specific applications;
detecting a selection by a specified user of a particular element among the specified user interface elements;
for a selected specific element, a representation on the indicated display of a plurality of selectable and problem-oriented options, each such option being associated with a particular function of a particular application, at least one option being associated with a second application, and the specified representation of a plurality of options is performed without starting the specified second application ;
detecting a selection by a user of a particular option among the specified options;
calling the function associated with the specified specific option. 2. The method according to claim 1, in which the specified display is a touch, and the user makes the specified selection by touching the touch display. 3. The method according to claim 1, in which these selectable user interface elements are icons located in stationary positions on the specified display. 4. The method according to claim 1, in which these problem-oriented options are presented in the form of menu items. 5. A handheld computer having a user interface that includes a display and is designed to execute various software applications, each application having many functions, and each function is designed to provide certain functionalities for a handheld computer user, while the handheld computer is capable of implementing a method for item 1. 6. A method of changing the scaling factor of the content displayed on the display of a handheld computer, including
receiving input to display the menu at a specific target position on the specified display,
displaying the indicated menu containing at least one menu item, each menu item containing one of a plurality of predetermined scaling factors, for changing the specified scaling factor,
receiving input to change the specified scaling factor by detecting a menu item with a new selected scaling factor, and
rendering said content using said new scaling factor around said target position, said display being a touch screen and said data input for displaying a menu being touch data input on said touch screen. 7. The method according to claim 6, in which the specified data input for displaying the menu is a click on the specified touch screen for a time period exceeding a predetermined threshold value. 8. The method according to claim 6, in which the specified data entry for displaying the menu is a double touch of the specified touch screen. 9. The method according to claim 6, in which said content belongs to a web browser application running on said handheld computer. 10. The method according to claim 6, in which the specified menu is a context-sensitive menu. 11. A handheld computer adapted to implement the method according to claim 6. 12. A method of viewing previously visited web pages in a web browser application running on a handheld computer that includes a display, the method including
visualization of the first web page on the specified display,
first data entry to mark the selection of text for the specified first web page,
rendering the indicated first web page using the indicated marked text selection,
Automatically save the specified text selection in the specified web browser in association with the first web page,
second data entry to render the second web page,
visualization of the specified second web page,
third data input for re-rendering the specified first web page,
Automatically retrieve the saved text selection for the specified first web page and
rendering the indicated first web page using the specified saved text selection. 13. The method according to item 12, in which the specified third input is an input for navigating "back" through the history of the browser. 14. The method according to item 12, in which the specified third input is an input for navigation "forward" on the history of the browser. 15. A handheld computer adapted to implement the method according to item 12. 16. A method for scrolling content in a window displayed on a touch screen of a handheld computer, said display additionally displaying a scroll bar comprising a scroll slider being moved in a tray, the method including
detection of a touch of a writing instrument at some touch position in a specified tray,
scrolling the specified content while the writing tool is touching the display, including updating the position of the specified scroll slider in the specified tray by moving the specified scroll slider in the specified tray,
detecting a rise in said writing instrument, and
as soon as the rise of the specified writing instrument is detected, stopping the specified scroll of content,
moreover, at the indicated scroll step, the indicated scroll is performed so that the indicated position of the scroll slider continues to move past the indicated touch position in the indicated tray until the writing instrument is lifted or the end of the scrollable content is reached, while the indicated scroll step of the indicated content scrolls the content by one page, moreover,
said method includes pausing scrolling after the first page has been scrolled, to allow the user to stop scrolling after the first page. 17. The method according to clause 16, in which the specified position is different from the specified scroll slider. 18. A handheld computer adapted to implement the method according to clause 16. 19. A handheld computer comprising a display with a user interface and a controller for displaying a plurality of application representations, each application representation corresponding to an application, and each application having a nominal function, said nominal function including receiving commands and providing information, furthermore, said the controller is additionally designed to provide access to limited parts of the specified nominal function as in relation to the received commands, t As for the information provided through the specified presentation of the application, the reception of the input data for executing the application corresponds to the presentation of the application in full mode, and the resources allocated to the presentation of the application are much less than the resources allocated to the application in full mode. 20. A method for displaying previously visited hypermedia pages using a browser application for hypermedia executed in a mobile communication terminal comprising a display, the method comprising
visualization of the first page of hypermedia on the specified display,
first data input for modifying the visualization of the specified first page of hypermedia according to the first content display mode,
storing said first content display mode in association with said first hypermedia page,
rendering the specified first page of hypermedia according to the specified first content display mode,
second data entry to render the second page of hypermedia,
visualization of the specified second page of hypermedia,
a third data entry for re-visualizing the specified first page of hypermedia,
extracting said stored first content display mode and
rendering the specified first page of hypermedia according to the specified stored first mode of displaying content, while the specified mode of displaying content includes a mode in which text is selected on the first page of hypermedia. 21. The method according to claim 20, in which the specified third input is an input for navigating "back" through the history of the browser. 22. The method according to claim 20, in which the specified third input is an input for navigating "forward" on the history of the browser. 23. The method of claim 20, wherein said hypermedia pages represent at least one type of content selected from the following group: html content, wml content, sgml content, and xml content. 24. A mobile communication terminal capable of executing a hypermedia browser application, wherein the hypermedia browser application renders the hypermedia pages on a display of said mobile communication terminal, and this mobile communication terminal comprises
means for visualizing on the specified display the first page of hypermedia,
means for first inputting data intended to modify the visualization of said first hypermedia page according to the first content display mode,
means for storing said first content display mode in association with said first hypermedia page,
means for visualizing said first hypermedia page according to said first content display mode,
means for the second input of data intended for visualization of the second page of hypermedia,
means for visualizing the second page of hypermedia,
means for the third input of data intended for re-visualization of the specified first page of hypermedia,
means for retrieving said stored first content display mode; and
means for rendering said first hypermedia page according to said stored first content display mode, wherein said content display mode includes a mode in which text is selected on said first hypermedia page. 25. The memory of a digital computer containing portions of program codes for implementing the method according to claim 20.

Images