CN101308434A - Electronic device and user interface navigation method of software thereof - Google Patents

Abstract

The invention discloses an electronic device and a user interface navigation method of software thereof. The processor of the electronic device receives the input signal through the touch sensing device, judges the type of an input tool generating the input signal, and finally turns on or off a user interface navigation function according to the type of the tool. Thereby improving the convenience of operating the electronic device.

Description

User interface navigation method of electronic device and its software

technical field

The present invention relates to a user interface operation of an electronic device, and in particular to a navigation method of an electronic device and its user interface.

Background technique

In the busy and compact life of modern people, it has become a very common living habit to emphasize convenience and efficiency in everything. Take handheld devices such as mobile phones or personal digital assistants as an example. In addition to having the characteristics of powerful functions and light weight, users also hope that they can be turned on and executed in a very short time. This is especially true for functions that users use more frequently, such as writing text messages or checking call logs. If the user can quickly activate some commonly used functions when operating the handheld device, the convenience of using the handheld device will certainly be improved.

In order to meet the above requirements, manufacturers of handheld devices set hot keys corresponding to specific commonly used functions on the keyboard or shell of the handheld device at the beginning of design. Accordingly, when the user presses the hot key, the corresponding frequently used function can be quickly opened, thereby shortening the time required for searching and opening the function. For example, some mobile phone manufacturers will set a button on the side of the mobile phone to enable the camera function. When the user presses this button, the camera function of the mobile phone can be activated immediately.

However, under the trend of smaller and smaller handheld devices, manufacturers have very limited space for setting hot keys. In addition, the user's requirements for the appearance of the handheld device cannot be ignored. In order to ensure that the appearance of the handheld device meets the requirements of simplicity and beauty, the manufacturer must control the number of hot keys during design, so only a few hot keys can be passed. There are many hotkeys to meet the needs of quick access to frequently used functions.

Because of this, only a very small number of functions in the handheld device have corresponding hotkeys for users to quickly activate. However, when the user wants to execute a function that does not have a corresponding hotkey, he must open it by operating the menu. Since the menus of handheld devices are mostly in a tree structure, and the menus are mostly displayed on the display of the handheld device, the user may need to click on the user interface displayed on the display on the touch-sensitive device overlapping the display to enter After multiple sub-menus, you can find the desired function options. For some frequently used functions, if the above-mentioned method must be used to start and execute each time, it will inevitably consume a lot of operating time, which will cause a lot of inconvenience in use.

Generally speaking, at present, users mostly use the contact or sensing behavior generated between fingers or stylus and touch sensing devices to perform clicking actions, but on general handheld devices, no matter whether it is through fingers or touch There is no corresponding difference in the user interface provided on the handheld device (the user interface shown in FIG. 6 ) for clicking with the pen. However, when the user uses the finger and the stylus to input the touch sensing device, they will have different input characteristics; generally speaking, the stylus will be more accurate than the user's finger, so it can be compared on the user interface. Sophisticated manipulations, such as typing on a virtual keyboard displayed on the monitor or selecting from densely packed menus. But on the other hand, it is more intuitive, fast and convenient for the user to directly use fingers to perform actions on the touch-sensitive device, because the action of extracting the stylus can be omitted and the operation can be performed with one hand, although The contact area between the finger and the touch sensing device will be larger, and it is easier to mistakenly touch other options on the user interface.

To sum up, the current general handheld devices have some disadvantages. One is that some specific functions of the handheld device require the user to expand layers of menus before they can be selected and activated. The second is that when the user operates on the user interface displayed on the general handheld device, it will be more flexible to use the stylus to control, which is more troublesome for the user. It is more convenient to say, but the flexibility of control is reduced, and it is easy to cause false touches. For users, it is difficult to achieve the best of both worlds no matter whether they use a stylus or fingers.

Therefore, if the handheld device can provide users with different applications or operation modes for different input tools, for example, when using a stylus, the handheld device has an application or operation mode suitable for the use of the stylus. If the hand-held device has another application or operation mode suitable for fingers, the user will feel more convenient when using the hand-held device. In addition, how to choose among these different applications or operation modes is also a subject extended from this.

In addition, the casing of the traditional handheld device is usually adjacent to the edge of the display area of the touch display, and protrudes much more than the touch sensing plane of the touch display. Since the protruding part of the shell will block the touch operation of input tools (including fingers or stylus pens) and easily scratch the fingers, the user will not be able to quickly and effectively touch the pixels on the edge of the display area of the touch display, and cannot In addition, the non-display area of the touch display still has the ability of touch sensing, and the shell of the general handheld device usually covers this area, which not only hinders the user's touch operation, but also allows the The application of touch sensing in touch displays is limited.

Contents of the invention

In view of this, the present invention provides a user interface operation method, a handheld device, an operating system, an application program, an electronic device with unimpeded touch operation, and a computer-readable recording media. The present invention can enable or disable the navigation function of the user interface according to different input tools by distinguishing the types of the input tools.

The invention provides a method for operating a user interface, which is suitable for a handheld device and includes the following steps. First, an input signal is received in a user interface. Determine the tool type of the input tool that generates the input signal, and then enable or disable the user interface navigation function according to the tool type.

In an embodiment of the present invention, the user interface navigation function includes a user interface translation function or a user interface scroll function.

In one embodiment of the present invention, the input signal is generated when the input tool touches or approaches a touch sensing device, and the step of determining the type of the tool includes: when the input tool touches or approaches the touch sensing device, according to the Types of sensing area, pressure, temperature, or image judgment input tools.

In an embodiment of the present invention, the step of determining the type of the tool includes the following steps. First record a piece of information contained in the input signal within a certain period of time, calculate the variation range of this information within a certain period of time, and judge the type of tool according to the size of the variation range. This information can be the position or pressure of the input tool touching or approaching the touch sensing device, or other relevant information.

In an embodiment of the present invention, the step of determining the type of the tool includes the following steps. First count the number of sensing pads on the touch sensing device within a certain period of time, and then determine the type of tool according to the number of sensing pads.

The present invention further provides a handheld device, including a display, a touch sensing device, and a processor. The display is used for displaying the user interface. The touch sensing device is used for receiving an operation of an input tool. The processor is coupled to the display and the touch sensing device, and is used for judging the type of the input tool, and opening or closing the user interface navigation function according to the type of the input tool.

The present invention further provides an operating system for integrating at least one hardware function. The operating system includes a program that can identify signal input tools. The main functions of the above program are as follows. Firstly, an input signal is received, the type of the input tool generating the input signal is judged, and the navigation function of the user interface is opened or closed according to the type of the tool.

The present invention also provides an application program whose main functions are as follows. First, an input signal is received in a user interface, the type of the input tool that generates the input signal is judged, and the navigation function of the user interface is opened or closed according to the type of the tool.

The present invention further provides an electronic device capable of identifying types of input tools, including a display, a touch sensing device, and a processor. The display is used for displaying the user interface. The touch sensing device is used for receiving an operation of an input tool. The processor is coupled to the display and the touch sensing device, and is used for judging the type of the input tool, and opening or closing the user interface navigation function according to the tool type.

The present invention further provides an electronic device with unimpeded touch operation for identifying the type of input tool, including a casing, a touch display, and a processor. The casing has an opening. The touch-sensitive display is arranged in the opening of the casing to receive the operation of the input tool. The touch-sensitive display has a touch-sensing plane, and the outer surface of the casing does not substantially protrude from the touch-sensing plane. The processor is coupled to the touch-sensitive display, and is used for judging the type of the input tool, and opening or closing the user interface navigation function according to the tool type.

The present invention further provides an electronic device with unimpeded touch operation for identifying the type of input tool, including a casing, a touch display, and a processor. The casing has an opening. The touch-sensitive display is arranged in the opening of the casing to receive the operation of the input tool. The touch-sensitive display has a touch-sensing plane, the edge of the opening of the housing is in continuous contact with the touch-sensing plane, and the outer surface of the housing does not protrude substantially from the touch-sensing plane. The processor is coupled to the touch-sensitive display, and is used for judging the type of the input tool, and opening or closing the user interface navigation function according to the tool type.

When the input tool touches or approaches the touch sensing device of the electronic device, the present invention can judge the tool type of the input tool according to characteristics such as the contact area, contact pressure, sensing area, tool temperature, or image of the input tool. And according to different types of tools, the navigation function of the user interface is automatically turned on or off. Accordingly, the convenience of operating the electronic device is improved.

In order to make the above-mentioned features and advantages of the present invention more comprehensible, preferred embodiments are specifically cited below and described in detail with accompanying drawings.

Description of drawings

FIG. 1 is a flowchart of an operation method of a user interface according to an embodiment of the present invention.

2A to 2D are block diagrams of a handheld device according to an embodiment of the present invention.

3A and 3B are schematic views of the contact area of the input tool according to an embodiment of the present invention.

4A to 4C are flowcharts of a method for identifying types of input tools according to an embodiment of the present invention.

FIG. 5 is a flowchart of a method for identifying types of input tools according to another embodiment of the present invention.

FIG. 6 and FIG. 7 are schematic diagrams of the user interface of the handheld device according to the embodiment of the present invention.

8A to 8C are flowcharts of a user interface operation method according to an embodiment of the present invention.

FIG. 9A is a front view of an electronic device according to an embodiment of the present invention.

FIG. 9B is a cross-sectional view of the electronic device of FIG. 9A .

Detailed ways

With the current hand-held devices, users can only quickly open some specific functions by pressing hot keys. However, the number of hot keys on the hand-held devices is limited. A user interface with common functions is bound to increase the convenience of operating the handheld device. The present invention is a method for operating a user interface and a handheld device using the method developed based on the above viewpoint. In order to make the content of the present invention more clear, the following specific examples are given as examples in which the present invention can indeed be implemented.

FIG. 1 is a flowchart of a user interface operation method according to an embodiment of the present invention. Please refer to FIG. 1 . This embodiment illustrates the detailed steps of how the handheld device automatically switches the corresponding user interface according to different input tools when the user is operating a handheld device. Wherein, the handheld device includes a mobile phone, a personal digital assistant, or a smart phone, etc., and the scope thereof is not limited here.

When the user uses the input tool to operate the handheld device, first, as shown in step 110, the handheld device receives an input signal in a user interface. Then in step 120 , according to the area, pressure, temperature, or image sensed by the touch-sensing device when the input tool touches or approaches the touch-sensing device, the tool type of the input tool is determined accordingly. Finally, as shown in step 130, the handheld device converts and displays the corresponding user interface according to different types of tools.

It should be noted that the above operation method can be divided into two parts, one part is the method of identifying the type of input tool (ie step 110 and step 120), and the other part is the method of using the identification result for application (ie step 130). That is to say, in the method flow shown in FIG. 1 , the present invention at least provides an identification method including step 110 and step 120 , and the steps after step 120 can be designed according to actual application requirements. The step 130 in FIG. 1 is only used to respectively represent an embodiment (conversion of the user interface) on the application. In this embodiment, the handheld device displays corresponding user interfaces according to different types of tools. For the convenience of description, in the following embodiments, it is used to distinguish two different input tools as an example, such as a stylus (stylus) and the user's finger, and to switch the corresponding user according to the two different tool types. The flow of the interface is used to further illustrate the present invention. Any number of tool types may then be included within the scope of the present invention.

In the following embodiments, the user interface corresponding to the stylus is a general user interface including all functions of the handheld device, and the user interface corresponding to the finger is a common function interface showing some functions of the handheld device. The functions displayed on the frequently used function interface can be preset by users according to their habits or needs.

In this embodiment, there are multiple methods to determine the type of the input tool, and different determination methods require different hardware designs, as shown in the block diagrams of the handheld device in FIGS. 2A to 2D , which will be described sequentially below.

The handheld device in FIG. 2A includes a display 210 , a touch sensing device 220 , and a processor 230 . The display 210 is used to display a user interface, and the touch sensing device 220 is, for example, a touch panel (touch panel), which is used to detect the operation of the input tool and generate an input signal according to the operation of the input tool. The processor 230 is coupled to the display 210 and the touch sensing device 220 for determining the tool type of the input tool, and switching the corresponding user interface according to the tool type.

The touch sensing device 220 of FIG. 2A includes a resistive sensor device 240 . The resistive sensor can sense the contact position and pressure of the input tool during operation, so the input signal provided by the touch sensing device 220 includes information such as the contact position and pressure of the input tool. It is worth noting that the resistive sensor can only provide an input signal of one contact point at a time, and the contact points will be distributed within the contact area of the input tool and the resistive sensor, as shown in FIGS. 3A and 3B . The resistive sensor itself can only judge whether there is contact with the input tool, but cannot distinguish the type of the input tool. Therefore, it is necessary to cooperate with the method provided by the present invention, through the input signals of multiple contact points collected within a certain period of time. Determine the type of input tool. The contact points t-1 to t-4 of the stylus as shown in Figure 3A, because the contact area of the stylus is small, so the contact points are relatively concentrated, and the method provided by the present invention can be used to determine the contact points with the resistive sensor The input tool for contact is a stylus. Figure 3B shows the contact points t-1 to t-4 of the fingers. Because the contact area of the fingers is relatively large, the contact points are relatively scattered. Through the method provided by the present invention, it can be judged that the input tool in contact with the resistive sensor is a finger . Since the resistive sensor can only provide the input signal of one contact point at the same time, the method provided by the present invention (the processor 230 described in detail below will continue to record the information of the input signal within a certain period of time, and calculate its range of variation) , and then judge the type of the input tool according to the size of the variation range.

Taking the four contact points in FIGS. 3A and 3B as an example, assume that the input signal generated by the contact point t-i is (Xi, Yi, Pi), where i can be 1, 2, 3, or 4. Xi is the X coordinate of the contact position of t-i, Yi is the Y coordinate of the contact position of t-i, and Pi is the contact pressure of t-i. Processor 230 may calculate the average values of position and pressure respectively as follows:

X coordinate average: Xa=(X1+X2+X3+X4)/4

Y coordinate average: Ya=(Y1+Y2+Y3+Y4)/4

Average pressure: Pa=(P1+P2+P3+P4)/4

Then the variation ranges of position and pressure can be calculated respectively as follows:

X coordinate change range: Xd＝|Xa-X1|+|Xa-X2|+|Xa-X3|+|Xa-X4|

Y coordinate variation range: Yd＝|Ya-Y1|+|Ya-Y2|+|Ya-Y3|+|Ya-Y4|

Pressure range: Pd＝|Pa-P1|+|Pa-P2|+|Pa-P3|+|Pa-P4|

As for how to determine the tool type according to the variation range of the position and the pressure, the details are shown in the flow charts of FIGS. 4A to 4C , which will be described sequentially below.

FIG. 4A is a flow chart of a method for identifying an input tool type executed by the processor 230 of FIG. 2A . The process in FIG. 4A is to determine the tool type according to the variation range of the contact position. Firstly, in step 410, the contact of the input tool is detected, and in step 420, the X and Y coordinates of the contact point are recorded at intervals of a preset sampling time. Then in step 430 it is checked whether the number of samples is sufficient, if the preset number of the processor 230 is met, the process proceeds to step 440, otherwise returns to step 420 to continue recording.

Next, at step 440 , calculate the variation ranges Xd and Yd of the contact position, and at step 450 check whether Xd<Vx and Yd<Vy, where Vx and Vy are preset ranges of the processor 230 . If the variation ranges of the two coordinates are both smaller than the corresponding preset range, the processor 230 determines in step 460 that the type of the input tool is a stylus, and converts the user interface into a corresponding common user interface. Otherwise, the processor 230 determines at step 470 that the type of the input tool is a finger, and converts the user interface into a corresponding common function interface.

FIG. 4B is a flowchart of another input tool type identification method executed by the processor 230. The process in FIG. 4B is to determine the type of the tool according to the variation range of the contact pressure. The processor 230 records the contact pressure of the input tool every sampling time at step 421 , calculates the variation range Pd of the contact pressure at step 441 , and then checks whether Pd<Vp at step 451 , where Vp is the preset range of the processor 230 . If Pd<Vp, the processor 230 determines at step 460 that the type of the input tool is a stylus, and converts the user interface into a corresponding common user interface. Otherwise, the processor 230 determines at step 470 that the type of the input tool is a finger, and converts the user interface into a corresponding common function interface. The remaining steps in FIG. 4B are the same as those in FIG. 4A and will not be repeated here.

FIG. 4C is a flow chart of another input tool type identification method executed by the processor 230. The process in FIG. 4C is to determine the tool type according to the variation range of the contact position and the pressure at the same time. The processor 230 records the contact position and pressure of the input tool every sampling time in step 422, calculates the variation range Xd, Yd of the contact position and the variation range Pd of the contact pressure in step 442, and then checks in step 452 whether Xd<Vx, Yd<Vy and Pd<Vp. If yes, the processor 230 determines at step 460 that the type of the input tool is a stylus, and converts the user interface into a corresponding common user interface. Otherwise, the processor 230 determines at step 470 that the type of the input tool is a finger, and converts the user interface into a corresponding common function interface. The remaining steps in FIG. 4C are the same as those in FIG. 4A and will not be repeated here.

Next is another identification method of the input tool type under another hardware design, please refer to FIG. 2B and FIG. 5 . 2B is a block diagram of a handheld device according to another embodiment of the present invention. The main difference between FIG. 2B and FIG. 2A is that the touch sensing device 220 in FIG. 2A is replaced with a touch sensing device including a capacitive sensor device 250. 221. A capacitive sensor is structured with a plurality of sensor pads arranged in an array. The sensing pad will only have a capacitive effect on a conductor large enough to sense the contact or proximity of the conductor. Fingers are conductors that cause the sensor pad to sense. If the stylus is made of a conductor and the size is large enough, the sensor pad can also be sensed. Capacitive sensors generally use a scanning method for sensing, so multiple sensing pads can sense at the same time or within a short period of time. Because the capacitive sensor itself can only judge whether there is contact with the input tool, but cannot distinguish the type of the input tool, it needs to cooperate with the method provided by the present invention to judge by the input signals sensed by multiple contact pads in a short period of time. Enter the type of tool. When the processor 230 in FIG. 2B executes the method provided by the present invention (detailed below), it can calculate the size of the sensing area according to the number of sensing pads where sensing occurs, and distinguish whether the input tool is a finger or a stylus.

FIG. 5 is a flow chart of a method for identifying the type of an input tool executed by the processor 230 of FIG. 2B . Firstly, in step 510 , the contact or proximity of the input tool is detected at intervals of sampling time, and then in step 520 , it is checked whether there is a sensing pad for induction. If not, return to step 510 to continue detection. If so, proceed to step 530 , and count the number of sensing pads in the capacitive sensor 250 that generate sensing when the input tool operates the touch sensing device 221 within a predetermined period of time. Then, at step 540 , it is checked whether the above-mentioned number of sensing pads is less than a preset value of the processor 230 . If the number of sensing pads is less than the preset value, the processor 230 determines at step 550 that the type of the input tool is a stylus, and converts the user interface into a corresponding common user interface. Otherwise, the processor 230 determines at step 560 that the type of the input tool is a finger, and converts the user interface into a corresponding common function interface. The above preset value can be set according to the density per unit area of the sensing pad.

2C is a block diagram of a handheld device according to another embodiment of the present invention. The main difference between FIG. 2C and FIG. 2A is that the touch sensing device 220 in FIG. 2A is replaced with a touch sensing device 222 including a temperature sensor 260 . In this embodiment, the processor 230 determines the tool type according to the tool temperature when the input tool touches or approaches the touch sensing device 222 . Please refer to FIG. 1 and FIG. 2C at the same time. When the user uses an input tool to operate on the touch sensing device 222, the processor 230 will receive a corresponding input signal (step 110). At this time, the processor 230 detects the tool temperature input during tool operation through the temperature sensor 260, and compares the tool temperature with a preset temperature (eg, the average value of room temperature and body temperature). If the tool temperature is lower than the preset temperature, the processor 230 determines that the input tool is a stylus, otherwise, determines that the input tool is a finger (step 120 ). Next, the processor 230 displays the corresponding common user interface or common function interface on the display 210 according to the tool type, as described in the previous embodiment (step 130 ).

In addition to judging the type of the tool by using the differences in area, pressure and temperature, in the embodiment of FIG. 2D , the processor 230 can also use image recognition technology to judge the type of the tool. Please refer to FIG. 1 and FIG. 2D at the same time. FIG. 2D is a block diagram of a handheld device according to another embodiment of the present invention. The main difference from FIG. 2A is that the touch sensing device 220 in FIG. control sensing device 223. When the user uses an input tool to operate on the touch sensing device 223 , in step 110 , the processor 230 receives an input signal through the touch sensing device 223 . Then at step 120, the processor 230 controls the image capture device 270 to capture an image including the input tool, and judges the tool type according to the feature or dimension of the input tool in the image. For example, the processor 230 can obtain features such as the edge profile of the input tool in the image through image recognition technology, so as to determine the type of the tool. Or calculate the size of the input tool in the image, and compare it with the size of the reference object to determine the type of tool. If the processor 230 determines that the input tool is a stylus, then at step 130 the common user interface is displayed through the display 210 . If the processor 230 determines that the input tool is a finger, then at step 130 the display 210 displays a commonly used function interface.

It is worth mentioning that the processor in the handheld device can adjust the size of the user interface options when converting and displaying the user interface according to different types of tools. For example, when the processor determines that the input tool is a stylus, as shown in FIG. 6 , the options on the user interface 600 are displayed in a normal size. However, when the processor determines that the input tool is the user's finger, it will enlarge the options of the user interface to a size that can be operated by the finger, as shown in the user interface 700 in FIG. user interface to operate. The above options include items such as images (icons) or images (images) that can be selected by the input tool.

In addition to switching different user interfaces according to the type of input tool, the handheld device of the present invention can also perform various preset functions in different ways according to the type of input tool, as shown in the flow chart of FIG. 8A . FIG. 8A is a flowchart of a user interface operation method executed by the handheld device according to an embodiment of the present invention. The process is detailed below. First, the processor of the handheld device receives an input signal through the touch sensing device (step 810), determines the type of input tool that generates the input signal (step 820), and then executes a preset function according to the tool type (step 830). For example, the preset function may be to switch the corresponding user interface according to the type of tool (step 840 ), and the related details have been included in the previous embodiments, and will not be repeated here. The preset function in step 830 may also be to enable or disable a specific function according to the tool type (step 850 ). The processor can also perform other preset functions according to the type of tool, which is not limited to the above examples.

The specific function of step 850 may be a user interface browsing function. The user interface navigation function may include user interface panning, user interface scrolling, or both (step 860 ). For example, when the input tool is a stylus, the user interface translation and scrolling functions are disabled, and when the input tool is a finger, the user interface translation and scrolling functions are enabled, so that the user can move the finger to pan or scroll the user interface. Display content.

The detailed flow of step 860 is shown in Figure 8B. Firstly, in step 861, it is judged that the type of the input tool is a finger, and the translation and scrolling functions of the user interface are enabled. In step 862, it is checked whether the contact or proximity state of the finger has been released, that is, whether the finger has left the touch sensing device. If not, execute the user interface translation function in step 863, so that the user interface can be translated with the movement of the user's finger. On the other hand, if the finger has left the touch sensing device, it is checked in step 864 whether there is movement while the finger is leaving. If there is no movement, the process ends here. If there is movement, go to step 865 to execute the scrolling function of the user interface, so that the user interface is scrolled according to the moving direction of the finger.

Alternatively, the specific function of step 850 may be a multiple selection function (step 870). For example, when the input tool is a stylus, enable the multi-selection function, allowing the user to select multiple data items or function items on the user interface at the same time with the stylus, and turn off the multi-selection function when the input tool is a finger, allowing the user Only a single item can be selected at a time. Because the precision of the finger is not as good as that of the stylus, it is easy to make a wrong selection, which can improve the accuracy and efficiency of use.

The detailed flow of step 870 is shown in Figure 8C. Firstly, in step 871, it is judged that the type of the input tool is a touch pen, and the multiple selection function is enabled. Then in step 872, it is checked whether the area where the stylus touches or approaches the touch sensing device has any options covered. If not, the process ends here. If so, all options covered by the contact area are selected at step 873 .

In addition, after the processor executes the identification method provided by the present invention to determine the type of the input tool, it can also enable or disable other specific functions according to the type of the input tool, which is not limited to the above examples. That is to say, in the method flow shown in FIG. 8A , the identification method provided by the present invention includes at least step 810 and step 820 , and the steps after step 820 can be designed according to actual application requirements. Step 830 to step 870 in FIG. 8A are only used to respectively represent various embodiments in application.

The handheld device in the above embodiments can be extended to a general electronic device, and the various method processes in the above embodiments can also be executed by the operating system or application program of the handheld device or the electronic device to integrate functions of hardware such as the electronic device. The above-mentioned operating system or application program can be stored in a computer-readable recording medium, and can be executed by the processor of the electronic device. The operations thereof are basically the same, and will not be repeated here.

In the embodiments shown in FIGS. 2A to 2D , the display and the touch sensing device are two independent components, wherein the display is used for displaying a user interface, and the touch sensing device is used for receiving input signals. In other embodiments of the present invention, the display and the touch sensing device can constitute a touch display, as shown in FIGS. 9A and 9B .

FIG. 9A is a perspective view of a handheld electronic device with unimpeded touch operation according to an embodiment of the present invention, and FIG. 9B is a cross-sectional view of the electronic device in FIG. 9A . The electronic device includes a housing 901 , a touch-sensitive display 902 , and a processor 903 . The casing 901 has an outer surface 904 and an accommodating space 905 , and the accommodating space communicates with the outside through an opening 906 on the outer surface 904 . The touch display 902 includes a display 907 and a touch sensing device 908 . The display 907 is disposed in the accommodating space 905 of the casing 901 . The touch sensing device 908 is disposed in the opening 906 of the outer surface 904 of the casing 901 for receiving an operation of an input tool. The touch sensing device 908 has a touch sensing plane 909 , and the touch sensing plane 909 includes a display area 910 and a non-display area 911 . The edge of the opening 906 of the housing 901 is in continuous contact with the touch-sensing plane 909, and the outer surface 904 of the housing 901 does not protrude from the touch-sensing plane 909, and the housing 901 referred to here does not include the hand-held electronic device. hotkeys or keys. The processor 903 is coupled to the display 907 and the touch sensing device 908 for determining the type of the input tool and executing a preset function according to the tool type.

It is worth noting that because the outer surface 904 of the housing 901 does not protrude from the touch-sensitive plane 909, the housing surface 904 and the touch-sensitive plane 909 are equivalent to a continuous smooth surface, allowing the input tool to move and operate without hindrance . Furthermore, since the non-display area 911 exposed by the touch-sensitive plane 909 is not covered by the housing 901 as conventionally, in the design of the handheld electronic device, in addition to allowing the input tool to move and operate without hindrance, This non-display area 911 can be fully utilized to add more touch operation applications that make users feel more convenient.

Like the previous embodiments, the processor 903 can determine the type of the input tool according to the area, pressure, temperature, or image when the input tool operates the touch sensing device 908 . As for the details of the judging process and the execution of the preset functions, etc., which have been seen in the previous embodiments, the description will not be repeated.

To sum up, the present invention can determine the tool type of the input tool, and enable or disable the navigation function of the user interface according to the different tool types. The user can operate the electronic device in a more convenient way, thereby improving the efficiency and convenience of use.

Although the present invention has been disclosed above with preferred embodiments, it is not intended to limit the present invention, and anyone with ordinary knowledge in the technical field may make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention should be defined by the claims.

Claims (49)

1. A method for operating a user interface, suitable for a handheld device, comprising: receiving an input signal; determining the type of an input tool generating the input signal; and A user interface navigation function is enabled or disabled according to the type of the tool. 2. The method for operating a user interface according to claim 1, wherein the input signal is generated when the input tool touches or approaches a touch sensing device, and the step of determining the type of the tool comprises: When the input tool touches or approaches the touch sensing device, the type of the tool is determined according to the area, pressure, temperature, or image sensed by the touch sensing device. 3. The operation method of the user interface as claimed in claim 2, wherein the step of judging the type of the tool comprises: record an information contained in the input signal within a specific time; calculate the range of change for that information over that specified time; and The type of the tool is judged according to the size of the variation range. 4. The operation method of the user interface as claimed in claim 3, wherein the step of recording the information comprises: This information is recorded every sampling time during the specified time. 5 . The operating method of the user interface according to claim 3 , wherein the information is the position or pressure of the input tool touching or approaching the touch sensing device. 5 . 6. The operation method of the user interface as claimed in claim 2, wherein the step of judging the type of the tool comprises: counting the number of sensing pads on the touch sensing device within a specific time period; and The type of the tool is judged according to the number of the sensing pads. 7. The operation method of the user interface as claimed in claim 2, wherein the step of judging the type of the tool comprises: detecting a tool temperature when the input tool touches or approaches the touch sensing device; and The tool type is determined by comparing the tool temperature with a preset temperature. 8. The operation method of the user interface as claimed in claim 2, wherein the step of judging the type of the tool comprises: capture an image including the input tool; and According to the feature or size of the input tool in the image, the type of the tool is determined. 9. The operating method of a user interface according to claim 1, wherein the user interface navigation function comprises a user interface translation function or a user interface scroll function. 10. The operating method of the user interface according to claim 1, further comprising: In a user interface, the input signal is received. 11. The method for operating a user interface according to claim 10, wherein the user interface is displayed on a display, and a touch sensing device receives the input signal, and the display and the touch sensing device A touch display is formed. 12. The operating method of the user interface according to claim 11, further comprising: If the tool category is a first category, then disable the user interface navigation function; and If the tool type is a second type, then enable the user interface navigation function. 13. The operating method of a user interface according to claim 12, wherein the user interface navigation function comprises a user interface translation function or a user interface scroll function. 14. The operating method of the user interface according to claim 13, wherein if the type of the tool is the second type, the operating method of the user interface further comprises: check whether the input tool has left the touch-sensitive device; and If the input tool has not left the touch sensing device, the user interface translation function is executed. 15. The operating method of the user interface according to claim 13, further comprising: If the input tool has left the touch sensing device, checking whether the input tool moves while leaving; and If the input tool moves when leaving, the user interface scrolling function is executed. 16 . The operating method of the user interface according to claim 12 , wherein the first category includes a stylus, and the second category includes a finger. 17. An electronic device capable of identifying types of input tools, comprising: a display; a touch sensing device for receiving an operation of an input tool; and A processor, coupled to the display and the touch sensing device, is used for judging the type of the input tool, and opening or closing a user interface navigation function according to the tool type. 18 . The electronic device capable of identifying the type of input tool as claimed in claim 17 , wherein the processor judges the tool type according to the area, pressure, temperature, or image when the input tool operates the touch sensing device. 19. The electronic device capable of identifying types of input tools as claimed in claim 18, wherein the touch sensing device generates an input signal according to the operation of the input tool, and the processor records the output of the input signal within a specific time period. The included information calculates the variation range of the information within the specified time, and then judges the type of the tool according to the size of the variation range. 20. The electronic device capable of identifying types of input tools as claimed in claim 19, wherein the processor records the information every sampling time within the specific time. 21. The electronic device capable of identifying types of input tools as claimed in claim 19, wherein the touch sensing device comprises a resistive sensor, and the information is the position or pressure of the input tool operating the resistive sensor. 22. The electronic device capable of identifying types of input tools as claimed in claim 18, wherein the touch sensing device comprises a capacitive sensor, and the processor calculates that the input tool operates the touch sensor within a specific time. When the device is installed, the number of sensing pads generated in the capacitive sensor is used to determine the type of the tool according to the number of sensing pads. 23. The electronic device capable of identifying types of input tools as claimed in claim 18, wherein the touch sensing device includes a temperature sensor, and the processor detects when the input tool operates the touch sensing device through the temperature sensor The tool temperature is compared with a preset temperature to determine the type of the tool. 24. The electronic device capable of identifying types of input tools as claimed in claim 18, wherein the touch sensing device comprises an image capturing device for capturing an image including the input tool, wherein the processor According to the feature or size of the input tool in the image, the type of the tool is determined. 25. The electronic device capable of identifying types of input tools as claimed in claim 17, wherein the user interface navigation function comprises a user interface translation function or a user interface scroll function. 26. The electronic device capable of identifying types of input tools as claimed in claim 17, wherein the display and the touch sensing device form a touch display. 27. The electronic device capable of identifying types of input tools as claimed in claim 26, wherein the user interface navigation function comprises a user interface translation function or a user interface scroll function. 28. The electronic device capable of identifying the type of input tool as claimed in claim 27, wherein if the tool type is a first type, the processor disables the user interface translation function and the user interface scrolling function function, if the tool type is a second type, then the processor enables the user interface translation function and the user interface scroll function. 29. The electronic device capable of identifying the type of input tool as claimed in claim 28, wherein if the tool type is the second type, the processor checks whether the input tool has left the touch sensing device, if The processor executes the translation function of the user interface before the input tool leaves the touch sensing device. 30. The electronic device capable of identifying types of input tools as claimed in claim 29, wherein if the input tool has left the touch sensing device, the processor checks whether the input tool moves while leaving, if the If the input tool moves when leaving, the processor executes the user interface scrolling function. 31. The electronic device capable of identifying types of input tools as claimed in claim 28, wherein the first type includes a stylus, and the second type includes fingers. 32. An electronic device with unimpeded touch operation, used to identify the type of input tool, including: a shell with an opening; A touch-sensitive display is arranged in the opening of the housing to receive the operation of an input tool, the touch-sensitive display has a touch-sensitive plane, and the outer surface of the housing does not protrude substantially from the touch control sensing plane; and A processor, coupled to the touch-sensitive display, is used for judging the type of the input tool, and opening or closing a user interface navigation function according to the tool type. 33. The electronic device with unimpeded touch operation as claimed in claim 32, wherein the processor judges the type of the tool according to the area, pressure, temperature, or image of the input tool when operating the touch-sensitive display. 34. The electronic device with unimpeded touch operation as claimed in claim 33, wherein the touch display generates an input signal according to the operation of the input tool, and the processor records the input signal generated by the input signal within a specific period of time. The included information calculates the variation range of the information within the specified time, and then judges the type of the tool according to the size of the variation range. 35. The electronic device with unimpeded touch operation as claimed in claim 34, wherein the processor records the information every sampling time within the specific time. 36. The electronic device with unobstructed touch operation as claimed in claim 34, wherein the touch-sensitive display comprises a display and a touch-sensing device, and the processor is coupled to the display and the touch-sensing device device, wherein the touch sensing device includes a resistive sensor, and the information is the position or pressure of the input tool operating the resistive sensor. 37. The electronic device with unimpeded touch operation as claimed in claim 33, wherein the touch-sensitive display comprises a display and a touch-sensing device, and the processor is coupled to the display and the touch-sensing device device, wherein the touch sensing device includes a capacitive sensor, and the processor calculates the number of sensing pads in the capacitive sensor that generate induction when the input tool operates the capacitive sensor within a specific time, and according to the sensing The number of pads determines the type of tool. 38. The electronic device with unimpeded touch operation as claimed in claim 33, wherein the touch display includes a temperature sensor, and the processor detects that when the input tool operates the touch display through the temperature sensor The tool temperature is compared with a preset temperature to determine the type of the tool. 39. The electronic device with unimpeded touch operation as claimed in claim 33, wherein the touch-sensitive display comprises an image capture device for capturing an image comprising the input tool, wherein the processor According to the feature or size of the input tool in the image, the type of the tool is determined. 40. The electronic device with unimpeded touch operation as claimed in claim 32, wherein the user interface navigation function comprises a user interface translation function or a user interface scroll function. 41. The electronic device with unimpeded touch operation as claimed in claim 40, wherein if the tool type is a first type, the processor disables the user interface translation function and the user interface scrolling function function, if the tool type is a second type, then the processor enables the user interface translation function and the user interface scroll function. 42. The electronic device with unimpeded touch operation as claimed in claim 41, wherein if the tool type is the second type, the processor checks whether the input tool has left the touch-sensitive display, if The processor executes the user interface translation function before the input tool leaves the touch-sensitive display. 43. The electronic device with unimpeded touch operation as claimed in claim 42, wherein if the input tool has left the touch-sensitive display, the processor checks whether the input tool moves while leaving, if the If the input tool moves when leaving, the processor executes the user interface scrolling function. 44. The electronic device with unimpeded touch operation as claimed in claim 41, wherein the first type includes a stylus, and the second type includes a finger. 45. The electronic device with unimpeded touch operation as claimed in claim 36, wherein the touch sensing plane includes a display area. 46. The electronic device with unimpeded touch operation as claimed in claim 45, wherein the touch sensing plane further comprises a non-display area. 47. The electronic device with unimpeded touch operation as claimed in claim 37, wherein the touch sensing plane includes a display area. 48. The electronic device with unimpeded touch operation as claimed in claim 47, wherein the touch sensing plane further comprises a non-display area. 49. An electronic device with unimpeded touch operation, used to identify the type of input tool, comprising: a shell with an opening; A touch-sensitive display is arranged in the opening of the housing to receive the operation of an input tool, the touch-sensitive display has a touch-sensitive plane, and the opening edge of the housing is in continuous contact with the touch-sensitive plane connected, and the outer surface of the housing does not substantially protrude from the touch sensing plane; and A processor, coupled to the touch-sensitive display, is used for judging the type of the input tool, and executing a user interface navigation function according to the tool type.

Images