CN101488042A - User interface of portable device and operation method thereof - Google Patents

Abstract

The invention discloses an operation method of a user interface, which is suitable for an input tool to directly carry out an input operation on a virtual control panel of a portable device, and comprises the following steps: an input signal is received through the virtual control panel. And then, judging a tool type of the input tool generating the input signal on the virtual control panel. Then, a sensory feedback is generated on the portable device according to the tool type.

Description

User Interface and Operation Method of Portable Device

technical field

The present invention relates to a method for operating a user interface of a portable device, and in particular to a method for generating different sensory feedbacks according to types of input tools to confirm receiving input signals.

Background technique

With the rapid development of the two-pointing device (Pointing Stick and Touch Pad) technology, manufacturers of electronic products such as notebook computers, mobile phones, and portable multimedia players are using touch screens to replace traditional keyboards. As a new generation input interface trend. Taking a mobile phone as an example, when operating a traditional mobile phone, the user must click on the keyboard with his finger while comparing the display on the screen, so as to perform operations such as inputting text or selecting a menu. However, for operating a mobile phone combined with a touch screen, in addition to using fingers, users can also directly input text or open applications on the screen through auxiliary devices such as a stylus (stylus). It can be seen that the touch screen can provide users with more flexible and convenient input methods.

However, different from the traditional physical keyboard input, when using the touch screen to select keys, there will be no substantial input feedback, that is, when the user cannot input on the touch screen, he will get the same effect as a physical keyboard. The tactile and audible feedback produced by the keyboard rebound when inputting a signal. As a result, it is difficult for the user to immediately confirm the input action through the tactile or auditory feedback. At present, although there is a system feedback signal to solve the above-mentioned problem that the user is difficult to confirm the input action when using the touch screen, the above-mentioned feedback signal can only passively respond to the user's input action with a single feedback signal, and cannot actively identify The input tool used by the user generates different feedback signals according to the different tools used.

Contents of the invention

The purpose of the present invention is to provide a user interface operation method, which enables the user to obtain different sensory feedbacks according to different input tools to confirm the user's input action when using the touch panel for input.

The invention provides a user interface operation method, which is suitable for using an input tool to directly perform an input operation on a virtual control panel of a portable device. The method includes: receiving an input signal through the virtual control panel. Afterwards, a tool type of the input tool that generates the input signal on the virtual control panel is determined. Then, according to the type of the tool, a sensory feedback is generated on the portable device.

The present invention provides a user interface, including: a touch and display unit capable of displaying a virtual control panel and receiving an input signal generated by an input tool through contact from the virtual control panel, and an input judging unit for A tool type of the input tool is judged, and a sensory feedback device, wherein the sensory feedback device generates a sensory feedback according to the judgment result of the input judging unit.

According to the user interface and its operation method according to the preferred embodiment of the present invention, the sensory feedback includes a tactile vibration, a visual change or a sound. In addition, according to the tool type, generating the sensory feedback on the portable device includes: when the tool type is a finger of a user, the sensory feedback is the tactile vibration, and the tactile vibration includes the portable device. The portable device vibrates mechanically so that the user feels the mechanical vibration through the finger that generates the input signal, and if the tool type is a stylus, the portable device does not generate any vibration. In addition, according to the tool type, generating the sensory feedback on the portable device includes: when the tool type is a stylus, the sensory feedback is the visual change, and the visual change is based on the stylus In the selected virtual control panel, an input point serving as the input signal is a center point, and an image deformation of a water ripple is generated outward. Even if sound effects are used as feedback, different input tools can be used to give back different sound effects. For example, when the tool type is a stylus, the portable device feeds back a sharper sound, and when the tool type is a user's finger, the portable device feeds back a relatively low sound.

According to the user interface and its operation method described in the preferred embodiment of the present invention, the portable device has a touch controller as a contact interface between the input tool and the virtual control panel. The step of judging the tool type includes: when the input tool touches the touch controller, according to the area size of a contact point of the input tool on the touch controller, a pressure exerted by the input tool on the touch controller value or the touch controller senses a temperature of the input tool.

According to the user interface and its operation method according to the preferred embodiment of the present invention, wherein the portable device includes a personal digital assistant and a mobile phone.

According to the user interface and its operation method described in the preferred embodiment of the present invention, wherein the virtual control panel includes a virtual keyboard group (virtual keyboard), a selection box group (checkbox set) and a selection button group (radiobutton set) ).

In the present invention, since the touch panel is used to display the virtual control panel, when the user clicks any key, selection box or selection button, the control system of the portable device will generate a A sensory feedback signal to acknowledge receipt of an input signal. And the user can use the sensory feedback signal to directly feel the operation feeling as if operating a physical button. In addition, in the present invention, the user can decide to use different input tools to obtain different sensory feedback signals of the portable device according to personal needs, instead of only one feedback signal regardless of any input tool as before, or even is a non-feedback signal.

Description of drawings

In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and understandable, the specific embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings, wherein:

FIG. 1 is a flowchart of an operation method of a user interface according to a preferred embodiment of the present invention.

FIG. 2 is a schematic diagram of tactile vibration feedback generated by using a finger as an input tool according to a preferred embodiment of the present invention.

FIG. 3 is a schematic diagram of visual change feedback generated by using a stylus as an input tool according to a preferred embodiment of the present invention.

FIG. 4 is a system architecture diagram of a user interface according to a preferred embodiment of the present invention.

Description of main component symbols:

S101～S105: process steps

200: Portable device

202: Touch and display unit

204: Virtual Control Panel

208: Ripple deformation

300: fingers

302: Stylus

400: User Interface

402: Touch and display unit

404: input judgment unit

406: Vibration device

408: Sound Effect Device

Detailed ways

FIG. 1 is a flowchart of an operation method of a user interface according to a preferred embodiment of the present invention. Please refer to FIG. 1 , firstly, in step S101 , an input tool is used to directly perform an input operation on a virtual control panel of a portable device, and the portable device receives an input signal through the virtual control panel. The portable device is, for example, a portable computer, a personal digital assistant (PDA) or a mobile phone. FIG. 2 is a schematic diagram of tactile vibration feedback generated by using a finger as an input tool according to a preferred embodiment of the present invention. FIG. 3 is a schematic diagram of visual change feedback generated by using a stylus as an input tool according to a preferred embodiment of the present invention. Please refer to FIG. 1, FIG. 2 and FIG. 3 at the same time. The above-mentioned portable device 200 has a touch and display unit 202, for example, wherein the touch and display unit 202 has a display screen and receives input signals generated by touching its surface. function, so using this touch and display unit 202 can create a virtual control panel 204, that is to say, the keys on the virtual control panel 204 are non-physical keys generated through display, and these non-physical keys are touched through input tools The buttons also have the function of signal input. The virtual control panel 204 shown in FIG. 2 and FIG. 3 of the present invention has only one virtual keyboard, including 12 independent buttons. However, the present invention is not limited to this illustration. The key types in the virtual control panel 204 may also include a checkbox set, a radio button set, and the like.

Next, in step S103 , a tool type of the input tool that generates the input signal on the virtual control panel 204 is determined. Wherein, the method for judging the tool type of the input tool includes that when the user touches the virtual control panel 204 with an input tool, the input tool can be applied to the virtual control panel 204 according to the size of a contact point area of the input tool on the virtual control panel 204 . The tool type of the input tool used by the user can be judged by a pressure value on the screen or the temperature of the input tool sensed by the virtual control panel 204 . That is to say, the area of the contact point sensed by the virtual control panel 204 (generally speaking, the contact area of the finger 300 will be larger than that of the stylus 302), the contact pressure value (generally, the contact pressure generated by the finger 300 will be smaller than the stylus 302) and the temperature of the input tool (generally speaking, the temperature of the finger 300 is higher than that of the stylus 302) and other parameters, compared with the built-in database of the portable device, it can be identified and used The tool type of the input tool used by the reader.

Then, in step S105 , the tool type of the input tool used by the user generates a sensory feedback on the portable device 200 confirming receipt of the input signal. That is, for different input tools, the portable device 200 automatically feeds back a feedback signal to the user, so that the user knows that the portable device 200 has received the input signal. And the sensory feedback can be a mechanical feedback or a software feedback. That is to say, the feedback signal can be expressed by mechanical vibration or starting sound, or by executing a program to change the image of the virtual control panel 204 displayed on the touch and display unit 202 (ie, visual change). .

As shown in FIG. 2 , when the tool type is the user's finger 300 , the sensory feedback is, for example, a tactile vibration or a sound change, allowing the user to clearly know that the work of the signal input has been completed. The tactile vibration includes that the portable device 200 vibrates mechanically, and the user feels the mechanical vibration through the finger 300 that generates the input signal. The mechanical vibration is, for example, activated by a built-in vibration device. In addition, the vibrating device can be directly connected with the touch and display unit 202 that the input tool is in contact with, so as to provide the virtual control panel 204 with a mechanical vibrating tactile sensation. If it is detected that the input tool is the stylus 302 , the tactile feedback method is not used or the vibration method of other frequencies is used.

Please refer to FIG. 3, because the tactile feedback method may not be completely conveyed to the user through the stylus 302, so when the tool type is a stylus 302, for example, visual changes, sound changes or Do not produce any sensory response, etc. as a way of feedback. Wherein the visual change is, for example, in the virtual control panel 204 selected by the stylus 302, as an input point/input button (key 0 in this embodiment) as an input signal, an image deformation (such as water) is generated outwards. Ripple deformation 208), and the image deformation is, for example, a software feedback generated by executing a program. If it is detected that the input tool is the finger 300 , no visual feedback method or other image deformation methods are used.

Please refer to FIG. 2 and FIG. 3 at the same time, wherein the change of the sound can also be used as sensory feedback for different input tools. For example, when the detected tool type is a finger 300, the sound effect device of the portable device 200 emits a button sound effect (such as a relatively deep button sound effect), and if the detected tool type is a stylus 302, it can The sound effect device of the portable device 200 emits another key sound effect (such as a sharper key sound effect). Another embodiment consistent with the present invention further provides a system architecture of a user interface 400 capable of implementing the aforementioned user interface operation method. Referring to FIG. 4 , the user interface 400 includes a touch and display unit 402 , an input determination unit 404 , a vibration device 406 and an audio device 408 .

The touch and display unit 202 shown in Figure 2 and Figure 3 is general, the touch and display unit 402 has the function of displaying the screen and receiving the input signal generated by touching its surface at the same time, so using this touch and display Unit 402 can create a virtual control panel.

The input judging unit 404 can judge which input tool the user uses to input signals on the aforementioned virtual control panel, such as distinguishing fingers and stylus. The contact area of the stylus will be larger than that of the stylus), the contact pressure value (generally speaking, the contact pressure generated by the finger will be smaller than that of the stylus), and the temperature of the input tool (generally, the temperature of the finger will be lower than that of the stylus) Come too high) and other parameters as the basis for judgment.

After determining the type of the input tool, the input judging unit 404 controls a sensory feedback device to generate a sensory feedback to the user, wherein different types of sensory feedback are generated for different input tools. In this embodiment, the sensory feedback includes tactile feedback, visual feedback and auditory feedback, etc., so the sensory feedback device includes a touch and display unit 402 , a vibration device 406 and an audio device 408 .

As described in the previous embodiments, when the input judging unit 404 determines that the input tool is a finger, it controls the vibrating device 406 to generate tactile vibrations to allow the user to feel tactile feedback, wherein the tactile vibrations may be mechanical vibrations. In addition, the vibrating device 406 can be directly connected to the touch and display unit 402 that the input tool is in contact with mechanically, so as to provide the virtual control panel with the tactile sensation of mechanical vibration. If the input judging unit 404 detects that the input tool is a stylus, it does not use the tactile feedback method or adopts other vibration methods.

As described in the previous embodiments, when the input judging unit 404 judges that the input tool is a stylus, it will control the touch and display unit 402 to change the vision, change the sound, or not produce any sensory response as a feedback method. Wherein the visual change is, for example, in the virtual control panel selected by the stylus, as the periphery of an input point of the input signal, an image deformation (such as water ripple-like deformation) is generated outward, and the image deformation is, for example, the execution of a program A software feedback is generated. If it is detected that the input tool is a finger, no visual feedback method or other image deformation methods are used.

As mentioned in the previous embodiments, the input judging unit 404 also uses the change of the sound as the auditory feedback generated for different input tools. For example, when the tool type detected by the input judging unit 404 is a finger, the input judging unit 404 will control the sound effect device 406 to send out a key sound effect (such as a relatively deep key sound effect), and if the tool type detected by the input judging unit 404 When it is a stylus, the input judging unit 404 will control the sound effect device 406 to emit another key sound effect (such as a sharper key sound effect).

In the present invention, since the touch and display unit is used to display the virtual control panel, when the user clicks any button, selection box or selection button, the control system of the portable device will follow the input tool used by the user. Types, responding to different sensory feedback signals to the user, so that the user can confirm its input action definitely. Moreover, the user can directly feel the operation feeling as if operating a physical button by means of the sensory feedback signal. In addition, in the present invention, the user can decide to use different input tools to obtain different sensory feedback signals of the portable device according to personal needs, instead of only one feedback signal regardless of any input tool as before, or even is a non-feedback signal. Among them, the above-mentioned types of sensory feedback are just examples for the convenience of describing the present invention, and are not intended to limit the present invention, and these sensory feedback methods can also be mixed with each other, for example, to achieve different tactile and sound effects at the same time Feedback on a portable device.

Although the present invention has been disclosed above with preferred embodiments, it is not intended to limit the present invention. Any person skilled in the art may make some modifications and improvements without departing from the spirit and scope of the present invention. Therefore, the present invention The scope of protection should be defined by the claims.

Claims (10)

1. the How It Works of user's interface is suitable for and directly carries out an input operation on a virtual control panel of a portable apparatus with an input tool, and this method comprises:

Via this virtual control panel, receive an input signal;

Judge a tool kind that on this virtual control panel, produces this input tool of this input signal; And

According to this tool kind, on this portable apparatus, produce a sense organ feedback.

2. the How It Works of user's interface as claimed in claim 1 is characterized in that, according to this tool kind, produces this sense organ feedback and comprise on this portable apparatus:

When this tool kind was a finger of a user, then this sense organ feedback was a tactile vibrations.

3. the How It Works of user's interface as claimed in claim 1 is characterized in that, according to this tool kind, produces this sense organ feedback and comprise on this portable apparatus:

When this tool kind was a pointer, then this sense organ feedback was a visible change that results from this portable apparatus.

4. the How It Works of user's interface as claimed in claim 1 is characterized in that, according to this tool kind, produces this sense organ feedback and comprise on this portable apparatus:

When this tool kind was a finger of a user, this sense organ feedback was a resonant; And

When this tool kind was a pointer, this sense organ feedback was another resonant.

5. the How It Works of user's interface as claimed in claim 1, it is characterized in that, the step of judging this tool kind comprises: analyze this input signal, impose on a temperature that a force value on this virtual control panel or this virtual control panel respond to this input tool as the foundation of judging this tool kind so as to obtaining this input tool in a contact point area size, this input tool on this virtual control panel.

6. portable apparatus comprises:

One touch-control and display unit can show a virtual control panel and receive the input signal that an input tool is produced via contact from this virtual control panel;

One input judging unit is in order to judge a tool kind of this input tool; And

One sense organ feedback device, wherein this sense organ feedback device is the judged result according to this input judging unit, to produce a sense organ feedback.

7. portable apparatus as claimed in claim 6 is characterized in that, this sense organ feedback device comprises a vibrating device, and when this tool kind was a finger of a user, this sense organ feedback was a tactile vibrations.

8. portable apparatus as claimed in claim 6 is characterized in that, this sense organ feedback device comprises this touch-control and display unit, and when this tool kind was a pointer, this sense organ feedback was a visible change that results from this virtual control panel.

9. portable apparatus as claimed in claim 6 is characterized in that, this sense organ feedback device comprises an audio device, when this tool kind is a finger of a user, this audio device feedback one resonant, when this tool kind is a pointer, this another resonant of audio device feedback.

10. portable apparatus as claimed in claim 6, it is characterized in that, this input judging unit is utilize to analyze this input signal, imposes on a temperature that a force value on this virtual control panel or this virtual control panel respond to this input tool as the foundation of judging this tool kind so as to obtaining this input tool in a contact point area size, this input tool on this virtual control panel.

Images