CN103576900B - Seamless link method chosen by Writing-painting based on a multi-parameter information and menu - Google Patents

Abstract

The invention provides a method for seamlessly linking writing, drawing and menu selection based on pen multi-parameter information. The invention can meet the user's need to select a function menu in a tool bar without moving the pen tip when writing and drawing freely. This method can not only realize the menu selection based on the pen tip not moving, but also solve the disadvantage of inconvenient operation for long-distance menu selection in large screens.

Description

A method for seamless linking of writing, drawing and menu selection based on pen multi-parameter information

technical field

The invention belongs to the field of human-computer interaction, and specifically relates to a method for controlling menu selection by using multi-parameter information of the pen at the current position of the pen tip, that is, a menu that seamlessly connects the writing and drawing mode with the menu control mode in the pen-type interactive interface Choose a method.

Background technique

The traditional pen-style operation interface only relies on the movement trajectory of the pen tip (two-dimensional time series position information x(t), y(t)) to realize input. Therefore, when performing a menu selection operation, if there are no other auxiliary tools, the user needs to stop the ongoing writing and drawing task, and then move the pen tip to click a menu item to realize the menu selection operation. For example, in the process of drawing a picture, the user will frequently change the color of the brush, the thickness of the line, and select different drawing tools, etc., thus causing the pen device to go back and forth between the writing area and the command area (menu selection area) Switching can easily cause physical fatigue and waste of time.

In addition, in large-screen operation, the menu is far away, inconvenient to operate, time-consuming and labor-intensive, and prone to ambiguity, that is, the movement track caused by menu selection cannot be determined by the device as part of writing or drawing. At present, some people have studied the menu selection method based on the pen tip not moving, such as Toolglass (Bier, E.A., Stone, M.C., Pier, K., Buxton, W., Derose, T.D., Toolglass and magic lenses: The see-throughinterface. In Proc. SIGGRAPH 1933,73-80.) and Tilt Menu (Tian, F., Xu, L.,Wang, H., Zhang, X., Liu, Y., Setlur,V. and Dai, G. (2008 ). Tilt menu: using the 3D orientation information of pen devices to extend the selection capability of pen-based user interfaces. Proc. CHI, 1371-1380.), but this menu design has a limited number of menus to choose from, limited to commonly used There are several menu options, which cannot meet the needs of users very well.

Contents of the invention

Purpose of the invention: The present invention provides a method for seamlessly linking writing, drawing and menu selection based on pen multi-parameter information.

Technical solution: the present invention is achieved through the following technical solutions:

A method for seamlessly linking writing, drawing and menu selection based on pen multi-parameter information, characterized in that: the specific steps of the method are as follows:

(1) Use the pressure and angle sensors inside the system to monitor the parameters of the pen inclination angle, rotation angle and pressure in real time. The pen holder is tilted to a state within 30° from the operating plane, that is, the tilt angle of the pen is placed within the range of 0° to 30°, which can trigger the mode conversion operation, and convert the pen from the input mode to the menu selection command mode;

(2) After the mode conversion command is triggered, use the signal processing and control module to divide the available tilt angle range of 30° to 150° according to the number of tabs in the current writing and drawing interface, and process the equalized tilt angle range , so that different tilt angle ranges are mapped to different tabs; the user needs to tilt the pen holder to browse the target, when the target tab is highlighted, the user confirms the tab by increasing the pressure of the pen tip;

(3) After step (2) is confirmed, use the signal processing and control module to monitor the current rotation angle information of the pen and divide the available rotation angle range from 0° to 360° into equal parts according to the number of first-level submenus, and map them to different The submenu corresponding to the angle range. If the user wants to select the first-level submenu contained in the tab, the pen should be rotated clockwise or counterclockwise around the pen axis; after the user locates the submenu according to the highlighted prompt, increase the pen pressure to confirm the option.

When the user selects the second-level submenu based on the "(3)" step, the selection method is the same as that of the first-level submenu.

Use the signal processing and control module to collect the current parameter information of the electronic stylus such as tilt angle, rotation angle and pressure every 20ms, and give the signal processing results: when the pen tilt angle<30°, trigger the mode conversion command, when 30° When ≤pen tilt angle≤150°, select the tab; after confirming the tab with pen pressure, if you need to select a submenu item, the signal processing and control module will perform submenu item selection based on the currently monitored pen rotation angle information. Browse; after confirming the selection of the target menu, the pen will switch from the command mode back to the input mode, and the user can continue to write and draw.

The method of using the tilt angle of the pen to select the tab described in step (2) is: use the signal processing and control module to divide the available tilt angle range of the pen from 30° to 150° according to the number of tabs in the current writing and drawing interface, And different inclination angle intervals correspond to different tabs in turn; then monitor the current inclination angle value of the pen in real time, and determine the inclination angle interval where the inclination angle value of the current pen is located; finally, the tab corresponding to the inclination angle interval Highlighted to provide visual feedback to the user to confirm the selection.

The method of using the rotation angle of the pen to select submenu options described in step (3) is: the signal processing and control module divides the available rotation angle of the pen from 0° to 360° according to the number of submenus under the current tab, and the divided Each rotation angle interval corresponds to each submenu item contained in the tab in turn; then monitor the current rotation angle value of the pen in real time, and determine the rotation angle interval in which the current rotation angle value of the pen is located; finally correspond to the rotation angle interval The submenu item of the is highlighted, providing visual feedback to the user for the user to confirm the selection. The pen body can be rotated clockwise or counterclockwise, which can respectively realize the sequential highlighting of menu items in two opposite directions.

The pen tip pressure used when confirming a menu item is greater than the pressure range in which the user normally writes and draws freely, that is, a force far greater than 4N is used to confirm the selected menu.

The method of judging the rotation direction of the pen body is: use the information processing and control module to collect the rotation angle information of the pen every 20ms and perform sampling and recording, and compare the angles of two adjacent records. If the latter is greater than the former, it is judged as The user is currently rotating the pen clockwise. Similarly, if the former is greater than the latter, it is determined that the user is currently rotating the pen counterclockwise.

Advantages and effects: The present invention provides a method for seamlessly linking writing, drawing and menu selection based on pen multi-parameter information. This invention can meet the user's need to select the function menu in the toolbar without moving the pen tip when writing and drawing freely. This method can not only realize the menu selection based on the pen tip not moving, but also solve the disadvantage of inconvenient operation for long-distance menu selection in large screens.

The invention fully and rationally utilizes the multi-parameter information based on the pen in the pen-type interactive device to control the selection operation of the command menu, saves the time and distance consumed by the user to select menu items multiple times back and forth, and improves the efficiency. The present invention has more advantages in selecting a long-distance menu in a large-screen operating environment.

Description of drawings:

Fig. 1 is a schematic diagram of four parameter information (respectively pressure, tilt angle, azimuth angle, and rotation angle) of the pen used in the method of the present invention.

FIG. 2 is a schematic diagram of the present invention using an inclination angle ranging from 0° to 30° (the azimuth angle can be arbitrary) to trigger the mode switching operation.

FIG. 3 is a schematic diagram of selecting tabs by using the tilt angle of the pen in the present invention, and confirming the selected items by using the pressure of the pen tip.

Fig. 4 is a schematic diagram of the present invention using the rotation angle of the pen to execute the selection of the first-level menu, and using the pen pressure to confirm.

Fig. 5 is a schematic diagram of the present invention to rotate clockwise to execute the selection of the secondary menu, and use the pen pressure to confirm.

Fig. 6 is a schematic diagram of the second-level menu selection performed by counterclockwise rotation in the present invention, and confirmed by pen pressure.

detailed description:

In order to facilitate a better understanding, the use method of the present invention will be described in detail below in conjunction with the accompanying drawings:

The present invention provides a method for seamlessly linking writing, drawing and menu selection based on pen multi-parameter information, which is characterized in that: the pen multi-parameter information used is information on inclination angle, rotation angle and azimuth angle as shown in FIG. 1 . Among them, the pen tilt angle refers to the angle α between the plane of the pen input device and the pen body as shown in Figure 1, and the range of the pen tilt angle recognized by the device can be extended from 30° to 90° to 30° through the aid of the azimuth angle. °～150°. The pen azimuth refers to the angle β between the projection of the pen body on the plane of the pen input device as shown in Figure 1 and the north of the pen input device, and the range of use is 0° to 360°. Left and right handed users. The pen rotation angle refers to the angle of rotation along the radial axis of the pen tube, and the range of use is 0° to 360°. The f in Figure 1 is a sign indicating the rotation angle.

Concrete use steps of the present invention are as follows:

According to our previous research (Xin, Y., Bi, X., Ren, X., Natural Use Profiles for the Pen: An Empirical Exploration of Pressure, Tilt, and Azimuth. CHI2012, ACM Press (2012), 801-804. ), and obtained the commonly used ranges of pressure, inclination angle, azimuth angle and rotation angle when the user uses the pen for natural writing and painting. Therefore, based on the cumbersome problem of current menu selection, we make full use of the multi-parameter information of the pen and design the following How to seamlessly link writing, drawing and menu selection:

(1) When the user uses the pen to freely write and draw or operate freely in the pen-style interactive interface, if a certain menu item needs to be selected, the user does not need to lift and move the pen tip, and the multi-parameter information of the pen can be used at the current position of the pen tip Implement the menu selection operation. As shown in Figure 2, when the user wants to select a menu item during writing, the user tilts the pen to the range of 0°-30° in the current area of the pen tip, and triggers the mode conversion operation after the analysis and processing by the signal processing and control module. Switches the pen from input mode to menu selection command mode.

(2) Referring to Figure 3, there are five tabs in total. After the user triggers the mode conversion, use the signal processing and control module to divide the tilt angle interval of 30°～150° into five equal tilt angle intervals according to the number of current tabs, and Corresponding to the five tabs in turn; then sample the tilt angle in real time at a frequency of 20ms to determine which tab the current tilt angle value of the pen belongs to; when the user tilts the pen to the range of 78°~102° , corresponding to the third tab is highlighted at this time, and the user can confirm the selection of the third tab by increasing the pressure of the pen tip according to the visual feedback.

(3) After confirming the selection of the tab, if it is necessary to continue to select the second submenu, as shown in Figure 4, the user rotates the pen clockwise and rotates the pen rotation angle to the angle range corresponding to the second submenu. The processing method of the signal processing and control module is the same as step (2), after the target menu is highlighted, increase the pressure of the pen tip to confirm the selection.

(4) If the user selects a menu item in the second-level submenu, as shown in Figure 5, the user needs to rotate the pen body along the radial axis of the pen tube again. Different rotation angle ranges correspond to different submenu highlights. When the target submenu is highlighted, increase tip pressure to confirm the selection. Similarly, the selection method of the third-level submenu is the same as that of the second-level submenu.

When using the pen rotation angle for menu selection, in order to facilitate manipulation, clockwise rotation and counterclockwise rotation correspond to the sequential highlighting of menu items in two opposite directions. As shown in Figure 5, when the pen is rotated clockwise, the menus are highlighted sequentially from top to bottom; as shown in Figure 6, when the pen is rotated counterclockwise, the menus are highlighted sequentially from bottom to top.

The method for seamlessly linking writing and drawing with menu selection based on the multi-parameter information of the pen proposed by the present invention can enable the user to select the target menu item without repeatedly moving the pen tip during the free writing and drawing process, especially solving the problem of remote control in the large-screen operating environment. The problem that the distance menu is not easy to manipulate. This method not only saves time, is convenient for users to operate, and is not easy to cause limb fatigue.

Claims (5)

1. a Writing-painting based on a multi-parameter information chooses seamless link method with menu, it is characterised in that: the method Step as follows:

(1) pressure utilizing internal system monitors the inclination angle of pen, the anglec of rotation and pressure parameter letter in real time with angular transducer Breath, when user's Free Writing drawing in handwriting pad, if a certain menu item need to be selected, then inclines penholder in nib current location Tiltedly to becoming the state within 30 ° with operation planar, patten transformation behaviour will be triggered in the range of the inclination angle of pen is placed in 0 °～30 ° Make, pen is converted to menu by input pattern and chooses command mode；

(2), after patten transformation command triggers, utilize signal processing and control module according to tab in current Writing-painting interface Number 30 °～150 ° of available tilt angles scopes are carried out decile, and the tilt angle ranges after decile is processed so that no Same tilt angle ranges is mapped to different tab；User needs penholder to browse to carry out target, when targets option card When being highlighted, tab is confirmed by user by increasing pen point pressure；

(3) after step (2) confirms, utilize signal processing and control module to monitor the current rotary angle information of pen and by 0 °～ 360 ° of available rotation angle carry out decile according to the quantity of one-level submenu, and are sequentially mapped to corresponding to different angles scope Submenu；If the one-level submenu that user's tab to be selected is comprised, then pen is rotated around an axle clockwise or counterclockwise； After user is according to highlighted prompting locator menu, increases pen pressure and option is confirmed；

When user selects secondary sub-menu on the basis of " (3) " step, choose the mode of operation of mode and one-level submenu Identical；

Signal processing is utilized to gather, every 20ms, inclination angle, the anglec of rotation and the pressure that primary electron writing pencil is current with control module Parameter information also provides signal processing results: as an inclination angle ＜ 30 °, triggers pattern conversion command, when 30 °≤inclinations angle When≤150 °, carry out the selection operation of tab；After using pen pressure to confirm tab, if Submenu Items, then signal need to be selected Process can carry out Submenu Items according to a currently monitored rotary angle information with control module and browse；When confirming that target menu is chosen Afterwards, pen will be converted back input pattern by command mode, and user can proceed with Writing-painting operation.

Seamless link method chosen by Writing-painting based on a multi-parameter information the most according to claim 1 and menu, its It is characterised by: the mode of the inclination angle selection tab using pen described by step (2) is: utilizes signal processing and controls mould The available tilt angles scope 30 °～150 ° of pen is split by block according to the number of tab in current Writing-painting interface, and Different intervals, inclination angle is corresponding in turn in different tab；The tilt values that monitoring pen is current the most in real time, and judge The inclination angle at the tilt values place going out current pen is interval；Finally tab corresponding for this interval, inclination angle is highlighted, for User provides visual feedback to confirm to select for user.

Seamless link method chosen by Writing-painting based on a multi-parameter information the most according to claim 1 and menu, its It is characterised by: the mode of the anglec of rotation selection sub-menu option utilizing pen described by step (3) is: signal processing and control mould The available anglec of rotation 0 °～360 ° of pen is split by block according to the number of submenu under current tab, each after segmentation Anglec of rotation interval is corresponding in turn to each Submenu Items comprised in tab；The rotation angle values that monitoring pen is current the most in real time, And judge that the anglec of rotation at the rotation angle values place of current pen is interval；Finally by highlighted for Submenu Items corresponding for this anglec of rotation interval Display, provides the user visual feedback and confirms to select for user；Body rotates to turn clockwise and also can rotate counterclockwise, can Realize being highlighted successively of menu item on two rightabouts respectively.

Seamless link method chosen by Writing-painting based on a multi-parameter information the most according to claim 1 and menu, its It is characterised by: confirm that the pen point pressure used during menu item is greater than pressure present during user's normal Free Writing drawing Scope.

Seamless link method chosen by Writing-painting based on a multi-parameter information the most according to claim 3 and menu, its It is characterised by: the mode of a judgement body direction of rotation is: utilize information processing and control module to gather once pen every 20ms Rotary angle information also carries out sample record, is contrasted by the angular dimension of adjacent twice record, if the latter is more than the former, sentences Break the operation that currently pen turned clockwise for user, in like manner, if the former is more than the latter, it is judged that currently pen is entered for user Row rotation process counterclockwise.