CN104635922A - command device - Google Patents

Abstract

The present invention relates to a command device. An instruction device is used for communicating an instruction with an icon in an image area, and includes a motion sensing unit and a processing unit. The motion sensing unit senses a first motion to generate a corresponding first signal. The processing unit generates a first trajectory to determine a first region in the image area in response to the corresponding first signal to determine whether the icon should or has been selected based on a relationship between the first region and a second region where the icon is displayed in the image area.

Description

command device

This application is a divisional application of an application whose filing date is August 10, 2009, application number is 200980131344.3, and the title of the invention is "command device and communication method".

technical field

The present invention relates to an instruction device and a communication method, and more particularly to a device and method for communicating instructions with image icons.

Background technique

For a long time, the general operation mode of a conventional two-dimensional (2D) mouse moving on the desktop is to position the cursor (Cursor) on the computer screen in the icon (Icon), and then continuously press the left button of the mouse to execute the operation of the icon. Function. Please refer to FIG. 1( a ) and FIG. 1( b ), which are diagrams illustrating conventional selection configurations 911 and 912 of the icon selection system 91 . As shown in FIG. 1( a ), the selection configuration 911 includes a display system S91 , a display area A91 , a cursor C91 and a mouse M91 . A plurality of icons I1, I2, I3, I4, I5, and I6 are displayed in the display area A91. The mouse M91 can be a two-dimensional (2D) mouse operated on a plane or a three-dimensional (3D) mouse operated in the air. As shown, regarding the operation of selecting the icon I2, the purpose of the movement of the conventional mouse M91 is to move the cursor C91 to the desired icon I2. Therefore, the movement of the mouse M91 moves the cursor C91 in the X or Y direction.

As shown in Figure 1 (b), the cursor C91 in the selection configuration 912 is used to select the icon I1, and the motion trace GA of the cursor C91 may generally include a plurality of connected line segments, such as those line segments A1, A2, A3, A4, A5, A6, A7 and A8.

Recently, since accelerometers, gyroscopes, and electronic compasses of micro-electromechanical types are more common, so-called three-dimensional mice that sense hand motions in the air to control computer screen cursors to select icons and perform the functions of the icons have gradually been developed. However, there is a major difference between the operation of a three-dimensional mouse and a conventional two-dimensional mouse used on a desktop. The two-dimensional mouse moving on the desktop is always supported by the contact surface of the desktop, so that when the button of the two-dimensional mouse is pressed continuously with a finger, the cursor moving on the screen will not deviate from the pointed icon, and the cursor on the screen will not deviate. Executes the icon's function when the icon is selected. In contrast, a hand-held 3D mouse operated in the air has no additional support, so when the button is continuously pressed with a finger to perform the function of the icon, the cursor moved on the screen by the 3D mouse can easily deviate from the selected object due to inadvertent hand movements. If the location of the icon is not specified, it will cause wrong operation. Unfortunately, users of commercial products such as Logitech's Air Mouse face this problem.

In order to overcome the above-mentioned problems, some companies arrange active buttons (ActiveButton) on their products to improve the movement operation of the cursor; for example, the three-dimensional mouse/AirMouse commercial product provided by Gyration Company. The method is described as follows. When the three-dimensional mouse moves in the air and the active button is pressed, the cursor on the screen can move with the mouse. When the cursor is over an icon and the active button is released, the cursor no longer moves with the mouse. At this time, pressing the button executes the function of the icon, even if the mouse is movable. Since the on-screen cursor and the movement of the mouse are disconnected from each other, the cursor can be positioned over the icon such that the function is successfully performed. Contrary to Gyration, another supplier on the market called Hillcrest also offers an Air Mouse-like device called Freespace, with control buttons arranged on the screen to fix the cursor on the screen, and the control buttons are used for the screen. The active button that moves the cursor is the opposite. That is, in operation, when the control button is released, the movement of the cursor always follows the movement of the Freespace device; however, when the control button is pressed, the movement of the cursor and the device The connection will be disconnected, the cursor will be fixed on the screen, and inadvertent movement of the device will not dislodge the cursor from its position during a double tap on the left button to perform the function of the selected icon.

Although these two modes of operation allow the function to be performed correctly, such an operation behavior actually violates ergonomic motion. Not only is the operation choppy without continuity, it is also uncomfortable.

However, in order to overcome the above-mentioned shortcoming of the conventional technology, the inventor of the present invention submitted a Taiwan patent application with application number TW097130594 titled "SELECTION DEVICE AND METHOD" and cited as a reference of the present invention, wherein its technical solution is provided as follows.

As shown in FIG. 2( a ), it is a schematic diagram showing the system architecture 921 of the above selection device and method. The selection unit U92 is configured to have a motion F21, convert the motion F21 into a trajectory G21, determine the region (Region) H21 in the display area A92 on the display system S92 according to the trajectory G21, and be displayed on the display according to the region H21 and the icon I1 The area K21 in the area A92 is used to determine whether the icon I1 is selected.

The selection unit U92 may include a motion sensing unit SS92 and a processing unit P92. The motion sensing unit SS92 converts the motion F21 into a signal S1. The processing unit P92 converts the signal S1 into a trajectory G21. In the cited reference, the processing unit P92 (such as the microprocessor P921) determines the area H21 according to the trajectory G21 to determine whether the icon I1 is selected or not according to the specific relationship of the area H21 relative to the area K21.

The operation of the selection unit in the prior art provided by the inventor of the present invention using the technique of mapping motion to a trajectory to select and execute the function of an icon on the screen of a personal computer is effective, and is effective for the operation in three dimensions Devices like an air mouse are easy to operate.

However, in the present invention, the operation of the selection unit can be further widely applied to more diverse and complex electronic menus of the man-machine operation graphical interface of the home entertainment center, wherein there are icons of various functions in different sizes, shapes and arrangements be shown. The user's operation convenience can be further improved, and the icon and electronic menu selection operation of the complex man-machine graphical interface can be improved to be more intuitive, so that the user can simply, accurately and effectively select various electronic menu items and enable its function to be executed.

Contents of the invention

It is an object of the present invention to determine a trajectory around the first zone in response to motion, or to further form a geometric pattern trajectory, or to form a geometric line. The first area, the geometric pattern locus or the geometric line is compared with the second area where the icon is located and to be selected, so that a cross relationship with enclosing, passing or covering between them is used to select the icon. After the icon is in the selected state, a movement is then performed to cause the icon's preset function to be executed, and the movement can be a tick, cross, circle movement, or other movement performed by the arm and wrist or posture. The operation method of the present invention for selecting and executing the function of the icon is not only ergonomic, but also smooth and complete in one go.

Therefore, one aspect of the present invention is to provide an instruction device for communicating an instruction with a first response medium, and the instruction device includes a sensing unit and a response unit. The sensing unit senses the first instruction medium to generate a corresponding first signal. The response unit generates a geometric reference in response to the corresponding first signal to determine whether communication between the command and the first reactive medium should be performed based on a relationship between the geometric reference and the first reactive medium.

The communication may be transmitting the instruction to the first response medium.

Said communication may be by causing said first reaction medium to be operated.

The communication may be to transmit a feedback signal to the sensing unit through the first reactive medium.

The first reaction medium may be arranged in a specific area.

said geometric reference may comprise a first trajectory;

The response unit may also determine a first zone in the specific area based on the first trajectory; and

The relationship may be a first relationship between the first zone and a second zone in the specific area where the first reaction medium is located.

The specific area may be an image area;

The specific area may be arranged on one of a screen, a monitor and a display;

The first response medium may be an icon;

The first medium of instruction may be a first movement;

The second zone may also include a second reaction medium adjacent to the first reaction medium;

The sensing unit may be a motion sensing unit and the responding unit may be a processing unit;

said communication may be conducted to determine whether said icon is or has been selected;

The instruction may be a selection instruction;

The processing unit may also convert the corresponding first signal into the first trace;

The first trajectory may include a first circular arc, a combination of a second circular arc and a first line segment, and at least one of a plurality of second line segments, the first circular arc may have an arc angle, wherein when the first circular arc When a trajectory is the first circular arc, the arc angle of the first circular arc may be one of 180° and more than 180°;

The first zone may comprise an enclosed zone;

said first movement may be produced by at least one of hands, arms, feet, legs, head, neck, shoulders, and waist;

When the first relationship is a cross relationship, the processing unit may cause the first reaction medium to be selected; and

The cross relationship may be in a specific condition, and the specific condition may be one of the following conditions:

said first zone and said second zone are a first condition of partial overlap;

said first zone and said second zone are a second condition of complete overlap;

a third condition that the first zone completely covers the second zone;

a fourth condition that the centroid of the first zone is located within the second zone;

a fifth condition that the first trajectory passes through the second zone; and

A sixth condition of the first track touching the second zone.

The instruction device may also be configured to have a second motion, the second motion is converted into a feature, and the processing unit may determine the selected state of the icon according to the feature. Whether the preset function of the icon is executed, the feature may be one of a second signal and a second track, and the second track may be one of a check mark, a cross mark and a circle mark.

The instruction device may also be configured to have a second motion, an acceleration-deceleration profile of the second motion is analyzed, and after the processing unit confirms the selected state of the icon, a predetermined It is assumed whether the function is executed, wherein the second movement may be one of a plurality of movements of ticking, crossing, drawing a wavy line, drawing a triangle, drawing an arc and drawing a circle.

The first medium of instruction may be a first movement;

said geometric reference may comprise a first trajectory;

The response unit may also determine a first zone in the specific area based on the first trajectory;

The specific area may also include a specific area in which at least a second reaction medium in the vicinity of the first reaction medium may be arranged;

The relationship may be a first relationship between the first zone and a second zone in the specific area where at least two reaction media are located together, the at least two reaction media may be replaced by the first reaction media and said at least a second reaction medium; and

The communication may be conducted to determine whether the first reactive medium is selected.

The first trajectory may comprise at least one of a first arc, a combination of a second arc and a first line segment, and a plurality of second line segments, the first arc having an arc angle;

When the first trajectory is the first circular arc, the angle of the arc angle of the first circular arc may be one of 360°, close to 360° and exceeding 360°;

When the first relationship is a cross relationship, the response unit may cause the at least two response agents to be selected; and

The at least two icons may have reverse video sequentially displayed thereon through a button for selecting the first reaction medium.

The instruction means may also be configured with a selection instruction medium to cause a particular state, wherein:

The selection instruction medium may be a selection motion, and the selection motion may be one of a yaw motion, a pitch motion, and a roll motion; and

The specific state may be one of the following states:

The at least two reactive media may have a first state of inverse video sequentially displayed thereon; and

The first trace may be scaled down to a second state of a second trace, which may be sequentially displayed on the at least two reaction media.

The geometric reference may comprise at least three reference positions;

The response unit may also determine a first zone in the specific area based on the at least three reference positions; and

The relationship may be a first relationship between the first zone and a second zone in the specific area where the first reaction medium is located.

The first instruction medium may be a physical effect, and the physical effect may be one of sound wave, light wave, non-contact force, contact force and mechanical force, wherein the non-contact force may be electromagnetic wave, electric power, magnetic force and inertial force One, and the mechanical force may be one of pressure, friction and elastic force;

The response unit may be a processor;

The first reaction medium may be frequently displayed in the specific area;

said at least three reference positions may be used to form a specific trajectory;

The specific trajectory can be a geometric pattern trajectory, and the geometric pattern trajectory can be one of a closed trajectory and an open trajectory, wherein the closed trajectory can be one of a circle, an ellipse, a polygon, a heart line and a rose line, so Said polygon can be one of triangle, rectangle and pentagon, and said non-closed locus can be one of arc, curve and cycloid;

The first zone may be surrounded by the specific trajectory;

said second zone may be associated with said first reaction medium;

The first relationship may be a cross relationship; and

The cross relationship may be in a specific condition, wherein the specific condition may be one of the following conditions:

a first condition that the first zone completely covers the second zone;

said first zone partially overrides a second condition of said second zone;

a third condition that said first zone and said second zone are completely overlapping; and

The first zone and the second zone are partially overlapping fourth conditions.

The specific area may also include a specific area in which at least a second reaction medium in the vicinity of the first reaction medium may be arranged;

The geometric reference may comprise at least three reference positions;

The response unit may also determine a first zone in the specific area based on the at least three reference positions; and

The relationship may be a first relationship between the first zone and a second zone in the specific area where at least two reaction media are located together, the at least two reaction media may be replaced by the first reaction media and said at least second reaction medium.

The geometric reference may include at least two reference positions; and

The relationship may be a first relationship between the at least two reference positions and the first reaction medium.

The at least two reference positions may be one for forming a geometric pattern and a geometric zone; and

The communication may be a specific operation, and the specific operation may be one of the following operations:

a first operation of passing the instruction to the first reaction medium; and

A feedback signal is transmitted to a second operation of the response unit through the first response medium.

The geometric reference may comprise at least two reference positions;

The response unit may also determine a geometric line based on the at least two reference positions; and

The relationship may be a first relationship between the geometric line and the first reaction medium.

The first relationship may be a positional relationship between the geometric line and a first zone in the specific area where the first reaction medium is located;

The geometric line may be a straight line;

The positional relationship may be whether a crossing relationship between the geometric line and the first area exists; and

The cross relationship may be one of the following relationships:

said geometric line passes through said first zone; and

The geometric line touches the boundary of the first zone.

Therefore, another aspect of the invention is to provide a command device for communicating commands with the first reaction medium, and the command device includes a command unit. The instruction unit is configured to send the instruction agent to determine the geometric reference to determine whether communication between the instruction and the first reaction agent should be performed based on the relationship between the geometric reference and the first reaction agent.

The geometric reference may comprise at least two reference locations, and the relationship may be a first relationship between the at least two reference locations and the first reaction medium.

The first reaction medium may be arranged in a specific area;

The instruction unit may also convert the instruction medium into the geometric reference including a first trajectory, and may determine a first region based on the first trajectory;

The relationship may be a first relationship between the first zone and a second zone in the specific area where the first reaction medium is located;

The first reaction medium may be an icon, the specific area may be an image area, and the instruction medium may be a first movement of the instruction unit;

The instruction unit may include:

a motion sensing unit that converts the first motion into a first signal; and

a processing unit, which converts the first signal into the first trace, and determines the first region according to the first trace, to determine the Whether communication between the command and the icon should be performed.

The first movement may be formed by manually driving the instruction unit;

The first motion may include at least one of three-dimensional motion and two-dimensional motion;

The first trajectory may include a first arc, a combination of a second arc and a first line segment, and at least one of a plurality of second line segments, the first arc having an arc angle, wherein when the first When the trajectory is the first circular arc, the arc angle of the first circular arc may be one of 360°, close to 360° and exceeding 360°;

The first zone may comprise an enclosed zone;

When the relationship is a cross relationship, the instruction unit may transfer the instruction to the icon; and

The icon may be selected after the instruction unit confirms that the instruction is delivered to the icon.

The motion sensing unit may include a gyroscope capable of sensing the first motion for generating the first signal;

The processing unit may comprise one of a microcontroller, a microprocessor, a digital signal processor, and a central processing unit;

The instruction unit may also be configured to have a second movement, convert the second movement into a second trajectory, and after the instruction unit confirms the selected state of the icon, it may, according to the second trajectory to determine whether the preset function of the icon is executed; and

The second locus may be one of a hook shape, a fork shape and a circle shape.

The motion sensing unit may include:

a gyroscope having at least two sensing degrees of freedom and sensing said first motion for generating a first portion of said first signal; and

an accelerometer having at least two sensing degrees of freedom and sensing said first motion for generating a second portion of said first signal;

The instruction unit may also be configured to have a second movement, analyze an acceleration-deceleration distribution of the second movement, and determine a predicted state of the icon after the instruction unit confirms the selected state of the icon. whether the set function is performed; and

The second motion may be one of a plurality of motions of ticking, crossing, wavy lines, triangles, arcs and circles.

Therefore, another aspect of the present invention is to provide an instruction communication method for communicating an instruction with a first response medium. The command communication method includes the steps of: providing a geometric reference in response to the command medium; furthermore, determining whether communication between the command and the first reactive medium should be performed based on a relationship between the geometric reference and the first reactive medium.

The geometric reference may comprise at least two reference locations, and the relationship may be a first relationship between the at least two reference locations and the first reaction medium.

The instruction communication method may also include the following steps:

A specific area is provided in which the first reaction medium can be displayed, wherein the instruction medium is a motion.

The geometric reference may include at least two reference positions, and the instruction communication method may further include the following steps:

A geometric line is formed by the at least two reference positions, wherein the relationship is a positional relationship between the geometric line and the first reaction medium in the specific area, and the geometric line is a straight line .

The geometric reference may include at least three reference positions, and the instruction communication method may further include the following steps:

A first zone is formed by said at least three reference positions, wherein said relationship is a first relationship between said first zone and a second zone in said specific zone where said first reaction medium is located .

The geometric reference may include a trajectory, and the instruction communication method may further include the following steps:

A first zone is determined from the trajectory, wherein the relationship is a first relationship between the first zone and a second zone in the specific area where the first reaction medium is located.

Therefore, another aspect of the present invention is to provide an instruction device for communicating instructions with the first response medium, and the instruction device includes a sensing unit and a response unit. The sensing unit senses the instruction medium to generate a corresponding signal. The response unit temporarily generates a reference signature of one of the reference parameter, the position reference and the reference signal in response to the corresponding signal, based on the relationship between the first reaction medium and the selected one of the reference parameter, the position reference and the reference signal. relationship to determine whether communication between the command and the first-response intermediary should be performed.

Accordingly, another aspect of the present invention is to provide an instruction means for communicating an instruction with a first reaction medium, the instruction means comprising:

a sensing unit, which senses the first instruction medium to generate a corresponding signal; and

a response unit temporarily generating a reference signature in response to said corresponding signal to determine based on a relationship between said first reactive agent and a selected one of said reference parameter, position reference and reference signal Whether communication between the command and the first reaction medium should be performed, the reference characteristic is one of a reference parameter, a position reference and a reference signal.

The reference feature may be the location reference, the location reference may be a reference location, and the relationship may be a first relationship between the reference location and the first reaction medium.

The first reaction medium may be located in the specific area;

The reference location may be located in the specific area;

The first relationship may be a positional relationship between the reference position and the first reaction medium in the specific area;

said reference position may be generated within a period between 0.1 seconds and 3 seconds;

The first reaction medium may occupy a first zone in the specific area;

The response unit may also generate a geometric pattern at the reference position in response to the corresponding signal, wherein the geometric pattern may be one of a circle, an ellipse and a polygon, and the polygon may be a triangle, a rectangle and one of the pentagons;

The response unit may also determine whether the instruction is transmitted to the first response medium according to the positional relationship;

The positional relationship may be the presence or absence of a cross relationship between the geometric pattern and the first zone;

The cross relationship may be in a specific condition, wherein the specific condition may be one of the following conditions:

said geometric pattern covers a first condition of said first zone;

a second condition that the geometric pattern overlaps the first region; and

a third condition under which the geometric pattern intersects the first region;

whether the command is communicated to the first reaction medium is a fourth condition determined based on whether the reference position is located in the first zone;

The instructions may include a command message for selecting the first reaction medium and changing a particular representation of the selected reaction medium; and

The specific representation may be one of the following representations:

displaying a first representation of an inverse video of the selected reaction medium;

changing the second representation of the color of the selected reaction medium;

a third representation displayed by scaling said selected reaction medium with equal aspect ratio;

a fourth representation displayed by scaling said selected reaction medium with unequal aspect ratios;

a fifth representation displayed by flashing said selected reaction medium;

a sixth representation displayed by interactively changing the color of said selected reaction medium; and

A seventh representation of sound waves is produced.

The selected reference feature may be the reference signal, and the relationship may be a first relationship between the reference signal and the first reactive agent.

The reference signal may be a first geometric feature, and the first geometric feature may be one of a first location and a first zone;

said first reaction medium may be located within a second geometric feature, said second geometric feature may be one of a second location and a second zone;

The first relationship may be whether a cross relationship exists;

The cross relationship may be in a specific condition, wherein the specific condition may be one of the following conditions:

a first condition that the first geometric feature and the second geometric feature overlap each other;

a second condition that the first geometric feature and the second geometric feature overlap each other;

a third condition that the first geometric feature and the second geometric feature intersect; and

The response unit may also generate an instruction signal according to whether the first relationship is established, and the instruction signal may cause the instruction device to generate different sound waves, different light waves or different vibration waves.

The selected reference characteristic may be the reference parameter, and the relationship may be a first relationship between the reference parameter and the first reaction medium.

The reference parameter may be one of a reference position, a reference geometric pattern, a geometric region, and a reference signal; and

The communication may be a specific operation, which may be one of the following:

a first operation of passing the instruction to the first reaction medium; and

A feedback signal is transmitted to a second operation of the response unit through the first response medium.

It is therefore a further aspect of the present invention to provide a command device for communicating commands with a first reaction medium, and the command device comprises a command unit configured to send the command medium to temporarily generate reference parameters, position references and a reference characteristic of one of the reference signals and configured to determine whether the communication between the command and the first reactive agent is based on a relationship between the first reactive agent and a selected one of the reference parameter, the position reference, and the reference signal should be carried out.

The reference signal may be one of a location and a zone, the zone may have a geometric feature, the geometric feature may be one of a geometric shape and a geometric profile;

The instruction unit may also generate a geometric pattern similar to the geometric characteristic in response to the geometric characteristic of the zone; and

The geometric pattern may be one of circle, ellipse, rectangle, triangle and polygon.

Therefore, another aspect of the present invention is to provide an instruction communication method for communicating an instruction with a first response medium. The command communication method includes the steps of: temporarily providing one of a reference parameter, a position reference and a reference signal in response to a command medium; furthermore, based on a first reaction medium and a selected one of the reference parameter, position reference and reference signal relationship to determine whether communication between the command and the first-response intermediary should be performed.

The reference characteristic may be the reference parameter, and the relationship may be a first relationship between the reference parameter and the first reaction medium.

The reference feature may be the location reference, the location reference may be a reference location, and the relationship may be a first relationship between the reference location and the first reaction medium;

The reference position is for example located in a specific area and used to form the first zone; and

The first reaction medium may be located in the specific area and used to form a second area.

The reference feature may be the reference signal, and the relationship may be a first relationship between the reference signal and the first reaction medium;

The first medium of instruction may be a first movement;

The reference signal may be a first position signal;

The reference signal may be temporarily provided for a period between 0.1 seconds and 3 seconds.

The first position signal may be located in a specific area and used to form a first zone;

The first reaction medium may be located in the specific region and used to form a second region; and

The instruction may be communicated to the first reaction agent to place the first reaction agent in a functionally ready state.

The instruction communication method may also include the following steps:

converting the first motion into the first position signal;

converting the first position signal into a first trajectory with a reference point;

passing the instruction to the first reaction medium when the relationship between the first zone and the second zone is in a specific condition, wherein the specific condition may be one of the following conditions:

said first zone and said second zone are a first condition of partial overlap;

said first zone and said second zone are a second condition of complete overlap;

a third condition that the first zone completely covers the second zone; and

a fourth condition that the centroid of the first zone is located within the second zone;

converting the second motion into a second trajectory; and

determining whether a preset function of the first reaction medium is executed according to the second trajectory;

The instruction communication method may also include the following steps:

initiating said first movement with a gesture;

initializing the reference point of the first trajectory; and

Calibration and compensation of the reference point is performed in association with the pose of the first motion.

Therefore, another aspect of the present invention is to provide an instruction device for communicating an instruction with a first response medium, and the instruction device includes a first response unit and a second response unit. The first response unit generates a signal in response to the instruction medium. The second response unit generates at least two location references in response to the signal to determine whether the communication between the instruction and the first reaction agent should be executed based on a relationship between the first reaction agent and the at least two location references. conduct.

Therefore, another aspect of the present invention is to provide a command device for communicating commands with the first response medium, and the command device includes a command unit. The command unit is configured to send the command medium to generate at least two reference signals to determine whether the communication between the command and the first reactive medium should be executed according to the relationship between the at least two reference signals and the first reactive medium. conduct.

Therefore, another aspect of the present invention is to provide an instruction device for communicating an instruction with a first response medium, and the instruction device includes a first response unit and a second response unit. The first response unit generates a signal in response to the instruction medium. The second response unit temporarily generates one of the reference parameter, the position reference and the reference signal in response to the signal, based on the selected one of the first reaction medium and the first reaction medium and the reference parameter, the position reference and the reference signal. relationship to determine whether communication between the command and the first-response intermediary should be performed.

Therefore, another aspect of the present invention is to provide an instruction device for communicating an instruction with a first response medium, and the instruction device includes a notification unit and a response unit. The notification unit generates a corresponding signal in response to the instruction medium. The response unit generates one of the reference parameter, the position reference and the reference signal in response to the corresponding signal, to determine whether the command is based on the relationship between the first reaction medium and the selected one of the reference parameter, the position reference and the reference signal. Whether communication with first responder media should be performed.

Description of drawings

The foregoing and other features and advantages of the present invention will be more clearly understood by the following description with reference to the accompanying drawings, in which:

Fig. 1 (a) and Fig. 1 (b) are the schematic diagrams showing the selection configuration of conventional selection system;

Fig. 2 (a) is a schematic diagram showing the system architecture of a conventional selection device provided by the inventors of the present invention;

Fig. 2 (b) is a schematic diagram showing the system architecture of the instruction device according to the present invention;

3 is a schematic diagram illustrating a first icon selection operation mode of the instruction device and method according to the present invention;

4 is a schematic diagram illustrating a second icon selection operation mode of the instruction device and method according to the present invention;

5 is a schematic diagram illustrating a third icon selection operation mode of the command device and method according to the present invention;

6 is a schematic diagram illustrating a fourth icon selection operation mode of the instruction device and method according to the present invention;

7 is a schematic diagram showing a fifth icon selection operation mode of the instruction device and method according to the present invention;

8 is a schematic diagram showing a sixth icon selection operation mode of the instruction device and method according to the present invention;

9( a ) and FIG. 9( b ) are schematic diagrams illustrating actual operation schemes related to the first icon selection operation mode and the second icon selection operation mode according to the present invention;

FIG. 10(a) and FIG. 10(b) are schematic diagrams illustrating actual operation schemes related to the third icon selection operation mode according to the present invention;

11(a) and FIG. 11(b) are schematic diagrams showing the actual operation scheme related to the fourth icon selection operation mode according to the present invention;

Fig. 12(a), Fig. 12(b), Fig. 12(c) and Fig. 12(d) are schematic diagrams illustrating actual operation schemes related to the fifth icon selection operation mode according to the present invention;

Fig. 13(a), Fig. 13(b), Fig. 13(c) and Fig. 13(d) are schematic diagrams illustrating the actual operation scheme related to the sixth icon selection operation mode according to the present invention;

14 is a schematic diagram showing the system architecture of an instruction device with the function of feeding back icon selection status to the user according to the present invention;

FIG. 15 is a schematic diagram showing the association between the operating angle range of the selection unit of the command device and the display area range of the display system according to the present invention;

16( a ) and FIG. 16( b ) are diagrams illustrating the initial association between the operation posture of the selection unit of the instruction device and the absolute reference coordinates of the center point or the relative reference coordinates of any point in the display area according to the present invention. a schematic diagram of ; and

FIG. 17 is a flowchart showing the operation of the selection system for instructing apparatus and methods according to the present invention.

Detailed ways

The present invention will now be described more specifically with reference to the following embodiments. It should be noted that the following description of the preferred embodiments of the present invention is presented herein for purposes of illustration and description only and is not intended to be exhaustive or limited to the precise forms disclosed.

The system architecture of the selection device of the present invention:

Please refer to FIG. 2( b ), which is a schematic diagram showing the system architecture 922 and its operation of the selection system 92 according to the first embodiment of the present invention. As shown, the selection system 92 includes a display system S92 and a selection device M92. The display system S92 includes a display device V92. The display device V92 has a display area A92, and the icon I1 is displayed on the display area A92. The selection means M92 comprise a selection unit U92. The selection unit U92 is used to cause the icon I1 in the display area A92 to be selected.

In one embodiment, the motion sensing unit SS92 includes a gyroscope (Gyroscope) SS921, and the gyroscope SS921 senses the motion F21 for generating the signal S1. In one embodiment, the motion sensing unit SS92 includes an accelerometer (Accelerometer) SS922, and the accelerometer SS922 senses the motion F21 for generating the signal S1. In one embodiment, the motion sensing unit SS92 includes a magnetometer/e-compass SS923, and the magnetometer SS923 senses the motion F21 for generating the signal S1. In one embodiment, the motion sensing unit SS92 includes a gyroscope SS921 , an accelerometer SS922 and a magnetometer SS923 . The gyroscope SS921 has at least two sensing degrees of freedom and senses the motion F21 of the first portion S11 used to generate the signal S1. The accelerometer SS922 has at least two sensing degrees of freedom and senses the motion F21 of the second portion S12 used to generate the signal S1. The magnetometer SS923 has at least two sensing degrees of freedom and senses the motion F21 of the third portion S13 used to generate the signal S1.

In addition, the processing unit P92 may include a controller P921, and the controller P921 may include a microcontroller (Microcontroller), a microprocessor (Microprocessor), a digital signal processor (Digital signal processor), a field programmable gate array (Field-Programmable Gate Array) (FPGA)) and at least one of a central processing unit (CPU).

The basic operation and principles describing how trajectories correspond to the motion of a selection system according to an embodiment:

The selection device provided in the present invention and its operation method are shown in Fig. 2(b). The selection unit U92 is configured to have a motion F21, convert the motion F21 into a locus G21 on the display area A92, determine the area H21 in the display area A92 according to the locus G21, and display the area H21 and the icon I1 on the display area A92 The zone K21 in the icon I1 is used to determine whether the icon I1 is selected, wherein the zone K21 and the zone of the icon I1 can be the same as or different from each other.

The selection unit U92 may include a motion sensing unit SS92 and a processing unit P92. The motion sensing unit SS92 converts the motion F21 into a signal S1. The processing unit P92 converts the signal S1 into a trajectory G21. Of course, the processing unit P92 may determine whether the icon I1 is selected by considering the specific relationship of the track G21 itself with respect to the zone K21. Otherwise, the processing unit P92 can determine the area H21 according to the trajectory G21, and determine whether the icon I1 is selected according to another specific relationship between the area H21 and the area K21. The implementation of these specific relationships will be detailed in subsequent paragraphs.

Additionally, a hand (not shown) may actuate the selection unit U92 to form a motion F21 of the selection unit U92. The motion F21 may include at least one of a three-dimensional motion and a two-dimensional motion. The trajectory G21 on the display area A92 may include at least one of a first arc, a plurality of second arcs, a first curve, a plurality of second curves, a first line segment and a plurality of second line segments, or any combination thereof , the first arc has an arc angle. When the trajectory G21 is the first arc, the angle of the arc angle of the first arc may be one of 180°, exceeding 180°, 360°, approaching 360°, and exceeding 360°.

Of course, the motion F21 sensed by the motion sensing unit SS92 may be generated by at least one of the group (not shown) consisting of hand, arm, foot, leg, head, neck, shoulder, and waist.

Six modes of operation for the method of selecting icons:

As for the method of selecting an icon, six operation modes provided in the present invention are described as follows. The operation method for selecting a single specific icon is described in the technical solutions of the first selection operation mode to the fourth selection operation mode. The operation methods described in the technical solutions of the fifth selection operation mode to the sixth selection operation mode have the following features: selecting a plurality of candidate icons, and then selecting a specific icon from the candidate icons.

Regarding the first selection operation mode, please refer to FIG. 3 , which is an operation diagram illustrating the first icon selection operation mode of the instruction device and method according to the present invention. In the sub-picture 101, the user's hand (not shown) moves the selection device M92 of the present invention shown in FIG. 2, and the trajectory T1 is displayed on the screen in response to the movement. As shown in the sub-graph 101 of FIG. 3 , the trajectory T1 includes a movement trajectory MT1 and a selection trajectory ST1 . The motion trajectory MT1 is formed in response to the movement of the selection device M92 actuated by hand, wherein the selection device M92 is moved from a first spatial position relative to a previous reference point (not shown) on the screen to a starting point N11 of the selection trajectory ST1 position in the second space. When the hand operates the selection device M92 to surround the icon I1, a selection trajectory ST1 is formed in response to the motion of the selection device M92 driven by the hand. The selection trajectory ST1 has a selection start point N11 and a selection end point N12, and encloses an area STA1 (an area enclosed by a dotted line). The area STA1 is compared with the comparison area IA1 (area surrounded by dotted lines) associated with the icon I1 to determine whether the icon I1 is selected. The comparison condition may be whether the area STA1 intersects the area IA1. When the comparison condition is a cross relation, the icon I1 is selected. The cross relationship is in a specific condition, wherein the specific condition is one of the first condition, the second condition, the third condition, the fourth condition, the fifth condition, the sixth condition and the seventh condition. The first condition is that the area STA1 and the area IA1 are partially overlapping; the second condition is that the area STA1 and the area IA1 are completely overlapping; the third condition is that the area STA1 completely covers the area IA1; the fourth condition is that the area STA1 has the shape The centroid is located in the area IA1; the fifth condition is that the centroid of the area IA1 is located in the area STA1; the sixth condition is that the track ST1 passes through the area IA1; the seventh condition is that the track ST1 touches the area IA1.

As shown in the sub-figure 102, when the icon I1 is selected, a geometric pattern related to the selection track ST1 is displayed to indicate that the icon I1 has been selected, wherein the geometric pattern is, for example, an outer circle surrounding the periphery of the icon I1 G1, or the inner circle G2 inside the icon I1. Then, make the icon I1 change its color or make the icon I1 display with an inverse video (Inverse video) to form an icon, as shown in sub-figure 103, the formed icon is an inverse video icon I10, wherein the inverse video icon I10 is defined by the outer circle A circle surrounded by G1, or an inner circle G2, is displayed within the inverse video icon I10. Then, as shown in the sub-figure 104 , the outer circle G1 or the inner circle G2 used to prompt the user to select the state can disappear, which leaves the inverse video icon I10 for displaying the selection result.

Regarding the second selection operation mode, please refer to FIG. 4 , which is an operation schematic diagram of the second icon selection operation mode of the instruction device and method according to the present invention. In the sub-picture 201, the user's hand (not shown) moves the selection device M92 of the present invention shown in FIG. 2, and the trajectory T2 is displayed on the screen in response to the movement. As shown in the sub-graph 201 of FIG. 4 , the trajectory T2 includes a movement trajectory MT2 and a selection trajectory ST2. The motion trajectory MT2 is formed in response to the movement of the selection device M92 actuated by hand, wherein the selection device M92 is moved from a first spatial position related to a previous reference point on the screen to a second spatial location related to the starting point N21 of the selection trajectory ST2 Location. When the hand operates the selection device M92 to surround the icon I1, a selection trajectory ST2 is formed in response to the motion of the selection device M92 driven by the hand.

The selection trajectory ST2 has a selection start point N21 and a selection end point N22. As shown in the sub-graph 202, three independent points P1, P2 and P3 are defined on the selection trajectory ST2, and are used to form a geometric pattern G1, such as a closed circle, through these independent points P1, P2 and P3. The geometric pattern G1 encloses an area GA1. The area GA1 is compared with the comparison area IA2 associated with the icon I1 to determine whether the icon I1 is selected. Of course, the comparison area IA2 can also be the same as the area of the icon I1. The comparison condition may be whether the area GA1 intersects with the area IA2. When the comparison condition is a cross relation, the icon I1 is selected. The cross relationship is in a specific condition, and the specific condition is one of the first condition, the second condition, the third condition, the fourth condition, the fifth condition, the sixth condition and the seventh condition. The first condition is that the area GA1 and the area IA2 are partially overlapping; the second condition is that the area GA1 and the area IA2 are completely overlapping; the third condition is that the area GA1 completely covers the area IA2; the fourth condition is that the shape of the area GA1 The centroid is located in the area IA2; the fifth condition is that the centroid of the area IA2 is located in the area GA1; the sixth condition is that the geometric pattern G1 passes through the area IA2; the seventh condition is that the geometric pattern G1 touches the area IA2.

When icon I1 is selected, make icon I1 change its color or make icon I1 display with reverse video to form an icon, as shown in sub-figure 203, the formed icon is reverse video icon I10, wherein consists of three independent The circle G1 defined by the points P1, P2 and P3 is displayed within the inverse video icon I10 through the inverse video icon I10, or the inner circle G2. Then, as shown in the sub-diagram 204 , the circle G1 or the inner circle G2 used to prompt the user to select the state can disappear, which leaves the inverse video icon I10 for displaying the selection result.

Regarding the third selection operation mode, please refer to FIG. 5 , which is an operation schematic diagram of the third icon selection operation mode of the command device and method according to the present invention. In the sub-picture 301, the user's hand (not shown) moves the selection device M92 of the present invention shown in FIG. 2, and the trajectory T3 is displayed on the screen in response to the movement. As shown in the sub-graph 302, on the track T3, a reference start point S3 and a reference end point E3 can be defined. The line segment L3 is used to connect the reference start point S3 and the reference end point E3. Whether the icon I1 is selected may depend on the comparison result of whether the reference line segment L3 intersects with the area of the icon I1. That is to say, the determination condition may be whether the reference line segment L3 passes through or touches the area of the icon I1. If either of the above two conditions is satisfied, the icon I1 is selected.

As shown in the sub-figure 302, when the icon I1 is crossed by the reference line segment L3 and selected, the icon I1 can become an anti-video icon I10, or, for example, a circle G1 can be used to surround the icon I1 or the anti-video icon I10 to further The user is reminded of the selected state of the icon I1.

Then, as shown in the sub-diagram 304 , the circle G1 or the line segment L3 used to prompt the user to select the state can disappear, which leaves the inverse video icon I10 for displaying the selection result of the icon I1 .

Regarding the fourth selection operation mode, please refer to FIG. 6 , which is an operation schematic diagram of the fourth icon selection operation mode of the instruction device and method according to the present invention. In the sub-picture 401, the user's hand (not shown) moves the selection device M92 of the present invention shown in FIG. 2, and the trajectory T4 is displayed on the screen in response to the movement. As shown in the sub-graph 402, on the track T4, a reference end point E4 can be defined. Whether the icon I1 is selected may depend on the comparison result of whether the reference track T4 intersects the icon I1. That is, the actual determination condition may be a specific condition which is one of the first condition, the second condition, and the third condition. The first condition is whether the reference end point E4 is located in the area of the icon I1; the second condition is whether the reference end point E4 touches the icon I1; the third condition is whether a part of the reference track T4 touches the area of the icon I1. When the specific condition is satisfied, the icon I1 is selected. As shown in the sub-figure 402, when the icon I1 is selected, the icon I1 can become the reverse video icon I10 as shown in figure 403, or for example, a circle G1 can be used to surround the icon I1 or the reverse video icon I10 of the icon I1 to The user is further reminded of the selected state of the icon I1.

In addition, as shown in the sub-diagram 404, when the icon I1 is selected, the reference endpoint E40 with reverse video can be displayed in the icon I1 to display the selection result of the icon I1.

Regarding the fifth selection operation mode, please refer to FIG. 7 , which is an operation schematic diagram of the fifth icon selection operation mode of the instruction device and method according to the present invention. In sub-figure 501, the user's hand (not shown) moves the selection device M92 of the present invention shown in FIG. show. Trajectory T5 includes a movement trajectory MT5 and a selection trajectory ST5. The motion trajectory MT5 is formed in response to the movement of the hand-actuated selection device M92, wherein the selection device M92 is moved from a first spatial position associated with a previous reference point (not shown) on the screen to a location associated with the starting point N51 of the selection trajectory ST5. position in the second space. When the selection device M92 is used to surround the icons I1 and I2, or when the selection device M92 is used to surround the comparison area IA5 containing the icons I1 and I2, the selection trajectory ST5 is formed in response to the movement of the selection device M92 driven by hand.

The selection trajectory ST5 has a selection start point N51 and a selection end point N52, and encloses an area STA5 (an area enclosed by a dotted line). The area STA5 is compared with the comparison area IA5 (area surrounded by dotted lines) including the icons I1 and I2 to determine whether the icons I1 and I2 are selected. The comparison condition may be whether the area STA5 intersects with the area IA5. When said comparison condition is in a specific condition, a decision is made: the area IA5 or the icons I1 and I2 in the area IA5 are surrounded and marked by the selection means M92. The specific condition is one of a first condition, a second condition, a third condition, a fourth condition, a fifth condition, a sixth condition, and a seventh condition. The first condition is that area STA5 and area IA5 are partially overlapping; the second condition is that area STA5 and area IA5 are completely overlapping; the third condition is that area STA5 completely covers area IA5; the fourth condition is the geometry of area STA5 The centroid is located in the area IA5; the fifth condition is that the centroid of the area IA5 is located in the area STA5; the sixth condition is that the track ST5 passes through the area IA5; the seventh condition is that the track ST5 touches the area IA5.

As shown in the sub-graph 502, when the area IA5 containing the icons I1 and I2 is surrounded, the geometric pattern associated with the selection track ST5 is displayed to indicate that the area IA5 is selected, or the icons I1 and I2 are selected together, wherein The geometric pattern is, for example, an ellipse G5 surrounding the periphery of the area IA5. Then, make the icons I1 and I2 change their colors or make the icons I1 and I2 appear as reverse video icons I10 and I20, respectively. Then, as shown in the sub-figure 503, a first hand movement M51 or a first hand gesture is performed on the hand-held selection device M92, or a button of the selection device M92 is operated to select from these two inverse video icons I10 and I20 , so as to determine the icon finally selected, wherein the first hand motion M51 is, for example, a Yaw motion or a Roll motion. In one embodiment, as shown in the sub-figure 503, when the inverse video icon I20 is selected through the first hand motion M51 or the first hand gesture, a geometric pattern can be displayed to prompt the user of the current icon position. Select the state, wherein the geometric pattern is, for example, a circle G51 surrounding the reverse video icon I20, or an inner circle G52 inside the reverse video icon I20.

For example, when confirming that the anti-video icon I20 is selected, the user further performs a second hand motion M51 or a second hand gesture to the selection device M92 to confirm the selection, wherein the second hand motion M51 is for example ticking "ν" movement. At the same time, as shown in the sub-picture 504, the icon I2 is confirmed to be selected, and the icon I2 is displayed as the reverse video icon I20.

Regarding the sixth selection operation mode, please refer to FIG. 8 , which is an operation schematic diagram of the sixth icon selection operation mode of the instruction device and method according to the present invention. In sub-figure 601, the user's hand (not shown) moves the selection device M92 of the present invention shown in FIG. show. Trajectory T6 includes a movement trajectory MT6 and a selection trajectory ST6. The motion trajectory MT6 is formed in response to the movement of the hand-actuated selection device M92, wherein the selection device M92 is moved from a first spatial position associated with a previous reference point (not shown) on the screen to a location associated with the starting point N61 of the selection trajectory ST6. position in the second space. When the selection means M92 is used to surround the icons I1, I2, I3 and I4, or when the selection means M92 is used to surround the comparison area IA6 containing the icons I1, I2, I3 and I4, the selection trajectory ST6 responds to the selection driven by the hand The movement of the device M92 is formed.

The selection trajectory ST6 has a selection start point N61 and a selection end point N62, and encloses an area STA6 (an area enclosed by a dotted line). Area STA6 is compared with comparison area IA6 (area surrounded by dotted lines) containing icons I1, I2, I3, and I4 to determine whether icons I1, I2, I3, and I4 are selected. The comparison condition may be whether area STA6 intersects area IA6. When the comparison condition is in a specific condition, a decision is made: the area IA6 or the icons I1, I2, I3 and I4 in the area IA6 are surrounded and marked by the selection means M92, wherein the specific condition is the first condition, the second One of condition, third condition, fourth condition, fifth condition, sixth condition and seventh condition. The first condition is that area STA6 and area IA6 are partially overlapping; the second condition is that area STA6 and area IA6 are completely overlapping; the third condition is that area STA6 completely covers area IA6; the fourth condition is the geometry of area STA6 The centroid is located in the area IA6; the fifth condition is that the centroid of the area IA6 is located in the area STA6; the sixth condition is that the track ST6 passes through the area IA6; the seventh condition is that the track ST6 touches the area IA6.

When the area IA6 containing the icons I1, I2, I3 and I4 is surrounded, the geometric pattern associated with the selection track ST6 is displayed to indicate that the area IA6 has been selected, or the icons I1, I2, I3 and I4 are selected together, The geometric pattern is, for example, a circle G6 surrounding the periphery of the area IA6. Then, make the icons I1, I2, I3, and I4 change their colors or make the icons I1, I2, I3, and I4 displayed as inverse video icons I10, I20, I30, and I40, respectively. Then, as shown in the sub-figure 603, do the first hand movement M61 or the first hand gesture to the hand-held selection device M92, or operate the button of the selection device M92, to select from these four reverse video icons I10, I20, I30 and Select in I40 to determine the final selected icon, wherein the first hand motion M61 is, for example, a Yaw motion, a Roll motion or a Pitch motion, and the button is, for example, a direction button (not shown). In one embodiment, as shown in the sub-figure 603, when the inverse video icon I20 is selected through the first hand motion M61 or the first hand gesture, a geometric pattern can be displayed to remind the user of the current icon position. Select the state, wherein the geometric pattern is, for example, a circle G61 surrounding the inverse video icon I20, or an inner circle G62 inside the inverse video icon I20.

When confirming that the anti-video icon I20 is selected, the user further performs a second hand motion M61 or a second hand gesture to the selection device M92 to confirm the selection, wherein the second hand motion M61 is, for example, ticking " ν" movement. At the same time, as shown in the sub-picture 604, the confirmation icon I2 is selected, so that the icon I2 is displayed as the reverse video icon I20, and the other icons I2, I3 and I4 are restored and displayed normally.

The actual operation schemes according to the above six selection operation modes are respectively described as follows.

For the actual operational scheme associated with the first or second selection mode of operation shown in FIGS. 3 and 4 respectively, please refer to FIGS. A schematic diagram of the actual operation scheme 95 related to the two icon selection operation modes. In FIG. 9( a ) is shown a selection configuration 951 for an actual operating scenario 95 comprising a display system S95 and a selection device D95 . The display system S95 includes a display device V95. The display device V95 has a display area A95 in which image icons I1, I2, I3, I4, and I5 are displayed. The selection means D95 senses a hand movement M951. The surrounded trajectory T95 is displayed on the display area A95 in response to the hand motion M951, and surrounds the icon I4.

Please refer to FIG. 9( b ), which shows a selection configuration 952 for the actual operating scenario 95 . Consider the comparison conditions provided in the first or second selection mode of operation. When the first or second selection operation mode confirms that the icon I4 is selected, the selected icon I4 is made to change its color or the icon I4 is displayed as its inverse video icon I40 to confirm successful wrapping around the icon I4. That is, the reverse video icon I40 is an indication that the confirmation icon I4 is selected.

After the selected state of the icon I4 is confirmed, the selection means D95 may transmit a message to the display system S95 through a specific operation, wherein the specific operation is one of the first operation and the second operation, to execute the function of the icon I4. The first operation is to sense hand motion M952. The second operation is to press the button DB95 arranged on the selection device D95.

Regarding the actual operation scheme related to the third selection operation mode shown in FIG. 5, please refer to FIG. 10(a) and FIG. 10(b), which are the actual operation scheme related to the third icon selection operation mode according to the present invention 96 schematic. In FIG. 10( a ) is shown a selection configuration 961 for the actual operating scenario 96 , which includes a display system S96 and a selection device D96 . The display system S96 includes a display area A96, and image icons I1, I2, I3, I4, and I5 are displayed in the display area A96. The selection means D96 senses a hand movement M961. The selection trajectory T96 is displayed on the display area A96 in response to the hand motion M961, and passes through the icon I4.

Please refer to FIG. 10( b ), which shows a selection configuration 962 for the actual operating scenario 96 . The comparison conditions provided in the third selection mode of operation are taken into account. When the third selection operation mode confirms that the icon I4 is selected, the selected icon I4 is made to change its color or the icon I4 is displayed as its inverse video icon I40 to confirm the successful selection of the icon I4. That is, the reverse video icon I40 is an indication that the confirmation icon I4 is selected.

After the selected state of the icon I4 is confirmed, the selection means D96 may transmit a message to the display system S96 through a specific operation, wherein the specific operation is one of the first operation and the second operation, to execute the function of the icon I4. The first operation is to sense hand motion M962. The second operation is to press the button DB96 provided on the selection device D96.

Regarding the actual operation scheme related to the fourth selection operation mode shown in FIG. 6, please refer to FIG. 11(a) and FIG. 11(b), which are the actual operation scheme related to the fourth icon selection operation mode according to the present invention 97 schematic. In FIG. 11( a ) is shown a selection configuration 971 for the actual operating scenario 97 , which includes a display system S97 and a selection device D97 . The display system S97 includes a display area A97, and image icons I1, I2, I3, I4, and I5 are displayed in the display area A97. The selection means D97 senses a hand movement M971. The selection trajectory T97 is displayed on the display area A97 in response to the hand motion M971, and the end point E97 of the selection trajectory T97 is located within the area of the icon I4.

Please refer to FIG. 11( b ), which shows a selection configuration 972 for the actual operating scenario 97 . The comparison conditions provided in the fourth selection mode of operation are taken into account. When the fourth selection operation mode confirms that the icon I4 is selected, the selected icon I4 is made to change its color or the icon I4 is displayed as its inverse video icon I40 to confirm the successful selection of the icon I4. That is, the reverse video icon I40 is an indication that the confirmation icon I4 is selected.

After the selected state of icon I4 is confirmed, if the user wants to cancel the selected state of said icon I4 and make the reverse video icon I40 or the color-changed icon return to the unselected state of icon I4, the selection means D97 A message may be passed to the display system S97 by a specific operation, which is one of the first operation and the second operation, to cancel the inverse video icon I40 and restore the inverse video icon I40 to the icon I4. The first operation is to do the movement of crossing "X". The second operation is to press the button DB97 provided on the selection device D97.

For the actual operational scheme associated with the fifth selection mode of operation shown in Figure 7, please refer to Figures 12(a), 12(b), 12(c) and A schematic diagram of the actual operating scenario 98 associated with the fifth icon selection mode of operation. In FIG. 12( a ) is shown a selection configuration 981 for the actual operating scenario 98 , which includes a display system S98 and a selection device D98 . The display system S98 includes a display area A98, and the image icons I1, I2, I3, I4, and I5 are displayed in the display area A98. The selection means D98 senses a hand movement M981. The selection locus T981 is displayed on the display area A98 in response to the hand motion M981, and surrounds the icons I3 and I4, which are separately displayed on the display area A98. The comparison conditions provided in the fifth selection operation mode are considered to decide one of the icons I3 and I4 as the finally selected icon.

Please refer to FIG. 12( b ), which shows a selection configuration 982 for the actual operation scheme 98 associated with the fifth selection mode of operation. The selection configuration 982 includes a display system S98 and a selection device D98. The display system S98 includes a display area A98. Adjacent image icons J11, J12, J13, J14, J15, J21, J22, J23, J24, and J25 are arranged sequentially; separated image icons I1 and I2 are arranged independently; and adjacent image icons arranged in pairs Image icons K11 and K12 are displayed in the display area A98. Selection device D98 senses hand movement M982. The selection trajectory T982 is displayed on the display area A98 in response to the hand motion M982 and surrounds the adjacent icons J12 and J13 displayed on the display area A98. Please refer to FIG. 12( c ), which shows a selection configuration 983 for the actual operating scenario 98 . Make the selected icons J12 and J13 change their color or make the icons J12 and J13 displayed as reverse video icons J120 and J130, respectively, to indicate that the icons J12 and J13 are candidates to be further selected.

In the selection configuration 983, the selection device D98 senses a selection motion, such as a yaw motion comprising a left yaw motion M983L and a right yaw motion M983R ( Yaw Motion) M983, and the yaw motion M983 rotates around the z-axis of the selection device D98. Further selection operations can be performed using the movement M983L or movement M983R, and the brightness or color of the reverse video icon J120 can be different from that of the reverse video icon J130 to remind the user of the current selection state.

Please refer to FIG. 12( d ), which shows a selection configuration 984 for the actual operating scenario 98 . When one of the inverse video icons J120 and J130 having different brightness or colors from each other is the final selection target, the selection device D98 can transmit a confirmation message to the display system S98 through a specific operation of the selection device D98 to confirm the final selection. The icon is one of inverse video icons J120 and J130 in an inverse video state, where a specific operation is one of a first operation and a second operation. The first operation is to sense a circular motion M984C. The second operation is to press the button DB98 provided on the selection device D98.

For example, under the condition that the anti-video icon J130 in the anti-video state of the icon J13 is confirmed as the icon finally selected, when the selection device D98 senses a function activation motion (such as ticking "ν" motion M984V), the icon The function of J13 can be performed.

For the actual operational scheme associated with the sixth selection mode of operation shown in Figure 8, please refer to Figures 13(a), 13(b), 13(c) and A schematic diagram of the actual operating scenario 99 associated with the sixth icon selection operating mode. A selection configuration 991 for the actual operating scenario 99 is shown in FIG. 13( a ). The selection configuration 991 includes a display system S99 and a selection device D99. The display system S99 includes a display area A99, and image icons I1, I2, I3, I4, and I5 are displayed in the display area A99. The selection means D99 senses a hand movement M991. The selection trajectory T991 is displayed on the display area A99 in response to the hand motion M991, and surrounds the icons I1, I2, I3, and I4 which are separately displayed on the display area A99. The comparison conditions provided in the sixth selection operation mode are considered to decide one of the icons I1, I2, I3, and I4 as the finally selected icon.

Please refer to FIG. 13( b ), which shows a selection configuration 992 for the actual operation scenario 99 associated with the sixth selection mode of operation. The selection configuration 992 includes a display system S99 and a selection device D99. The display system S99 includes a display area A99. In the display area A99, there are image icons I1 and I2 with a space therebetween, an array of image icons J11, J12, J13, J14, J15, J21, J22, J23, J24, J25 without a space therebetween, and adjacent image Icons K11 and K12. The selection device D99 senses a hand movement M992. The selection locus T992 is displayed on the display area A99 in response to the hand motion M992, and surrounds the adjacent icons J12, J13, J22, and J23 displayed on the display area A99. Please refer to FIG. 13( c ), which shows a selection configuration 993 for the actual operating scenario 99 . Make selected icons J12, J13, J22 and J23 change their color or make icons J12, J13, J22 and J23 be displayed as reverse video icons J120, J130, J220 and J230 respectively, to show that icons J12, J13, J22 and J23 is a candidate to be further selected.

In the selection configuration 993, the selection device D99 senses a selection motion M993 to further select from the inverse video icons J120, J130, J220 and J230 of the candidate object, wherein the selection motion M993 includes a counterclockwise rolling motion (Roll motion) M993L, Clockwise rolling motion M993R, upward motion (Pitch-up motion) M993U and downward motion (Pitch-down motion) M993D, and counterclockwise rolling motion M993L and clockwise rolling motion M993R all rotate around the x-axis of the selection device D99. Under the condition that the motions M993L, M993R, M993U and M993D are used to perform a further selection operation, when one of the reverse video icons J120, J130, J220 and J230 (such as the reverse video icon J120) is further selected, the one The brightness or color of the icon is changed to be different from the brightness or color of the anti-video icon J120, J130 or J230, to remind the user of the current selection status.

Please refer to FIG. 13( d ), which shows a selection configuration 994 for the actual operating scenario 99 . When the reverse video icon J220 with different brightness or color is the final selection target, the selection device D99 can pass a confirmation message to the display system S99 through a specific operation of the selection device D99, to confirm that the final selected icon is in the reverse video state Inverse video icon J220 in , where the specific operation is one of the first operation and the second operation. The first operation is to sense a circular motion M994C. The second operation is to press the button DB99 provided on the selection device D99.

For example, under the condition that the anti-video icon J220 in the anti-video state of the icon J22 is confirmed as the icon finally selected, when the selection device D99 senses a function activation motion (such as ticking "ν" motion M994V), the icon The function of J22 can be performed.

Please refer to FIG. 14 , which is a schematic diagram showing the system architecture of the command device having the function of feeding back the icon selection status to the user according to the present invention. As shown, the selection system 9A includes a display system S9A and a selection device D9A. Display system S9A has display area A9A capable of displaying images. The image may be an icon I1. In the display area A9A there is a definable position 3A, wherein the definable position 3A can be defined to any position in the display area A9A.

The selection means D9A comprise a selection unit U9A. The selection unit U9A includes a button DB9A, a motion sensing unit SS9A, a processing unit P9A, a wireless transmitter U9A3, a light emitting unit U9A4, and a talking unit U9A5. Each of button DB9A, motion sensing unit SS9A, wireless transmitter U9A3, lighting unit U9A4, and talk unit U9A5 are coupled to processing unit P9A.

The motion sensing unit SS9A has the capability of sensing motion in three dimensions (x, y, z), and provides a signal S3 to the processing unit P9A. The motion sensing unit SS9A includes at least a gyroscope SS9A1 or/and an accelerometer SS9A2, wherein the gyroscope SS9A1 or the accelerometer SS9A2 may have one, two or three independent degrees of freedom for sensing. The gyroscope SS9A1 and the accelerometer SS9A2 respectively provide the sub-signal S31 and the sub-signal S32 of the signal S3 to the processing unit P9A.

The display system S9A also includes a processing module S9A1 and a wireless transmitter S9A2. Processing unit P9A uses wireless transmitter U9A3 to send signal S3 to wireless transmitter S9A2 of display system S9A, wherein signal S3 is processed or not processed by processing unit P9A as signal S4. The wireless transmitter S9A2 receives the signal S4 with information. Said information related to signal S3 is processed by processing module S9A1 of display system S9A. The motion (not shown) sensed by the sensing unit SS9A is converted into a trajectory G31 displayed on the display area A9A; that is, the trajectory G31 corresponds to the motion by the processing module S9A1. Then, when the specific relationship between the locus G31 and the icon I1 is established, the selected state of the icon I1 is confirmed. Thus, the processing module S9A1 is able to cause the surrounding icon I1 to change its color, for example to be displayed with inverse video or flashing. In other aspects, at the same time, the processing module S9A1 can use the wireless transmitter S9A2 to send the selection indication signal to the wireless transmitter U9A3. The wireless transmitter U9A3 receives the selection indication signal. The processing unit P9A sends an interaction signal in response to the selection indication signal, and the interaction signal causes the light-emitting unit U9A4 to generate light waves or the communication unit U9A5 to generate sound waves.

That is to say, the above operations can make the computer (not shown), the display system S9A or the selection unit U9A itself generate sound waves, light waves, force feedback or vibration waves, and the sound waves, light waves, force feedback or vibration waves are used to remind the user of the icon The selection state of I1 or the icon I1 has been selected, wherein the selection unit U9A is electrically coupled to said computer or display system S9A. Thus, the above-described operations can make the action between the user, the selection device, and the icon or electronic menu interactive.

Regarding the association between the operation movement and the relevant position displayed on the screen, please refer to FIG. 15, which shows the relationship between the operating angle range of the selection unit of the command device and the display area range of the display system according to the present invention. A schematic diagram of the association. As shown, the display system S9B includes a display device V9B. Display device V9B includes a display area A9B having a length L and a width H. As shown in FIG. There is a center point C in the display area A9B. From the center point C, the length L and width H of the display area A9B are expressed as (-l/2, 1/2) and (-h/2, h/2), respectively.

Subfigures A1 and A2 schematically show the operating angle configurations for roll angle (Roll Angle) α and yaw angle (Yaw Angle) β. The relationship between the angular definition area of the roll angle α or the yaw angle β and the definition area of the length L of the display area A9B can be expressed as follows:

$\mathrm{<span\; class="notranslate">\; \&alpha;</span>}<span\; class="notranslate">\; \&Subset;</span><span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; \&alpha;\; L</span>}<span\; class="notranslate">\; ,</span>\mathrm{<span\; class="notranslate">\; \&alpha;S</span>}<span\; class="notranslate">\; )</span><span\; class="notranslate">\; \&Right\; Arrow;</span>\mathrm{<span\; class="notranslate">\; L</span>}<span\; class="notranslate">\; \&Subset;</span><span\; class="notranslate">\; (</span><span\; class="notranslate">\; -</span>\mathrm{<span\; class="notranslate">\; 1</span>}<span\; class="notranslate">\; /</span>\mathrm{<span\; class="notranslate">\; 2,1</span>}<span\; class="notranslate">\; /</span>\mathrm{<span\; class="notranslate">\; 2</span>}<span\; class="notranslate">\; )</span>$

$\mathrm{<span\; class="notranslate">\; \&beta;</span>}<span\; class="notranslate">\; \&Subset;</span><span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; \&beta;\; L</span>}<span\; class="notranslate">\; ,</span>\mathrm{<span\; class="notranslate">\; \&beta;S</span>}<span\; class="notranslate">\; )</span><span\; class="notranslate">\; \&Right\; Arrow;</span>\mathrm{<span\; class="notranslate">\; L</span>}<span\; class="notranslate">\; \&Subset;</span><span\; class="notranslate">\; (</span><span\; class="notranslate">\; -</span>\mathrm{<span\; class="notranslate">\; 1</span>}<span\; class="notranslate">\; /</span>\mathrm{<span\; class="notranslate">\; 2,1</span>}<span\; class="notranslate">\; /</span>\mathrm{<span\; class="notranslate">\; 2</span>}<span\; class="notranslate">\; )</span>$

Wherein, αS, αL and βS, βL can be set arbitrarily, for example, let αS=βS>=-π/2, αL=βL<=π/2.

Subfigure A3 schematically shows the operating angle configuration for pitch angle (Pitch angle) γ. The relationship between the angle definition area of the pitch angle γ and the definition area of the width H of the display area A9B can be expressed as follows:

$\mathrm{<span\; class="notranslate">\; \&gamma;</span>}<span\; class="notranslate">\; \&Subset;</span><span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; \&gamma;S</span>}<span\; class="notranslate">\; ,</span>\mathrm{<span\; class="notranslate">\; \&gamma;L</span>}<span\; class="notranslate">\; )</span><span\; class="notranslate">\; \&Right\; Arrow;</span>\mathrm{<span\; class="notranslate">\; h</span>}<span\; class="notranslate">\; \&Subset;</span><span\; class="notranslate">\; (</span><span\; class="notranslate">\; -</span>\mathrm{<span\; class="notranslate">\; h</span>}<span\; class="notranslate">\; /</span>\mathrm{<span\; class="notranslate">\; 2</span>}<span\; class="notranslate">\; ,</span>\mathrm{<span\; class="notranslate">\; h</span>}<span\; class="notranslate">\; /</span>\mathrm{<span\; class="notranslate">\; 2</span>}<span\; class="notranslate">\; )</span>$

Wherein, γS and γL can be set arbitrarily, for example, let γS>=-π/2, γL<=π/2.

In embodiments where actual angle values are obtained, a gyroscope may be used to measure the yaw angle β as described above, and an accelerometer or gyroscope may be used to measure the roll angle α or the pitch angle γ. The selection device D9B includes a button DB9B and a display panel DA9B.

In addition, the center point C can be used as an absolute position reference point for the function of the sensed motion corresponding to the trajectory in the display area A9B. The scheme for initiating the association is described as follows. The selection device D9B is held in the hand, and its power (not shown) is turned on. The button DB9B is pressed, and the selection device D9B is operated to perform a cycle consisting of up and down pitch motion, left and right yaw motion and clockwise and counterclockwise roll motion. Then, the selection device D9B sends the initial roll angle, yaw initial angle and pitch initial angle read by the accelerometer and gyroscope to the display system S9B, and these initial angles are displayed on the display area A9B of the display system S9B.

Of course, these initial angles can be displayed on the display panel DA9B arranged on the selection device D9B to remind the user of the values of the three initial angles when the selection device D9B is started to be used. Then, the display system S9B or the selection device D9B further resets these initial angle values to zero, so that an operational relationship between the zero initial angle values of the three operating angles in the selection system and the initial posture of the selection device D9B is established. The trajectory corresponding to said movement and displayed on the display area A9B then has a starting point, referred to as the center point C of the display area A9B, used as an absolute reference point.

Regarding the operation scheme of the actual initial posture of the selection device and the initial setting of the relative reference point of the display area, please refer to Figure 16, which shows the operation posture of the selection unit of the instruction device and the center point in the display area according to the present invention The initialization association between the absolute reference coordinates of , or the relative reference coordinates of any point.

Fig. 16(a) and Fig. 16(b) are schematic diagrams showing the initial configurations 9B1 and 9B2 of the selection system 9B, respectively. As shown in FIG. 16( a ), in order to initialize motion sensing or start motion sensing, a button DB9A of the selection unit U9B may be pressed to start sensing, or a certain movement may be used to start sensing. By analyzing the acceleration-deceleration distribution of a certain movement, the certain movement can be identified using the gyroscope SS9B1 or the accelerometer SS9B2 to activate the sensing function. For example, the motion sensing function of the selection unit U9B is activated by using the up and down pitch swing F41.

As shown in Figure 16(b), after the motion sensing function of the selection unit U9B is activated, the center point C of the image area A9B corresponds to the starting point of the trajectory G42, which is displayed in response to the motion F42 of the selection unit U9B . The absolute coordinates of any reference point G421 on the trajectory G42 can be read by pressing the button DB9A, and the selection unit U9B can regard the reference point G421 as a new relative reference point for use with the The initial positioning reference point of the trajectory corresponding to a movement.

Flow chart of icon selection operation:

Please refer to FIG. 17 , which is a flow chart illustrating the operation of the selection system 9B for the instruction apparatus and method according to the present invention. As shown in step Q06, the range of operation of the selection unit U9B corresponds to the range of the display area A9B to associate any definable position 3A in the display area A9B with a gesture of motion of the selection unit U9B. In step Q02, motion sensing starts. In step Q04, the center point C of the selection device and the display area is initialized to define an absolute reference point. If necessary, step Q08 is performed to define a relative reference point, for example, a point on track G42 is defined as a starting position reference point G421 of a new track corresponding to the next movement. In step Q09, it is determined whether to perform calibration and compensation. If the determined result is true, the flow proceeds to step Q10. If the determined result is false, the flow proceeds to step Q12. In step Q10, calibration and compensation of the reference point G421 are performed. In step Q12, the relevant operating conditions are compared based on the icon selection operating mode employed. In step Q14, the preset function of the icon I1 is executed by using the motion M994V shown in FIG. 14(b).

Implementation

CLAIMS 1. An instruction device for communicating instructions with a first response medium, comprising:

a sensing unit, which senses the first instruction medium to generate a corresponding first signal; and

A response unit that generates a geometric reference in response to the corresponding first signal to determine whether communication between the instruction and the first reactive medium should be performed based on a relationship between the geometric reference and the first reactive medium.

2. The command device of embodiment 1, wherein the communication is transmission of the command to the first response medium.

3. The command device of embodiment 1, wherein the communication is performed by causing the first response medium to be operated.

4. The command device of embodiment 1, wherein the communication is to transmit the feedback signal to the sensing unit through the first response medium.

5. The instruction device of embodiment 1, wherein the first reaction medium is arranged in a specific area.

6. The instruction device of embodiment 5, wherein the specific area is arranged on one of a screen, a monitor, and a display.

7. The command device of embodiment 5, wherein the geometric reference includes at least two reference positions, and the relationship is a first relationship between the at least two reference positions and the first reaction medium.

8. The command device of embodiment 7, wherein the at least two reference positions form a geometric line.

9. The command device of embodiment 5, wherein the geometric reference comprises at least three reference locations to determine whether communication between the command and the first reactive medium should be performed based on the relationship being in the specified area The first relationship between the first zone in the specific area and the second zone where the first reaction medium is located in the specific area, the first zone is jointly formed by the at least three reference positions.

10. The command device of embodiment 9, wherein the second region further includes a second reactive medium adjacent to the first reactive medium.

11. The command device of embodiment 9, wherein the command medium is motion, and the sensing unit is a motion sensing unit.

12. The command device according to embodiment 9, wherein the first relationship is a positional relationship, and the first reaction medium is an icon.

13. The instruction device of embodiment 9, wherein the corresponding first signal generates a trajectory describing the first region.

14. An instruction means for communicating instructions with an icon in an image area, comprising:

a motion sensing unit that senses a first motion to generate a corresponding first signal; and

a processing unit that generates a first trajectory in response to a corresponding first signal to determine a first region in the image area to determine based on a relationship between the first region and a second region in the image area where the icon is displayed Determines whether the icon should or has been selected.

15. The instruction device of embodiment 14, wherein said instruction is a selection instruction.

16. The instruction device of embodiment 14, wherein the processing unit further converts the corresponding first signal into the first trace.

17. The command device of embodiment 14, wherein:

the first trajectory includes a first arc, a combination of a second arc and the first line segment, and at least one of a plurality of second line segments, the first arc having an arc angle; and

When the first trajectory is the first circular arc, the angle of the arc angle of the first circular arc is 180° and one exceeding 180°.

18. The command device of embodiment 14, wherein the first region comprises an enclosed region.

19. The command device of embodiment 14, wherein:

When the first relationship is a cross relationship, the processing unit causes the icon to be selected; and

A cross relationship is in a specific condition, where the specific condition is one of the following conditions:

The first condition and the second zone are partially overlapping first conditions;

The first and second zones are fully overlapping second conditions;

The third condition that the first zone completely covers the second zone;

The fourth condition that the centroid of the first zone is located in the second zone;

a fifth condition that the first trajectory passes through the second zone; and

A sixth condition of the first track touching the second zone.

20. The instruction device according to embodiment 19 is further configured to have a second motion, the second motion is converted into a feature, and after the processing unit confirms the selected state of the icon, it is determined according to the feature whether the preset function of the icon is executed , the feature is one of the second signal and the second trace.

21. The command device of embodiment 20, wherein the second trace is one of a hook, a cross, and a circle mark.

22. The instruction device of embodiment 19, further configured to have a second movement, analyze the acceleration-deceleration distribution of the second movement, and determine whether the preset function of the icon is executed after the processing unit confirms the selected state of the icon.

23. The command device of embodiment 22, wherein the second movement is one of tick, cross, wavy, triangle, arc and circle movements.

24. The command device of embodiment 14, wherein the first motion is produced by at least one of a hand, arm, foot, leg, head, neck, shoulder, and waist.

25. An instruction means for communicating an instruction with a first icon in an image area, wherein at least a second icon is located adjacent to the first icon, the instruction means comprising:

a motion sensing unit that senses a first motion to generate a corresponding first signal; and

a processing unit that generates a first trajectory in response to a corresponding first signal to determine a first area in the image area, to determine a first area in the image area based on a second area in which at least two icons are displayed together in the image area Whether the first icon is selected is determined based on the relationship between them, and the at least two icons are composed of the first icon and at least the second icon.

26. The command device of embodiment 25, wherein:

the first trajectory includes a first arc, a combination of a second arc and the first line segment, and at least one of a plurality of second line segments, the first arc having an arc angle; and

When the first trajectory is the first circular arc, the angle of the arc angle of the first circular arc is one of 360°, close to 360° and exceeding 360°.

27. The command device of embodiment 25, wherein the first region comprises an enclosed region.

28. The command device of embodiment 25, wherein:

When the relationship is a cross relationship, the processing unit causes the at least two icons to be selected; and

A cross relationship is in a specific condition, where the specific condition is one of the following conditions:

The first condition and the second zone are partially overlapping first conditions;

The first and second zones are fully overlapping second conditions;

The third condition that the first zone completely covers the second zone;

The fourth condition that the centroid of the first zone is located in the second zone;

a fifth condition that the first trajectory passes through the second zone; and

A sixth condition of the first track touching the second zone.

29. The command device of embodiment 25, further configured to have a selection motion to cause a specific state, wherein the specific state is one of the following states:

The at least two icons have a first state of inverse video sequentially displayed thereon; and

The first trace is scaled down to a second state of the second trace, which is sequentially displayed on the at least two icons.

30. The command device of embodiment 29, wherein the selected motion is one of a yaw motion, a pitch motion, and a roll motion.

31. The command device of embodiment 25, wherein the at least two icons have reverse video displayed sequentially thereon by a button for selecting the first icon.

32. An instruction device for communicating instructions to a first response medium in a specific area, comprising:

a motion sensing unit that senses a first motion to generate a corresponding first signal; and

a response unit that generates at least three reference positions in response to corresponding first signals to determine a first zone in the specific area based on the location between the first zone and the second zone in the specific area where the first reaction medium is located relationship to determine whether communication between the command and the first-response intermediary should be performed.

33. The instruction device of embodiment 32, wherein the specific area is an image area.

34. The command device of embodiment 32, wherein the first response medium is an icon.

35. The instruction device of embodiment 32, wherein the response unit is a processor.

36. The command device of embodiment 32, wherein the first response medium is frequently displayed in the specific area.

37. The instruction device of embodiment 32, wherein said at least three reference positions are used to form a specific trajectory.

38. The command device of embodiment 37, wherein:

The specific trajectory is a geometric pattern trajectory, and the geometric pattern trajectory is one of a closed trajectory and a non-closed trajectory;

The closed locus is one of circle, ellipse, polygon, heart-shaped line, and rose-shaped line, where polygon is one of triangle, rectangle, and pentagon; and

An unclosed trajectory is one of arcs, curves, and cycloids.

39. The command device of embodiment 38, wherein the first region is surrounded by a specific track.

40. The command device of embodiment 32, wherein the second zone is associated with the first reaction medium.

41. The command device of embodiment 32, wherein:

said relationship is a cross relationship; and

A cross relationship is in a specific condition, where the specific condition is one of the following conditions:

the first condition that the first zone completely covers the second zone;

the first zone partially covers the second condition of the second zone;

the third condition that the first zone and the second zone are completely overlapping; and

The first zone and the second zone are partially overlapping fourth conditions.

42. An instruction means for communicating an instruction to a first reactive agent in a particular area, wherein at least a second reactive agent is located adjacent to the first reactive agent, the instruction means comprising:

a motion sensing unit that senses a first motion to generate a corresponding first signal; and

a response unit that generates at least three reference positions in response to the corresponding first signal to determine a first region in the image region based on a second region located in the specific region together with at least two reaction agents in the first region It is determined whether the communication between the instruction and the first reaction agent should be performed based on the relationship between the at least two reaction agents consisting of the first reaction agent and the at least second reaction agent.

43. An instruction device for communicating an instruction to a first response medium in a specific area, comprising:

a sensing unit, which senses the first instruction medium to generate a corresponding first signal; and

a response unit that generates at least three reference positions in response to corresponding first signals to determine a first zone in the specific area based on the location between the first zone and the second zone in the specific area where the first reaction medium is located relationship to determine whether the command should be delivered to the first-response intermediary.

44. The command device of embodiment 43, wherein the first command medium is motion.

45. The command device of embodiment 43, wherein:

The first instruction medium is a physical effect, and the physical effect is one of sound wave, light wave, non-contact force, contact force and mechanical force;

The non-contact force is one of electromagnetic waves, electricity, magnetism, and inertial force; and

Mechanical force is one of pressure, friction, and elastic force.

46. An instruction device for communicating an instruction to a first response medium in a specific area, comprising:

a sensing unit, which senses the first instruction medium to generate a corresponding first signal; and

a response unit, which generates at least two reference positions in response to the corresponding first signal, to determine the relationship between the command and the first reaction medium based on the relationship between the first reaction medium and the at least two reference positions Whether communication should be performed.

47. The instruction device of embodiment 46, wherein the at least two reference positions are used to form one of a geometric pattern and a geometric region.

48. The instruction device of embodiment 46, wherein said communication is a specific operation, one of the following operations:

a first operation to communicate the instruction to the first response medium; and

The feedback signal is transmitted to the second operation of the response unit through the first response medium.

49. An instruction device for communicating an instruction to a first response medium in a specific area, comprising:

a sensing unit, which senses the first instruction medium to generate a corresponding first signal; and

a response unit generating at least two reference positions to form a geometric line in response to the corresponding first signal to determine communication between the command and the first reaction medium based on the relationship between the geometric line and the first reaction medium should be performed.

50. The command device of embodiment 49, wherein the relationship is a positional relationship between the geometric line and the first zone in the particular area where the first reactive agent is located.

51. The command device of embodiment 50, wherein the positional relationship is whether an intersection relationship exists between the geometric line and the first region.

52. The instruction device of embodiment 51, wherein the cross relationship is one of the following relationships:

a first relation in which the geometric line passes through the first region; and

A second relation where the geometric line touches the boundary of the first region.

53. The command device of embodiment 49, wherein the geometric line is a straight line.

54. An apparatus for communicating instructions to a first response medium, comprising:

An instruction unit configured to send the instruction agent to determine the geometric reference to determine whether communication between the instruction and the first reaction agent should be performed based on the relationship between the geometric reference and the first reaction agent.

55. The command device of embodiment 54, wherein the geometric reference includes at least two reference locations, and the relationship is a first relationship between the at least two reference locations and the first reaction medium.

56. The command device of embodiment 54, wherein the command medium is the motion of the command unit, the motion of the command unit being converted into a trajectory to define the at least two reference positions.

57. The command device of embodiment 54, wherein the command medium is in a specific area, and the geometric reference includes at least three reference positions to determine whether communication between the command and the first reactive medium should be performed based on the relationship , the relationship is a first relationship between a first zone in the specific area and a second zone in the specific area where the first reaction medium is located, the first zone being jointly formed by the at least three reference positions.

58. An instruction device for communicating instructions with a first response medium, comprising:

an instruction unit configured to send an instruction medium to generate at least two reference positions to determine whether the communication between the instruction and the first reaction medium is based on the relationship between the at least two reference positions and the first reaction medium should be carried out.

59. An instruction means for communicating instructions with an icon in an image area, comprising:

an instruction unit configured to perform a first movement, convert the first movement into a first trajectory to determine a first area in the image area, and to determine a first area in the image area according to the difference between the first area and the second area in which the icon is displayed in the image area relationship to determine whether communication between the command and the icon should be performed.

60. The instruction device of embodiment 59, wherein the instruction unit comprises:

a motion sensing unit that converts the first motion into a first signal; and

A processing unit converts the first signal into a first trace, and determines a first area according to the first trace, so as to determine whether communication between the instruction and the icon should be performed according to the first area and the second area.

61. The instruction device of embodiment 60, wherein the motion sensing unit comprises:

A gyroscope that senses a first motion for generating a first signal.

62. The instruction device of embodiment 60, wherein the motion sensing unit comprises:

a gyroscope having at least two sensing degrees of freedom and sensing a first motion for generating a first portion of a first signal; and

An accelerometer having at least two sensing degrees of freedom and sensing a first motion for generating a second portion of the first signal.

63. The instruction device of embodiment 60, wherein the processing unit comprises one of a microcontroller, a microprocessor, a digital signal processor, and a central processing unit.

64. The command device of embodiment 59, wherein:

The first movement is formed by manually driving the instruction unit; and

The first movement includes at least one of three-dimensional movement and two-dimensional movement.

65. The command device of embodiment 59, wherein:

the first trajectory includes a first arc, a combination of a second arc and the first line segment, and at least one of a plurality of second line segments, the first arc having an arc angle; and

When the first trajectory is the first circular arc, the angle of the arc angle of the first circular arc is one of 360°, close to 360° and exceeding 360°.

66. The command device of embodiment 59, wherein the first region comprises an enclosed region.

67. The command device of embodiment 59, wherein:

When the relationship is a cross relationship, the instruction unit transmits the instruction to the icon; and

A cross relationship is in a specific condition, where the specific condition is one of the following conditions:

The first condition and the second zone are partially overlapping first conditions;

The first and second zones are fully overlapping second conditions;

The third condition that the first zone completely covers the second zone;

The fourth condition that the centroid of the first zone is located in the second zone;

a fifth condition that the first trajectory passes through the second zone; and

A sixth condition of the first track touching the second zone.

68. The command device of embodiment 59, wherein:

After the command unit confirms that the command is delivered to the icon, the icon is selected.

69. The command device of embodiment 68, wherein:

The instruction unit is also configured to have a second movement, convert the second movement into a second trajectory, and determine whether the preset function of the icon is executed according to the second trajectory after the instruction unit confirms the selected state of the icon; and

The second locus is one of tick, cross and circle marks.

70. The instruction device of embodiment 68, wherein the instruction unit is further configured to have a second movement, analyze the acceleration-deceleration distribution of the second movement, and determine whether the preset function of the icon is determined after the instruction unit confirms the selected state of the icon be executed.

71. The command device of embodiment 70, wherein the second motion is one of a tick, a cross, a wavy line, a triangle, an arc, and a circle movement.

72. An instruction device for communicating an instruction to a first response medium in a specific area, comprising:

an instruction unit configured to have a first motion, convert the first motion into a first trajectory to determine a first area in the specific area, to be displayed in the specific area according to the first area and the first reaction medium The relationship between the two areas to determine whether communication between the command and the first response medium should be performed.

73. A method of communicating instructions for communicating instructions with a first response medium comprising the steps of:

providing a geometric reference in response to an instruction medium; and

Whether communication between the command and the first reaction medium should be performed is determined based on the relationship between the geometric reference and the first reaction medium.

74. The command communication method of embodiment 73, wherein the geometric reference includes at least two reference locations, and the relationship is a first relationship between the at least two reference locations and the first reaction medium.

75. The instruction communication method of embodiment 74, further comprising the following steps:

providing a specific area to display first response media in the specific area; and

A geometric line is formed by the at least two reference positions, wherein the first relationship is a positional relationship between the geometric line and the first reaction medium in the specific area.

76. The instruction communication method of embodiment 73, wherein the geometric reference includes at least three reference positions, and the instruction communication method further includes the following steps:

The first zone is formed by the at least three reference positions, wherein the relationship is a first relationship between the first zone and the second zone in the specific area where the first reaction medium is located.

77. The command communication method of embodiment 73, wherein the geometric reference includes a trajectory, and the command communication method further comprises the following steps:

The first zone is determined from the trajectory, wherein the relationship is a first relationship between the first zone and a second zone in the specific area where the first reaction medium is located.

78. A method of communicating instructions for communicating instructions with a first response medium comprising the steps of:

providing at least two location references in response to an instruction medium; and

Whether a communication between the command and the first reaction medium should be carried out is determined on the basis of the relationship between the at least two positional references and the first reaction medium.

79. A method of command communication for communicating commands to a first-response medium in a specific area, comprising the steps of:

generating at least two reference positions in response to the first motion to form the geometric line; and

Whether or not communication between the command and the first reaction medium should be performed is determined based on the relationship between the geometric line and the second area where the first reaction medium is displayed in the specific area.

80. The command communication method of embodiment 79, wherein the geometric line is a straight line.

81. A method of command communication for communicating commands to a first response medium in a specific area comprising the steps of:

generating at least three reference positions in response to the first movement;

determining a first zone responsive to the at least three reference positions; and

Whether or not communication between the instruction and the first reaction medium should be performed is determined based on the relationship between the first region and the second region where the first reaction medium is displayed in the specific area.

82. The command communication method of embodiment 81, wherein:

The specific area is an image area;

the first-response medium is an icon; and

The first zone is located within the image area.

83. A method of command communication for communicating commands with an icon in an image area, comprising the steps of:

converting the first motion into a first trajectory;

determining a first zone in the image area based on the first trajectory; and

Whether communication between the command and the icon should be performed is determined based on the relationship between the first area and the second area where the icon is displayed in the image area.

84. An instruction device for communicating instructions to a first response medium, comprising:

a sensing unit, which senses the first instruction medium to generate a corresponding first signal; and

a response unit that temporarily generates one of a reference parameter, a position reference and a reference signal in response to a corresponding first signal, in accordance with a selected one of the first reaction medium and the reference parameter, position reference and reference signal relationship to determine whether communication between the command and the first-response intermediary should be performed.

85. An instruction device for communicating an instruction to a first response medium in a specific area, comprising:

a sensing unit, which senses the first instruction medium to generate a corresponding first signal; and

A response unit temporarily generates a reference position in response to the corresponding first signal to determine whether communication between the command and the first reaction medium should be performed based on a relationship between the reference position and the first reaction medium.

86. The command device of embodiment 85, wherein the reference location is located in a specific area.

87. The command device of embodiment 85, wherein the reference position is generated within a period of between 0.1 seconds and 3 seconds.

88. The command device of embodiment 85, wherein the relationship is a positional relationship between the reference position and the first reactive agent in the specific area.

89. The command device of embodiment 88, wherein the first reactive agent occupies a first zone in the specified area.

90. The command device of embodiment 89, wherein:

the response unit also generates a geometric pattern at the reference location in response to the corresponding first signal;

The geometric pattern is one of circles, ellipses and polygons; and

A polygon is one of a triangle, a rectangle, and a pentagon.

91. The command device of embodiment 90, wherein:

The response unit also determines whether the instruction is transmitted to the first response medium according to the positional relationship;

The positional relationship is whether a cross relationship exists between the geometric pattern and the first zone; and

A cross relationship is in a specific condition, where the specific condition is one of the following conditions:

a first condition that the geometric pattern covers the first region;

a second condition that the geometric pattern overlaps the first region; and

The third condition for the geometric pattern to intersect with the first zone.

92. The command device of embodiment 89, wherein whether the command is passed to the first reaction medium is determined based on whether the reference location is located in the first zone.

93. The instruction device of embodiment 92, wherein the instruction includes a command message for selecting a first reaction medium and changing a particular representation of the selected reaction medium.

94. The instruction device of embodiment 92, wherein the specific representation is one of the following representations:

displaying a first representation of the inverse video of the selected reaction medium;

changing the second representation of the color of the selected reaction medium;

A third representation displayed by scaling the selected reaction medium with an equal aspect ratio;

A fourth representation displayed by scaling the selected reaction medium with unequal aspect ratios;

A fifth representation displayed by flashing the selected reaction medium;

a sixth representation displayed by interactively changing the color of the selected reaction medium; and

A seventh representation of sound waves is produced.

95. An instruction device for communicating instructions to a first response medium in a specific area, comprising:

a sensing unit, which senses the first instruction medium to generate a corresponding first signal; and

A response unit temporarily provides a reference position in response to the corresponding first signal to determine whether communication between the instruction and the first reaction medium should be performed based on a relationship between the reference position and the first reaction medium.

96. The command device of embodiment 95, wherein the first reactive agent is located in a specific area.

97. The command device of embodiment 96, wherein the reference location is located in a specific area.

98. An instruction device for communicating instructions to a first response medium, comprising:

a sensing unit, which senses the first instruction medium to generate a corresponding first signal; and

A response unit temporarily generates a reference signal in response to the corresponding first signal to determine whether communication between the instruction and the first reaction medium should be performed based on a relationship between the reference signal and the first reaction medium.

99. The command device of embodiment 98, wherein the reference signal is a first geometric feature, the first geometric feature is one of a first location and a first zone, and the first reactive agent is located in a second geometric feature, the second geometric feature is 2nd location and 2nd district one.

100. The command device of embodiment 99, wherein:

The relationship is whether or not a cross relationship exists; and

A cross relationship is in a specific condition, where the specific condition is one of the following conditions:

a first condition that the first geometric feature and the second geometric feature overlap each other;

a second condition that the first geometric feature and the second geometric feature overlap each other; and

A third condition for the intersection of the first geometric feature and the second geometric feature.

101. The command device according to embodiment 98, further generates a command signal according to whether the relationship is established, and the command signal causes the command device to generate different sound waves, different light waves or different vibration waves.

102. An instruction device for communicating instructions with a first response medium, comprising:

a sensing unit, which senses the first instruction medium to generate a corresponding first signal; and

A response unit temporarily generates a reference parameter in response to the corresponding first signal to determine whether communication between the instruction and the first reaction medium should be performed based on a relationship between the reference parameter and the first reaction medium.

103. The command device of embodiment 102, wherein the reference parameter is one of a reference position, a reference geometric pattern, a geometric region, and a reference signal.

104. The instruction device of embodiment 102, wherein the communication is a specific operation, the specific operation being one of the following operations:

a first operation to communicate the instruction to the first response medium; and

The feedback signal is transmitted to the second operation of the response unit through the first reaction medium.

105. An instruction device for communicating an instruction with a first reaction medium, comprising an instruction unit configured to:

sending out an instruction medium to temporarily generate one of a reference parameter, a position reference, and a reference signal; and

Whether or not communication between the command and the first reactive agent should be performed is determined based on a relationship between the first reactive agent and a selected one of the reference parameter, the position reference, and the reference signal.

106. An instruction device for communicating an instruction with a first response medium, comprising:

An instruction unit configured to send out an instruction medium to temporarily generate a reference parameter to determine whether communication between the instruction and the first response medium should be performed based on a relationship between the reference parameter and the first response medium.

107. An instruction device for communicating an instruction to a first response medium in a specific area, comprising:

An instruction unit configured to send out an instruction medium to temporarily generate a reference position to determine whether communication between the instruction and the first reaction medium should be performed based on a relationship between the reference position and the first reaction medium.

108. An instruction device for communicating instructions with a first response medium, comprising:

An instruction unit configured to send out the instruction medium to temporarily generate a reference signal to determine whether communication between the instruction and the first reaction medium should be performed based on a relationship between the reference signal and the first reaction medium.

109. The command device of embodiment 108, wherein the reference signal is one of a location and a zone, the zone has a geometric feature, the geometric feature is one of a geometric shape and a geometric profile.

110. The command device of embodiment 109, wherein:

the instruction unit is also responsive to the geometric characteristics of the zone to generate a geometric pattern similar to the geometric characteristics; and

A geometric pattern is one of circles, ovals, rectangles, triangles and polygons.

111. A method of communicating instructions for communicating instructions with a first response medium comprising the steps of:

temporarily providing one of a reference parameter, a position reference, and a reference signal in response to an instruction medium; and

It is determined whether communication between the command and the first reactive agent should be performed based on a relationship between the first reactive agent and the selected one of the reference parameter, the position reference and the reference signal.

112. A method of communicating instructions for communicating instructions with a first response medium comprising the steps of:

temporarily providing the reference parameter in response to the instruction medium; and

Whether or not communication between the command and the first reaction agent should be performed is determined based on the relationship between the reference parameter and the first reaction agent.

113. A method of communicating instructions for communicating instructions with a first response medium comprising the steps of:

temporarily generating at least a reference position in response to the first movement; and

Whether or not communication between the command and the first reaction medium should be performed is determined based on the relationship between the reference location and the first reaction medium.

114. The instruction communication method of embodiment 113, wherein:

the reference location is located in the particular area and is used to determine the first zone; and

A first reaction medium is located in a specific area and is used to define a second area.

115. A method of communicating instructions for communicating instructions with a first response medium comprising the steps of:

temporarily providing the reference signal in response to the first instruction medium; and

Whether or not communication between the command and the first reaction medium should be performed is determined based on the relationship between the reference signal and the first reaction medium.

116. The command communication method of embodiment 115, wherein:

The first instruction medium is the first movement;

the reference signal is a first position signal; and

The reference signal is provided temporarily for a period between 0.1 second and 3 seconds.

117. The instruction communication method of embodiment 116, further comprising the following steps:

converting the first motion into a first position signal; and

Convert the first position signal to a first trajectory.

118. The instruction communication method of embodiment 117, further comprising the following steps:

start the first movement;

initializing the reference point of the first trajectory; and

Associated with the pose of the first motion to perform calibration and compensation of reference points.

119. The command communication method of embodiment 116, wherein:

the first location signal is located in the specific area and is used to determine the first zone; and

A first reaction medium is located in a specific area and is used to define a second area.

120. The command communication method according to embodiment 119, further comprising the following steps:

passing an instruction to the first reaction medium when the relationship is a first relationship between the first zone and the second zone and the first relationship is in a specified condition, wherein the specified condition is one of the following conditions:

The first condition and the second zone are partially overlapping first conditions;

The first and second zones are fully overlapping second conditions;

the third condition that the first zone completely covers the second zone; and

The fourth condition is that the centroid of the first zone is located within the second zone.

121. The command communication method of embodiment 115, wherein the command is transmitted to the first response medium to put the first response medium in a functional ready state, the method further comprising the following steps:

converting the second motion into a second trajectory; and

Whether the preset function of the first reaction medium is executed is determined according to the second trajectory.

122. An instruction device for communicating instructions to a first response medium, comprising:

a first response unit that generates a signal in response to the instruction medium; and

a second response unit that generates at least two location references in response to the signal to determine whether communication between the command and the first reaction agent is based on a relationship between the first reaction agent and the at least two location references should be carried out.

123. An instruction device for communicating instructions to a first response medium, comprising:

an instruction unit configured to send an instruction agent to generate at least two reference signals to determine whether the communication between the instruction and the first reaction agent is based on the relationship between the at least two reference signals and the first reaction agent should be carried out.

124. An instruction device for communicating instructions with a first response medium, comprising:

a first response unit that generates a signal in response to the instruction medium; and

a second response unit that temporarily generates one of a reference parameter, a position reference and a reference signal in response to said signal, in accordance with a relationship between the first reaction medium and a selected one of the reference parameter, position reference and reference signal relationship to determine whether communication between the command and the first-response intermediary should be performed.

125. An instruction device for communicating instructions to a first response medium, comprising:

a notification unit that causes a corresponding signal to be generated in response to the instruction medium; and

a response unit for generating one of a reference parameter, a position reference and a reference signal in response to said corresponding signal, based on a relationship between the first reaction medium and a selected one of the reference parameter, position reference and reference signal to determine whether communication between the command and the first response medium should be performed.

The advancement of the present invention over the operation of the 3D air mouse in the prior art is described as follows. Basically, in the present invention the trajectory is determined in response to motion. The area surrounded by the track or the track itself is compared with the comparison area associated with the target icon (object icon); a cross-relation is determined to determine whether said icon is selected, the cross-relation is between the first area and the second area Geometric relationship between , between locus and third zone, or between point and fourth zone. In actual operation, the trajectory determined in response to the natural movement of the hand is used to select items of an electronic menu on a human-machine graphical interface. After an item on the menu is selected, natural wrist and arm movements are used to cause the item's preset function to be executed.

Such ergonomic and intuitive operation not only possesses novelty, but is also effective in terms of ease of development of free operation of a selection device such as a three-dimensional mouse. The technical features of the present invention are greatly different from the prior art on the market. For example, the prior art provided by the three-dimensional remote controller of Gyration Company or the Air Mouse of Logitech Company follows the operation scheme of the two-dimensional mouse about the planar motion constrained on the desktop, and can only drive the cursor on the general screen. A cursor or an object on the screen is moved to select an icon on the screen, and then an active button of a conventional mouse is pressed twice in succession to execute a preset function of the icon. In fact, this conventional operation scheme cannot make full use of the convenience of the additional freedom provided by the three-dimensional mouse which further possesses another degree of freedom in the spatial dimension.

While the invention has been described in terms of what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not necessarily limited to the disclosed embodiment. On the contrary, the intention is to cover various modifications and similar arrangements included within the spirit and scope of the appended claims, which claims are accorded the broadest interpretation so as to cover all such modifications and similar structures.

Claims (3)

1. An instruction device for communicating an instruction with a reaction medium, the instruction device comprising: a first response unit that generates a signal in response to an instruction medium, wherein the instruction medium is one of contact force, friction force, elastic force, and pressure; and a second response unit that generates at least two position references in response to the signal to determine between the command and the reaction medium based on a relationship between the reaction medium and the at least two position references whether communication between them should be performed. 2. An instruction device for communicating an instruction with a reaction medium, the instruction device comprising: a first response unit that generates a signal in response to the instruction medium; and a second response unit that generates at least two position references in response to the signal to determine between the command and the reaction medium based on a relationship between the reaction medium and the at least two position references Whether a communication should be carried out, wherein the second response unit confirms that the instruction is delivered to the reaction medium through the communication. 3. The command device according to claim 2, wherein: the command medium is mechanical force, and the mechanical force is one of contact force, friction force, elastic force and pressure.