CN115686203A - Head motion interaction method, device, equipment and storage medium for smart glasses terminal - Google Patents

Abstract

The application discloses a head-moving interaction method, a device, equipment and a storage medium of an intelligent glasses terminal, the method comprises the steps of obtaining the current visual field center of a user wearing the intelligent glasses terminal, displaying a corresponding visual field cursor, completely driving the visual field cursor to execute a preset number of times of actions to a target image based on a translation and rotation mode of the user, executing preset operation on the target image according to a preset event corresponding to action information, liberating two hands, completely realizing interaction with an application program by depending on the head movement, and solving the problems that the existing interaction mode of wearable glasses equipment still needs to use two hands to complete interaction, and depends on external equipment, and the interaction is inconvenient.

Description

Head motion interaction method, device, equipment and storage medium for smart glasses terminal

technical field

The present application relates to the technical field of VR or AR, and in particular to a head movement interaction method, device, device and storage medium of a smart glasses terminal.

Background technique

Since mankind entered the information age, computing platforms have been constantly evolving. The two major computing platforms of PC and smart phone have created two golden ages in the history of the Internet. After years of development of PCs and smart phones, the industry has basically matured, and the room for industry growth and performance improvement is very limited, and users expect less and less. Smart glasses display terminals with advanced near-eye optical displays will become the next generation of personal computing platforms and display screens, bringing users a subversive and innovative experience.

The existing interaction methods of wearable glasses devices currently mainly use touchpads, buttons, etc. for interaction, but still need to use both hands to complete the interaction, and rely on external devices, which has the technical problem of inconvenient interaction.

Contents of the invention

This application provides a head movement interaction method, device, device, and storage medium for smart glasses terminals, which solves the problem that the existing interaction methods of wearable glasses devices currently mainly use touchpads, buttons, etc. for interaction, and still need to use Using both hands to complete the interaction, and relying on external devices, there is a technical problem of inconvenient interaction.

In view of this, the first aspect of the present application provides a head movement interaction method for a smart glasses terminal, the method including:

S1. Obtain the current visual field center of the user wearing the smart glasses terminal;

S2. Correspondingly displaying a field of view cursor according to the center of the current field of view;

S3. Receive the action information of the preset number of times the user moves the vision cursor to the target icon by moving the head in a preset time;

S4. Perform a preset operation on the target icon according to a preset event corresponding to the preset times of action information.

Optionally, after the step S2, it also includes:

S5. When the visual field cursor is located in the preset sliding area of the application window, receive the first head moving cursor track generated by the user by turning the head clockwise or counterclockwise;

S6. When the trajectory of the first head-moving cursor forms a closed figure, determine the sliding direction of the application window according to the direction in which the user turns his head;

S7. After the first head-moving cursor trajectory forms a closed figure, if it is detected that the user's head continues to move in the sliding direction, slide the application window in the sliding direction until the user is detected If the head moves in the opposite direction to the sliding direction, stop sliding the application window and stop displaying the first head-moving cursor track.

Optionally, after the step S4, it also includes:

S8. When the field of view cursor is located in the preset input area of the input box, and within the preset time, the user drives the field of view cursor to perform preset times of action information corresponding to the target icon by panning and turning the head. When the event is set as a selected event, a head-moving tablet is generated;

S9. When the visual field cursor is located in the corresponding area of the head tablet, receive a second head cursor trajectory generated by the user by moving the head;

S10. When the visual field cursor leaves the corresponding area of the head-hand writing pad, perform character recognition according to the second head-moving cursor track, and input the character recognition result into the input box.

Optionally, after the step S2, it also includes:

S11. Select the application window or icon when the visual field cursor hovers over the application window or icon for a time greater than a first preset time threshold;

S12. Drag the application window or icon to the target position according to the target position of the user by moving the head;

S13. When the visual field cursor hovers over the application window or icon for a time longer than a second preset time threshold, cancel the selected state of the application window or icon.

Optionally, the step S11 or S13 also includes:

When the view cursor hovers over the application window or icon, a countdown prompt is displayed in the preset display area.

The second aspect of the present application provides a head motion interaction device for a smart glasses terminal, the device includes:

an acquisition unit, configured to acquire the current visual field center of the user wearing the smart glasses terminal;

A display unit, configured to correspondingly display a field of view cursor according to the center of the current field of view;

The first receiving unit is configured to receive the action information of the preset number of times the user drives the field of view cursor to the target icon by panning and turning the head within a preset time;

The first processing unit is configured to perform a preset operation on the target icon according to a preset event corresponding to the preset times of action information.

Optionally, also include:

The second receiving unit is configured to receive the first head moving cursor track generated by the user by turning the head clockwise or counterclockwise when the visual field cursor is located in the preset sliding area of the application window;

The second processing unit is configured to determine the sliding direction of the application window according to the direction in which the user turns his head when the trajectory of the first head-moving cursor forms a closed figure;

The third processing unit is configured to slide the application window in the sliding direction if it is detected that the user's head continues to move in the sliding direction after the first head-moving cursor track forms a closed figure until If it is detected that the user's head moves in the opposite direction to the sliding direction, then stop sliding the application window and stop displaying the first head moving cursor track.

Optionally, also include:

The fourth processing unit is configured to, when the field of view cursor is located in the preset input area of the input box, and within the preset time, the user drives the field of view cursor to the target icon for a preset number of executions by panning and turning the head When the preset event corresponding to the action information is a selected event, a head-moving tablet is generated;

A third receiving unit, configured to receive a second head-moving cursor trajectory generated by the user by moving the head when the visual field cursor is located in the corresponding area of the head-hand writing tablet;

The fifth processing unit is configured to perform character recognition according to the track of the second head-moving cursor when the field-of-view cursor leaves the corresponding area of the head-hand writing pad, and input the character recognition result into the input box.

The third aspect of the present application provides a head-motion interaction device for a smart glasses terminal, the device includes a processor and a memory:

The memory is used to store program codes and transmit the program codes to the processor;

The processor is configured to execute the steps of the head motion interaction method for the smart glasses terminal described in the first aspect according to the instructions in the program code.

The fourth aspect of the present application provides a computer-readable storage medium, the computer-readable storage medium is used to store program code, and the program code is used to execute the method for head motion interaction of the smart glasses terminal described in the first aspect above step.

It can be seen from the above technical solutions that the embodiments of the present application have the following advantages:

In this application, a head movement interaction method, device, device and storage medium of a smart glasses terminal are provided. By obtaining the current field of view center of the user wearing the smart glasses terminal, the corresponding field of view cursor is displayed, which is completely based on the user's translation The way of turning the head drives the field of view cursor to perform a preset number of actions to the target image, and performs preset operations on the target image according to the preset events corresponding to the action information, freeing hands, and completely relying on head movement to achieve interaction with the application. This solves the problem that the existing interaction methods of wearable glasses devices currently mainly use touchpads, buttons, etc., but still need to use both hands to complete the interaction, and rely on external devices, which has the technical problem of inconvenient interaction.

Description of drawings

FIG. 1 is a flow chart of the first method of a head movement interaction method for a smart glasses terminal in an embodiment of the present application;

FIG. 2 is a flowchart of a second method of a head movement interaction method for a smart glasses terminal in an embodiment of the present application;

FIG. 3 is a flow chart of a third method of a head movement interaction method for a smart glasses terminal in an embodiment of the present application;

FIG. 4 is a flowchart of a fourth method of a head movement interaction method for a smart glasses terminal in an embodiment of the present application;

FIG. 5 is a schematic structural diagram of a head-motion interaction device for a smart glasses terminal in an embodiment of the present application;

FIG. 6 is a schematic structural diagram of a head-motion interaction device of a smart glasses terminal in an embodiment of the present application.

Detailed ways

In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiment of the application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiment of the application. Obviously, the described embodiment is only It is a part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

This application designs a head movement interaction method, device, device and storage medium for smart glasses terminals, which solves the problem that the existing interaction methods of wearable glasses devices currently mainly use touchpads, buttons, etc. for interaction, and still need to use Using both hands to complete the interaction, and relying on external devices, there is a technical problem of inconvenient interaction.

For ease of understanding, please refer to FIG. 1. FIG. 1 is a flow chart of the first method of a head motion interaction method for a smart glasses terminal in the embodiment of the present application, as shown in FIG. 1, specifically:

S1. Obtain the current visual field center of the user wearing the smart glasses terminal;

It should be noted that the virtual large screen refers to a desktop that is larger than the current field of view, and functional components such as application icons and navigation bars are parked on the virtual large screen desktop. The virtual large screen will be static relative to the real space. After turning on the head-motion interactive mode, you can turn your head in any direction to view the contents of different areas of the virtual large screen.

S2. Correspondingly display the visual field cursor according to the center of the current visual field;

It should be noted that after the user's current visual field center is determined, a visual field cursor is displayed at a corresponding position, and the visual field cursor is equivalent to a mouse cursor.

S3. Receive the action information of the preset number of times the user moves the vision cursor to the target icon by moving the head in a preset time;

It should be noted that, for example, within the preset time of 1 second, the user drives the vision cursor to pass through the target icon twice by panning and turning the head, and corresponding action information will be generated.

Ways to cross the target icon can be divided into crossing from top to bottom, crossing from top to bottom, crossing from left to right and crossing from right to left.

S4. Perform a preset operation on the target icon according to a preset event corresponding to the action information of a preset number of times.

It should be noted that different combinations of traversing actions can generate different action information, and the action information will correspond to preset events, for example:

Top wear + bottom wear event 1;

Wear left + wear right Event 2;

Top up twice Event 3;

Twice under the event 4;

Twice left cross event 5;

Two right crosses Event 6;

Events may include but not limited to single-click, double-click, right-click, select, delete, rename, etc. The specific action information corresponds to which preset event can be customized by the user.

Please refer to FIG. 2. FIG. 2 is a flow chart of the second method of a head motion interaction method for a smart glasses terminal in the embodiment of the present application, as shown in FIG. 2, specifically:

Also include after step S2:

S5. When the field of view cursor is located in the preset sliding area of the application window, receive the first moving cursor trajectory generated by the user by turning the head clockwise or counterclockwise;

S6. When the trajectory of the first head-moving cursor forms a closed figure, determine the sliding direction of the application window according to the direction in which the user turns his head;

S7. After the first head-moving cursor trajectory forms a closed figure, if it is detected that the user's head continues to move in the sliding direction, then slide the application window in the sliding direction until the reverse movement of the user's head in the sliding direction is detected, then stop sliding The application window and stop showing the first cursor trail.

It should be noted that, in an application window that needs to be slid up and down, it is generally achieved by dragging a slide rail of the application window with a mouse. In the technical solution of the present application, the user can judge whether to slide up, slide down, slide to the left or slide to the right by turning the head clockwise or counterclockwise. When the user turns his head to form a closed figure, such as a circle, to determine the direction of the slide, on the basis of the closed figure, the user continues to move in the direction of the slide by panning the head to determine the distance of the slide, if it moves in the opposite direction of the slide Represents stopping the sliding of the window.

Please refer to FIG. 3. FIG. 3 is a flow chart of the third method of a head motion interaction method for a smart glasses terminal in the embodiment of the present application, as shown in FIG. 3, specifically:

Also include after step S4:

S8. When the visual field cursor is located in the preset input area of the input box, and within the preset time, the preset event corresponding to the action information of the preset number of times the user drives the visual field cursor to the target icon by panning and turning the head is a selected event , to generate a head-moving tablet;

S9. When the field of view cursor is located in the corresponding area of the head tablet, receive the second head-moving cursor track generated by the user by moving the head;

S10. When the visual field cursor leaves the corresponding area of the head-hand writing board, perform character recognition according to the second head-moving cursor trajectory, and input the character recognition result into the input box.

It should be noted that when inputting text information, the visual field cursor can be recognized based on the preset event corresponding to the action information as the input box corresponding to the position where the visual field cursor is selected, and the generated head-moving tablet is displayed. In the area corresponding to the head-moving tablet Write text by turning your head.

Please refer to FIG. 4. FIG. 4 is a flow chart of the fourth method of a head motion interaction method for a smart glasses terminal in the embodiment of the present application, as shown in FIG. 4, specifically:

Also include after step S2:

S11. Select the application window or icon when the visual field cursor hovers over the application window or icon for a time greater than a first preset time threshold;

S12. Drag the application window or icon to the target position according to the target position of the user by moving the head;

S13. When the visual field cursor hovers over the application window or icon for a time longer than the second preset time threshold, cancel the selected state of the application window or icon.

It should be noted that if the visual field cursor stays on a certain application window or icon for a first preset time exceeding 3 seconds, the current application window or icon is selected.

By turning the head, you can drag the application icon or window to any position on the virtual big screen.

When it is placed in the parking area, the head is still for the second preset time of 3s, and the selected state is cancelled;

If it is in an area that cannot be dropped, the dragging state will be automatically canceled after 3s when the original position is restored or the dragging limit is reached (such as the boundary of the virtual large screen).

There can be a countdown prompt window when both selected and unselected.

Please refer to FIG. 5. FIG. 5 is a schematic structural diagram of a head-motion interaction device for a smart glasses terminal in an embodiment of the present application, as shown in FIG. 5, specifically:

An acquisition unit 501, configured to acquire the current visual field center of the user wearing the smart glasses terminal;

A display unit 502, configured to display a field of view cursor correspondingly according to the center of the current field of view;

The first receiving unit 503 is configured to receive the action information of the preset number of times the user drives the field of view cursor to the target icon by panning and turning the head within a preset time;

The first processing unit 504 is configured to perform a preset operation on the target icon according to a preset event corresponding to the preset times of action information.

Further, it also includes:

The second receiving unit 505 is configured to receive the first head moving cursor track generated by the user by turning the head clockwise or counterclockwise when the view cursor is located in the preset sliding area of the application window;

The second processing unit 506 is configured to determine the sliding direction of the application window according to the direction in which the user turns the head when the first head-moving cursor track forms a closed figure;

The third processing unit 507 is configured to slide the application window in the sliding direction if it is detected that the user's head continues to move in the sliding direction after the first head-moving cursor track forms a closed figure, until the user's head in the sliding direction is detected Move in the reverse direction, stop sliding the application window, and stop showing the first moving cursor track.

Further, it also includes:

The fourth processing unit 508 is used to predict the action information corresponding to the preset number of actions performed by the user to drive the visual field cursor to the target icon when the visual field cursor is located in the preset input area of the input box and within the preset time. When the event is set as a selected event, a head-moving tablet is generated;

The third receiving unit 509 is configured to receive the second head-moving cursor trajectory generated by the user by moving the head when the visual field cursor is located in the corresponding area of the head-hand writing pad;

The fifth processing unit 510 is configured to perform character recognition according to the second head-moving cursor trajectory when the view cursor leaves the corresponding area of the head-hand writing pad, and input the character recognition result into the input box.

The embodiment of the present application also provides another head-motion interaction device for the smart glasses terminal, as shown in Figure 6. For the sake of illustration, only the parts related to the embodiment of the present application are shown. If the specific technical details are not disclosed, please refer to Refer to the Methods section for the Examples of this application. The terminal can be any terminal including mobile phone, tablet computer, personal digital assistant (English full name: PersonalDigital Assistant, English abbreviation: PDA), sales terminal (English full name: Point of Sales, English abbreviation: POS), vehicle-mounted computer, smart glasses, etc. Device, taking the terminal as smart glasses as an example:

FIG. 6 is a block diagram showing a partial structure of smart glasses related to the terminal provided by the embodiment of the present application. Referring to FIG. 6 , smart glasses include: radio frequency (English full name: Radio Frequency, English abbreviation: RF) circuit 1010, memory 1020, input unit 1030, display unit 1040, sensor 1050, audio circuit 1060, wireless fidelity (English full name: wireless fidelity, English abbreviation: WiFi) module 1070 , processor 1080 , power supply 1090 and other components. Those skilled in the art can understand that the structure of the smart glasses shown in FIG. 6 does not constitute a limitation on the mobile phone, and may include more or less components than shown in the figure, or combine some components, or arrange different components.

The following is a specific introduction to each component of the smart glasses in combination with Figure 6:

The RF circuit 1010 can be used for sending and receiving information or receiving and sending signals during a call. In particular, after receiving the downlink information from the base station, it is processed by the processor 1080; in addition, it sends the designed uplink data to the base station. Generally, the RF circuit 1010 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (full English name: Low Noise Amplifier, English abbreviation: LNA), a duplexer, and the like. In addition, RF circuitry 1010 may also communicate with networks and other devices via wireless communications. The above-mentioned wireless communication can use any communication standard or protocol, including but not limited to Global System for Mobile Communication (English full name: Global System of Mobile communication, English abbreviation: GSM), General Packet Radio Service (English full name: General Packet Radio Service, GPRS ), Code Division Multiple Access (English full name: Code Division Multiple Access, English abbreviation: CDMA), Wideband Code Division Multiple Access (English full name: WidebandCode Division Multiple Access, English abbreviation: WCDMA), Long Term Evolution (English full name: Long TermEvolution, English abbreviation: LTE), email, short message service (English full name: Short Messaging Service, SMS), etc.

The memory 1020 can be used to store software programs and modules, and the processor 1080 executes various functional applications and data processing of the smart glasses by running the software programs and modules stored in the memory 1020 . The memory 1020 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.); Data created using smart glasses (such as audio data), etc. In addition, the memory 1020 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.

The input unit 1030 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the smart glasses. Specifically, the input unit 1030 may include a touch panel 1031 and other input devices 1032 . The touch panel 1031, also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 1031 or near the touch panel 1031). operation), and drive the corresponding connection device according to the preset program. Optionally, the touch panel 1031 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to the to the processor 1080, and can receive and execute commands sent by the processor 1080. In addition, the touch panel 1031 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1031 , the input unit 1030 may also include other input devices 1032 . Specifically, other input devices 1032 may include, but are not limited to, one or more of physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, joysticks, neck rings, and the like.

The display unit 1040 may be used to display information input by or provided to the user and various menus of the smart glasses. The display unit 1040 may include a display panel 1041. Optionally, a liquid crystal display (English full name: Liquid Crystal Display, English abbreviation: LCD), an organic light-emitting diode (English full name: Organic Light-Emitting Diode, English abbreviation: OLED) etc. may be used. form to configure the display panel 1041 . Furthermore, the touch panel 1031 can cover the display panel 1041, and when the touch panel 1031 detects a touch operation on or near it, it sends it to the processor 1080 to determine the type of the touch event, and then the processor 1080 determines the type of the touch event according to the Type provides a corresponding visual output on the display panel 1041 . Although in FIG. 6, the touch panel 1031 and the display panel 1041 are used as two independent components to realize the input and input functions of the mobile phone, in some embodiments, the touch panel 1031 and the display panel 1041 can be integrated to form a mobile phone. Realize the input and output functions of smart glasses.

The smart glasses may also include at least one sensor 1050, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor can include an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 1041 according to the brightness of the ambient light, and the proximity sensor can automatically wake up the display panel 1041 when wearing smart glasses. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used to identify the application of smart glasses attitude (such as raising the head, bowing the head, Turn head), vibration recognition related functions (such as pedometer, tap), etc.; As for other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc. that can be configured in smart glasses, I will not repeat them here.

The audio circuit 1060, the speaker 1061, and the microphone 1062 can provide an audio interface between the user and the smart glasses. The audio circuit 1060 can transmit the electrical signal converted from the received audio data to the speaker 1061, and the speaker 1061 converts it into an audio signal for output; After being received, it is converted into audio data, and then the audio data is processed by the output processor 1080, and then sent to, for example, another smart glasses through the RF circuit 1010, or the audio data is output to the memory 1020 for further processing.

WiFi is a short-distance wireless transmission technology. Smart glasses can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 1070. It provides users with wireless broadband Internet access. Although FIG. 6 shows the WiFi module 1070, it can be understood that it is not a necessary component of the smart glasses, and can be completely omitted according to needs without changing the essence of the invention.

The processor 1080 is the control center of the smart glasses. It uses various interfaces and lines to connect various parts of the whole smart glasses. By running or executing the software programs and/or modules stored in the memory 1020, and calling the data stored in the memory , perform various functions of the smart glasses and process data, so as to monitor the smart glasses as a whole. Optionally, the processor 1080 may include one or more processing units; preferably, the processor 1080 may integrate an application processor and a modem processor, wherein the application processor mainly processes operating systems, user interfaces, and application programs, etc. , the modem processor mainly handles wireless communications. It can be understood that the foregoing modem processor may not be integrated into the processor 1080 .

The smart glasses also include a power supply 1090 (such as a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 1080 through the power management system, so that functions such as charging, discharging, and power consumption management can be realized through the power management system.

Although not shown, the smart glasses may also include a camera, a Bluetooth module, etc., which will not be repeated here.

In this embodiment of the application, the processor 1080 included in the terminal also has the following functions:

S1. Obtain the current visual field center of the user wearing the smart glasses terminal;

S2. Correspondingly display the visual field cursor according to the center of the current visual field;

S3. Receive the action information of the preset number of times the user moves the vision cursor to the target icon by moving the head in a preset time;

S4. Perform a preset operation on the target icon according to a preset event corresponding to the action information of a preset number of times.

An embodiment of the present application further provides a computer-readable storage medium for storing program codes, and the program codes are used to execute any one of the implementation manners of the head motion interaction method for a smart glasses terminal in the foregoing embodiments.

In the embodiment of the present application, a head movement interaction method, device, device, and storage medium of a smart glasses terminal are provided. By obtaining the current field of view center of the user wearing the smart glasses terminal, the corresponding field of view cursor is displayed, which is completely based on the user's Drive the field of view cursor to perform a preset number of actions to the target image by moving the head in translation, and perform preset operations on the target image according to the preset event corresponding to the action information, free your hands, and completely rely on head movement to realize the interaction with the application program Interaction, so as to solve the existing interaction methods of wearable glasses equipment. At present, touchpads, buttons and other methods are mainly used for interaction, but both hands are still required to complete the interaction, and rely on external devices, which has the technical problem of inconvenient interaction.

Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

The terms "first", "second", "third", "fourth", etc. (if any) in the description of the present application and the above drawings are used to distinguish similar objects and not necessarily to describe specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments of the application described herein, for example, can be practiced in sequences other than those illustrated or described herein. Furthermore, the terms "comprising" and "having", as well as any variations thereof, are intended to cover a non-exclusive inclusion, for example, a process, method, system, product or device comprising a sequence of steps or elements is not necessarily limited to the expressly listed instead, may include other steps or elements not explicitly listed or inherent to the process, method, product or apparatus.

It should be understood that in this application, "at least one (item)" means one or more, and "multiple" means two or more. "And/or" is used to describe the association relationship of associated objects, indicating that there can be three types of relationships, for example, "A and/or B" can mean: only A exists, only B exists, and A and B exist at the same time , where A and B can be singular or plural. The character "/" generally indicates that the contextual objects are an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one item (piece) of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c ", where a, b, c can be single or multiple.

In the several embodiments provided in this application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or part of the contribution to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (English full name: Read-OnlyMemory, English abbreviation: ROM), random access memory (English full name: Random Access Memory, English abbreviation: RAM), magnetic disk Or various media such as CDs that can store program codes.

As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present application, and are not intended to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still understand the foregoing The technical solutions described in each embodiment are modified, or some of the technical features are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the application.

Claims (10)

1. A head motion interaction method for a smart glasses terminal, characterized in that it comprises: S1. Obtain the current visual field center of the user wearing the smart glasses terminal; S2. Correspondingly displaying a field of view cursor according to the center of the current field of view; S3. Receive the action information of the preset number of times the user moves the vision cursor to the target icon by moving the head in a preset time; S4. Perform a preset operation on the target icon according to a preset event corresponding to the preset times of action information. 2. The head movement interaction method of the smart glasses terminal according to claim 1, characterized in that, after the step S2, it also includes: S5. When the visual field cursor is located in the preset sliding area of the application window, receive the first head moving cursor track generated by the user by turning the head clockwise or counterclockwise; S6. When the trajectory of the first head-moving cursor forms a closed figure, determine the sliding direction of the application window according to the direction in which the user turns his head; S7. After the first head-moving cursor trajectory forms a closed figure, if it is detected that the user's head continues to move in the sliding direction, slide the application window in the sliding direction until the user is detected If the head moves in the opposite direction to the sliding direction, stop sliding the application window and stop displaying the first head-moving cursor track. 3. The head movement interaction method of the smart glasses terminal according to claim 1, characterized in that, after the step S4, it also includes: S8. When the field of view cursor is located in the preset input area of the input box, and within the preset time, the user drives the field of view cursor to perform preset times of action information corresponding to the target icon by panning and turning the head. When the event is set as a selected event, a head-moving tablet is generated; S9. When the visual field cursor is located in the corresponding area of the head tablet, receive a second head cursor trajectory generated by the user by moving the head; S10. When the visual field cursor leaves the corresponding area of the head-hand writing pad, perform character recognition according to the second head-moving cursor track, and input the character recognition result into the input box. 4. The head movement interaction method of the smart glasses terminal according to claim 1, characterized in that, after the step S2, it also includes: S11. Select the application window or icon when the visual field cursor hovers over the application window or icon for a time greater than a first preset time threshold; S12. Drag the application window or icon to the target position according to the target position of the user by moving the head; S13. When the visual field cursor hovers over the application window or icon for a time longer than a second preset time threshold, cancel the selected state of the application window or icon. 5. The head movement interaction method of the smart glasses terminal according to claim 4, characterized in that, the step S11 or S13 further comprises: When the view cursor hovers over the application window or icon, a countdown prompt is displayed in the preset display area. 6. A head-motion interaction device for a smart glasses terminal, characterized in that it comprises: an acquisition unit, configured to acquire the current visual field center of the user wearing the smart glasses terminal; A display unit, configured to correspondingly display a field of view cursor according to the center of the current field of view; The first receiving unit is configured to receive the action information of the preset number of times the user drives the field of view cursor to the target icon by panning and turning the head within a preset time; The first processing unit is configured to perform a preset operation on the target icon according to a preset event corresponding to the preset times of action information. 7. The head motion interaction device of the smart glasses terminal according to claim 6, further comprising: The second receiving unit is configured to receive the first head moving cursor track generated by the user by turning the head clockwise or counterclockwise when the visual field cursor is located in the preset sliding area of the application window; The second processing unit is configured to determine the sliding direction of the application window according to the direction in which the user turns his head when the trajectory of the first head-moving cursor forms a closed figure; The third processing unit is configured to slide the application window in the sliding direction if it is detected that the user's head continues to move in the sliding direction after the first head-moving cursor track forms a closed figure until If it is detected that the user's head moves in the opposite direction to the sliding direction, then stop sliding the application window and stop displaying the first head moving cursor track. 8. The head motion interaction device of the smart glasses terminal according to claim 6, further comprising: The fourth processing unit is configured to, when the field of view cursor is located in the preset input area of the input box, and within the preset time, the user drives the field of view cursor to the target icon for a preset number of executions by panning and turning the head When the preset event corresponding to the action information is a selected event, a head-moving tablet is generated; A third receiving unit, configured to receive a second head-moving cursor trajectory generated by the user by moving the head when the visual field cursor is located in the corresponding area of the head-hand writing tablet; The fifth processing unit is configured to perform character recognition according to the track of the second head-moving cursor when the field-of-view cursor leaves the corresponding area of the head-hand writing pad, and input the character recognition result into the input box. 9. A head-motion interaction device for a smart glasses terminal, characterized in that the device includes a processor and a memory: The memory is used to store program codes and transmit the program codes to the processor; The processor is configured to execute the head motion interaction method of the smart glasses terminal according to any one of claims 1-5 according to the instructions in the program code. 10. A computer-readable storage medium, characterized in that the computer-readable storage medium is used to store program codes, and the program codes are used to execute the header of the smart glasses terminal according to any one of claims 1-5. interactive method.

Images