CN112148120A - A method, device and storage medium for displaying virtual interface - Google Patents

Abstract

The embodiment of the application discloses a method, equipment and a storage medium for displaying a virtual interface, which are not only from the perspective of user comfort, but also only need a user to directly turn over an operation gesture, provide the most comfortable operation gesture for the user to display the virtual interface, are efficient and convenient, are low in learning cost, and provide comfortable experience for the user. The aforementioned method may be applied to one or more of an AR device, a VR device and an MR device, and may include: acquiring a first operation gesture of a user; overturning the first operation gesture to obtain a second operation gesture; and when the second operation gesture is matched with the preset operation gesture set, displaying the virtual interface in the preset area of the second operation gesture.

Description

A method, device and storage medium for displaying virtual interface

technical field

The embodiments of the present application relate to the field of communications technologies, and in particular, to a method, a device, and a storage medium for displaying a virtual interface.

Background technique

With the rise of augmented reality (AR) devices, virtual reality (VR) devices, and mediated reality (MR) devices, naked-eye interaction gestures are a hot spot in the field of human-computer interaction, and have gradually become a The development trend of natural interaction in the future. Compared with the traditional interaction method based on graphical user interface, the naked-eye interaction gesture frees the user from the constraints of the keyboard and mouse, thus gradually providing the user with a natural interaction method that conforms to human nature. Through naked-eye interaction gestures, users can operate the virtual interface and the content in the virtual interface in three-dimensional space.

However, in the process that the user wakes up and displays the virtual interface by means of naked-eye interaction gestures, since various naked-eye interaction gestures represent different meanings, based on the existing display methods, the user is required to respond to various naked-eye interaction gestures. To learn and memorize, the learning cost is high and the operation is difficult, resulting in low wake-up efficiency, and it is difficult to provide users with a high-quality experience.

SUMMARY OF THE INVENTION

The embodiments of the present application provide a method, a device and a storage medium for displaying a virtual interface, which are not only from the perspective of user comfort, but also only require the user to directly flip the operation gesture, so as to provide the user with the most comfortable operation gesture to display the virtual interface , efficient and convenient, low learning cost, providing users with a comfortable experience.

In a first aspect, an embodiment of the present application provides a method for displaying a virtual interface. The method can be applied to one or more of an AR device, a VR device, and an MR device. The method can include: acquiring a user's first operation gesture ; Flip the first operation gesture to obtain the second operation gesture; when the second operation gesture matches the preset operation gesture set, display a virtual interface in the preset area of the second operation gesture. In the above manner, the user only needs to flip the first operation gesture, and when the flipped second operation gesture matches the preset operation gesture set, the virtual interface can be directly displayed in the preset area of the second operation gesture, Provide users with the most comfortable operation gestures to display the virtual interface. Users only need to flip the operation gestures directly, and do not need to keep in mind various complex naked-eye interaction gestures. It is efficient and convenient, with low learning cost, and provides users with a comfortable experience.

Optionally, in combination with the above-mentioned first aspect, in a first possible implementation manner, the method further includes: when the second operation gesture matches a preset operation gesture set, on the second operation gesture Displaying at least one virtual logo, where each virtual logo in the at least one virtual logo is used to identify a corresponding virtual interface; receiving a click instruction, the click instruction is when any virtual logo in the at least one virtual logo is clicked instruction; correspondingly, displaying the virtual interface in the preset area of the second operation gesture includes: displaying the virtual interface in the preset area of the second operation gesture based on the click instruction. Through the above method, not only from the perspective of user comfort, but also the user only needs to directly flip the first operation gesture, which is efficient and convenient, and the learning cost is low, and the virtual logo is displayed in the flipped second operation gesture. The logo is used to display the virtual interface, which avoids the problem of false touches in the process of pursuing efficiency and convenience, and provides users with a comfortable experience.

Optionally, in combination with the first aspect or the first possible implementation manner of the first aspect, in a second possible implementation manner, flipping the first operation gesture to obtain the second operation gesture includes: according to The first operation gesture is flipped at a preset flip angle to obtain the second operation gesture. In the above manner, the preset flip angle is defined from a comfortable angle of user experience, so that multiple flip modes of the first operation gesture can be implemented based on the preset flip angle, thereby providing a user with a comfortable experience.

Optionally, in combination with the second possible implementation manner of the above-mentioned first aspect, in a third possible implementation manner, the preset flip angle includes a counterclockwise rotation of 180°. In the above manner, the preset flip angle is limited to rotate 180° counterclockwise, so that when the user uses the first operation gesture of the left hand to flip, the second operation gesture obtained after flipping is in the most natural state of the user, which can It provides users with the most comfortable experience and avoids the problem of arm soreness and tiredness caused by frequently opening the palm for a long time.

Optionally, in combination with the first aspect or the first possible implementation manner of the first aspect, in a fourth possible implementation manner, matching the second operation gesture with a preset operation gesture set includes: parsing the The second operation gesture is to obtain gesture feature information; the gesture feature information is matched with the gesture feature corresponding to each preset operation gesture in the preset operation gesture set.

Optionally, in combination with the first to fourth possible implementation manners of the first aspect, in a fifth possible implementation manner, the virtual logo includes a floating button in a preset style.

In a second aspect, an embodiment of the present application provides a display device, and the display device may include: an acquisition unit, configured to acquire a user's first operation gesture; An operation gesture is flipped to obtain a second operation gesture; a display unit is configured to display the second operation gesture in a preset area of the second operation gesture when the second operation gesture obtained by the flipping unit matches a preset operation gesture set Display the virtual interface.

Optionally, in combination with the above second aspect, in a first possible implementation manner, the display device further includes: the display unit, further configured to, when the second operation gesture matches a preset operation gesture set , at least one virtual logo is displayed on the second operation gesture, and each virtual logo in the at least one virtual logo is used to identify the corresponding virtual interface; the receiving unit is used to receive a click instruction, and the click instruction is a click An instruction when any one of the at least one virtual identifier is a virtual identifier; correspondingly, the display unit is configured to display a virtual interface in a preset area of the second operation gesture based on the click instruction.

Optionally, in combination with the second aspect or the first possible implementation manner of the second aspect, in the second possible implementation manner, the flip unit is configured to convert the first operation gesture according to a preset flip angle. Flip to get the second action gesture.

Optionally, in combination with the second possible implementation manner of the second aspect, in a third possible implementation manner, the preset flip angle includes a counterclockwise rotation of 180°.

Optionally, in combination with the second aspect or the first to third possible implementation manners of the second aspect, in a fourth possible implementation manner, the display device further includes: a parsing unit for parsing the The second operation gesture is used to obtain gesture feature information; the matching unit is configured to match the gesture feature information with the gesture feature corresponding to each preset operation gesture in the preset operation gesture set.

Optionally, in combination with the first to fourth possible implementation manners of the second aspect, in a fifth possible implementation manner, the virtual logo includes a floating button in a preset style.

In a third aspect, embodiments of the present application provide a computer-readable storage medium, including instructions, which, when executed on a computer, cause the computer to execute the method of the first aspect or any possible implementation manner of the first aspect.

In a fourth aspect, embodiments of the present application provide a computer program product containing instructions, which, when executed on a computer, cause the computer to execute the method of the first aspect or any possible implementation manner of the first aspect.

In a fifth aspect, an embodiment of the present application provides a chip system, where the chip system includes a processor for supporting a display device to implement the functions involved in the first aspect or any possible implementation manner of the first aspect. In a possible design, the chip system further includes a memory for storing necessary program instructions and data of the information generating device. The chip system may be composed of chips, or may include chips and other discrete devices.

As can be seen from the above technical solutions, the embodiments of the present application have the following advantages:

In this embodiment of the present application, the first operation gesture of the user is obtained; the first operation gesture is flipped to obtain the second operation gesture; when the second operation gesture matches the preset operation gesture set, the The preset area of the second operation gesture displays a virtual interface. In the above manner, the user only needs to flip the first operation gesture, and when the flipped second operation gesture matches the preset operation gesture set, the virtual interface can be directly displayed in the preset area of the second operation gesture, Provide users with the most comfortable operation gestures to display the virtual interface. Users only need to flip the operation gestures directly, and do not need to keep in mind various complex naked-eye interaction gestures. It is efficient and convenient, with low learning cost, and provides users with a comfortable experience.

Description of drawings

In order to illustrate the technical solutions of the embodiments of the present application more clearly, the following briefly introduces the accompanying drawings used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application.

1 is a schematic diagram of a display virtual interface provided in an existing scheme;

2 is a schematic diagram of another display virtual interface provided in an existing scheme;

3 is a schematic diagram of a possible application scenario of an embodiment of the present application;

4 is a schematic diagram of an embodiment of a method for displaying a virtual interface provided by an embodiment of the present application;

5 is a schematic diagram of a flip operation gesture provided in an embodiment of the present application;

6 is a schematic diagram of another embodiment of the method for displaying a virtual interface provided by an embodiment of the present application;

7 is a schematic diagram of a display virtual interface provided in an embodiment of the present application;

8 is a schematic diagram of a hardware structure of a communication device provided by an embodiment of the present application;

FIG. 9 is a schematic structural diagram of a display device provided by an embodiment of the present application;

FIG. 10 is a schematic structural diagram of another display device provided by an embodiment of the present application.

Detailed ways

The embodiments of the present application provide a method, a device and a storage medium for displaying a virtual interface, which are not only from the perspective of user comfort, but also only require the user to directly flip the operation gesture, so as to provide the user with the most comfortable operation gesture to display the virtual interface , efficient and convenient, low learning cost, providing users with a comfortable experience.

The terms "first", "second", "third", "fourth", etc. (if any) in the description and claims of this application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It is to be understood that data so used may be interchanged under appropriate circumstances so that the embodiments of the application described herein can be practiced in sequences other than those illustrated or described herein. Furthermore, the terms "comprising" and "having", and any variations thereof, are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those expressly listed Rather, those steps or units may include other steps or units not expressly listed or inherent to these processes, methods, products or devices.

The technical solutions in the present application will be described below with reference to the accompanying drawings.

In the current industry, more and more users operate the virtual interface and the content in the virtual interface in a three-dimensional space by using AR devices, VR devices, etc., and with the help of naked-eye interaction gestures.

For displaying a virtual interface in the prior art, please refer to FIG. 1 , which is a schematic diagram of displaying a virtual interface provided in an existing solution. As shown in Figure 1, the user puts the fingers of the right hand together with the palm facing upward, and then opens the palm of the right hand. At this time, the virtual interface appears on the upper part of the palm of the right hand. Alternatively, please refer to FIG. 2 , which is another schematic diagram of displaying a virtual interface provided in the existing solution. As shown in Figure 2, the user's left hand is in an open state. At this time, a virtual button appears on the wrist of the left hand, and then the user clicks the virtual button on the wrist of the left hand with the right hand, and a virtual interface can appear above the palm of the left hand. . However, regardless of the way shown in Figure 1 or Figure 2 to display the virtual interface, the user needs to learn and memorize various operation gestures, the learning cost is high and the operation is difficult, resulting in low wake-up efficiency, and it is difficult to provide users with high-quality experience.

Therefore, in order to solve the above technical problems, an embodiment of the present application provides a method for displaying a virtual interface, and the method for displaying a virtual interface can be applied to head-mounted display devices such as AR equipment, VR equipment, and/or MR equipment. . In practical applications, it may also be other head-mounted displays, which will not be specifically described in the embodiments of the present application. In the embodiments of the present application, only an AR device, a VR device, and/or an MR device are used as examples for description.

FIG. 3 shows a schematic diagram of a possible application scenario of the embodiment of the present application. As shown in FIG. 3 , the application scenario may include a target user and a display device, and the display device may include, but is not limited to, an AR device, a VR device, and/or an MR device. The target user can wear the AR device, VR device and/or MR device at the head position, and display the virtual interface by means of operation gestures.

It will be appreciated that the above-mentioned AR devices, VR devices and/or MR devices are usually capable of supporting a variety of applications, such as: word processing applications, telephony applications, email applications, instant messaging applications, photo management applications An application program, a web browsing application program, a digital music player application program, and/or a digital video player application program, etc., are not specifically described in the embodiments of the present application. Further, after the user displays the virtual interface based on the operation gesture, the user can also perform operations on the above-mentioned application program based on the operation gesture in the virtual interface, such as: opening, displaying the content in the application program, sliding or deleting, etc. , which will not be specifically limited in the embodiments of the present application.

The method of displaying the virtual interface in the present application will be described below from the perspective of the method. Please refer to FIG. 4 , which is a schematic diagram of an embodiment of a method for displaying a virtual interface provided by an embodiment of the present application. The method may include:

401. Acquire a first operation gesture of the user.

After wearing an AR device, a VR device, and/or an MR device, the user can sense the user's hand state through a sensor, etc., to obtain the user's first operation gesture.

402. Flip the first operation gesture to obtain the second operation gesture.

After the first operation gesture of the user is acquired, the corresponding second operation gesture can be obtained by inverting the first operation gesture.

For example, when the user extends the back of the right hand, and the back of the hand is up and the palm is down. At this time, the sensor can sense that the user's hand state is "the back of the right hand is facing up and the palm is facing down", then the obtained first operation gesture of the user is "the back of the right hand is facing up and the palm is facing down" ". In this way, by flipping "the back of the right hand is facing up and the palm is facing down", the result obtained by flipping is "the back of the right hand is facing down and the palm is facing up", then the result obtained by flipping is used as the second operation gesture, That is, the second operation gesture is "the back of the right hand is facing down and the palm is facing up".

It should be understood that the first operation gesture described above is "the back of the right hand is facing up and the palm is facing down" is only a schematic description, and in practical applications, it can also be "the palm of the right hand is facing up and the palm is facing down". "The palm of the left hand is facing down", "the back of the left hand is facing up and the palm is facing down", or "the palm of the left hand is facing up and the palm is facing down", etc., are not specifically described in the embodiments of the present application.

Exemplarily, in some embodiments, flipping the first operation gesture to obtain the second operation gesture may include: flipping the first operation gesture according to a preset flip angle to obtain the second operation gesture.

It can be understood that, the preset flip angle described above may be a clockwise rotation of 180°, a clockwise rotation of 90° and a counterclockwise rotation of 180°, a counterclockwise rotation of 90°, and the like. Specifically in practical applications, the preset flip angle mentioned above may also be, for example, 100°, 120°, etc., which will not be limited in the embodiments of the present application.

403. When the second operation gesture matches the preset operation gesture set, display a virtual interface in a preset area of the second operation gesture.

In an embodiment, the user stores a preset operation gesture set in a storage module of an AR device, a VR device, and/or an MR device in advance, and the preset operation gesture set has a mapping relationship with the virtual interface. In this way, after the second operation gesture is obtained by flipping the first operation gesture, the second operation gesture can be matched with the preset operation gesture set. If the second operation gesture is successfully matched with the preset operation gesture set, the virtual interface that has a mapping relationship with the preset operation gesture set can be displayed in the preset area of the second operation gesture. In this way, the user can further view the virtual interface in the preset area of the second operation gesture.

Specifically, in some embodiments, matching the second operation gesture with a preset operation gesture set includes: parsing the second operation gesture to obtain gesture feature information; combining the gesture feature information with each preset operation in the preset operation gesture set The gesture features corresponding to the gesture are matched.

It should be understood that the preset area for the second operation gesture mentioned above may include, but is not limited to, azimuth areas such as directly above, directly in front, right or left of the second operation gesture. Do limit. It is further explained that the display style of the virtual interface can also be defined based on the user's viewing comfort, such as displaying the virtual interface in a rectangle, a table, etc., which is not specifically described.

For example, take the preset flip angle as a counterclockwise rotation of 180° as an example. Please refer to FIG. 5 , which is a schematic diagram of a flip operation gesture provided in an embodiment of the present application. As shown in FIG. 5 , after the first operation gesture of the user is obtained as “the back of the left hand is up and the palm is down”, the first operation gesture can be rotated 180° counterclockwise. In this way, the second operation gesture as shown in FIG. 5 can be obtained, that is, the second operation gesture is “the palm of the left hand is facing up and the back of the hand is facing down”. Moreover, it can also be seen from FIG. 5 that the virtual interface is directly displayed in the area just above the second operation gesture.

It can be understood that when the first operation gesture is "the back of the left hand is up and the palm is down", the first operation gesture is rotated 180° counterclockwise to obtain the corresponding second operation gesture. In other words, as long as the user stretches out the back of the left hand and the back of the hand is facing up, and then turns the back of the hand 180° counterclockwise, so that the back of the hand is facing down and the palm is facing up, at this time, the user can directly use the preset area of the palm facing upward. A virtual interface is displayed.

In the embodiment of the present application, not only from the perspective of user comfort, the user can be provided with the most comfortable operation gesture to display the virtual interface, and the user only needs to directly flip the operation gesture, which is efficient and convenient, and the learning cost is low. Provide users with a comfortable experience.

In order to prevent the user from misoperation in the process of displaying the virtual interface based on the operation gesture, on the basis of the embodiment described in FIG. 4 above, please refer to FIG. A schematic diagram of an embodiment, the method may include:

601. Acquire a first operation gesture of the user.

After wearing an AR device, a VR device, and/or an MR device, the user can sense the user's hand state through a sensor, etc., to obtain the user's first operation gesture.

602. Flip the first operation gesture to obtain the second operation gesture.

After the first operation gesture of the user is acquired, the corresponding second operation gesture can be obtained by inverting the first operation gesture.

For example, when the user extends the back of the right hand, and the back of the hand is up and the palm is down. At this time, the sensor can sense that the user's hand state is "the back of the right hand is facing up and the palm is facing down", then the obtained first operation gesture of the user is "the back of the right hand is facing up and the palm is facing down" ". In this way, by flipping "the back of the right hand is facing up and the palm is facing down", the result obtained by flipping is "the back of the right hand is facing down and the palm is facing up", then the result obtained by flipping is used as the second operation gesture, That is, the second operation gesture is "the back of the right hand is facing down and the palm is facing up".

It should be understood that the first operation gesture described above is "the back of the right hand is facing up and the palm is facing down" is only a schematic description, and in practical applications, it can also be "the palm of the right hand is facing up and the palm is facing down". "The palm of the left hand is facing down", "the back of the left hand is facing up and the palm is facing down", or "the palm of the left hand is facing up and the palm is facing down", etc., are not specifically described in the embodiments of the present application.

Exemplarily, in some embodiments, flipping the first operation gesture to obtain the second operation gesture may include: flipping the first operation gesture according to a preset flip angle to obtain the second operation gesture.

It can be understood that, the preset flip angle described above may be a clockwise rotation of 180°, a clockwise rotation of 90° and a counterclockwise rotation of 180°, a counterclockwise rotation of 90°, and the like. Specifically in practical applications, the preset flip angle mentioned above may also be, for example, 100°, 120°, etc., which will not be limited in the embodiments of the present application.

603. When the second operation gesture matches the preset operation gesture set, display at least one virtual identifier on the second operation gesture, and each virtual identifier in the at least one virtual identifier is used to identify a corresponding virtual interface.

In the embodiment, the user will pre-store the preset operation gesture set in the storage module of the AR device, VR device, and/or MR device, etc., and the preset operation gesture set can be used as the judgment of whether the second operation gesture is correct. in accordance with. In order to prevent the problem of accidentally touching the virtual interface in the process based on direct flipping, when the second operation gesture is successfully matched with the preset operation gesture set, at least one virtual logo may be displayed in the second operation gesture, and each Virtual identifiers can be used to identify virtual interfaces.

Optionally, in other embodiments, the virtual logo may include, but is not limited to, a floating button, an icon, or a touch point in a preset style. Wherein, the shapes of the floating buttons, icons or touch points of the preset styles described above may be circles, rectangles, prisms, squares, etc., and the styled floating buttons, icons or touch points may also have colors, such as: red , black or blue, etc., which will not be specifically described in the embodiments of the present application.

604. Receive a click instruction, where the click instruction is an instruction when any one of the at least one virtual identifier is clicked.

In the embodiment, when at least one virtual logo is displayed on the second operation gesture, the user can click on any virtual logo in the at least one virtual logo, and the click instruction generated at this time can be fed back to the AR device, VR device or in MR equipment. In this way, the AR device, the VR device or the MR device can display the virtual interface in the preset area of the second operation gesture based on the click instruction.

605. Display a virtual interface in a preset area of the second operation gesture based on the click instruction.

In the embodiment, since the virtual logo can be used to identify the corresponding virtual interface, when a click instruction from the user on the virtual logo is received, the virtual interface can be displayed in the preset area of the second operation gesture directly based on the click instruction. . It should be understood that the described preset area for the second operation gesture may include, but is not limited to, orientation areas such as directly above, right in front, right or left of the second operation gesture, which are not specifically limited in the embodiments of the present application. .

For example, on the basis of taking FIG. 5 as an example, FIG. 7 is a schematic diagram of displaying a virtual interface provided in an embodiment of the present application. As shown in FIG. 7 , after the first operation gesture of the user is obtained as “the back of the left hand is facing up and the palm is facing down”, then the first operation gesture can be rotated 180° counterclockwise, so that the The second operation gesture as shown in FIG. 7 is obtained, that is, the second operation gesture is "the palm of the left hand is facing up and the back of the hand is facing down". At this time, it can also be seen from FIG. 7 that three circular virtual signs are displayed in the second operation gesture, that is, three circular virtual signs are displayed on the palm of the left hand. Click on any circular virtual logo, and the corresponding virtual interface can be displayed directly above the palm of the left hand. It should be understood that the number of virtual identifiers shown in FIG. 7 is three, which is only a schematic description, and is not specifically limited in practice.

In other words, as long as the user stretches out the back of the left hand and the back of the hand is up, and then turns the back of the hand 180° counterclockwise, so that the back of the hand is down and the palm is up, and at this time, at least one virtual logo appears on the palm of the left hand, and the user uses the right hand Click on any virtual logo, and at this time, the virtual interface can be directly displayed in the preset area of the upward-facing left palm.

In the embodiment of the present application, not only from the perspective of user comfort, but also only requires the user to directly flip the first operation gesture, which is efficient and convenient, and has a low learning cost, and a virtual logo is displayed in the flipped second operation gesture, By clicking on the virtual logo to display the virtual interface, the problem of false touches caused by the pursuit of efficiency and convenience is avoided, and the user is provided with a comfortable experience.

The solutions provided by the embodiments of the present application have been introduced above mainly from the perspective of methods. It can be understood that, in order to realize the above-mentioned functions, the above-mentioned display device includes corresponding hardware structures and/or software modules for executing each function. Those skilled in the art should easily realize that, in conjunction with the functions described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is performed by hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.

Described from the perspective of an entity device, the above-mentioned display device may be an AR device, a VR device, or an MR device. Specifically, it may be implemented by one entity device, or jointly implemented by multiple entity devices, or may be a logical function in one entity device. unit, which is not specifically limited in this embodiment of the present application.

For example, the above-mentioned display apparatus may be implemented by the communication device in FIG. 8 . FIG. 8 is a schematic diagram of a hardware structure of a communication device according to an embodiment of the present application. The communication device includes at least one processor 801 , memory 802 , display 803 and input device 804 .

The processor 801 may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (application-specific integrated circuit, server IC), or one or more integrated circuits for controlling the execution of the programs of the present application. The processor 801 can perform operations such as judgment, analysis, calculation, etc., including inverting the first operation gesture obtained based on the input device 804, and matching the second operation gesture obtained by the inversion with a preset operation gesture set, etc. It is used to send a corresponding instruction to the display 803 to display the virtual interface in a preset style.

The display 803 can output the results to the user through a screen, which can be a touch screen or the like on a physical entity. The display 803 may exist independently or be connected to the processor 801 .

The input device 804, using any transceiver-like device, is used to communicate with other devices or communication networks, such as Ethernet, radio access networks (RAN), wireless local area networks (WLAN), and the like. The input device 804 can be connected to the processor 801. The input device 804 can acquire the first operation gesture input by the user through sensors such as the head gesture.

Memory 802 may be read-only memory (ROM) or other type of static storage device that can store static information and instructions, random access memory (RAM), or other type of static storage device that can store information and instructions It can also be an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM), or other optical disk storage, optical disk storage (including compact disc, laser disc, compact disc, digital versatile disc, blu-ray disc, etc.), magnetic disk storage medium or other magnetic storage device, or capable of carrying or storing desired program code in the form of instructions or data structures and capable of being accessed by a computer any other medium, but not limited to. The memory 802 may exist independently or be connected to the processor 801 . The memory 802 may also be integrated with the processor 801 .

The memory 802 is used for storing computer-executed instructions for executing the solution of the present application, and the execution is controlled by the processor 801 . The processor 801 is configured to execute the computer-executed instructions stored in the memory 802, thereby implementing the method for displaying a virtual interface provided by the above method embodiments of the present application.

As a possible implementation manner, the computer-executed instructions in the embodiments of the present application may also be referred to as application code, which is not specifically limited in the embodiments of the present application.

In a specific implementation, as an embodiment, the processor 801 may include one or more CPUs, such as CPU0 and CPU1 in FIG. 8 .

From the perspective of functional units, the present application may divide the display device into functional units according to the above method embodiments. For example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one functional unit. middle. The above-mentioned integrated functional units may be implemented in the form of hardware, and may also be implemented in the form of software functional units.

For example, in the case of dividing each functional unit in an integrated manner, FIG. 9 shows a schematic structural diagram of a display device provided by an embodiment of the present application. As shown in FIG. 9 , an embodiment of the display device 90 of the present application may include:

an obtaining unit 901, configured to obtain the first operation gesture of the user;

a flipping unit 902, configured to flip the first operation gesture acquired by the acquiring unit 901 to obtain a second operation gesture;

The display unit 903 is configured to display a virtual interface in a preset area of the second operation gesture when the second operation gesture obtained by the flipping unit 902 matches a preset operation gesture set.

Optionally, based on the embodiment described in FIG. 9 above, FIG. 10 shows a schematic structural diagram of another display device provided by an embodiment of the present application. As shown in FIG. 10 , the display device 90 of the present application may further include:

The display unit 903 is further configured to display at least one virtual identifier on the second operation gesture when the second operation gesture matches a preset operation gesture set, each virtual identifier in the at least one virtual identifier. The identifier is used to identify the corresponding virtual interface;

A receiving unit 904, configured to receive a click instruction, where the click instruction is an instruction when clicking on any one of the at least one virtual identifier;

Correspondingly, the display unit 903 is configured to display the virtual interface in the preset area of the second operation gesture based on the click instruction.

In some embodiments of the present application, the flip unit 902 is configured to flip the first operation gesture according to a preset flip angle to obtain the second operation gesture.

In some embodiments of the present application, the preset flip angle includes a counterclockwise rotation of 180°.

In some embodiments of the present application, the display device 90 further includes:

a parsing unit for parsing the second operation gesture to obtain gesture feature information;

A matching unit, configured to match the gesture feature information with the gesture feature corresponding to each preset operation gesture in the preset operation gesture set.

In some embodiments of the present application, the virtual logo includes a floating button with a preset style.

The display device provided in the embodiment of the present application is used to execute the method in the method embodiment corresponding to FIG. 4 to FIG. 7 . Therefore, the embodiment of the present application may be understood with reference to the relevant part of the method embodiment corresponding to FIG. 4 to FIG. 7 .

In the embodiment of the present application, the display device is presented in the form of dividing each functional unit in an integrated manner. A "functional unit" herein may refer to an application-specific integrated circuit (ASIC), a processor and memory executing one or more software or firmware programs, an integrated logic circuit, and/or other devices that can provide the above-mentioned functions . In a simple embodiment, those skilled in the art can imagine that the display device may take the form shown in FIG. 8 .

For example, the processor 801 in FIG. 8 may invoke the computer execution instructions stored in the memory 802 to cause the display device to execute the method performed by the display device in the method embodiments corresponding to FIGS. 4-7 .

Specifically, the functions/implementation process of the flipping unit 902, the display unit 903, the parsing unit and the matching unit in FIG. 9 can be realized by the processor 801 in FIG. 8 mobilizing the computer execution instructions stored in the memory 802.

The functions/implementation process of the acquiring unit 901 in FIG. 9 and the receiving unit 904 in FIG. 10 can be implemented by the input device 804 in FIG. 8 .

In the device shown in FIG. 8 of the present application, each component is communicatively connected, that is, the processing unit (or processor), the storage unit (or memory) and the transceiver unit (transceiver) communicate with each other through an internal connection path to transfer control and/or data Signal. The foregoing method embodiments of the present application may be applied to a processor, or the processor may implement the steps of the foregoing method embodiments. A processor may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method embodiments may be completed by a hardware integrated logic circuit in a processor or an instruction in the form of software. The above processor may be a central processing unit (CPU), a network processor (NP) or a combination of CPU and NP, a digital signal processor (DSP), an application specific integrated circuit (application specific integrated circuit) integrated circuit, ASIC), off-the-shelf programmable gate array (field programmable gate array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. Various methods, steps and logic block diagrams disclosed in this application can be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps in combination with the method disclosed in this application can be directly embodied as executed by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software modules may be located in random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers and other storage media mature in the art. The storage medium is located in the memory, and the processor reads the information in the memory, and completes the steps of the above method in combination with its hardware. Although only one processor is shown, the apparatus may include multiple processors or processors include multiple processing units. Specifically, the processor may be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor.

Memory is used to store computer instructions for execution by the processor. The memory may be a storage circuit or a memory. The memory can be volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. Wherein, the non-volatile memory may be a read-only memory, a programmable read-only memory, an erasable programmable read-only memory, an electrically erasable programmable read-only memory, or a flash memory. Volatile memory may be random access memory, which acts as an external cache. The memory may be independent of the processor, or may be a storage unit in the processor, which is not limited herein. Although only one memory is shown in the figures, the apparatus may include multiple memories or the memories include multiple storage units.

The transceiver is used to realize the content interaction between the processor and other units or network elements. Specifically, the transceiver may be a communication interface of the device, a transceiver circuit or a communication unit, or a transceiver. The transceiver may also be a communication interface or a transceiver circuit of the processor. Optionally, the transceiver may be a transceiver chip. The transceiver may also include a transmitting unit and/or a receiving unit. In one possible implementation, the transceiver may include at least one communication interface. In another possible implementation, the transceiver may also be a unit implemented in the form of software. In various embodiments of the present application, the processor may interact with other units or network elements through the transceiver. For example, the processor obtains or receives content from other network elements through the transceiver. If the processor and the transceiver are two physically separate components, the processor can interact with other units of the device without going through the transceiver.

In one possible implementation, the processor, the memory, and the transceiver may be connected to each other through a bus. The bus may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus or the like. The bus can be divided into address bus, data bus, control bus and so on.

In the embodiments of the present application, words such as "exemplary" or "for example" are used to represent examples, illustrations or illustrations. Any embodiment or design described in the embodiments of the present application as "exemplary" or "such as" should not be construed as preferred or advantageous over other embodiments or designs. Rather, use of words such as "exemplary" or "such as" is intended to present the related concepts in a specific manner.

In each embodiment of the present application, various examples are provided for the convenience of understanding. However, these examples are merely examples and are not meant to be the best way to implement the present application.

The above embodiments may be implemented in whole or in part by software, hardware, firmware or any combination thereof, and when implemented in software, may be implemented in whole or in part in the form of computer program products.

A computer program product includes one or more computer instructions. When the computer-executed instructions are loaded and executed on the computer, the flow or function according to the embodiments of the present application is generated in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable device. Computer instructions may be stored on or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server, or data center over a wire (e.g. coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (eg, infrared, wireless, microwave, etc.) to another website site, computer, server, or data center. The computer-readable storage medium can be any available medium that a computer can store, or a data storage device such as a server, a data center, etc., that includes one or more available media integrated. Useful media may be magnetic media (eg, floppy disk, hard disk, magnetic tape), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk (SSD)), among others.

The technical solutions provided by the present application have been introduced in detail above, and the principles and implementations of the present application have been described with specific examples in the present application. The descriptions of the above embodiments are only used to help understand the methods and core ideas of the present application. At the same time, for those skilled in the art, according to the idea of the application, there will be changes in the specific implementation and application scope. To sum up, the content of this description should not be construed as a limitation to the application.

Claims (14)

1. A method of displaying a virtual interface for one or more of an Augmented Reality (AR) device, a Virtual Reality (VR) device, and a Mixed Reality (MR) device, comprising:

acquiring a first operation gesture of a user;

overturning the first operation gesture to obtain a second operation gesture;

and when the second operation gesture is matched with a preset operation gesture set, displaying a virtual interface in a preset area of the second operation gesture.

2. The method of claim 1, further comprising:

when the second operation gesture is matched with a preset operation gesture set, displaying at least one virtual identifier on the second operation gesture, wherein each virtual identifier in the at least one virtual identifier is used for identifying a corresponding virtual interface;

receiving a click instruction, wherein the click instruction is an instruction when any one of the at least one virtual identifier is clicked;

correspondingly, displaying a virtual interface in a preset area of the second operation gesture, including:

and displaying a virtual interface in a preset area of the second operation gesture based on the click command.

3. Method according to claim 1 or 2, characterized in that flipping the first operating gesture for obtaining a second operating gesture comprises:

and turning the first operation gesture according to a preset turning angle to obtain a second operation gesture.

4. The method of claim 3, wherein the preset flip angle comprises a counter-clockwise rotation of 180 °.

5. The method according to any one of claims 1-4, wherein the second operating gesture matches a preset operating gesture set, including:

analyzing the second operation gesture to obtain gesture feature information;

and matching the gesture characteristic information with the gesture characteristics corresponding to each preset operation gesture in the preset operation gesture set.

6. The method of any of claims 2-5, wherein the virtual identifier comprises a preset pattern of hover buttons.

7. A display device, comprising:

the acquisition unit is used for acquiring a first operation gesture of a user;

the overturning unit is used for overturning the first operation gesture acquired by the acquiring unit to acquire a second operation gesture;

and the display unit is used for displaying a virtual interface in a preset area of the second operation gesture when the second operation gesture obtained by the overturning unit is matched with a preset operation gesture set.

8. The display device according to claim 7, further comprising:

the display unit is further configured to display at least one virtual identifier on the second operation gesture when the second operation gesture matches a preset operation gesture set, where each virtual identifier in the at least one virtual identifier is used to identify a corresponding virtual interface;

the receiving unit is used for receiving a click instruction, wherein the click instruction is an instruction when any one of the at least one virtual identifier is clicked;

correspondingly, the display unit is used for displaying a virtual interface in a preset area of the second operation gesture based on the click command.

9. The display device according to claim 7 or 8, wherein the flipping unit is configured to flip the first operation gesture by a preset flipping angle to obtain a second operation gesture.

10. The display device of claim 9, wherein the preset flip angle comprises a counter-clockwise rotation of 180 °.

11. The display device according to any one of claims 7 to 10, further comprising:

the analysis unit is used for analyzing the second operation gesture to obtain gesture characteristic information;

and the matching unit is used for matching the gesture characteristic information with the gesture characteristics corresponding to each preset operation gesture in the preset operation gesture set.

12. The display device according to any one of claims 8 to 11, wherein the virtual identifier comprises a preset pattern of hover buttons.

13. A display device, comprising:

a processor, a memory; the processor and the memory are communicated with each other;

the memory is to store instructions;

the processor is configured to execute the instructions in the memory to perform the method of any of claims 1-6.

14. A computer-readable storage medium comprising instructions that, when executed on a computer, cause the computer to perform the method of any one of claims 1-6.

Images