CN106896918A - A kind of virtual reality device and its video broadcasting method - Google Patents

Abstract

The invention discloses a kind of virtual reality device and its video broadcasting method, the video acquiring module of virtual reality device is used to obtain video information；Head-tracking device is used to obtain displacement information of the head in the X-direction of three-dimensional system of coordinate, Y-direction and Z-direction；Video playback selecting module is used for the displacement information obtained according to head-tracking device, the mobile selection of selection position video information and video play mode；Video playback module, for the video play mode selected according to video playback selecting module, plays the video information of video playback selecting module selection.Virtual reality device of the invention can obtain unmanned plane during flying device take photo by plane in real time or third party's video source video, and play the video of acquisition；Different play mode may be selected simultaneously to play video；Realize both can control unmanned plane during flying device with virtual reality device, and video playback can be carried out again；Interest is enhanced, Consumer's Experience sense is lifted.

Description

A kind of virtual reality device and its video playing method

technical field

The invention relates to the technical field of virtual reality, in particular to a virtual reality device and a video playing method thereof.

Background technique

Due to the advantages of good maneuverability, low cost, and convenient use, UAVs have been used in many industries, such as aerial photography, agricultural plant protection, surveying and mapping, and many other fields.

The combination of UAV and virtual reality (VR, Virtual Reality) technology has lowered the entry threshold for UAV operation. At present, some UAV manufacturers have begun to try to use VR glasses to control or watch the pictures in the PTZ camera.

In the process of realizing the present invention, the inventor found the following problems in the prior art: the prior art does not have VR glasses that can control the drone and play video.

Contents of the invention

The main purpose of the present invention is to propose a virtual reality device and a video playing method thereof, aiming at solving the technical problems existing in the prior art.

In order to achieve the above object, the first aspect of the embodiment of the present invention provides a virtual reality device, the virtual reality device is used to generate posture information when moving, acquire angle change data according to the posture information, and send the angle change data to For the UAV; wherein the angle change data includes pitch angle change data, yaw angle change data and roll angle change data;

The drone controls the rotation angle of the drone platform according to the angle change data;

The virtual reality device also includes a video acquisition module, a head tracking device, a video playback selection module and a video playback module;

The video acquisition module is used to acquire video information;

The head tracking device is used to obtain displacement information of the head in the X direction, Y direction and Z direction of the three-dimensional coordinate system;

The video playback selection module is used to select video information and video playback mode by moving the selected position according to the displacement information obtained by the head tracking device;

The video playing module is configured to play the video information selected by the video playing selection module according to the video playing mode selected by the video playing selection module.

Further, the video information includes a video from a third-party video source and/or a real-time aerial video taken by an unmanned aerial vehicle.

Further, the video acquisition module acquires video from a third-party video source in a wireless or wired manner.

Further, the video playback mode includes theater mode or immersive mode.

Further, the head tracking device includes a gyroscope, an accelerometer and a magnetometer.

Further, the virtual reality device also includes a judging module;

The judging module is used to judge whether the dwell time of the selection operation of the video playback selection module exceeds a preset time; if it exceeds the preset time, an enabling signal is generated to the video playback selection module;

The video playback selection module is further configured to select the video information or the video playback mode at the staying position according to the enabling signal generated by the judging module.

Further, the virtual reality device also includes a video sharing module;

The video sharing module is used to share the video information.

In addition, in order to achieve the above object, the second aspect of the embodiment of the present invention provides a video playback method of a virtual reality device, the virtual reality device is used to generate posture information when moving, obtain angle change data according to the posture information, and The angle change data is sent to the UAV; wherein the angle change data includes pitch angle change data, yaw angle change data and roll angle change data; the UAV controls the UAV according to the angle change data The rotation angle of cloud platform; Described video playing method comprises:

Obtain video information;

Obtain the displacement information of the head in the X direction, Y direction and Z direction of the three-dimensional coordinate system;

According to the displacement information, move the selection position to select video information and video playback mode;

Play the selected video information according to the selected video playback mode.

Further, the video information includes videos from third-party video sources and real-time aerial videos taken by drones.

Further, the video of the third-party video source is obtained in a wireless or wired manner.

Further, the video playback mode includes theater mode or immersive mode.

Further, the selection of video information and video playback mode includes:

Judging whether the dwell time of the selection operation exceeds the preset time;

If the dwell time of the selection operation exceeds the preset time, the video information or video playback mode at the dwell position is selected.

Further, the method also includes the steps of:

The video information is shared.

The virtual reality device and its video playback method provided by the embodiment of the present invention, the virtual reality device can obtain the video of the real-time aerial photography of the UAV aircraft or the video of the third-party video source, and play the obtained video; at the same time, different playback modes can be selected to play the video ; Realized that the UAV aircraft can be controlled by virtual reality equipment, and video playback can be performed; the fun is enhanced and the user experience is improved.

Description of drawings

FIG. 1 is a schematic structural diagram of a virtual reality device provided by an embodiment of the present invention;

FIG. 2 is another structural schematic diagram of a virtual reality device provided by an embodiment of the present invention;

FIG. 3 is a schematic flowchart of a video playback method for a virtual reality device provided by an embodiment of the present invention;

FIG. 4 is another schematic flowchart of a video playing method for a virtual reality device provided by an embodiment of the present invention.

The realization of the purpose of the present invention, functional characteristics and advantages will be further described in conjunction with the embodiments and with reference to the accompanying drawings.

detailed description

It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

Implementations of various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, use of suffixes such as 'module', 'part' or 'unit' for denoting elements is only for facilitating description of the present invention and has no specific meaning by itself.

The descriptions involving "first", "second" and so on in the present invention are only for descriptive purposes, and should not be understood as indicating or implying their relative importance or implicitly indicating the number of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include at least one of these features. In addition, the technical solutions of the various embodiments can be combined with each other, but it must be based on the realization of those skilled in the art. When the combination of technical solutions is contradictory or cannot be realized, it should be considered that the combination of technical solutions does not exist , nor within the scope of protection required by the present invention.

It should be noted that all directional indications (such as up, down, left, right, front, back...) in the embodiments of the present invention are only used to explain the relationship between the components in a certain posture (as shown in the accompanying drawings). Relative positional relationship, movement conditions, etc., if the specific posture changes, the directional indication will also change accordingly.

As shown in Figure 1, a virtual reality device provided by the first embodiment of the present invention, the virtual reality device 10 is used to generate posture information when moving, obtain angle change data according to the posture information, and send the angle change data to no one machine; the angle change data includes pitch angle change data, yaw angle change data and roll angle change data; the UAV controls the rotation angle of the UAV gimbal according to the angle change data.

In this embodiment, the virtual reality device 10 includes, but is not limited to, virtual reality glasses, a virtual reality helmet, and the like.

The virtual reality device 10 includes a video acquisition module 101 , a head tracking device 102 , a video playback selection module 103 and a video playback module 104 .

The video acquisition module 101 is configured to acquire video information.

In this embodiment, the video information includes video from a third-party video source and/or real-time aerial video taken by the UAV.

In one embodiment, after the UAV and the virtual reality device 10 establish a wireless or wired connection, the real-time aerial video captured by the camera of the UAV can be transmitted to the virtual reality device 10 . Videos from third-party video sources can be obtained through SD card, Bluetooth, Wi-Fi, etc.

The head tracking device 102 is configured to acquire displacement information of the head in the X direction, the Y direction and the Z direction of the three-dimensional coordinate system.

Specifically, the head tracking device 102 includes a gyroscope, an accelerometer and a magnetometer. Through the gyroscope, accelerometer and magnetometer, the displacement information of the head in the X, Y and Z directions of the three-dimensional coordinate system can be obtained, and the movements of the head such as front, rear, left and right can be accurately measured.

The video playback selection module 103 is configured to move the selection position to select video information and a video playback mode according to the displacement information acquired by the head tracking device 102 .

In this embodiment, the video playback mode includes theater mode or immersive mode.

The video playing module 104 is configured to play the video information selected by the video playing selection module 103 according to the video playing mode selected by the video playing selection module 103 .

As an example, take virtual reality glasses as an example. After the virtual reality glasses obtain the video from the third-party video source and/or the real-time aerial video of the UAV aircraft, the corresponding video information can be displayed on the display interface of the virtual reality glasses. The display interface of the virtual reality glasses may include multiple options for displaying different information, such as video information or video playback mode. The display interface has a cursor, and the head tracking device obtains the displacement information of the head in the X direction, the Y direction and the Z direction of the three-dimensional coordinate system, and controls the movement of the cursor according to the displacement information. When the cursor moves to an option on the virtual reality glasses interface, the option can be confirmed and selected; if the option is not selected, the head can be moved to make the cursor leave the option.

Further, as shown in FIG. 2, the virtual reality device 10 may also include a judging module 105, which is used to judge whether the dwell time of the selection operation of the video playback selection module 103 exceeds a preset time; if it exceeds the preset time, then Generate enable signal to video playback selection module 103;

The video play selection module 103 is further configured to select the video information or the video play mode at the staying position according to the enabling signal generated by the judging module 105 .

Taking the above-mentioned VR glasses as an example, the head tracking device obtains the displacement information of the head in the X direction, Y direction and Z direction of the three-dimensional coordinate system, and when controlling the cursor to move to an option on the virtual reality glasses interface according to the displacement information, This option is selected by default if the cursor stays for longer than three seconds.

Further, please refer to FIG. 2 , the virtual reality device 10 may further include a video sharing module 106; the video sharing module 106 is used for sharing video information.

For example, after the virtual reality device 10 establishes a connection with other devices, the video information of the virtual reality device 10 can be shared with other devices through the video sharing module 106 . Other devices may include another virtual reality device or a mobile terminal and so on.

Specifically, taking drones, VR glasses, and drones as examples, after the first user's VR glasses, mobile phone, and drone establish a connection, the VR glasses transmit the video to the first user's mobile phone, and the second One user can view the video taken by the drone; the second user's mobile phone establishes a connection with the first user's VR glasses, then the second user can access the video taken by the first user's drone, and in the second directly on the mobile phone of the first user to watch the playback video on the VR glasses of the first user.

Through the video sharing module 106, the user's interest can be further enhanced, and the user's sense of experience can be improved.

The virtual reality device provided by the embodiment of the present invention, the virtual reality device can obtain the video of the real-time aerial photography of the UAV aircraft or a third-party video source, and play the obtained video; at the same time, different playback modes can be selected to play the video; Use the virtual reality device to control the UAV aircraft, and it can also play video; it enhances the fun and improves the user experience.

The present invention further provides a video playing method.

Referring to Fig. 3, Fig. 3 is a video playback method of a virtual reality device provided by the second embodiment of the present invention, the virtual reality device is used to generate posture information when moving, obtain angle change data according to the posture information, and send the angle change data For the UAV; the angle change data includes pitch angle change data, yaw angle change data and roll angle change data; the UAV controls the rotation angle of the UAV gimbal according to the angle change data. The video playback method includes steps:

20. Obtain video information.

In this embodiment, the video information includes videos from third-party video sources and real-time aerial videos taken by UAVs.

In a possible implementation manner, after the UAV aircraft establishes a wireless or wired connection with the virtual reality device, the real-time aerial video captured by the camera of the UAV aircraft can be transmitted to the virtual reality device. Videos from third-party video sources can be obtained through SD card, Bluetooth, Wi-Fi, etc.

21. Obtain the displacement information of the head in the X direction, the Y direction and the Z direction of the three-dimensional coordinate system.

Specifically, the displacement information of the head in the X direction, Y direction and Z direction of the three-dimensional coordinate system can be obtained through the head tracking device, and the movements such as the head's forward, backward, left, and right movements can be accurately measured. Head tracking devices include gyroscopes, accelerometers and magnetometers.

22. According to the displacement information, move the selected position to select video information and video playback mode.

In this embodiment, the video playback mode includes theater mode or immersive mode.

23. Play the selected video information according to the selected video playback mode.

As an example, take virtual reality glasses as an example. After the virtual reality glasses obtain the video from the third-party video source and/or the real-time aerial video of the UAV aircraft, the corresponding video information can be displayed on the display interface of the virtual reality glasses. The display interface of the virtual reality glasses may include multiple options for displaying different information, such as video information or video playback mode. The display interface has a cursor, and the head tracking device obtains the displacement information of the head in the X direction, the Y direction and the Z direction of the three-dimensional coordinate system, and controls the movement of the cursor according to the displacement information. When the cursor moves to an option on the virtual reality glasses interface, the option can be confirmed and selected; if the option is not selected, the head can be moved to make the cursor leave the option.

In this embodiment, selecting video information and video playback mode may include steps:

Judging whether the dwell time of the selection operation exceeds the preset time;

If the dwell time of the selection operation exceeds the preset time, the video information or video playback mode at the dwell position is selected.

Taking the above-mentioned VR glasses as an example, the head tracking device obtains the displacement information of the head in the X direction, Y direction and Z direction of the three-dimensional coordinate system, and when controlling the cursor to move to an option on the virtual reality glasses interface according to the displacement information, This option is selected by default if the cursor stays for longer than three seconds.

Further, as shown in Figure 4, the method may also include the steps of:

24. Share video information.

For example, after the virtual reality device establishes a connection with other devices, the video information of the virtual reality device may be shared with other devices. Other devices may include another virtual reality device or a mobile terminal and so on.

Video sharing can further enhance user interest and improve user experience.

In the video playback method of the virtual reality device provided by the embodiment of the present invention, the virtual reality device can obtain the video of the real-time aerial photography of the UAV aircraft or the video of the third-party video source, and play the obtained video; at the same time, different playback modes can be selected to play the video; Realized that the UAV aircraft can be controlled by virtual reality equipment, and video playback can be performed; the fun is enhanced and the user experience is improved.

It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element.

The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process conversion made by using the description of the present invention and the contents of the accompanying drawings, or directly or indirectly used in other related technical fields , are all included in the scope of patent protection of the present invention in the same way.

Claims (13)

1. A virtual reality device, characterized in that, the virtual reality device is used to generate attitude information when moving, obtains angle change data according to the attitude information, and sends the angle change data to the unmanned aerial vehicle; wherein the The angle change data includes pitch angle change data, yaw angle change data and roll angle change data; The drone controls the rotation angle of the drone platform according to the angle change data; The virtual reality device also includes a video acquisition module, a head tracking device, a video playback selection module and a video playback module; The video acquisition module is used to acquire video information; The head tracking device is used to obtain displacement information of the head in the X direction, Y direction and Z direction of the three-dimensional coordinate system; The video playback selection module is used to select video information and video playback mode by moving the selected position according to the displacement information obtained by the head tracking device; The video playing module is configured to play the video information selected by the video playing selection module according to the video playing mode selected by the video playing selection module. 2. A virtual reality device according to claim 1, wherein the video information includes a video of a third-party video source and/or a real-time aerial video of an unmanned aerial vehicle. 3. The virtual reality device according to claim 2, wherein the video acquisition module acquires the video of a third-party video source in a wireless or wired manner. 4 . The virtual reality device according to claim 1 , wherein the video playback mode includes a theater mode or an immersive mode. 5. A virtual reality device according to claim 1, wherein the head tracking device comprises a gyroscope, an accelerometer and a magnetometer. 6. A virtual reality device according to any one of claims 1-5, wherein the virtual reality device further comprises a judging module; The judging module is used to judge whether the dwell time of the selection operation of the video playback selection module exceeds a preset time; if it exceeds the preset time, an enabling signal is generated to the video playback selection module; The video playback selection module is further configured to select the video information or the video playback mode at the staying position according to the enabling signal generated by the judging module. 7. A kind of virtual reality device according to any one of claims 1-5, characterized in that, the virtual reality device further comprises a video sharing module; The video sharing module is used to share the video information. 8. A video playback method for a virtual reality device, the virtual reality device is used to generate attitude information when moving, obtain angle change data according to the attitude information, and send the angle change data to the drone; wherein The angle change data includes pitch angle change data, yaw angle change data and roll angle change data; the UAV controls the rotation angle of the UAV cloud platform according to the angle change data; it is characterized in that the video Playback methods include: Obtain video information; Obtain the displacement information of the head in the X direction, Y direction and Z direction of the three-dimensional coordinate system; According to the displacement information, move the selection position to select video information and video playback mode; Play the selected video information according to the selected video playback mode. 9. The video playback method of a virtual reality device according to claim 8, wherein the video information includes a video of a third-party video source and a real-time aerial shot of a drone. 10. The video playing method of a virtual reality device according to claim 9, wherein the video of a third-party video source is obtained in a wireless or wired manner. 11. A video playing method for a virtual reality device according to claim 8, wherein the video playing mode comprises a theater mode or an immersive mode. 12. The video playback method of a virtual reality device according to claim 8, wherein the selection of video information and video playback mode comprises: Judging whether the dwell time of the selection operation exceeds the preset time; If the dwell time of the selection operation exceeds the preset time, the video information or video playback mode at the dwell position is selected. 13. The video playback method of a virtual reality device according to any one of claims 8-12, wherein the method further comprises the steps of: The video information is shared.