CN108650494B - Live broadcast system capable of instantly obtaining high-definition photos based on voice control - Google Patents

Abstract

The invention provides a live broadcast system based on voice control that can instantly obtain high-definition photos, including a host computer end, a lower computer end, a server end and a user end; A movable carrying device of a transmission module; the image acquisition device includes one or more camera modules; the lower computer end includes a remote control device, a second transmission module and a voice module. In the above-mentioned system of the present invention, the two cameras of each camera module respectively output picture data and video data with a time-corresponding relationship with approximately the same viewing angle, and dual data stream output to meet the needs of users to take high-definition photos in real time when watching videos; When watching the live broadcast, the user sends voice or non-voice control information, and the server obtains the corresponding voice and forwards it to the ground staff, instructing them to perform corresponding remote control operations to control the movable bearer device and/or the PTZ, which can change the viewing angle of the user. Improve user entertainment interactivity.

Description

A live broadcast system that can instantly obtain high-definition photos based on voice control

technical field

The invention relates to information processing technology, in particular to a live broadcast system based on voice control that can instantly acquire high-definition photos.

Background technique

Aerial photography, also known as aerial photography or aerial photography, refers to the photographic activities of the earth's landforms, urban landscapes, and people from the air. At present, drone aerial photography has been widely used in military, transportation construction, water conservancy projects, ecological research, TV programs and art photography.

However, whether it is the existing drone aerial photography technology or other technologies such as vehicle-mounted photography, these existing technologies can only output video or output pictures in a single mode, and correspond to a single user, which cannot meet the needs of multiple users and multiple aspects. requirements, causing inconvenience to users.

SUMMARY OF THE INVENTION

The following presents a brief summary of the present invention in order to provide a basic understanding of certain aspects of the invention. It should be understood that this summary is not an exhaustive overview of the invention. It is not intended to identify key or essential parts of the invention nor to limit the scope of the invention. Its sole purpose is to present some concepts in a simplified form as a prelude to the more detailed description that is discussed later.

In view of this, the present invention provides a live broadcast system based on voice control that can instantly obtain high-definition photos, so as to at least solve the problem that existing technologies such as drone aerial photography or vehicle-mounted photography can only output video or output pictures in a single mode, corresponding to A single user cannot meet the needs of multiple users and multiple aspects.

According to one aspect of the present invention, there is provided a live broadcast system based on voice control that can instantly obtain high-definition photos, and the voice-controlled live broadcast system that can instantly obtain high-definition photos includes a host computer, a lower computer, a server, and a user end; the upper computer end includes a movable bearing device, and the movable bearing device is provided with a pan-tilt, an image acquisition device connected to the pan-tilt, and a first transmission module; wherein, the pan-tilt is used to adjust the The position and/or direction of the connected image capture device; the image capture device includes one or more camera modules, wherein each camera module includes two cameras, and the two cameras in the same camera module are The corresponding acquisition angles at the same time are approximately the same; the first transmission module includes one or more wireless image transmission modules for communicating with the lower computer terminal; wherein, the two cameras in each camera module are respectively used for Output picture data and video data, the picture data includes one or more groups of pictures, and the video data includes one or more groups of video frame sequences; the lower computer end includes a remote control device, a second transmission module and a voice module The second transmission module includes one or more wireless image transmission modules for communicating with the upper computer and a communication module for communicating with the server; the lower computer is used for receiving and forwarding from The acquisition instruction of the server side is sent to the host computer side, so that the image acquisition device of the host computer side starts or stops collecting the picture/video data in its field of view, and receives the picture/video data from the host computer side for real-time forwarding to the server; the remote control device is adapted to receive a manipulation instruction from a ground staff member, the manipulation instruction including a first instruction for controlling the movable carrying device and a second instruction for controlling the pan/tilt; The remote control device is adapted to send the first instruction in the manipulation instruction to the first control module in the movable carrying device to control the movable carrying device to perform corresponding operation actions, and the control instruction in the manipulation instruction. The second command is sent to the second control module of the PTZ to control the PTZ to perform corresponding operations; the voice module is adapted to receive voice control information from the server, and generate corresponding voice control information according to the voice control information. The voice is played to the ground staff to instruct the ground staff to input corresponding control instructions to the remote control device; the server side is used to perform real-time, Corresponding processing and storage, when receiving the request instruction from the user terminal, obtain the picture/video data matching the request instruction and send it to the user terminal that issued the request instruction, and receive the control information from the user terminal and generate the corresponding The voice control information is sent to the lower computer; wherein, the request instruction includes a request for video transmission instruction and/or a photographing instruction.

Further, the movable carrying device is any one of the following: unmanned aerial vehicle, mobile robotic arm, cable car, sightseeing car, train, plane or ship.

Further, when the movable carrying device is an unmanned aerial vehicle, the first instruction includes self-check, take-off, landing, return, hover, pitch, roll and yaw for controlling the unmanned aerial vehicle. Any one or more of the commands that control the action.

Further, the first instruction includes a flight direction control instruction and/or a flight height control instruction.

Further, the second instruction includes a control instruction for controlling the pan/tilt to move in the horizontal and/or pitch directions.

Further, if the control information sent by the user terminal is voice control information input by voice, the server terminal directly forwards the voice control information to the corresponding lower computer terminal in real time.

Further, if the control information sent by the user terminal is manually input non-voice control information, then the server terminal converts this non-voice control information into corresponding voice control information, so as to send this voice control information to the corresponding lower position in real time. machine side.

Further, the pan-tilt is a multi-degree-of-freedom pan-tilt, which is suitable for controlling the image acquisition device connected to it to perform multi-directional adjustment.

Further, the pan/tilt can control the image capture device connected to it to perform any one or more of the following movements: horizontal rotation, vertical pitch, and rotation around the optical axis of the image capture device.

Further, a telescopic device is provided on the pan/tilt, and the image acquisition device connected to the pan/tilt is arranged on the corresponding telescopic device, so that the image acquisition device can move with the expansion and contraction of the telescopic device.

Further, the PTZ includes a PTZ control module and a drive module, wherein the PTZ control module is used as the second control module; the PTZ control module is used to receive control instructions from the remote control device, Send an instruction to the drive module, and send a control signal and a drive pulse signal to the corresponding motor through the drive module, so as to control and change the movement posture of each rotating shaft of the pan/tilt head.

Further, the driving module further includes a limit switch, so as to control the rotation range of the corresponding pan/tilt through the limit switch.

Further, the camera of each camera module is a wide-angle camera.

Further, the picture data and video data collected by the two cameras included in each camera module have a time correspondence.

Further, the movable bearing device, the pan/tilt on the movable bearing device, and the image acquisition device all communicate with the lower computer terminal through an image transmission module.

Further, the movable bearing device, the pan/tilt on the movable bearing device, and the image acquisition device communicate with the lower computer through their corresponding image transmission modules respectively.

Further, the two cameras in each camera module transmit picture data and video data through an image transmission module respectively.

Further, the movable carrying device is provided with one or more PTZs, and a single PTZ is used to control two cameras in a corresponding single camera module to perform synchronous adjustment.

Further, the movable carrying device is provided with one or more PTZs, and a single PTZ is used to control the cameras of at least two camera modules in the one or more camera modules to perform synchronous adjustment.

Further, the movable carrying device is provided with a plurality of PTZs, and each camera module corresponds to two PTZs, wherein the two cameras in a single camera module are respectively adjusted asynchronously through the two PTZs. .

Further, the number of the upper computer end is one or more, and the number of the lower computer end is consistent with the quantity of the upper computer end; wherein, each upper computer end passes through the lower computer end corresponding to the upper computer end and the server-side communication.

Further, when the request instruction includes a video transmission instruction, the server is adapted to send the video data matching the requested video transmission instruction in the following manner: judging whether the request instruction is a streaming request or an on-demand video request: If it is a streaming request, send the streaming address to the corresponding client; if it is an on-demand video request, send the virtual path address of the stored video that matches the identifier carried in the request instruction to the corresponding client user terminal.

Further, when the request instruction includes a photographing instruction, the server is adapted to obtain picture data matching the photographing instruction in the following manner: according to the correspondence between multiple groups of pictures and video streams, and the information in the photographing instruction. For the sending time carried, select the image data corresponding to the sending time from the stored image data, and save it under the account of the user who issued the photographing instruction to respond to subsequent downloads by the user.

Further, when the image acquisition device includes multiple camera modules, the server is adapted to: determine, among the multiple camera modules, the camera to which the picture/video data matching the request instruction belongs The module, as the target camera module, selects the picture/video data collected by the target camera module as the picture/video data matching the request instruction of the user terminal.

Further, the server end is adapted to allow receiving control information sent from an authorized user, and refuse to receive control information sent from an unauthorized user.

Further, when one client controls the pan/tilt to change the viewing angle, other clients can share the viewing angle.

Further, after any user terminal sends control information to the server terminal, the server terminal will not receive the control instructions from the remote control device sent by other user terminals before the host computer terminal does not implement the control instructions corresponding to the control information from the remote control device. Other control information of the same type as the control information.

Further, when the server side receives the request instruction or control information of the user terminal, it determines whether the instruction or the information contains paid information, and establishes a data connection with the user terminal when the instruction contains the paid information. .

Further, the server end includes a processing module, a storage module and a third transmission module; wherein, the processing module is adapted to perform immediate and corresponding processing on the picture/video data received from the lower computer end, and the The storage module is adapted to store the picture/video data processed by the processing module, and the third transmission module is adapted to communicate with the lower computer and the client.

Further, the server side also includes a user management module, which is used to receive an identity authentication request from each user terminal, and based on the identity authentication request, perform identity authentication on the corresponding user equipment, and report to the corresponding user terminal after the authentication is successful. Send authentication success information to establish a data connection with the user equipment.

Further, each client includes: a sending module for sending an access request to the server to obtain video data, picture data and/or a request for controlling a PTZ; a receiving module for receiving a request sent by the server The video data, picture data and/or the relevant information data in response to the request of the control pan-tilt; a display module for displaying the video data, picture data and/or displaying the operation of the real-time control pan-tilt sent by the server; and the fourth The transmission module is used for data communication with the server.

Further, the voice module includes earphones and/or speakers.

Further, each camera module is respectively provided with a corresponding sensor group, wherein each sensor group includes a position sensor suitable for obtaining the position of the corresponding camera module in real time and an attitude sensor suitable for obtaining the posture of the corresponding camera module in real time. ; The server side receives the interest target instruction from the user, and selects one of the multiple preset interest target positions according to the interest point instruction as the current viewing target position, and according to the current viewing target position and the target camera model The connection line between the real-time positions of the group adjusts the pan/tilt corresponding to the target camera module, so that the main direction of the optical axis of each camera in the target camera module is consistent with the connection direction; The plurality of preset interest target positions include a plurality of known position points preset in a predetermined area.

Further, when the image capture device includes a camera module, the camera module is used as the target camera module; when the image capture device includes a plurality of camera modules, the target camera module is all The camera module closest to the current viewing target position among the plurality of camera modules.

Further, each camera module is respectively provided with a corresponding sensor group, wherein each sensor group includes a plurality of position sensors suitable for real-time acquisition of the position of each camera in the corresponding camera module and a plurality of position sensors suitable for real-time acquisition of the corresponding camera module. A plurality of posture sensors for the posture of each camera in the server; the server side receives the interest target instruction from the user, and selects one of the multiple preset interest target positions as the current viewing target position according to the interest point instruction, Adjust the pan/tilt corresponding to the target camera module according to the connection between the current viewing target position and the real-time positions of each camera of the target camera module, so that the main direction of the optical axis of each camera in the target camera module Consistent with the connection direction; wherein, the plurality of preset target interest positions include a plurality of known position points preset in a predetermined area.

Further, when the image capture device includes a camera module, the camera module is used as the target camera module; when the image capture device includes a plurality of camera modules, the target camera module is all The camera module to which the camera closest to the current viewing target position among the cameras of the plurality of camera modules belongs.

Further, the two cameras in a single camera module respectively perform synchronous attitude adjustment or asynchronous attitude adjustment according to the connection direction in real time through the two PTZs.

The host computer of the voice-controlled live broadcast system capable of instantly obtaining high-definition photos of the present invention is provided with an image acquisition device including one or more camera modules, and the two cameras in each camera module output perspectives that are close to the same. The picture data and video data with time correspondence, which is different from the single output mode (output video or output picture) in the existing aerial photography, this form cannot instantly download pictures while watching the live broadcast; also different from the prior art Taking screenshots in the video stream, this form of video has the same resolution as the picture. If you want to obtain a high-resolution picture, you need to shoot a high-resolution (such as 4K) video, which has stricter bandwidth requirements during the live broadcast; The present invention satisfies the user's requirement for real-time acquisition of high-resolution (eg, 4K) pictures when viewing a lower-resolution (eg, 1080P) live video by setting the dual data stream output mode of the two cameras corresponding in time. The above-mentioned voice-controlled live broadcast system that can instantly obtain high-definition photos sends data to the lower computer through the upper computer, the lower computer sends the data to the server, and then sends the data to at least one user through the server. Realize that multiple users can share the system to watch live video and take pictures at the same time.

In addition, using the above-mentioned voice-controlled live broadcast system that can instantly obtain high-definition photos of the present invention, users can not only watch live video and take pictures, but also send control information (voice or non-voice) to the server through the user terminal when watching the live broadcast. , and then obtain the corresponding voice control information through the server and send it (if the voice control information sent by the client itself is input through voice, it will be directly forwarded) to the voice module in the lower computer (through the second computer in the lower computer). transmission module), play the corresponding audio content to the ground staff through the voice module, and instruct the ground staff to perform corresponding operations on the remote control equipment, so as to realize the control of the corresponding movable bearing equipment and/or the PTZ, and realize the The real-time control of the actions and/or gestures of the movable carrying device and/or the PTZ can change the viewing angle of the user and improve the entertainment interactivity of the user.

In addition, the present invention can also enable the user to switch the interest target of interest in real time when watching the live video by allowing the user to set the interest target, thereby providing the user with a comfortable viewing effect.

These and other advantages of the present invention will become more apparent from the following detailed description of the preferred embodiments of the present invention in conjunction with the accompanying drawings.

Description of drawings

The present invention may be better understood by reference to the following description taken in conjunction with the accompanying drawings, wherein the same or like reference numerals are used throughout the drawings to refer to the same or like parts. The accompanying drawings, together with the following detailed description, are incorporated into and form a part of this specification, and are used to further illustrate the preferred embodiments of the invention and to explain the principles and advantages of the invention. In the attached image:

FIG. 1 is a structural diagram schematically showing an example of a live broadcast system that can instantly obtain high-definition photos based on voice control of the present invention;

Fig. 2 is a view schematically showing a possible structure of the server side in Fig. 1;

FIG. 3 is a view schematically showing one possible structure of a single client in FIG. 1 .

Skilled artisans will appreciate that elements in the figures are illustrated for simplicity and clarity only and have not necessarily been drawn to scale. For example, the dimensions of some of the elements in the figures may be exaggerated relative to other elements to help improve understanding of embodiments of the present invention.

Detailed ways

Exemplary embodiments of the present invention will hereinafter be described with reference to the accompanying drawings. In the interest of clarity and conciseness, not all features of an actual implementation are described in the specification. It should be appreciated, however, that many implementation-specific decisions must be made in the development of any such practical embodiment in order to achieve the developer's specific goals, such as compliance with those constraints associated with the system and business, and these Restrictions may vary from implementation to implementation. Furthermore, it should also be appreciated that while development work can be very complex and time consuming, such development work would be a routine undertaking for those skilled in the art having the benefit of this disclosure.

Here, it should also be noted that, in order to avoid obscuring the present invention due to unnecessary details, only device structures and/or processing steps closely related to the solution according to the present invention are shown in the drawings, and are omitted. other details not relevant to the present invention.

Embodiments of the present invention provide a live broadcast system based on voice control that can instantly obtain high-definition photos, and the voice control-based live broadcast system that can instantly obtain high-definition photos includes a host computer, a lower computer, a server, and a user. ; The host computer end includes a movable bearing device, and the movable bearing device is provided with a pan-tilt, an image acquisition device connected with the pan-tilt, and a first transmission module; wherein the pan-tilt is used to adjust the The position and/or orientation of the image capture device; the image capture device includes one or more camera modules, wherein each camera module includes two cameras, and the two cameras in the same camera module are at the same time The corresponding acquisition viewing angles are approximately the same; the first transmission module includes one or more wireless image transmission modules for communicating with the lower computer terminal; wherein, the two cameras in each camera module are respectively used for outputting pictures data and video data, the picture data includes one or more groups of pictures, and the video data includes one or more groups of video frame sequences; the lower computer end includes a remote control device, a second transmission module and a voice module; The second transmission module includes one or more wireless image transmission modules for communicating with the upper computer and a communication module for communicating with the server; the lower computer is used for receiving and forwarding from the The acquisition instruction of the server side is sent to the host computer side, so that the image acquisition device of the host computer side starts or stops collecting the picture/video data in its field of view, and receives the picture/video data from the host computer side to forward it to the host computer in real time. the server side; the remote control device is suitable for receiving manipulation instructions from ground staff, the manipulation instructions include a first instruction for controlling the movable carrying device and a second instruction for controlling the pan/tilt; the The remote control device is adapted to send the first instruction in the manipulation instruction to the first control module in the movable carrier device to control the movable carrier device to perform corresponding operation actions, and the second instruction in the manipulation instruction The instruction is sent to the second control module of the PTZ to control the PTZ to perform corresponding operations; the voice module is adapted to receive voice control information from the server, and generate corresponding voice playback according to the voice control information To the ground staff to instruct the ground staff to input corresponding control instructions to the remote control device; the server end is used to perform real-time and corresponding processing on the picture/video data received from the lower computer end Process and store, when receiving the request command from the user terminal, obtain the picture/video data matching the request command and send it to the user terminal that issued the request command, and receive the control information from the user terminal and generate the corresponding voice The control information is sent to the lower computer; wherein, the request instruction includes a request for video transmission and/or a photographing instruction.

FIG. 1 is a structural diagram of an example of a live broadcast system that can instantly obtain high-definition photos based on voice control of the present invention.

As shown in FIG. 1 , in this example, the live broadcast system that can obtain high-definition photos in real time based on voice control includes a host computer end 10 , a lower computer end 20 , a server end 30 and a user end 40 .

The host computer 10 includes a movable carrying device 11, and the movable carrying device 11 is provided with a pan-tilt 11-1, an image acquisition device 11-2 connected to the pan-tilt 11-1, and a first transmission module 11-3.

For example, the movable carrying device 11 may be, but is not limited to, any of the following: a drone, a mobile robotic arm, a cable car, a sightseeing car, a train, an airplane, or a ship, and the like.

The pan/tilt 11-1 is used to adjust the position and/or orientation of the image capture device 11-2 connected thereto.

The image capture device 11-2 includes one or more camera modules, wherein each camera module includes two cameras, and the two cameras in the same camera module have approximately the same capture angle at the same time.

Among them, the two cameras in the same camera module have roughly the same acquisition angle of view at the same time, that is, the acquisition angle of view of the two cameras at the same time is basically the same, for example, it can be completely the same, or the relative angle between the two can be Within a predetermined range (for example, the relative angle between the two is less than 5 degrees or 8 degrees, etc.).

According to the embodiment of the present invention, the camera of each camera module may be a wide-angle zoom camera or a non-zoom camera. When the two cameras of the camera module are both zoom cameras, the two zoom cameras can zoom synchronously, for example, and the relative angle satisfies that the viewing angles of the pictures captured by the two cameras at the same time are approximately the same. Wherein, the relative angle can be adjusted manually/automatically, for example.

According to an embodiment of the present invention, the arrangement of the two cameras in a single camera module includes, but is not limited to, horizontal or vertical arrangement, for example.

According to an embodiment of the present invention, for example, each camera module may be respectively provided with a corresponding sensor group, wherein each sensor group includes a position sensor suitable for real-time acquisition of the position of the corresponding camera module and a position sensor suitable for real-time acquisition of the corresponding camera module The attitude sensor of the attitude of the group; the server side receives the interest target instruction from the user, and selects one of the multiple preset interest target positions according to the interest point instruction as the current viewing target position, according to the current viewing target position. The connection line with the real-time position of the target camera module adjusts the pan/tilt corresponding to the target camera module, so that the main direction of the optical axis of each camera in the target camera module is consistent with the above-mentioned connection direction, thereby making the current The viewing target position is located at the shooting center of each camera of the target camera module. In this example, the positions and postures of the two cameras in the same camera module can be regarded as the same, so that the same position sensor is used to obtain the positions of the two cameras in the same camera module, and the same posture is adopted sensor to obtain the pose of two cameras in the same camera module. Wherein, the plurality of preset interest target positions include a plurality of known position points preset in a predetermined area. When the image capturing device includes one camera module, the camera module is used as the target camera module; when the image capturing device includes multiple camera modules, the target camera module is, for example, the distance from the current viewing target among the multiple camera modules. The closest camera module.

According to an embodiment of the present invention, each camera module may, for example, be provided with a corresponding sensor group, wherein each sensor group includes a plurality of position sensors suitable for real-time acquisition of the position of each camera in the corresponding camera module and a plurality of position sensors suitable for Obtain multiple attitude sensors corresponding to the attitudes of each camera in the camera module in real time; the server side receives the interest target instruction from the user, and selects one of the multiple preset interest target positions as the current view according to the interest point instruction. According to the connection between the current viewing target position and the real-time positions of each camera of the target camera module, adjust the pan/tilt corresponding to the target camera module, so that the main direction of the optical axis of each camera in the target camera module Consistent with the connection direction above. Wherein, the plurality of preset interest target positions include a plurality of known position points preset in a predetermined area. When the image capturing device includes one camera module, the camera module is used as the target camera module; when the image capturing device includes multiple camera modules, the target camera module is the distance between the cameras of the multiple camera modules and the current view. The camera module to which the camera closest to the scene target position belongs. In this example, the two cameras in a single camera module can respectively perform synchronous attitude adjustment or asynchronous attitude adjustment according to their corresponding connection directions in real time through the two PTZs. That is to say, in the same camera module, if the connection directions between the two cameras and the current viewing target position are different, the corresponding PTZs of the two cameras can be adjusted separately (not synchronized). ), so that both cameras can make the current viewing target position in their respective shooting centers

For example, a UAV (as an example of a movable carrying device, the UAV described below can also be other types of movable carrying devices) is constantly moving during the image acquisition process, in the case of changing the focus point, in order to make If the two images captured by the two cameras have a high degree of coincidence, the attitudes of the two cameras need to be adjusted at all times. The flight trajectory of the drone is preset, for example, the flight trajectory is a straight line or a circle, and the setting of the target of interest is, for example, For a natural or artificial building in different positions along a straight line or inside and outside a circle, different flight trajectories and targets of interest can be set according to different scenic spots; and the geographic location of the target of interest has been pre-obtained by the staff of the scenic spot.

In this way, by allowing the user to set an interest target, the user can switch the interest target he pays attention to in real time when watching the live video. Because the drone is moving and the interest target is not moving, it is necessary to obtain the model of a single camera on the drone in real time. The position and attitude data of the two cameras in the group (position and attitude sensors need to be placed on each camera), and the main direction of the camera's optical axis is determined according to the connection between the camera and the target of interest (known geographic location). The two cameras in a single camera module perform posture synchronization adjustment in real time according to the above connection data through two PTZs respectively, so that the target of interest is always in the center of the image. For example, at the initial moment of the flight, the connection distance between the first object of interest and the camera (calculated separately by the two cameras) is less than or equal to D (D is the set distance), then the object focused by the camera (calculated separately by the two cameras) is the first object of interest , when the drone has been flying for a period of time, the connection distance between the first interest target and the camera (the two cameras are calculated separately) is greater than D, while the connection distance between the second interest target and the camera (the two cameras are calculated separately) is less than or equal to D, then the camera (the two cameras are calculated separately) will automatically change the focus object to the second interest target. If the user still chooses the first interest target as the main viewing target, he only needs to click the first interest target logo, then the pan/tilt Still control the image acquisition device to turn to the first object of interest.

In this way, after recognizing the acquisition instruction, each camera module acquires the picture/video data in its field of view and transmits it to the lower computer terminal 20 in real time.

The first transmission module 11 - 3 includes one or more wireless image transmission modules for communicating with the lower computer terminal 20 . Wherein, the two cameras in each camera module are respectively used to output picture data and video data, the picture data includes one or more groups of pictures, and the video data includes one or more groups of video frame sequences. That is, in a single camera module, one of the cameras is used to output picture data, and the other camera is used to output video data.

Among them, the picture data and video data collected by the two cameras included in each camera module have a time correspondence, and the two cameras receive the collection instruction at the same time, and collect the picture data and the video data respectively, and the corresponding relationship is as follows: the video data is n A frame is a frame sequence, and the video stream is divided into several frame sequences according to the playback time sequence. Ir represents the rth frame sequence, Ir1, Ir2, ... Irn represents the nth frame image in the rth video frame sequence; in The picture data collected at the same time in the same camera module can be represented by Dr, and Dr1, Dr2, ... Drn represents the picture data corresponding to the n frames of images in the rth video frame sequence.

According to the embodiment of the present invention, under the condition of ensuring the image data transmission speed, the movable carrier device 11, the pan/tilt 11-1 on the movable carrier device 11, and the image acquisition device 11-2 can transmit images through the same image transmission device, for example. The module communicates with the lower computer terminal 20 .

According to the embodiment of the present invention, the movable carrier device 11, the pan/tilt 11-1 on the movable carrier device 11, and the image acquisition device 11-2 can also communicate with the lower computer terminal 20 through their corresponding image transmission modules respectively. . In this way, the data transmission of the corresponding device is respectively transmitted through a plurality of image transmission modules. For example, the movable carrying device 11 transmits data through the first image transmission module, and the PTZ 11-1 transmits data through the second image transmission module (if there are multiple image transmission modules) For example, the PTZ 11-1 can transmit data through a plurality of second image transmission modules), and the image acquisition device 11-2 transmits data through a third image transmission module.

In one example, in the image acquisition device 11-2, when multiple camera modules are included, the multiple camera modules may transmit data through multiple image transmission modules, or may only transmit data through the same image transmission module data.

In addition, for the same group of camera modules, the two cameras can transmit data through the same image transmission module, or can transmit data through two image transmission modules respectively. For example, in order to meet the fast transmission of image data, the two cameras in each camera module can respectively transmit image data and video data through one image transmission module, that is, the two cameras transmit image data and video through two image transmission modules respectively. data, so that picture data and video data are transmitted separately.

As shown in FIG. 1 , the lower computer terminal 20 includes a second transmission module 21, a remote control device 22 and a voice module 23. The second transmission module 21 includes one or more wireless image transmission modules for communicating with the upper computer terminal 10 and a A communication module for communicating with the server, for example, the communication module may be a wired communication module or a wireless communication module.

The lower computer terminal 20 is used to receive and forward the acquisition instruction from the server terminal 30 to the upper computer terminal 10 (for example, to the PTZ or the image acquisition device), so that the image acquisition device 11-2 of the upper computer terminal 10 starts or stops the acquisition. It has picture/video data in its field of view, and receives the picture/video data from the host computer 10 to forward it to the server 30 in real time.

In addition, the remote control device 22 is adapted to receive manipulation instructions from ground personnel. The remote control device 22 is, for example, a remote control operated by ground staff, and is used to control the movable carrier device 11 and/or the pan/tilt 11 - 1 in the upper computer terminal 10 .

The manipulation instruction received by the remote control device 22 may include a first instruction for controlling the movable carrying device 11 and a second instruction for controlling the pan/tilt head 11-1.

For example, the remote control device 22 can send the first instruction in the manipulation instruction to the first control module (such as the flight control module in the UAV) in the movable carrier device 11 to control the movable carrier device to perform corresponding operation actions, And send the second instruction in the manipulation instruction to the second control module of the pan/tilt 11-1 (eg, the pan/tilt control module mentioned below) to control the pan/tilt 11-1 to perform corresponding operations.

Wherein, the control instructions may include various types of instructions. For example, the control instructions include a first instruction for controlling the movable carrying device 11 and a second instruction for controlling the pan/tilt head 11-1.

Different types of control instructions (eg, first and second instructions) can be distinguished by specific fields in the control instructions. For example, the first field in the control instruction corresponds to the first instruction, and the second field in the control instruction corresponds to the second instruction.

For example, when the control instruction from the remote control device 22 received by the host computer 10 only includes the first instruction, the corresponding control operation will be performed on the movable carrier device 11, such as making the drone (as an example of the movable carrier device 11 ) ) to a predetermined altitude, etc.

For another example, when the control command from the remote control device 22 received by the host computer 10 only includes the second command, assuming that the sequence number of the corresponding pan/tilt in the second command is 2 (assuming that there are currently multiple pan/tilts), the sequence number is Perform corresponding control operations for the gimbal of 2, such as adjusting the pitch angle of the gimbal downward by 10 degrees.

For another example, when the control command from the remote control device 22 received by the host computer 10 includes both the first command and the second command, the corresponding movable carrying device 11 and the pan/tilt 11-1 can be respectively executed accordingly. Control operation.

According to an embodiment of the present invention, when the movable carrying device 11 is an unmanned aerial vehicle, the first instruction may include, for example, a first instruction for controlling the unmanned aerial vehicle to perform self-check, take-off, landing, return home, hover, pitch, roll and yaw The command of any one or more control actions in various flight control actions such as flight.

For example, the first command may include a flight direction control command and/or a flight height control command.

Wherein, the first instruction (such as a flight direction control instruction and/or a flight height control instruction) may be, for example, within a preset range (such as a preset geographic location range and/or a preset altitude range, etc.) to the movable carrying device 11 (such as UAV) to control, and when the movable carrying device 11 reaches the above-mentioned preset range boundary, the above-mentioned first instruction will no longer be valid. Thereby, the unsafe problem caused by the excessive control of the movable carrying device 11 by the first instruction can be avoided.

According to an embodiment of the present invention, the second command may include, for example, a control command for controlling the pan/tilt 11-1 to move in various directions such as the pan/tilt direction (such as a pan/tilt azimuth control command and/or a pan/tilt pitch). angle control commands, etc.).

Among them, various specific instructions (such as flight direction control instructions and flight height control instructions, or gimbal azimuth angle control instructions and gimbal pitch angle control instructions, etc.) contained in the first or second instructions can also be used in different fields. distinguish. For example, in the first field corresponding to the first command, the first one subfield corresponds to the flight direction control command, and the first two subfields in the first field correspond to the flight altitude control command; for another example, in the second command In the corresponding second field, the second first subfield corresponds to the azimuth angle control command of the gimbal, and the second second subfield corresponds to the gimbal pitch angle control command; and so on.

Therefore, different types of controls on different components in the upper computer end 10 are realized through different control instructions (eg, through different fields in the control instructions), and the control of different components in the upper computer end 10 can be carried out simultaneously, or non-simultaneously.

According to the embodiment of the present invention, if the control information sent by the user terminal 40 is voice control information input by voice, the server terminal 30 directly forwards the voice control information to the lower computer terminal in real time, and after the lower computer terminal receives the voice control information, The voice corresponding to the voice control information is generated by the voice module and the voice is played. The voice module may be, for example, an earphone and/or a speaker. In this way, the ground staff can listen to the audio content in the voice module by wearing the voice module, or by setting the voice module in a preset position (such as a fixed or movable position, etc.), so as to perform corresponding actions to the remote control device. operation.

In addition, if the control information sent by the user terminal 40 is manually input non-voice control information, the server terminal 30 can first convert the non-voice control information into corresponding voice control information, and then send the converted voice control information in real time to At the lower computer end, after receiving the voice control information, the lower computer terminal generates a voice corresponding to the voice control information through a voice module and plays the voice. In this way, the ground staff can listen to the audio content in the voice module by wearing the voice module, or by setting the voice module in a preset position (such as a fixed or movable position, etc.), so as to perform corresponding actions to the remote control device. operation.

The number of the upper computer ends 10 may be one or more, and the number of the lower computer ends 20 is consistent with the number of the upper computer ends 10 . Each upper computer end 10 can communicate with the server end 30 through the lower computer end 20 corresponding to the upper computer end 10 . It should be understood that FIG. 1 only shows an example of one upper computer end and one lower computer end, and in other examples, the number of the upper computer end and the lower computer end may also be multiple.

According to an embodiment of the present invention, the pan/tilt 11-1 is, for example, a multi-degree-of-freedom pan/tilt, which is suitable for controlling the image acquisition device 11-2 connected thereto to perform multi-directional adjustment.

For example, the pan/tilt 11-1 can control the image capture device 11-2 connected to it to perform any one or more of the following movements: horizontal rotation, vertical pitch, and rotation around the optical axis of the image capture device 11-2, etc. . For example, the PTZ 11-1 can integrate functions such as motor drive and servo control, and can adjust the image acquisition device connected to the PTZ to move in multiple directions according to the instructions. The above-mentioned horizontal rotation movement, vertical pitch movement and rotation movement around the optical axis of the camera

According to an embodiment of the present invention, a telescopic device may be provided on the pan/tilt 11-1, and the image acquisition device 11-2 connected to the pan/tilt 11-1 is disposed on the corresponding telescopic device, so that the image acquisition device 11-2 It can move with the expansion and contraction of the telescopic device.

According to the embodiment of the present invention, the pan-tilt 11-1 may include a pan-tilt control module (as the second control module) and a drive module; the pan-tilt control module is used to receive a control instruction from the remote control device 22 in the lower computer terminal 20, Send an instruction to the drive module, and send a control signal and a drive pulse signal to the corresponding motor through the drive module, so as to control and change the motion posture of each rotating shaft of the PTZ 11-1.

In addition, the driving module may further include a limit switch, so as to control the rotation range of the corresponding pan/tilt head 11-1 through the limit switch.

According to an embodiment of the present invention, the movable carrying device 11 is provided with, for example, one or more pan-tilts 11-1, and a single pan-tilt 11-1 is used, for example, to control two cameras in a corresponding single camera module to perform synchronous adjustment .

For example, the movable carrying device 11 is only provided with a pan-tilt 11-1 and a camera module, and the pan-tilt 11-1 can control the two cameras in the camera module to perform synchronous adjustment. Wherein, the lens of the above-mentioned camera module may, for example, be directed toward the front of the movable carrying device when it flies or travels.

For another example, the movable carrying device 11 is provided with a plurality of pan-tilts 11-1 and a plurality of camera modules, the pan-tilts 11-1 and the camera modules are in one-to-one correspondence, and each pan-tilt 11-1 controls a camera module respectively. The two cameras in the group are adjusted synchronously, but the adjustments between multiple camera modules do not have to be synchronized.

According to an embodiment of the present invention, the movable carrier device 11 is provided with, for example, one or more pan-tilts 11-1, and a single pan-tilt 11-1 is used, for example, to control at least two camera modules in one or more camera modules The camera is adjusted synchronously.

For example, the movable carrying device 11 is provided with a pan-tilt 11-1 and a plurality of camera modules, and the pan-tilt 11-1 can control all cameras in the plurality of camera modules to perform synchronous adjustment.

For another example, the movable carrying device 11 is provided with a pan-tilt 11-1 and a plurality of camera modules, and the pan-tilt 11-1 can control some cameras in the plurality of camera modules to perform synchronous adjustment.

For another example, the movable carrying device 11 is provided with a plurality of pan-tilts 11-1 and a plurality of camera modules, and a single pan-tilt 11-1 can control the cameras in at least two camera modules of the plurality of camera modules to perform the camera operation. Synchronized adjustment. For example, assuming there are 2 gimbal and 5 camera modules, the first gimbal controls 6 cameras of 3 camera modules for synchronous adjustment, while the second gimbal controls 4 of the other 2 camera modules. The cameras are adjusted synchronously.

As an example of controlling multiple groups of camera modules with a single gimbal, taking two groups as an example, the lenses of one group of camera modules face the front of the movable carrier device when flying or driving, and the other group of camera module lenses face the movable carrier device. Just behind the flight or driving, the gimbal controls the two groups of camera modules to move synchronously. For example, the two sets of camera modules are connected by mechanical shafts and remain relatively stationary, then the gimbal controls the movement of one camera module while the other camera module moves. The module will also move coaxially, and the viewing angle at this time is the front and rear of the movable carrier.

For example, when the gimbal receives an instruction to turn to the left, the camera module in front of it will turn to the left in real time, and the camera module in the back will turn to the right. Instead of connecting with a mechanical shaft, the gimbal control module sends the same rotation command to the drive module, for example, if it rotates upward, the drive module sends control signals and drive pulse signals to the corresponding two sets of pitch motors, so that the two sets of camera modules rotate upward at the same time. .

As an example of controlling multiple groups of camera modules with a single gimbal, in order to obtain more directional viewing angles, a single gimbal can also be used to control four groups of camera modules, then the lens of one camera module faces the direction of the moving carrier equipment flying or driving. Directly in front, a group of camera module lenses face the rear of the movable carrier equipment that flies or travels, and the two groups of camera modules are connected by mechanical shafts as a group A camera; a group of camera module lenses face the movable carrier equipment that flies or travels. On the left side, a group of camera module lenses are facing the right side of the mobile carrier equipment when flying or driving, and the two groups of camera modules are connected by mechanical shafts as group B cameras, then the gimbal controls the cameras in group A and group B to move synchronously For example, the middle part of the mechanical axis of group A camera and the middle part of the mechanical axis of group B camera are connected by another mechanical axis and remain relatively static, and the group A camera and the group B camera are in a cross shape that is not in the same plane, then the gimbal While controlling the movement of one of the camera modules, the other three camera modules will also move coaxially.

For example, when the gimbal receives an instruction to turn to the left, the camera module in front of it will turn to the left in real time, and the other three camera modules will also turn to the left. They are not connected by mechanical shafts, but the gimbal control module sends the same rotation command to the drive module, for example, if it rotates upward, the drive module sends control signals and drive pulse signals to the corresponding four groups of pitch motors, so that the four groups of camera modules can be simultaneously Rotate up.

In addition, according to the embodiment of the present invention, the movable carrying device 11 may be provided with multiple PTZs, and each camera module corresponds to two PTZs, wherein the two cameras in a single camera module pass through two The gimbal performs asynchronous fine-tuning. Wherein, the fine adjustment mentioned here may be, for example, adjustment within the range of 0-15 degrees, or other preset ranges.

In addition, optionally, for a single camera module, in addition to the two PTZs used to control the two cameras, another PTZ can be used to control the synchronous adjustment of the two cameras.

For example, suppose a camera module corresponds to three gimbals, namely PTZ A, PTZ B, and PTZ C, and the camera module includes a first camera and a second camera. The camera is fine-tuned (assuming that the adjustment range of each degree of freedom is 0-10 degrees), the gimbal B is used to fine-tune the second camera (assuming that the adjustment range of each degree of freedom is 0-10 degrees), and the gimbal C is used to fine-tune the second camera. Synchronously adjust the first and second cameras (assuming the adjustment range of each degree of freedom is 0-360 degrees). Assume that at time t1, the directions of the two cameras are facing the front of the movable carrier device 11 (such as a drone), and assuming that the distance between the shooting target and the movable carrier device 11 is 1000 meters at this time, the orientations of the two cameras are basically the same ( At the moment t2, it is assumed that the movable carrying device 11 is 500 meters away from the shooting target, which is still far away, and it is assumed that the orientation of the movable carrying device 11 is rotated 30 degrees to the right compared to the time t1. When , the first and second cameras can be adjusted synchronously as a whole through the PTZ C, that is, the first and second cameras can be rotated to the left by 30 degrees or other degrees synchronously (the target may move slightly); at time t3 , it is assumed that the movable carrying device 11 is 2 meters away from the shooting target, and the distance is very close. At this time, the positions of the first camera, the second camera, and the shooting target are similar to the three vertices of the triangle. The directions of the two cameras facing the shooting target are different, so it is necessary to adjust the two directions asynchronously (fine-tuning) instead of synchronously. Fine-tune 5 degrees to the right), and fine-tune the direction of the second camera through PTZ B (for example, fine-tune 5 degrees to the left), so that the capture directions of both can be aligned with the shooting target. In addition, for a single camera module, the respective positions of the two cameras in the camera module can also be adjusted through two independent telescopic devices.

The server end 30 is used for real-time and corresponding processing and storage of the picture/video data received from the lower computer end 20 . Encode and compress the video data (multiple sets of video frame sequences) into a live video stream in H.264 format, encapsulate and store the compressed live video stream (for example, in FLV format), and pass the video transmission protocol (for example, RTSP) to push and distribute, wherein, the corresponding relationship between live video stream and original video data is established in the encoding process; FLV format video file is stored on the server side as an on-demand video source, and a unique identifier is determined.

For example, the server end 30 can selectively store part or all of the multiple sets of pictures corresponding to the multiple sets of video frame sequences collected by each camera module, and establish the correspondence between the multiple sets of pictures and the live video stream according to the time correspondence principle.

Alternatively, part or all of the picture data corresponding to the rth video frame sequence can also be set on the host computer end 10, and the host computer end 10 passes the part/all picture data and video data for which the corresponding relationship has been established through the first transmission module 11- 3 is transmitted to the lower computer end 20 and forwarded to the server end 30 in real time, and the server end 30 receives part/all of the picture data and all the video data, performs the above-mentioned processing and stores it.

In addition, when receiving the request instruction from the client 40, the server 30 sends the picture/video data matching the request instruction to the client 40 that issued the request instruction. Wherein, the above-mentioned request instruction from the client 40 may be one request instruction from one client 40 , may also be multiple request instructions from one client 40 , or may be multiple request instructions from multiple clients 40 .

Wherein, the request instruction includes a request for video transmission instruction and/or a photographing instruction.

According to an embodiment of the present invention, when the request instruction includes a request for video transmission instruction, the server 30 may, for example, send video data matching the requested video transmission instruction in the following manner: judging that the user's instruction (ie, the request instruction) is a pull stream The request is still an on-demand video request. If it is a streaming request, the streaming address (URL) will be sent to the corresponding client; if it is an on-demand video request, the stored video that matches the identifier carried in the request instruction will be sent to the client. The virtual path address (URL) is sent to the corresponding client;

According to an embodiment of the present invention, when the request instruction includes a photographing instruction, the server 30 may obtain, for example, the picture data matching the photographing instruction in the following manner: according to the correspondence between multiple sets of pictures and video streams, and the photographing instruction in the The carried sending time is selected from the picture data stored (for example, from the storage module of the server end 30) corresponding to the picture data of the sending time, and stored under the user account that issued the photographing instruction, in response to the user's subsequent download .

When the image capturing device 11-2 includes multiple camera modules, the server 30 may, for example, determine the camera module to which the picture/video data matching the request instruction belongs among the multiple camera modules, as the target camera module to select the picture/video data collected by the target camera module as the picture/video data matching the request instruction of the client 40 . That is to say, when the image capture device 11-2 includes multiple camera modules, before acquiring the picture/video data that matches the request instruction of the client 40, the server end 30 must first determine the picture that matches the request instruction / The camera module to which the video data belongs, and then (for example, from the storage module of the server 30 ) select and acquire the picture/video data collected by the corresponding camera module.

Wherein, for example, the camera module to which the picture/video data matching the request instruction belongs can be determined as follows: obtain the transmission parameters in the request instruction, and the transmission parameters include the video frame parameters to be transmitted (such as which frame or which The serial number of the frame, or the serial number of the camera module, etc.), and the corresponding camera module is determined according to the transmission parameter.

In this way, the client can not only watch live/on-demand videos, but also take pictures to obtain high-definition pictures while watching live/on-demand videos, and can also issue control commands to control the PTZ while watching live videos. Users who control the gimbal in real time can watch the scenery from different perspectives and take high-definition pictures according to their wishes.

In addition, when one client 40 controls the pan/tilt to change the viewing angle, other clients 40 can share the viewing angle, for example. In this way, while one user controls the PTZ to change the viewing angle, other users can share the viewing angle to watch videos or take pictures.

According to the embodiment of the present invention, the server end 30 may allow to receive control information sent from an authorized user, and refuse to receive control information sent from an unauthorized user. Among them, an authorized user is a user with permission, and an unauthorized user is a user without permission.

For example, after any client 40 sends information to the server 30, the server 30 does not implement the control information corresponding to the control information on the host computer 10 (such as the movable bearer device 11 and/or the PTZ 11-1). Before the manipulation instruction of the device 22, other control information of the same type as the control information sent by other client terminals 40 is not received.

For example, when the server end 30 receives the control information sent from a certain user end 40, it is assumed that the control information is the voice control information input by voice, and the corresponding device name ( such as drones, etc., and/or the serial number of the gimbal 11-1, etc.), when it contains the name of the movable carrying device 11 (such as drones, etc.), then "other control information of the same type as the control information" "Information" refers to other information whose content also corresponds to the name of the movable carrier device 11 (such as drones, etc.); and when it corresponds to a PTZ, "other control information of the same type as the control information" refers to the content It also corresponds to other information of the gimbal. Similarly, when the control information sent by the user terminal 40 is non-voice control information, the corresponding processing is similar, and details are not repeated here.

In this way, when a user sends a control message to the server end 30 through its client end 40, it is assumed that the control message is voice control information, and the content is a voice of "fly to 200 meters". The server end 30 forwards the voice to the voice module 23 in the lower computer 20, and the voice module 23 plays the voice "Fly to 200 meters", so that the ground staff will operate the remote control device after hearing the voice. 22 so that the drone (as an example of the mobile carrying device 11 ) is flown to an altitude of 200 meters. At the same time, the server 30 recognizes that the content of "flying to 200 meters" corresponds to the "drone" (as an example of the movable carrying device 11 ) through the recognition technology (such as existing speech recognition, semantic recognition, etc.). , thus, before the drone has executed the voice control information of "fly to 200 meters", when another client sends new control information to the server, if the new control information also corresponds to the drone , the new control information is rejected.

In addition, according to an embodiment of the present invention, when receiving a request instruction (such as downloading) or control information from the client 40, the server side 30 can also determine whether the instruction or the information contains paid information, and the instruction contains If the information has been paid, a data connection with the client 40 is established. The paid information can be obtained, for example, by means of online payment.

FIG. 2 shows one possible structure of the server side 30 . As shown in FIG. 2 , the server end 30 may include, for example, a processing module 31 , a storage module 32 and a third transmission module 33 .

The processing module 31 can, for example, perform immediate and corresponding processing on the picture/video data received from the lower computer terminal 20, the storage module 32 can, for example, store the picture/video data processed by the processing module, and the third transmission module 33 For example, it can communicate with the lower computer terminal 20 and the user terminal 40 .

In addition, according to an embodiment of the present invention, the server end 30 may optionally include the user management module shown in FIG. 2 . Wherein, the dashed box of the user management module in FIG. 2 indicates that the module is optional but not required.

The user management module can receive the identity authentication request from each client 40, and based on the identity authentication request, perform identity authentication on the corresponding user equipment (that is, the equipment corresponding to the client), and report to the corresponding client 40 after the authentication is successful. Send authentication success information to establish a data connection with the user equipment.

FIG. 3 shows one possible structure of the user terminal 40 . As shown in FIG. 3 , the client 40 may include, for example, a sending module 41 , a receiving module 42 , a display module 43 and a fourth transmission module 44 . The user equipment corresponding to the user terminal 40 may be, for example, a smart phone or a tablet computer.

Wherein, the sending module 41 can send an access request to the server 30 to obtain video data, picture data and/or a request for controlling the PTZ.

The receiving module 42 can receive video data, picture data and/or related information data in response to a request for controlling the PTZ sent by the server 30 .

The display module 43 can display the video data and picture data sent by the server 30 and/or display the real-time control operation of the PTZ.

In addition, the fourth transmission module 44 may be used for data communication with the server end 30 .

In summary, this application provides the following solutions:

Scheme 1. The live broadcast system that can obtain high-definition photos instantly based on voice control, is characterized in that, the live broadcast system that can obtain high-definition photos instantly based on voice control comprises a host computer end, a lower computer end, a server end and a user end;

The upper computer end includes a movable bearing device, and the movable bearing device is provided with a PTZ, an image acquisition device connected to the PTZ, and a first transmission module; wherein, the PTZ is used to adjust the image connected to it. The position and/or orientation of the capture device; the image capture device includes one or more camera modules, wherein each camera module includes two cameras, and the two cameras in the same camera module correspond to each other at the same time The acquisition angle of view is roughly the same; the first transmission module includes one or more wireless image transmission modules for communicating with the lower computer terminal; wherein, the two cameras in each camera module are respectively used for outputting picture data and video data, the picture data includes one or more groups of pictures, and the video data includes one or more groups of video frame sequences;

The lower computer terminal includes a remote control device, a second transmission module and a voice module;

The second transmission module includes one or more wireless image transmission modules for communicating with the upper computer and a communication module for communicating with the server; the lower computer is used for receiving and forwarding from the host computer. The acquisition instruction of the server side is sent to the host computer side, so that the image acquisition device of the host computer side starts or stops collecting the picture/video data in its field of view, and receives the picture/video data from the host computer side to forward it to the host computer in real time. the server side;

The remote control device is suitable for receiving manipulation instructions from ground staff, and the manipulation instructions include a first command for controlling the movable carrying device and a second command for controlling the pan/tilt; the remote control device is adapted to Send the first instruction in the manipulation instruction to the first control module in the movable carrier device to control the movable carrier device to perform corresponding operation actions, and send the second instruction in the manipulation instruction to the the second control module of the PTZ to control the PTZ to perform corresponding operation actions;

The voice module is adapted to receive voice control information from the server, and generate a corresponding voice based on the voice control information and play it to the ground staff, so as to instruct the ground staff to input corresponding control instructions to the remote control device ;

The server side is used to perform immediate and corresponding processing and storage on the picture/video data received from the lower computer side, and when receiving the request instruction from the user side, obtain the picture/video data that matches the request instruction. The video data is sent to the user terminal that issued the request instruction, and the control information from the user terminal is received and the corresponding voice control information is generated and sent to the lower computer terminal; wherein, the request instruction includes a request video transmission instruction and/or a photographing instruction. .

Scheme 2. The live broadcast system that can obtain high-definition photos in real time based on voice control according to scheme 1, is characterized in that, the movable bearing device is any of the following:

Drones, mobile robotic arms, cable cars, sightseeing cars, trains, planes or ships.

Scheme 3. The voice-controlled live broadcast system that can instantly obtain high-definition photos according to scheme 1 or 2, wherein when the movable carrying device is an unmanned aerial vehicle, the first instruction includes an instruction for controlling Instructions for any one or more manipulation actions of self-checking, take-off, landing, returning, hovering, pitching, rolling and yaw of the UAV.

Scheme 4. The voice control-based live broadcast system capable of obtaining high-definition photos in real time according to Scheme 3, wherein the first instruction includes a flight direction control instruction and/or a flight height control instruction.

Scheme 5. The live system that can obtain high-definition photos in real time based on voice control according to any one of schemes 1-4, wherein the second instruction includes a method for controlling the PTZ to perform horizontal and/or Control commands for movement in the pitch direction.

Scheme 6. The voice control-based live broadcast system capable of instantly obtaining high-definition photos according to Schemes 1-5, wherein the voice module includes an earphone and/or a speaker.

Scheme 7. The live broadcast system that can instantly obtain high-definition photos based on voice control according to any one of schemes 1-6, is characterized in that, if the control information sent by the user terminal is the voice control information input by voice, then all The server terminal directly forwards the voice control information to the lower computer terminal in real time.

Scheme 8. The live broadcast system that can instantly obtain high-definition photos based on voice control according to any one of schemes 1-7, is characterized in that, if the control information sent by the user terminal is manually input non-voice control information, then all The server terminal converts the non-voice control information into corresponding voice control information, so as to send the voice control information to the lower computer terminal in real time.

Scheme 9. The voice-controlled live broadcast system that can instantly obtain high-definition photos according to any one of Schemes 1-8, wherein the PTZ is a multi-DOF PTZ suitable for controlling images connected to it The acquisition device is adjusted in multiple directions.

Scheme 10. The voice-controlled live broadcast system that can instantly obtain high-definition photos according to Scheme 9, wherein the PTZ can control the image acquisition device connected to it to perform any one or more of the following movements:

Horizontal rotation movement, vertical pitch movement, and rotational movement around the optical axis of the image capture device.

Scheme 11. The voice-controlled live broadcast system that can instantly obtain high-definition photos according to Scheme 9 or 10, wherein a telescopic device is provided on the PTZ, and the image acquisition device connected to the PTZ is set on the on the corresponding telescopic device, so that the image acquisition device can move with the expansion and contraction of the telescopic device.

Scheme 12. The voice-controlled live broadcast system that can instantly obtain high-definition photos according to any one of Schemes 9 to 11, wherein the PTZ includes a PTZ control module and a drive module, wherein the cloud a station control module as the second control module;

The pan-tilt control module is used to receive control commands from the remote control device, and send commands to the drive module, and send control signals and drive pulse signals to the corresponding motors through the drive module to control and change the cloud. The motion posture of each axis of rotation of the table.

Scheme 13. The voice-controlled live broadcast system that can instantly obtain high-definition photos according to Scheme 12, wherein the drive module further includes a limit switch, so as to control the rotation range of the corresponding PTZ through the limit switch .

Scheme 14. The voice-controlled live broadcast system capable of instantly obtaining high-definition photos according to any one of Schemes 1 to 13, wherein the camera of each camera module is a wide-angle zoom camera or a non-zoom camera.

Scheme 15. The live broadcast system that can obtain high-definition photos in real time based on voice control according to any one of schemes 1-14, is characterized in that, the picture data and video collected by the two cameras included in each camera module The data has a time correspondence.

Scheme 16. The voice-controlled live broadcast system that can instantly obtain high-definition photos according to any one of Schemes 1-15, wherein the movable carrying device, the PTZ and the image on the movable carrying device The acquisition equipment communicates with the lower computer terminal through an image transmission module.

Scheme 17. The voice-controlled live broadcast system that can instantly obtain high-definition photos according to any one of Schemes 1-15, wherein the movable bearing device, the PTZ and the image on the movable bearing device The acquisition device communicates with the lower computer terminal through respective corresponding image transmission modules.

Scheme 18. The voice-controlled live broadcast system capable of instantly obtaining high-definition photos according to Scheme 17, wherein the two cameras in each camera module transmit picture data and video data through a picture transmission module respectively.

Scheme 19. The voice-controlled live broadcast system that can instantly obtain high-definition photos according to any one of schemes 1 to 18, wherein the movable carrying device is provided with one or more PTZs, and a single cloud The station is used to control the two cameras in the corresponding single camera module for synchronous adjustment.

Scheme 20. The voice-controlled live broadcast system that can instantly obtain high-definition photos according to any one of schemes 1-18, wherein the movable carrying device is provided with one or more PTZs, and a single cloud The stage is used to control the cameras of at least two camera modules in the one or more camera modules to perform synchronous adjustment.

Scheme 21. The voice-controlled live broadcast system that can instantly obtain high-definition photos according to any one of schemes 1-18, wherein the movable carrying device is provided with a plurality of PTZs, and each camera is The module corresponds to two gimbals, in which the two cameras in a single camera module are separately fine-tuned asynchronously through the two gimbals.

Scheme 22. The voice-controlled live broadcast system that can instantly obtain high-definition photos according to any one of Schemes 1-21, wherein the number of the host computer is one or more, and the number of the host computer is one or more. The number is consistent with the number of the upper computer terminals; wherein, each upper computer terminal communicates with the server terminal through the lower computer terminal corresponding to the upper computer terminal.

Scheme 23. The voice-controlled live broadcast system that can instantly obtain high-definition photos according to any one of schemes 1-22, wherein when the request instruction includes a video transmission instruction, the server is adapted to pass Send the video data matching the requested video transmission instruction as follows:

Determine whether the request instruction is a streaming request or a video-on-demand request: if it is a streaming request, send the streaming address to the corresponding client; if it is an on-demand video request, convert the stored and the content carried in the request instruction The virtual path address of the video with the corresponding identifier is sent to the corresponding client.

Scheme 24. The voice-controlled live broadcast system that can instantly obtain high-definition photos according to any one of schemes 1-23, wherein, when the request instruction includes a photographing instruction, the server is adapted to pass the following: way to obtain the image data that matches the photographing instruction:

According to the corresponding relationship between multiple sets of pictures and video streams, and the sending time carried in the photographing instruction, select the picture data corresponding to the sending time from the stored picture data, and save it under the account of the user who issued the photographing instruction, to Respond to subsequent downloads by the user.

Scheme 25 According to the voice-controlled live broadcast system that can instantly obtain high-definition photos according to Scheme 23 or 24, it is characterized in that, in the case that the image acquisition device includes a plurality of camera modules, the server is suitable for:

Among the plurality of camera modules, the camera module to which the picture/video data matching the request instruction belongs is determined as the target camera module, so as to select the picture/video data collected by the target camera module as the target camera module. The picture/video data that matches the request instruction of the user side.

Scheme 26. The voice-controlled live broadcast system that can instantly obtain high-definition photos according to any one of schemes 1-25, wherein the server is adapted to allow receiving control information sent from an authorized user, and Refuse to receive control information sent by unauthorized users.

Scheme 27. The live broadcast system that can obtain high-definition photos instantly based on voice control according to any one of schemes 1-26, is characterized in that, when one user terminal controls the PTZ to change the viewing angle, other users can share the perspective.

Scheme 28. The voice-controlled live broadcast system that can instantly obtain high-definition photos according to scheme 27, is characterized in that, after any client sends control information to the server, the server does not implement the same procedure on the PTZ of the host computer. Before the control instruction corresponding to the control information and from the remote control device, other control information of the same type as the control information sent by other users is not received.

Scheme 29. The voice-controlled live broadcast system that can instantly obtain high-definition photos according to any one of Schemes 1-28, wherein the server side determines that the Whether the instruction or information contains paid information, and if the instruction contains paid information, establish a data connection with the client.

Scheme 30. The voice-controlled live broadcast system that can instantly obtain high-definition photos according to any one of schemes 1-29, wherein the server includes a processing module, a storage module and a third transmission module; wherein, The processing module is adapted to perform immediate and corresponding processing on the picture/video data received from the lower computer, the storage module is adapted to store the picture/video data processed by the processing module, and the The third transmission module is suitable for communicating with the lower computer and the user terminal.

Scheme 31. The voice-controlled live broadcast system that can instantly obtain high-definition photos according to scheme 30, wherein the server side further includes a user management module for receiving an identity authentication request from each user side, and based on the The identity authentication request performs identity authentication on the corresponding user equipment, and after successful authentication, sends authentication success information to the corresponding user terminal to establish a data connection with the user equipment.

Scheme 32. The voice-controlled live broadcast system that can instantly obtain high-definition photos according to any one of Schemes 1-31, wherein each client includes:

a sending module, configured to send an access request to the server to obtain video data, picture data and/or a request to control the PTZ;

a receiving module, configured to receive video data, picture data and/or relevant information data in response to the request of the control PTZ sent by the server;

a display module for displaying video data and picture data sent by the server and/or displaying the operation of the real-time control PTZ; and

The fourth transmission module is used for data communication with the server.

Scheme 33. The live broadcast system that can instantly obtain high-definition photos based on voice control according to any one of schemes 1-32, is characterized in that,

Each camera module is respectively provided with a corresponding sensor group, wherein each sensor group includes a position sensor suitable for obtaining the position of the corresponding camera module in real time and an attitude sensor suitable for obtaining the posture of the corresponding camera module in real time;

The server side receives the interest target instruction from the user, and selects one of a plurality of preset interest target positions according to the interest point instruction as the current viewing target position, according to the current viewing target position and the target camera module. The connection between the real-time positions of the target camera module is adjusted to adjust the pan/tilt corresponding to the target camera module, so that the main direction of the optical axis of each camera in the target camera module is consistent with the connection direction; wherein, the The plurality of preset interest target positions include a plurality of known position points preset in a predetermined area.

Scheme 34. The live broadcast system that can instantly obtain high-definition photos based on voice control according to scheme 33, is characterized in that,

When the image acquisition device includes a camera module, the camera module is used as the target camera module;

When the image acquisition device includes multiple camera modules, the target camera module is the camera module closest to the current viewing target position among the multiple camera modules.

Scheme 35. The live broadcast system that can instantly obtain high-definition photos based on voice control according to any one of schemes 1-34, characterized in that,

Each camera module is respectively provided with a corresponding sensor group, wherein each sensor group includes a plurality of position sensors suitable for real-time acquisition of the position of each camera in the corresponding camera module and a plurality of position sensors suitable for real-time acquisition of each camera in the corresponding camera module The attitude of multiple attitude sensors;

The server side receives the interest target instruction from the user, and selects one of a plurality of preset interest target positions according to the interest point instruction as the current viewing target position, according to the current viewing target position and the target camera module. The connection between the real-time positions of each camera adjusts the pan/tilt corresponding to the target camera module, so that the main direction of the optical axis of each camera in the target camera module is consistent with the connection direction; The plurality of preset interest target positions include a plurality of known position points preset in a predetermined area.

Scheme 36. The live broadcast system that can obtain high-definition photos in real time based on voice control according to scheme 35, is characterized in that,

When the image acquisition device includes a camera module, the camera module is used as the target camera module;

When the image acquisition device includes a plurality of camera modules, the target camera module is the camera module to which the camera closest to the current viewing target position among the cameras of the plurality of camera modules belongs.

Scheme 37. The live broadcast system that can instantly obtain high-definition photos based on voice control according to scheme 35 or 36, is characterized in that,

The two cameras in a single camera module perform synchronous adjustment or asynchronous adjustment of attitude according to the connection direction in real time through the two PTZs respectively.

While the invention has been described in terms of a limited number of embodiments, those skilled in the art will appreciate, having the benefit of the above description, that other embodiments are conceivable within the scope of the invention thus described. Furthermore, it should be noted that the language used in this specification has been principally selected for readability and teaching purposes, rather than to explain or define the subject matter of the invention. Accordingly, many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the appended claims. This disclosure is intended to be illustrative, not restrictive, as to the scope of the present invention, which is defined by the appended claims.

Claims (35)

1. The live broadcast system capable of acquiring the high-definition photos immediately based on the voice control is characterized by comprising an upper computer end, a lower computer end, a server end and a user end;

the upper computer end comprises movable bearing equipment, and the movable bearing equipment is provided with a holder, image acquisition equipment connected with the holder and a first transmission module; the holder is used for adjusting the position and/or the direction of the image acquisition equipment connected with the holder; the image acquisition equipment comprises one or more camera modules, wherein each camera module comprises two cameras, and the corresponding acquisition visual angles of the two cameras in the same camera module at the same moment are approximately the same; the first transmission module comprises one or more wireless image transmission modules for communicating with the lower computer end; the two cameras in each camera module are respectively used for outputting picture data and video data, the picture data comprises one or more groups of pictures, and the video data comprises one or more groups of video frame sequences; the camera module comprises a camera module, a camera module and a camera module, wherein the camera module comprises a plurality of cameras, the cameras are arranged in the camera module, the camera module comprises a camera module, image data and video data, the image data and the video data acquired by the two cameras in the camera module have time corresponding relations;

the lower computer end comprises remote control equipment, a second transmission module and a voice module;

the second transmission module comprises one or more wireless image transmission modules for communicating with the upper computer end and a communication module for communicating with the server end; the lower computer end is used for receiving and forwarding an acquisition instruction from the server end to the upper computer end so as to enable the image acquisition equipment at the upper computer end to start or stop acquiring image/video data in the visual field of the image acquisition equipment, and receiving the image/video data from the upper computer end to forward the image/video data to the server end in real time;

the remote control equipment is suitable for receiving control instructions of ground workers, and the control instructions comprise a first instruction for controlling the movable bearing equipment and a second instruction for controlling the holder; the remote control equipment is suitable for sending a first instruction in the control instruction to a first control module in the movable bearing equipment so as to control the movable bearing equipment to perform corresponding operation action, and sending a second instruction in the control instruction to a second control module of the holder so as to control the holder to perform corresponding operation action;

the voice module is suitable for receiving voice control information from the server side, generating corresponding voice according to the voice control information and playing the voice to the ground staff so as to instruct the ground staff to input corresponding control instructions to the remote control equipment;

the server is used for carrying out instant and corresponding processing and storage on the picture/video data received from the lower computer end, acquiring the picture/video data matched with the request instruction and sending the picture/video data to the user end sending the request instruction when receiving the request instruction from the user end, receiving the control information from the user end, generating corresponding voice control information and sending the voice control information to the lower computer end; the request instruction comprises a request video transmission instruction and/or a photographing instruction;

the server end receives an interest target instruction from a user, selects one of a plurality of preset interest target positions as a current view target position according to the interest target instruction, and adjusts a cloud deck corresponding to the target camera module according to a connecting line between the current view target position and a real-time position of the target camera module so that the main direction of an optical axis of each camera in the target camera module is consistent with the direction of the connecting line; wherein the plurality of preset target locations of interest comprise a plurality of known location points preset within a predetermined area.

2. The live system capable of instantly obtaining high definition pictures based on the voice control as claimed in claim 1, wherein the movable carrying device is any one of the following devices:

unmanned aerial vehicle, mobile robotic arm, cable car, sightseeing vehicle, train, plane or ship.

3. The live broadcast system capable of instantly obtaining high definition pictures based on the voice control as claimed in claim 1 or 2, wherein when the movable carrying device is an unmanned aerial vehicle, the first instruction comprises an instruction for controlling any one or more of self-check, take-off, landing, return, hovering, pitching, rolling and yawing actions of the unmanned aerial vehicle.

4. The live system capable of instantly obtaining high-definition pictures based on the voice control as claimed in claim 3, wherein the first command comprises a flight direction control command and/or a flight altitude control command.

5. The live system capable of instantly obtaining high-definition photos based on voice control as claimed in claim 1, wherein the second instruction comprises a control instruction for controlling the pan/tilt head to move in horizontal and/or pitch directions.

6. The live system capable of instantly obtaining high-definition photos based on voice control as claimed in claim 5, wherein the voice module comprises a headset and/or a speaker.

7. The live broadcast system capable of instantly obtaining high definition pictures based on voice control as claimed in claim 1, wherein if the control information sent by the user terminal is voice control information inputted by voice, the server terminal directly forwards the voice control information to the lower computer terminal in real time.

8. The live broadcast system capable of instantly obtaining high definition pictures based on voice control as claimed in claim 1, wherein if the control information sent by the user terminal is manually input non-voice control information, the server terminal converts the non-voice control information into corresponding voice control information so as to send the voice control information to the lower computer terminal in real time.

9. The live broadcast system capable of instantly obtaining high definition pictures based on voice control as claimed in claim 1, wherein the pan-tilt is a multi-degree of freedom pan-tilt suitable for controlling an image acquisition device connected thereto to perform multi-directional adjustment.

10. The live system capable of instantly obtaining high-definition pictures based on voice control as claimed in claim 9, wherein the pan-tilt can control the image capturing device connected thereto to perform any one or more of the following movements:

horizontal rotational movement, vertical tilting movement and rotational movement about the optical axis of the image acquisition device.

11. The live broadcast system capable of acquiring high-definition photos instantly based on voice control as claimed in claim 9 or 10, wherein a telescopic device is arranged on the pan/tilt, and the image acquisition equipment connected with the pan/tilt is arranged on the corresponding telescopic device, so that the image acquisition equipment can move along with the telescopic device.

12. The live broadcast system capable of instantly obtaining high-definition photos based on the voice control as claimed in claim 9, wherein the pan-tilt comprises a pan-tilt control module and a driving module, wherein the pan-tilt control module is used as the second control module;

the holder control module is used for receiving a control instruction from the remote control equipment, sending an instruction to the driving module, and sending a control signal and a driving pulse signal to the corresponding motor through the driving module so as to control and change the motion attitude of each rotating shaft of the holder.

13. The live system capable of instantly obtaining high-definition pictures based on voice control as claimed in claim 12, wherein the driving module further comprises a limit switch, so as to control a rotation range of the corresponding cradle head through the limit switch.

14. The live system capable of acquiring high-definition photos instantly based on the voice control as claimed in claim 1, wherein the camera of each camera module is a wide-angle zoom camera or a non-zoom camera.

15. The live broadcasting system capable of instantly obtaining high definition photos based on voice control as claimed in claim 1, wherein the movable carrying device, the cradle head on the movable carrying device and the image capturing device are all communicated with the lower computer end through a picture transmission module.

16. The live broadcasting system capable of instantly obtaining high definition photos based on voice control as claimed in claim 1, wherein the movable carrying device, the cradle head on the movable carrying device and the image capturing device are respectively communicated with the lower computer end through respective corresponding image transmission modules.

17. The live broadcasting system for instantly obtaining high definition pictures based on voice control as claimed in claim 16, wherein two cameras in each camera module respectively transmit picture data and video data through a picture transmission module.

18. The live broadcast system capable of acquiring high-definition photos instantly based on the voice control as claimed in claim 1, wherein one or more holders are provided on the movable carrying device, and a single holder is used for controlling two cameras in a corresponding single camera module to perform synchronous adjustment.

19. The live broadcast system capable of acquiring high-definition photos instantly based on the voice control as claimed in claim 1, wherein one or more holders are provided on the movable carrying device, and a single holder is used for controlling cameras of at least two camera modules of the one or more camera modules to perform synchronous adjustment.

20. The live broadcasting system capable of acquiring high-definition photos instantly based on voice control as claimed in claim 1, wherein a plurality of holders are provided on the movable carrying device, and each camera module corresponds to two holders, wherein two cameras in a single camera module are asynchronously fine-tuned through two holders respectively.

21. The live broadcast system capable of instantly obtaining high definition photos based on voice control as claimed in claim 1, wherein the number of the upper computer terminals is one or more, and the number of the lower computer terminals is consistent with the number of the upper computer terminals; and each upper computer end communicates with the server end through the lower computer end corresponding to the upper computer end.

22. The live system capable of instantly obtaining high definition photos based on the voice control as claimed in claim 1, wherein when the request command includes a video transmission command, the server is adapted to send video data matching the request video transmission command by:

judging whether the request instruction is a pull stream request or an on-demand video request: if the request is a pull request, the pull address is sent to the corresponding user side; and if the request is a video-on-demand request, sending the stored virtual path address of the video corresponding to the identifier carried in the request instruction to the corresponding user side.

23. The live broadcast system capable of instantly obtaining high definition photos based on voice control as claimed in claim 1, wherein when the request command includes a photo command, the server is adapted to obtain the picture data matching with the photo command by:

and selecting picture data corresponding to the sending time from the stored picture data according to the corresponding relation between the plurality of groups of pictures and the video stream and the sending time carried in the photographing instruction, and storing the picture data in the user account sending the photographing instruction so as to respond to the subsequent downloading of the user.

24. The live system capable of instantly obtaining high definition pictures based on the voice control as claimed in claim 22 or 23, wherein in case that the image capturing device comprises a plurality of camera modules, the server is adapted to:

and determining the camera module to which the picture/video data matched with the request instruction belongs from the plurality of camera modules as a target camera module so as to select the picture/video data collected by the target camera module as the picture/video data matched with the request instruction of the user side.

25. The live system capable of instantly obtaining high definition pictures based on voice control as claimed in claim 1, wherein the server is adapted to allow receiving the control information sent by the authorized user and refuse receiving the control information sent by the unauthorized user.

26. The live system capable of instantly obtaining high definition photos based on voice control as claimed in claim 1, wherein when one user controls the pan/tilt head to change the viewing angle, other users can share the viewing angle.

27. The live broadcast system capable of instantly obtaining high definition pictures based on voice control as claimed in claim 26, wherein after any user end sends control information to the server end, the server end does not receive other control information of the same type as the control information sent by other user ends until the upper computer end pan-tilt does not implement the control command from the remote control device corresponding to the control information.

28. The live system based on voice control and capable of obtaining high definition photos instantly as claimed in claim 1, wherein the server side determines whether the command or the information contains paid information or not when receiving a request command or control information from the user side, and establishes a data connection with the user side if the command contains paid information.

29. The live system capable of instantly obtaining high-definition pictures based on the voice control as claimed in claim 1, wherein the server comprises a processing module, a storage module and a third transmission module; the processing module is suitable for carrying out real-time and corresponding processing on the picture/video data received from the lower computer end, the storage module is suitable for storing the picture/video data processed by the processing module, and the third transmission module is suitable for communicating with the lower computer and the user end.

30. The live broadcasting system capable of instantly obtaining high definition photos based on voice control as claimed in claim 29, wherein the server further comprises a user management module for receiving an identity authentication request from each user terminal, performing identity authentication on the corresponding user equipment based on the identity authentication request, and sending an authentication success message to the corresponding user terminal after the authentication is successful so as to establish data connection with the user equipment.

31. The live system capable of instantly obtaining high-definition photos based on voice control as claimed in claim 1, wherein each user end comprises:

the sending module is used for sending an access request to the server side to acquire video data, picture data and/or a request for controlling the holder;

the receiving module is used for receiving video data, picture data and/or related information data responding to a control cloud deck request sent by the server;

the display module is used for displaying the video data and the picture data sent by the server side and/or displaying the operation of a real-time control holder; and

and the fourth transmission module is used for carrying out data communication with the server side.

32. The live system capable of instantly obtaining high-definition photos based on voice control as claimed in claim 1,

when the image acquisition equipment comprises a camera module, the camera module is used as the target camera module;

when the image acquisition equipment comprises a plurality of camera modules, the target camera module is the camera module which is closest to the current viewing target position in the plurality of camera modules.

33. The live system capable of instantly obtaining high-definition photos based on voice control as claimed in claim 1,

each camera module is provided with a corresponding sensor group, wherein each sensor group comprises a plurality of position sensors suitable for acquiring the positions of the cameras in the corresponding camera module in real time and a plurality of attitude sensors suitable for acquiring the attitudes of the cameras in the corresponding camera module in real time;

the server end receives an interest target instruction from a user, selects one of a plurality of preset interest target positions as a current view target position according to the interest target instruction, and adjusts a cloud deck corresponding to the target camera module according to a connecting line between the current view target position and the real-time position of each camera of the target camera module so that the main direction of the optical axis of each camera in the target camera module is consistent with the connecting line direction; wherein the plurality of preset target locations of interest comprise a plurality of known location points preset within a predetermined area.

34. The live system capable of instantly obtaining high definition photos based on voice control as claimed in claim 33,

when the image acquisition equipment comprises a camera module, the camera module is used as the target camera module;

when the image acquisition equipment comprises a plurality of camera modules, the target camera module is a camera module to which a camera closest to the current viewing target position belongs in each camera of the plurality of camera modules.

35. The live system capable of instantly obtaining high definition photos based on voice control as claimed in claim 33 or 34,

and two cameras in a single camera module respectively carry out attitude synchronous adjustment or attitude asynchronous adjustment according to the connecting line direction through two holders in real time.

Images