CN116886846A

CN116886846A - Data cooperative processing method and device, recording and playing system and storage medium

Info

Publication number: CN116886846A
Application number: CN202310189885.3A
Authority: CN
Inventors: 付金祥
Original assignee: Guangzhou Kaidelian Software Technology Co ltd
Current assignee: Guangzhou Kaidelian Software Technology Co ltd
Priority date: 2023-02-28
Filing date: 2023-02-28
Publication date: 2023-10-13

Abstract

The invention discloses a data cooperative processing method, a data cooperative processing device, a recording and broadcasting system and a storage medium. Comprising the following steps: generating an audio and video equipment information table according to the address information of each video acquisition equipment and each audio acquisition equipment in the recording and broadcasting system, and respectively transmitting the audio and video equipment information table to each mobile equipment in the recording and broadcasting system; receiving audio and video equipment selection information of each mobile equipment, and determining target video acquisition equipment and target audio acquisition equipment according to the audio and video equipment selection information and an audio and video equipment information table; and acquiring first target data acquired by the target video acquisition equipment and the target audio acquisition equipment, and processing the first target data according to the received data processing instruction. The technical scheme of the embodiment of the invention solves the problem that the calculation capability of the recorder is completely depended on in the existing recording and broadcasting process, reduces the data processing pressure of the recorder in the recording and broadcasting system, improves the data processing efficiency and improves the user experience.

Description

Data cooperative processing method and device, recording and playing system and storage medium

Technical Field

The present invention relates to the field of data processing technologies, and in particular, to a data collaborative processing method, a device, a recording and playing system, and a storage medium.

Background

With the development of electronic technology, electronic devices have more and more powerful functions, and meanwhile, the requirements on the working efficiency of data processing are also higher and higher. With the strong push of online teaching schemes in China, recording and broadcasting systems are increasingly entering classrooms and are applied to online course recording and live broadcasting.

The recorder is used as core equipment in a recording and playing system, is usually an embedded equipment, and has the main functions of controlling audio and video equipment, processing audio and video data and the like. In the existing online teaching implementation process, the recorder is required to encode, decode, encapsulate, splice and the like the acquired audio and video data, and the operations are all required to depend on the computing capacity of the recorder, namely the CPU or GPU capacity of the recorder. For a general and conventional teaching scenario, the CPU or GPU capability of the recorder is sufficient to support processing of audio and video data, however, in some special cases, the recorder may need to process multiple video channels simultaneously, such as pulling video of multiple image capturing devices and encoding and saving the video to the recorder, pushing the video to a server, providing a guiding function, and so on, where the recorder will need to have a powerful computing capability.

However, the performance of recorders cannot be improved indefinitely for cost reasons, which may lead to the effect of online lectures being affected by insufficient performance of recorders in certain large activities. In order to enable the recorder to process large-scale data at the same time, the method is usually realized by reducing the video code rate or reducing the video processing path number, and the use experience of users is seriously affected.

Disclosure of Invention

The invention provides a data cooperative processing method, a device, a recording and broadcasting system and a storage medium, which reduce the data processing pressure of a recording and broadcasting machine in the recording and broadcasting system, ensure the data processing effect of the recording and broadcasting system, reduce the construction cost of the recording and broadcasting system equipment and improve the user experience.

In a first aspect, an embodiment of the present invention provides a data cooperative processing method, which is applied to a recorder of a recording and playing system, where the method includes:

generating an audio and video equipment information table according to the address information of each video acquisition equipment and each audio acquisition equipment in the recording and broadcasting system, and respectively transmitting the audio and video equipment information table to each mobile equipment in the recording and broadcasting system;

receiving audio and video equipment selection information of each mobile equipment, and determining target video acquisition equipment and target audio acquisition equipment according to the audio and video equipment selection information and an audio and video equipment information table;

And acquiring first target data acquired by the target video acquisition equipment and the target audio acquisition equipment, and processing the first target data according to the received data processing instruction.

In a second aspect, an embodiment of the present invention further provides a data cooperative processing method, which is applied to a mobile device of a recording and broadcasting system, where the method includes:

receiving an audio and video equipment information table and an equipment selection instruction corresponding to the audio and video equipment information table;

generating audio and video equipment selection information according to the equipment selection instruction, and sending the audio and video equipment selection information to a recorder of a recording and broadcasting system so that the recorder marks video acquisition equipment and audio acquisition equipment corresponding to the audio and video equipment selection information;

and acquiring second target data acquired by the video acquisition equipment and the audio acquisition equipment corresponding to the audio and video equipment selection information according to the audio and video equipment information table, and processing the second target data according to the received data processing instruction.

In a third aspect, an embodiment of the present invention further provides a data cooperative processing apparatus, which is applied to a recorder of a recording and playing system, where the apparatus includes:

the information table generating module is used for generating an audio and video equipment information table according to the acquired address information of each video acquisition equipment and each audio acquisition equipment in the recording and broadcasting system, and respectively transmitting the audio and video equipment information table to each mobile equipment in the recording and broadcasting system;

The target equipment determining module is used for receiving the audio and video equipment selection information of each mobile equipment and determining target video acquisition equipment and target audio acquisition equipment according to the audio and video equipment selection information and the audio and video equipment information table;

the first data processing module is used for acquiring first target data acquired by the target video acquisition equipment and the target audio acquisition equipment and processing the first target data according to the received data processing instruction.

In a fourth aspect, an embodiment of the present invention further provides a data cooperative processing apparatus, which is applied to a mobile device of a recording and broadcasting system, where the apparatus includes:

the instruction receiving module is used for receiving the audio and video equipment information table and the equipment selection instruction corresponding to the audio and video equipment information table;

the information sending module is used for generating audio and video equipment selection information according to the equipment selection instruction and sending the audio and video equipment selection information to a recording and broadcasting machine of the recording and broadcasting system so that the recording and broadcasting machine marks video acquisition equipment and audio acquisition equipment corresponding to the audio and video equipment selection information;

the second data processing module is used for acquiring second target data acquired by the video acquisition equipment and the audio acquisition equipment corresponding to the audio and video equipment selection information according to the audio and video equipment information table, and processing the second target data according to the received data processing instruction.

In a fifth aspect, an embodiment of the present invention further provides a recording and broadcasting system, including: the recording and broadcasting machine, at least one mobile device, at least one video acquisition device and at least one audio acquisition device, wherein all devices in the recording and broadcasting system are positioned in the same local area network;

the recording and broadcasting machine is used for acquiring address information of each video acquisition device and each audio acquisition device, generating an audio and video device information table, and respectively transmitting the audio and video device information table to each mobile device;

the mobile device is used for receiving the audio and video device information table and a device selection instruction corresponding to the audio and video device information table, generating audio and video device selection information according to the device selection instruction, and sending the audio and video device selection information to the recorder;

the recording and broadcasting machine is used for marking the video acquisition equipment and the audio acquisition equipment corresponding to the audio and video equipment selection information according to the received corresponding relation between the audio and video equipment selection information and the mobile equipment;

the recording and broadcasting machine is also used for determining target video acquisition equipment and target audio acquisition equipment according to the selection information of each audio and video equipment and the information table of the audio and video equipment, acquiring first target data acquired by the target video acquisition equipment and the target audio acquisition equipment, and processing the first target data according to the received data processing instruction;

The mobile device is further used for acquiring second target data acquired by the video acquisition device and the audio acquisition device corresponding to the audio and video device selection information according to the audio and video device information table, and processing the second target data according to the received data processing instruction.

In a sixth aspect, an embodiment of the present invention further provides a computer readable storage medium, where computer instructions are stored, where the computer instructions are configured to cause a processor to execute the data cooperative processing method according to any one of the embodiments of the present invention.

The embodiment of the invention provides a data cooperative processing method, a device, a recording and broadcasting system and a storage medium, which are applied to a recording and broadcasting machine of the recording and broadcasting system, and are used for generating an audio and video equipment information table according to the address information of each video acquisition equipment and each audio acquisition equipment in the recording and broadcasting system, and respectively transmitting the audio and video equipment information table to each mobile equipment in the recording and broadcasting system; receiving audio and video equipment selection information of each mobile equipment, and determining target video acquisition equipment and target audio acquisition equipment according to the audio and video equipment selection information and an audio and video equipment information table; and acquiring first target data acquired by the target video acquisition equipment and the target audio acquisition equipment, and processing the first target data according to the received data processing instruction. By adopting the technical scheme, before the recording and broadcasting system carries out online video recording or live broadcasting, the data flow directions of all video acquisition equipment and all audio acquisition equipment in the recording and broadcasting system are determined, so that the recording and broadcasting machine only needs to process audio and video data which are not processed by the mobile equipment, and the mobile equipment is not required to be forwarded by the recording and broadcasting machine, the problem that the data processing in the existing recording and broadcasting process is completely dependent on the computing capability of the recording and broadcasting machine is solved, the data processing pressure of the recording and broadcasting machine in the recording and broadcasting system and the data quantity required to be transmitted by the recording and broadcasting machine in the data processing process are reduced, the data processing efficiency is improved, the construction cost of the recording and broadcasting system is reduced, and the user experience is improved.

It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the invention or to delineate the scope of the invention. Other features of the present invention will become apparent from the description that follows.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a flow chart of a data cooperative processing method according to a first embodiment of the present invention;

fig. 2 is a flowchart of a data cooperative processing method according to a second embodiment of the present invention;

FIG. 3 is a flowchart of a data cooperative processing method according to a third embodiment of the present invention;

fig. 4 is a flowchart of a data cooperative processing method according to a fourth embodiment of the present invention;

fig. 5 is a schematic structural diagram of a data co-processing device according to a fifth embodiment of the present invention;

fig. 6 is a schematic structural diagram of a data co-processing device according to a sixth embodiment of the present invention;

Fig. 7 is a schematic structural diagram of a recording and playing system according to a seventh embodiment of the present invention.

Detailed Description

In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.

It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Along with the strong pushing of on-line teaching schemes in China, recording and broadcasting systems increasingly enter classrooms and are applied to live curriculum broadcasting and recording processes of on-line teaching. The recorder in the recording and broadcasting system is generally an embedded device, and is used for controlling the other devices in the recording and broadcasting system, processing the acquired audio and video data, and the like.

It will be appreciated that a recording system will typically include multiple video capture devices, such as cameras, and multiple audio capture devices, such as microphones, and the like. The recorder needs to encode the acquired video YUV data, audio PGM data and the like by H264 or H265, store the video as local MP4 video, or package the video as RTMP format and push the video to an audio/video CDN server. Meanwhile, in the process of encoding and packaging the video, the recorder can also perform a series of processing on the video, such as watermarking, picture splicing, green screen matting and the like, and the recorder can also receive the audio and video data of the server and decode and play the audio and video data. The above related operations for audio and video are all dependent on the computing power of the recorder. In a conventional teaching scenario, the recorder computing power is sufficient to meet the processing requirements for audio and video data. However, for some teaching scenes that require large amounts of data to be calculated, a large amount of audio and video operations are required, and the computing power of the recorder may be difficult to meet the scene requirement due to cost. If all the data in the scene need to be processed, the code rate of the video data obtained by processing is reduced; if the quality of the video data is required to be ensured, the amount of the data to be processed is reduced, which results in the influence of the on-line teaching effect and difficulty in meeting the use requirements of users.

Therefore, the embodiment of the invention provides a data collaborative processing method applied to a recording and broadcasting system, which shares the audio and video data required to be processed by a recording and broadcasting machine through mobile equipment with data processing capacity except the recording and broadcasting machine in the recording and broadcasting system, reduces the data quantity required to be acquired and processed by the recording and broadcasting machine, and further reduces the data processing pressure of the recording and broadcasting machine. The data processing effect of the recording and broadcasting system is improved while the data processing capability of the recording and broadcasting machine is improved without higher cost, so that the user demands in different scenes can be met. The data cooperative processing method provided by the invention is explained below with reference to specific embodiments.

Example 1

Fig. 1 is a flowchart of a data cooperative processing method provided in a first embodiment of the present invention, where the embodiment of the present invention is applicable to a case of performing cooperative processing on acquired data in a recording and playing process, the method may be performed by a data cooperative processing device, the data cooperative processing device may be implemented by software and/or hardware, and the data cooperative device may be configured in a recorder of a recording and playing system. Optionally, the recording and broadcasting system may include a recorder, at least one mobile device, at least one video acquisition device, and at least one audio acquisition device, where each device in the recording and broadcasting system is in the same local area network.

In this embodiment, the recording and broadcasting system may be specifically understood as a device set for integrating and synchronously recording video, audio, and image signals recorded on site, and generating a standardized streaming media file for live broadcast, storage, post editing, and on-demand. The recording and broadcasting machine can be specifically understood as integrated recording and broadcasting equipment integrating functions of courseware recording and broadcasting, live broadcasting, on-demand broadcasting, intelligent guiding and broadcasting, storage and the like, is often designed based on an embedded hardware architecture, and can also be understood as a computer host in a recording and broadcasting system, plays a role in linking recording and broadcasting in the recording and broadcasting system, and is used for processing, storing and forwarding audio and video data in the recording and broadcasting system. The mobile device may be specifically understood as an electronic device in the recording and playing system, which is connected to the recorder through a local area network and has a data processing function. By way of example, the mobile device may be a classroom mobile terminal, a student mobile terminal, a teacher mobile terminal, and the like, to which embodiments of the present invention are not limited. The video collecting device may be specifically understood as an electronic device disposed in a meeting place and used for collecting video data generated in a lecture video of a lecture teacher or a conference, and the video collecting device may be a video camera or other electronic devices with a video collecting function, which is not limited in this embodiment of the present invention. The audio collection device may be specifically understood as an electronic device disposed in a conference hall and used for collecting audio data generated during the course of lecturing a lecture teacher or a conference, and the audio collection device may be, for example, a recorder, a microphone with a storage function, or the like.

As shown in fig. 1, the method for collaborative processing of data provided in the embodiment of the present invention may specifically include the following steps:

s101, generating an audio and video equipment information table according to the address information of each video acquisition equipment and each audio acquisition equipment in the recording and playing system, and respectively transmitting the audio and video equipment information table to each mobile equipment in the recording and playing system.

In this embodiment, the address information may be specifically understood as a network address of the video capturing device and the audio capturing device in the local area network, that is, an intranet IP address, where the device may be accessed and data captured by the device may be obtained under the condition that the address information is known. The audio and video equipment information table can be specifically understood to include a corresponding relation between each audio acquisition equipment and address information and a list of corresponding relation between each video acquisition equipment and address information, and by way of example, the corresponding audio and video equipment information table can be obtained by numbering different audio acquisition equipment and different video acquisition equipment and simultaneously associating and listing each number with corresponding address information.

Specifically, before the recording and broadcasting system formally executes the recording and broadcasting task, the recorder can clearly determine the video acquisition equipment and the audio acquisition equipment which are involved in the current recording and broadcasting task in the recording and broadcasting system. Because all the devices in the recording and broadcasting system are in the same local area network, all the devices can communicate by means of the local area network, the recording and broadcasting machine can acquire the determined address information of the video acquisition device and the audio acquisition device in the local area network, orderly group the acquisition devices and the address information to generate an audio and video device information table, and send the audio and video device information table to all the mobile devices participating in the current recording and broadcasting task through the local area network.

S102, receiving the audio and video equipment selection information of each mobile equipment, and determining target video acquisition equipment and target audio acquisition equipment according to the audio and video equipment selection information and the audio and video equipment information table.

In this embodiment, the audio and video device selection information may be specifically understood as information of the audio capturing device and the video capturing device selected by the mobile device. The target video capture device is specifically understood to be a video capture device in which the captured video data is processed by a recorder. The target audio collection device is specifically understood to be an audio collection device in which the collected audio data is processed by the recorder.

Specifically, the recorder and broadcaster receives the audio and video equipment selection information fed back by each mobile equipment, so that it is clear that each mobile equipment processes the data collected by which audio collection equipment and video collection equipment in the audio and video equipment information table when the recording and broadcasting task is executed, and the recorder and broadcaster is not required to process the data collected by the audio and video collection equipment selected by the mobile equipment, at the moment, the video collection equipment which does not belong to the audio and video equipment information table selected by each mobile equipment is determined to be the target video collection equipment, and the audio collection equipment which does not belong to the audio collection equipment selected by each mobile equipment is determined to be the target audio collection equipment. For example, the processing of the data collected by the audio and video device by the recorder or the mobile device may include optimizing and denoising the video image, improving resolution, marking and coding the image, and aligning and splicing the audio and video, which is not limited by the embodiment of the invention.

In the embodiment of the invention, as the audio and video equipment selection information of each mobile equipment is received by the recorder before the task is executed, the audio acquisition equipment and the video acquisition equipment which do not need to acquire data by the recorder are defined, the data volume which is required to be acquired by the recorder in the subsequent task execution process is reduced, the data processing efficiency is improved, and the data processing pressure of the recorder is reduced. And because the audio and video equipment selection information is the personalized selection of each mobile equipment, each mobile equipment can limit the number of the audio and video equipment and the like which can be selected by each mobile equipment according to the data processing capacity thereof when selecting, so that the data processed by the mobile equipment cannot exceed the data processing capacity of the mobile equipment, the stability of the task execution process of the recording and broadcasting system is ensured, the adaptation degree of different data processing is improved, and the user experience is improved.

S103, acquiring first target data acquired by the target video acquisition equipment and the target audio acquisition equipment, and processing the first target data according to the received data processing instruction.

In this embodiment, the first target data may be understood as a collection of data collected by the target video collection device and the target audio collection device. The data processing instruction may be specifically understood as an instruction given according to an actual requirement, where the instruction is used to process the first target data so as to meet a recording and playing task requirement, and exemplary data processing instructions may be an instruction for processing a video image in the first target data, an instruction for splicing an audio and video image in the first target data, an instruction for pushing the first target data after processing, and the embodiment of the present invention is not limited to this.

Specifically, the recorder determines addresses of the target audio acquisition device and the target video acquisition device in the local area network through the audio and video device information table, further acquires the audio data acquired by the target audio acquisition device from the target audio acquisition device, acquires the video data acquired by the target video acquisition device from the target video acquisition device, and combines the audio data and the video data to determine the first target data. Further, the recorder carries out corresponding processing on the first target data according to the received data processing instruction so as to complete the current recording and broadcasting task.

According to the technical scheme of the embodiment, an audio and video equipment information table is generated according to the acquired address information of each video acquisition equipment and each audio acquisition equipment in the recording and broadcasting system, and the audio and video equipment information table is respectively sent to each mobile equipment in the recording and broadcasting system; receiving audio and video equipment selection information of each mobile equipment, and determining target video acquisition equipment and target audio acquisition equipment according to the audio and video equipment selection information and an audio and video equipment information table; and acquiring first target data acquired by the target video acquisition equipment and the target audio acquisition equipment, and processing the first target data according to the received data processing instruction. By adopting the technical scheme, before the recording and broadcasting system carries out online video recording or live broadcasting, the data flow directions of all video acquisition equipment and all audio acquisition equipment in the recording and broadcasting system are determined, so that the recording and broadcasting machine only needs to process audio and video data which are not processed by the mobile equipment, and the mobile equipment is not required to be forwarded by the recording and broadcasting machine, the problem that the data processing in the existing recording and broadcasting process is completely dependent on the computing capability of the recording and broadcasting machine is solved, the data processing pressure of the recording and broadcasting machine in the recording and broadcasting system and the data quantity required to be transmitted by the recording and broadcasting machine in the data processing process are reduced, the data processing efficiency is improved, the construction cost of the recording and broadcasting system is reduced, and the user experience is improved.

Example two

Fig. 2 is a flowchart of a data cooperative processing method provided by a second embodiment of the present invention, where the technical solution of the second embodiment of the present invention is further optimized based on the foregoing alternative technical solutions, so that a determination method of a target video capturing device and a target audio capturing device is clarified, and when audio/video device selection information of each mobile device is received, corresponding devices are marked according to the audio/video device selection information, so that a recorder clarifies a data flow direction of each video capturing device and each audio capturing device, and when the data flow direction is ensured to be clear, an amount of data required to be acquired and processed by the recorder in a task execution process is reduced, an overall data processing efficiency of a recording and broadcasting system is improved, and a data processing pressure of the recorder is reduced. Further, the method for processing the acquired first target data by the recorder according to the data processing instruction directly input or sent by the mobile device is disclosed, so that the data processing flexibility is enhanced, the processing of the first target data can be adapted to the requirements of different users in the recorder system, and the user experience is improved.

As shown in fig. 2, a data cooperative processing method provided in a second embodiment of the present invention specifically includes the following steps:

S201, according to the obtained address information of each video acquisition device and each audio acquisition device in the recording and playing system, generating an audio and video device information table, and respectively sending the audio and video device information table to each mobile device in the recording and playing system.

S202, receiving audio and video equipment selection information of each mobile equipment, and determining video acquisition equipment which is not contained in the audio and video equipment selection information in the audio and video equipment list as target video acquisition equipment.

Specifically, the video acquisition devices corresponding to the audio and video device selection information of each mobile device are compared with all the video acquisition devices included in the audio and video device list, and the data acquired by the video acquisition devices corresponding to the audio and video device selection information are processed by the corresponding mobile device, so that different video acquisition devices in the comparison result can be determined as target video acquisition devices, namely, the video acquisition devices for acquiring the video data processed by the recorder-player.

Further, when receiving the audio/video device selection information of each mobile device, the method further comprises: and labeling the video acquisition equipment and the audio acquisition equipment corresponding to the audio and video equipment selection information according to the corresponding relation between the audio and video equipment selection information and the mobile equipment.

Specifically, when the recorder receives the audio and video selection information of each mobile device, it can be clear that the audio acquisition devices and the video acquisition devices which are to be used for data acquisition by different mobile devices are different, that is, the corresponding relationship exists between the mobile device and the selected audio acquisition devices and video acquisition devices, and the recorder can label the video acquisition devices and the audio acquisition devices selected by the mobile terminal in the audio and video device information table through the obtained corresponding relationship so as to clear the data flow directions of the different video acquisition devices and the audio acquisition devices.

For example, different mobile devices in the recording and playing system may have unique numbers, and when the recording and playing machine receives the audio and video device selection information of one of the mobile devices, the audio collection device and the video collection device corresponding to the audio and video device selection information may be marked with numbers corresponding to the mobile devices in the audio and video device information table, so that the data of the audio collection device and the video collection device marked with the numbers are explicitly processed by the mobile device corresponding to the numbers.

In the embodiment of the invention, the video acquisition equipment and the audio acquisition equipment are marked, so that the data flow in the recording and broadcasting system is clearer, the data processing is convenient to trace back and reprocess when the data processing is lost, the stability of the data processing in the recording and broadcasting system is improved, and the user experience is improved.

Further, the embodiment of the present invention also provides another method for acquiring data by a mobile device, after receiving the audio/video device selection information of each mobile device, the method further includes: and acquiring the data to be processed, which corresponds to the audio and video equipment selection information, and forwarding the data to be processed to the mobile equipment corresponding to the audio and video equipment selection information, so that the mobile equipment processes the data to be processed.

Specifically, after receiving the audio and video device selection information of each mobile device, the recorder may not acquire data of the audio acquisition device and the video acquisition device corresponding to the audio and video device selection information, but acquire and process the data by the mobile device. The method can also acquire the data acquired by the audio acquisition equipment and the video acquisition equipment corresponding to the audio and video equipment selection information, and the acquired data is used as the data to be processed by the mobile equipment corresponding to the audio and video equipment selection information, so that the data to be processed is sent to the corresponding mobile equipment through the local area network, and the mobile equipment can receive and process the data to be processed.

It is clear that whether the recorder is used for acquiring the data acquired by the audio acquisition equipment and the video acquisition equipment according to the selection information of the audio and video equipment can not influence the data quantity required to be processed of the recorder and is not limited by the data processing capacity of the recorder. When the recorder does not acquire the data to be processed, the data transmission pressure of the recorder can be reduced, and the data processing efficiency of the recorder is improved; when the recorder acquires the data to be processed, the consistency of data distribution in the recorder system can be ensured, the data distribution precision is ensured, the data processing failure caused by the failure of data acquisition of the mobile equipment is reduced, and the acquisition and transmission modes of the data acquired by the audio acquisition equipment and the video acquisition equipment are not limited in the embodiment of the invention.

S203, determining the audio collection device which is not contained in the audio and video device selection information in the audio and video device list as a target audio collection device.

Specifically, the corresponding audio collection devices in the audio and video device selection information of each mobile device are compared with all the audio collection devices included in the audio and video device list, and the data collected by the audio collection devices corresponding to the audio and video device selection information are processed by the corresponding mobile device, so that different audio collection devices in the comparison result can be determined as target audio collection devices, namely, the audio collection devices for collecting the audio data processed by the recorder-player.

It should be clear that there is no obvious sequence of steps S202 and S203 when they are executed, and in fig. 2, the sequence of steps S202 to S203 is merely taken as an example, which is not limited in the embodiment of the present invention.

S204, acquiring first target data acquired by the target video acquisition equipment and the target audio acquisition equipment, and receiving a data processing instruction.

The data processing instruction is an instruction directly input into the recorder or an instruction sent by the mobile device.

The data processing instruction at least comprises scene information.

In this embodiment, the scene information is specifically understood to be a scene, such as live broadcast, recorded broadcast, and guided broadcast, used to indicate the first target data processed by the recorder.

Specifically, the recorder acquires video data acquired by the target video acquisition device and audio data acquired by the target audio acquisition device through the local area network, and the combination of the video data and the audio data is determined to be first target data. After the first target data is acquired, the recorder receives a data processing instruction directly input by an external user or a data processing instruction sent by a mobile device in communication connection with the recorder in a local area network, and processes the first target data according to the data processing instruction.

S205, determining a target path according to the scene information, processing the first target data, and storing or pushing according to the target path.

In this embodiment, the target path may be specifically understood as path information where the processed first target data is to be pushed or stored.

Specifically, because the scene information is different, the requirements for displaying or storing the processed first target data are different, the data flow direction of the processed first target data, that is, the target path, can be determined according to the scene information, and after the target path is determined, the first target data can be processed and stored or pushed through the target path.

Further, determining a target path according to scene information in the data processing instruction, and storing or pushing the first target data according to the target path after processing, which can be specifically divided into the following cases:

a1, if the scene information is a recorded scene, determining a storage path of the recorder as a target path, processing first target data and then storing according to the target path;

b1, if the scene information is a live scene, determining a public network path corresponding to the live scene as a target path, processing first target data and pushing according to the target path;

And C1, if the scene information is a guide scene, determining the data to be displayed from the processed first target data according to the guide scene, determining a public network path corresponding to the guide scene as a target path, and pushing the data to be displayed according to the target path.

Specifically, when the scene information is a recorded scene, the recorder can be considered to process the acquired first target data, and then the acquired first target data does not need to be displayed externally, and only the processed data is stored in the storage space of the recorder, at the moment, the storage path corresponding to the storage space of the recorder is determined to be the target path, and after the first target data is processed, the first target data is stored in the storage space of the recorder according to the target path. Exemplary ways of processing the first target data may include, for example, denoising, converting, aligning, fusing, encoding, and the like, which are not limited by the embodiments of the present invention.

When the scene information is a live broadcast scene, the recorder can be considered to display the acquired first target data through a specific channel after processing the first target data, and the recorder can definitely determine a public network path required to display the video when executing a task, at this time, the public network path corresponding to the live broadcast scene can be determined as a target path, and after processing the first target data in the example, the first target data is pushed and played according to the target path so as to realize live broadcast of the processed first target data.

When the scene information is a broadcasting scene, the recorder can be considered to switch and display the data of different data sources in the first target data, namely, only partial data in the processed first target data is needed to be displayed through a specific channel, at the moment, the data to be displayed, which correspond to the data sources and need to be pushed, are selected from the processed first target data according to the requirement of the broadcasting scene, and the broadcasting can be specifically understood as switching the data sources in live broadcasting, so that the public network paths which need to be subjected to video display are definitely needed when the recorder executes a live broadcasting task, at the moment, the public network paths corresponding to the broadcasting scene can be determined as target paths, and the selected data to be displayed can be pushed and played according to the target paths, so that the broadcasting in the live broadcasting process is realized.

When the scene information is a broadcasting scene, the recorder can receive broadcasting instructions given by the outside or by all mobile terminals connected with the recorder, the broadcasting instructions can be given by an automatic broadcasting control program or are manual broadcasting inputs, and further different channels in which the recorder needs to display the processed first target data can be clearly determined, and then data to be displayed of the different channels and target paths corresponding to the data to be displayed can be determined, so that a broadcasting task of the first target data is realized.

In the above example, it may be assumed that the first target data acquired by the recorder is from the data source 1 and the data source 2, and when the recorder receives a guiding instruction for displaying the data of the data source 1 as a main picture and the data of the data source 2 as a sub-picture, the data from the data source 1 in the processed first target data may be determined as first data to be displayed, and the public network path for displaying the main picture may be determined as the first target path of the first data to be displayed; and determining the data from the data source 2 in the processed first target data as second data to be displayed, determining a public network path for displaying the auxiliary picture as a second target path of the second data to be displayed, pushing and playing the first data to be displayed according to the first target path, and pushing and playing the second data to be displayed according to the second target path so as to realize guide broadcasting in the live broadcasting process. Meanwhile, other mobile equipment in the recording and broadcasting system can determine third data to be displayed in the processed data and a third target path of a secondary picture to be displayed of the third data to be displayed according to the recording and broadcasting instruction received by the mobile equipment, so that the other mobile equipment can push and broadcast the third data to be displayed according to the third target path, and further the guiding and broadcasting of the whole recording and broadcasting system in the live broadcasting process is realized.

Further, if the data processing instruction further includes a video image processing instruction, before determining the target path according to the scene information in the data processing instruction, the method further includes:

and watermarking and/or filtering the first target data according to the video image processing instruction, and determining the first target data subjected to watermarking and/or filtering as new first target data.

In this embodiment, the video image processing instruction may be specifically understood as an instruction for modifying the displayed image such as tag addition to the acquired video data.

Specifically, before determining the target path according to the scene information in the data processing instruction, if the recorder determines that the data processing instruction further includes the video image processing instruction, it may be considered that the video data in the first target data needs to be modified, at this time, the video data in the first target data is correspondingly modified according to the type of the video image processing instruction, and the modified video data is updated to the original first target data, so as to obtain new first target data.

For example, if the video image processing instruction is a watermarking instruction, the recorder may add the watermark carried in the watermarking instruction to each frame of the video data in the first target data, so as to implement watermarking for the first target data; the recorder can also pull the corresponding watermark according to the watermark acquisition address carried in the watermark adding instruction, and add the watermark to each frame of the video data in the first target data, so as to realize the watermark adding for the first target data.

In the above example, if the video image processing instruction is a filter adding instruction, the recorder may add a filter carried in the filter adding instruction to each frame of video data in the first target data, so as to implement filter adding for the first target data; the recording and broadcasting machine can also pull the corresponding filter according to the filter acquisition address carried in the filter adding instruction, and add the filter to each frame of video data in the first target data, so as to realize the filter adding aiming at the first target data.

Further, after receiving the audio/video device selection information of each mobile device, the method further comprises: processed data fed back by each mobile device is received and stored.

Specifically, after receiving the audio and video device selection information of each mobile device, the recorder can consider that each mobile device will process the data of the device corresponding to the audio and video device selection information by itself. After each mobile device finishes data processing, the processed data obtained by processing can be sent to the recorder for unified management and storage, so the recorder can receive the processed data fed back by each mobile device and correspondingly store the received processed data in the storage space of the recorder.

Optionally, the recorder can upload the received processed data and the first target data processed by the recorder to the cloud for storage or to the cloud for downloading and playing by the user.

According to the technical scheme, when the recorder receives the audio and video equipment selection information, the determination of the target video acquisition equipment and the target audio acquisition equipment is completed, corresponding equipment in the audio and video equipment list is marked according to the received audio and video selection information of each mobile equipment, so that the recorder can clearly determine the data flow direction of each video acquisition equipment and each audio acquisition equipment, the data flow direction is clear, the data quantity required to be acquired and processed by the recorder in the task execution process is reduced, the overall data processing efficiency of a recorder is improved, and the data processing pressure of the recorder is reduced.

Example III

Fig. 3 is a flowchart of a data cooperative processing method provided in a third embodiment of the present invention, where the embodiment of the present invention is applicable to a case of performing cooperative processing on acquired data in a recording and playing process, the method may be implemented by a data cooperative processing device, the data cooperative processing device may be implemented by software and/or hardware, and the data cooperative processing device may be configured in a mobile device of the recording and playing system. The optional recording and playing system can comprise a recording and playing machine, at least one mobile device, at least one video acquisition device and at least one audio acquisition device, wherein all the devices in the recording and playing system are positioned in the same local area network.

As shown in fig. 3, the method for collaborative processing of data provided in the embodiment of the present invention may specifically include the following steps:

s301, receiving an audio and video equipment information table and an equipment selection instruction corresponding to the audio and video equipment information table.

In this embodiment, the device selection instruction may be specifically understood as an instruction received by the mobile device to determine that the mobile device will process the source of data. For example, if the audio and video device information table does not repeat numbering for each video capture device and each audio capture device, the device selection instruction may be the number of one or more video capture devices and audio capture devices, and the mobile device may be considered to process the data captured by the video capture device and the audio capture device corresponding to the number.

Specifically, before the recording and broadcasting system formally executes the recording and broadcasting task, the recording and broadcasting machine configured in the same local area network can be used as the mobile device capable of executing the recording and broadcasting task in the recording and broadcasting system to receive the audio and video device information table so as to clearly determine the video acquisition device and the audio acquisition device which are to perform data acquisition in the recording and broadcasting task to be executed, and the address information of each video acquisition device and each audio acquisition device. After receiving the audio and video equipment information table, the mobile equipment can display the audio and video equipment information table so that a user of the mobile equipment can acquire the audio and video equipment information in the recording and playing system, and then the user selects the audio and video equipment information according to actual conditions and receives equipment selection instructions input by the user so as to determine the data sources to be processed by the mobile equipment.

S302, generating audio and video equipment selection information according to the equipment selection instruction, and sending the audio and video equipment selection information to a recorder of a recording and broadcasting system so that the recorder marks video acquisition equipment and audio acquisition equipment corresponding to the audio and video equipment selection information.

Specifically, according to the corresponding relation between the device selection instruction and each device in the audio and video device information table, audio and video device selection information containing the video acquisition device and audio acquisition device information selected by the mobile device is generated, the audio and video device selection information carrying the mobile device identification is sent to the recorder through the local area network, so that the recorder can label the corresponding video acquisition device and audio acquisition device according to the received audio and video device selection information, namely, mobile device numbers corresponding to the audio and video device selection information are labeled on the corresponding video acquisition device and audio acquisition device, and further the recorder can clearly determine the flow direction of data acquired by each video acquisition device and audio acquisition device, and the clarity of the recorder on the flow direction of the data in the recording and playing system is ensured.

S303, acquiring second target data acquired by the video acquisition equipment and the audio acquisition equipment corresponding to the audio and video equipment selection information according to the audio and video equipment information table, and processing the second target data according to the received data processing instruction.

In this embodiment, the second target data may be specifically understood as a set of data acquired by the video acquisition device and the audio acquisition device selected by the mobile device. The data processing instruction may be specifically understood as an instruction given according to an actual requirement, and used to process the second target data so as to enable the second target data to meet the requirement of the recording and playing task.

Specifically, the mobile device may determine address information of the selected video acquisition device and the selected audio acquisition device in the local area network according to the audio/video device information table, further obtain video data acquired by the video acquisition device and audio data acquired by the audio acquisition device according to the corresponding address information, and determine that the audio data and the video data are combined as second target data. Further, the mobile device performs corresponding processing on the second target number according to the received data processing instruction so as to complete the current recording and playing task. It will be appreciated that the manner in which the mobile device processes the second target data according to the received data processing instruction is the same as the manner in which the recorder processes the collected data in the above embodiment, which will not be described in detail in the embodiment of the present invention.

According to the technical scheme, an audio and video equipment information table and an equipment selection instruction corresponding to the audio and video equipment information table are received; generating audio and video equipment selection information according to the equipment selection instruction, and sending the audio and video equipment selection information to a recorder of a recording and broadcasting system so that the recorder marks video acquisition equipment and audio acquisition equipment corresponding to the audio and video equipment selection information; and acquiring second target data acquired by the video acquisition equipment and the audio acquisition equipment corresponding to the audio and video equipment selection information according to the audio and video equipment information table, and processing the second target data according to the received data processing instruction. By adopting the technical scheme, before the recording and broadcasting system records or broadcasts the online video, the mobile equipment in the recording and broadcasting system selects the data source to be processed by the mobile equipment through the audio and video equipment information table given by the recording and broadcasting machine, generates corresponding audio and video equipment selection information and sends the corresponding audio and video equipment selection information to the recording and broadcasting machine, so that the recording and broadcasting machine can carry out corresponding marking on the data flow direction of each equipment. The mobile device can directly acquire data from the selected video acquisition device and audio acquisition device without forwarding the acquired data by the recorder or participating in the processing work of the data in the recorder, so that the problem that the computing capacity of the recorder is completely depended on in the existing recording and broadcasting process is solved, the data processing pressure of the recorder in the recording and broadcasting system and the data volume required to be transmitted by the recorder in the data processing process are reduced, the data processing efficiency is improved, the construction cost of the recording and broadcasting system is reduced, and the user experience is improved. Furthermore, as the audio and video equipment selection information is generated based on the self requirements of the mobile equipment and the data processing capacity, the adaptability of the task execution of the recording and broadcasting system and the adaptation degree of the mobile equipment and the processed data are improved, the data processed by the mobile equipment cannot exceed the data processing capacity of the mobile equipment, the stability of the task execution process of the recording and broadcasting system is ensured, and the user experience is improved.

Example IV

Fig. 4 is a flowchart of a data collaborative processing method provided by a fourth embodiment of the present invention, where the technical solution of the present invention is further optimized based on the foregoing alternative technical solutions, and a method for processing acquired second target data by a mobile device according to a data processing instruction directly input or sent by a recorder is disclosed, which further provides different storage modes for the processed second target data when the mobile device is a teacher mobile terminal, thereby enhancing data processing flexibility and improving user experience.

As shown in fig. 4, a data cooperative processing method provided in a fourth embodiment of the present invention specifically includes the following steps:

s401, receiving an audio and video equipment information table and an equipment selection instruction corresponding to the audio and video equipment information table.

S402, generating audio and video equipment selection information according to the equipment selection instruction, and sending the audio and video equipment selection information to a recorder of a recording and broadcasting system so that the recorder marks video acquisition equipment and audio acquisition equipment corresponding to the audio and video equipment selection information.

S403, acquiring second target data acquired by the video acquisition equipment and the audio acquisition equipment corresponding to the audio and video equipment selection information according to the audio and video equipment information table, and receiving a data processing instruction.

The data processing instruction is an instruction directly input into the mobile terminal or an instruction sent by the recorder.

The data processing instruction at least comprises scene information.

In this embodiment, the scene information is specifically understood to be a scene, such as live broadcast, recorded broadcast, and guided broadcast, used to indicate that the second target data processed by the mobile device is to be applied.

Specifically, the mobile device determines addresses of the selected audio acquisition device and the video acquisition device according to address information in the received audio and video device information table, acquires audio data acquired by the audio acquisition device and video data acquired by the video acquisition device through a local area network by the corresponding addresses, and combines the video data and the audio data to determine second target data. After the second target data is acquired, the mobile device receives a data processing instruction directly input by an external user or receives a data processing instruction sent by a recorder in communication connection with the mobile device in a local area network, and processes the second target data according to the data processing instruction.

Optionally, the embodiment of the present invention further provides another method for obtaining second target data, after sending the audio and video device selection information to the recorder, the method further includes: and receiving second target data which are transmitted by the radio recorder, are acquired by the video acquisition equipment and the audio acquisition equipment corresponding to the audio and video equipment selection information, and processing the second target data according to the received data processing instruction.

Specifically, for the acquisition of the second target data, the mobile device may also directly receive the second target data acquired by the recorder through the local area network from the recorder connected with the mobile device, that is, the mobile device does not directly acquire the acquired data of the selected audio/video device, but the recorder acquires the acquired data from the corresponding video acquisition device and the audio acquisition device according to the audio/video device selection information transmitted by the recorder, and combines the acquired data into the second target data to be transmitted to the mobile device.

In the embodiment of the invention, the mobile equipment directly acquires the second target data, so that the data transmission pressure of the recorder can be reduced, and the data processing efficiency of the recorder system can be improved; the second target data are acquired by the recorder and forwarded to the mobile device, so that the data acquired by each video acquisition device and each audio acquisition device are distributed by the recorder, the consistency of data distribution in the recorder system is ensured, the data distribution precision is ensured, the data processing failure caused by the data acquisition failure of the mobile device is reduced, and the acquisition and transmission modes of the data acquired by the audio acquisition device and the video acquisition device are not limited in the embodiment of the invention.

S404, determining a target path according to scene information in the data processing instruction, processing second target data, and storing or pushing according to the target path.

In this embodiment, the target path may be specifically understood as path information where the processed second target data is to be pushed or stored.

Specifically, because the scene information is different, the requirement for displaying or storing the processed second target data is different, the data flow direction of the processed second target data, that is, the target path, can be determined according to the scene information, and after the target path is determined, the second target data can be processed and stored or pushed through the target path.

Further, determining a target path according to scene information in the data processing instruction, and storing or pushing second target data according to the target path after processing, which can be specifically divided into the following cases:

a2, if the scene information is a recording scene, determining a transmission path of the recorder as a target path, processing second target data, and pushing the second target data to the recorder according to the target path so that the recorder stores the processed second target data;

B2, if the scene information is a live scene, determining a public network path corresponding to the live scene as a target path, processing second target data and pushing according to the target path;

and C2, if the scene information is the guided broadcast scene, determining the data to be displayed from the processed second target data according to the guided broadcast scene, determining a public network path corresponding to the guided broadcast scene as a target path, and pushing the data to be displayed according to the target path.

Specifically, when the scene information is a recorded scene, the mobile device can be considered to process the acquired second target data, and then the second target data is not required to be played and displayed, and only the processed data is required to be stored, but the processed second target data is required to be transmitted to the recorder by the mobile device because the processed data is always uniformly stored in the storage space of the recorder in the recorder, and then the transmission paths of the mobile device and the recorder are used as target paths, and after the second target data is processed, the processed second target data is pushed to the recorder according to the target storage path and then is stored in the storage space by the recorder. Exemplary processing means for the second target data may include, for example, denoising, conversion, alignment, fusion, encoding, and the like, which are not limited by the embodiment of the present invention.

When the scene information is a live broadcast scene, the mobile device can be considered to display the acquired second target data through a specific channel after processing the second target data, and the live broadcast can be directly displayed outwards without transmitting the processed second target data back to the recorder for uploading, and when the recorder system starts the task to execute, a public network path which is required to display the video is definitely determined, at the moment, the public network path corresponding to the live broadcast scene can be determined as a target path, and after the second target data is processed in the example, the second target data is pushed and played according to the target path, so that the live broadcast of the processed second target data is realized.

When the scene information is a broadcasting guide scene, the mobile device can be considered to switch and display the data from different video acquisition devices and audio acquisition devices in the second target data, namely, only part of the processed second target data is displayed through a specific channel, at the moment, according to the requirement of the broadcasting guide scene, the data to be pushed is selected from the processed second target data, a public network path of a live broadcast task corresponding to the broadcasting guide scene is determined as a target path for pushing and playing the data to be displayed, and the path to be displayed is pushed and played through the target path so as to realize broadcasting guide in the broadcasting guide process.

Further, when the scene information is a recorded broadcast scene, the mobile device can receive a guide instruction given by an external input or by a recording and broadcasting machine connected with the mobile device, the guide instruction can be given by an automatic guide control program or is a manual guide input, further different channels in which the mobile device needs to display the processed second target data are clear, data to be displayed in the different channels can be determined, and target paths corresponding to the data to be displayed can be determined, so that a guide task of the second target data is realized.

In the embodiment of the invention, the mobile equipment can execute operations such as storage, live broadcast, guide broadcast and the like on the data processed by the mobile equipment, and the data is not required to be transmitted to a record player for processing, so that the data traffic in a record broadcast system is reduced, and the data processing efficiency is improved.

and watermarking and/or filtering the second target data according to the video image processing instruction, and determining the second target data subjected to watermarking and/or filtering as new second target data.

Specifically, before determining the target path according to the scene information in the data processing instruction, if the mobile device determines that the data processing instruction further includes the video image processing instruction, it may be considered that the video data in the second target data needs to be modified, at this time, the video data in the second target data is correspondingly modified according to the type of the video image processing instruction, the modified video data is updated to the original second target data, so as to obtain new second target data, and then after the new second target data is processed as in the above example, the new second target data is stored or pushed according to the target path.

Further, if the mobile device is a teacher mobile terminal, determining a target path according to the scene information in the data processing instruction when the scene information is a recorded scene, and storing or pushing second target data according to the target path after processing, and further comprising:

and determining the storage path of the teacher mobile terminal as a target path, processing the second target data, and storing according to the target path.

In this embodiment, the teacher mobile terminal may be specifically understood as a mobile device held by the teacher in the recording and playing system.

Specifically, the device for processing data in the recording and playing system is a mobile device, and when the mobile device is a teacher mobile terminal held by a teacher, the data processed by the mobile device may be directly stored in the mobile device, that is, when the scene information is a recording scene, the storage path of the teacher mobile terminal may be determined as a target path, and after the second target data is processed as in the above example, the second target data is stored in the storage space of the teacher mobile terminal according to the target path.

It can be understood that, some teachers have a requirement of acquiring recorded video after recording online courses, in the traditional recording and broadcasting system, if the teacher needs to acquire recorded data, the teacher needs to insert a USB flash disk on a recording and broadcasting machine to copy the recorded video, or after the recording and broadcasting machine uploads the video to a server or a cloud end, the teacher accesses the server or the public network cloud end to download the video, and therefore the problems of troublesome operation, slower speed and larger security risk all exist. In the embodiment of the invention, as the mobile equipment can perform data processing, when the mobile equipment is a teacher mobile terminal, the teacher can select the video acquisition equipment and the audio acquisition equipment which want to record and copy as the data source by himself, and after the data of the data source is processed and recorded, the data is stored in the teacher mobile terminal, so that the mobile equipment can be directly taken away after recording and broadcasting, the time required by copying or downloading is avoided, and the safety risk caused by copying is reduced.

According to the technical scheme, the mobile device determines the video acquisition device and the audio acquisition device for acquiring the data which the mobile device wants to process, so that the recorder does not need to acquire, forward and process the part of data, the data quantity required to be processed by the recorder is reduced, the data processing efficiency is improved, and the construction cost of a recording and playing system is reduced. When the mobile device is a teacher mobile terminal, the processed data can be directly stored in the mobile device, the processed data is not required to be transmitted to the recording and broadcasting machine, then the recording and broadcasting machine is used for copying, the recording and broadcasting machine is used for uploading the processed data and then the server or the cloud is used for downloading the processed data, the flexibility of data processing of the recording and broadcasting system is enhanced, the time required for acquiring the recorded video is reduced, and meanwhile the safety risk for acquiring the recorded video is reduced.

Example five

Fig. 5 is a schematic structural diagram of a data co-processing device according to a fifth embodiment of the present invention, where the data co-processing device can be applied to a recorder of a recording and playing system. The data co-processing device includes: an information table generation module 51, a target device determination module 52 and a first data processing module 53.

The information table generating module 51 is configured to generate an audio and video device information table according to the obtained address information of each video acquisition device and each audio acquisition device in the recording and playing system, and send the audio and video device information table to each mobile device in the recording and playing system respectively; the target device determining module 52 is configured to receive the audio and video device selection information of each mobile device, and determine a target video acquisition device and a target audio acquisition device according to the audio and video device selection information and the audio and video device information table; the first data processing module 53 is configured to acquire first target data acquired by the target video acquisition device and the target audio acquisition device, and process the first target data according to the received data processing instruction.

According to the technical scheme, before the recording and broadcasting system records or broadcasts online videos, the data flow directions of all video acquisition devices and all audio acquisition devices in the recording and broadcasting system are determined, so that the recording and broadcasting machine only needs to process audio and video data which are not processed by the mobile device, and the mobile device is not required to be forwarded by the recording and broadcasting machine, the problem that data processing in the existing recording and broadcasting process is completely dependent on the computing capacity of the recording and broadcasting machine is solved, the data processing pressure of the recording and broadcasting machine in the recording and broadcasting system and the data quantity of the recording and broadcasting machine which needs to be transmitted in the data processing process are reduced, the data processing efficiency is improved, the construction cost of the recording and broadcasting system is reduced, and the user experience is improved.

Optionally, the target device determining module 52 includes:

and the video equipment determining unit is used for determining the video acquisition equipment which is not contained in the audio and video equipment selection information in the audio and video equipment list as target video acquisition equipment.

And the audio device determining unit is used for determining the audio acquisition device which is not contained in the audio and video device selection information in the audio and video device list as a target audio acquisition device.

Optionally, the first data processing module 53 includes:

and the first data acquisition unit is used for acquiring first target data acquired by the target video acquisition device and the target audio acquisition device.

The first data processing unit is used for determining a target path according to scene information in the data processing instruction, processing the first target data and then storing or pushing the first target data according to the target path; the data processing instruction at least comprises scene information, and the data processing instruction is an instruction directly input into the recorder or an instruction sent by the mobile equipment.

Optionally, the first data processing unit is specifically configured to:

if the scene information is a recording scene, determining a storage path of the recorder as a target path, processing first target data and storing the first target data according to the target path;

if the scene information is a live scene, determining a public network path corresponding to the live scene as a target path, processing first target data, and pushing according to the target path;

if the scene information is the guide scene, determining the data to be displayed from the processed first target data according to the guide scene, determining a public network path corresponding to the guide scene as a target path, and pushing the data to be displayed according to the target path.

Optionally, the data processing instruction further includes a video image processing instruction, and the first data processing module 53 further includes:

and the image processing unit is used for carrying out watermarking and/or filter addition on the first target data according to the video image processing instruction before determining the target path according to the scene information in the data processing instruction, and determining the first target data subjected to watermarking and/or filter addition as new first target data.

Optionally, the data co-processing device further includes:

and the equipment labeling module is used for labeling the video acquisition equipment and the audio acquisition equipment corresponding to the audio and video equipment selection information according to the corresponding relation between the audio and video equipment selection information and the mobile equipment when the audio and video equipment selection information of each mobile equipment is received.

Optionally, the data co-processing device further includes:

the data acquisition and forwarding module is used for acquiring the data to be processed, which corresponds to the audio and video equipment selection information, acquired by the video acquisition equipment and the audio acquisition equipment after receiving the audio and video equipment selection information of each mobile equipment, and forwarding the data to be processed to the mobile equipment corresponding to the audio and video equipment selection information so as to enable the mobile equipment to process the data to be processed.

Optionally, the data co-processing device further includes:

and the data storage module is used for receiving and storing the processed data fed back by each mobile device after receiving the audio and video device selection information of each mobile device.

The data cooperative processing device provided by the embodiment of the invention can execute the data cooperative processing method provided by the first embodiment and the second embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.

Example six

Fig. 6 is a schematic structural diagram of a data co-processing device according to a sixth embodiment of the present invention, where the data co-processing device may be applied to a mobile device of a recording and playing system. The data co-processing device includes: an instruction receiving module 61, an information transmitting module 62 and a second data processing module 63.

The instruction receiving module 61 is configured to receive an audio and video device information table and a device selection instruction corresponding to the audio and video device information table; the information sending module 62 is configured to generate audio and video device selection information according to the device selection instruction, and send the audio and video device selection information to a recorder of the recording and playing system, so that the recorder marks the video acquisition device and the audio acquisition device corresponding to the audio and video device selection information; and the second data processing module 63 is configured to obtain, according to the audio and video device information table, second target data acquired by the video acquisition device and the audio acquisition device corresponding to the audio and video device selection information, and process the second target data according to the received data processing instruction.

According to the technical scheme, before the recording and broadcasting system records or broadcasts online videos, mobile equipment in the recording and broadcasting system selects data sources to be processed by the mobile equipment through an audio and video equipment information table given by the recording and broadcasting machine, corresponding audio and video equipment selection information is generated and sent to the recording and broadcasting machine, and the recording and broadcasting machine can correspondingly mark data flow directions of all equipment. The mobile device can directly acquire data from the selected video acquisition device and audio acquisition device without forwarding the acquired data by the recorder or participating in the processing work of the data in the recorder, so that the problem that the computing capacity of the recorder is completely depended on in the existing recording and broadcasting process is solved, the data processing pressure of the recorder in the recording and broadcasting system and the data volume required to be transmitted by the recorder in the data processing process are reduced, the data processing efficiency is improved, the construction cost of the recording and broadcasting system is reduced, and the user experience is improved. Furthermore, as the audio and video equipment selection information is generated based on the self requirements of the mobile equipment and the data processing capacity, the adaptability of the task execution of the recording and broadcasting system and the adaptation degree of the mobile equipment and the processed data are improved, the data processed by the mobile equipment cannot exceed the data processing capacity of the mobile equipment, the stability of the task execution process of the recording and broadcasting system is ensured, and the user experience is improved.

Optionally, the second data processing module 63 includes:

the second data acquisition unit is used for acquiring second target data acquired by the video acquisition equipment and the audio acquisition equipment corresponding to the audio and video equipment selection information according to the audio and video equipment information table;

the second data processing unit is used for determining a target path according to scene information in the data processing instruction, processing second target data and storing or pushing the second target data according to the target path; the data processing instruction at least comprises scene information, and the data processing instruction is an instruction directly input into the mobile terminal or an instruction sent by the recorder.

Optionally, the second data processing unit is specifically configured to:

if the scene information is a recording scene, determining a transmission path of the recorder and the player as a target path, processing second target data, and pushing the second target data to the recorder and the player according to the target path so that the recorder and the player store the processed second target data;

if the scene information is a live scene, determining a public network path corresponding to the live scene as a target path, processing second target data, and pushing according to the target path;

if the scene information is the guide scene, determining the data to be displayed from the processed second target data according to the guide scene, determining a public network path corresponding to the guide scene as a target path, and pushing the data to be displayed according to the target path.

Optionally, the data processing instruction further includes a video image processing instruction, and the second data processing module 63 further includes:

and the image processing unit is used for carrying out watermark adding and/or filter adding on the second target data according to the video image processing instruction before determining the target path according to the scene information in the data processing instruction, and determining the second target data subjected to watermark adding and/or filter adding as new second target data.

Optionally, the data co-processing device further includes:

and the data receiving module is used for receiving second target data which is transmitted by the recorder and is acquired by the video acquisition equipment and the audio acquisition equipment corresponding to the audio and video equipment selection information after the audio and video equipment selection information is transmitted to the recorder.

Further, if the mobile device is a teacher mobile terminal, the second data processing unit is further configured to:

The data cooperative processing device provided by the embodiment of the invention can execute the data cooperative processing method provided by the third embodiment and the fourth embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.

Example seven

Fig. 7 is a schematic structural diagram of a recording and playing system according to a seventh embodiment of the present invention, where, as shown in fig. 7, the recording and playing system includes: the recorder 71, at least one mobile device 72, at least one video acquisition device 73 and at least one audio acquisition device 74, wherein the devices in the recorder system are in the same local area network, two mobile devices 72, two video acquisition devices 73 and two audio acquisition devices 74 are exemplified in fig. 7. As shown in fig. 7, the dashed lines represent that the data collected by the target video collection device 731 and the target audio collection device 741 can also be obtained by the recorder 71.

The recorder 71 is configured to obtain address information of each video capturing device 73 and each audio capturing device 74, generate an audio/video device information table, and send the audio/video device information table to each mobile device 72;

the mobile device 72 is configured to receive the audio and video device information table and a device selection instruction corresponding to the audio and video device information table, generate audio and video device selection information according to the device selection instruction, and send the audio and video device selection information to the recorder/reproducer 71;

the recorder 71 is configured to label the video capturing device 73 and the audio capturing device 74 corresponding to the audio and video device selection information according to the received correspondence between the audio and video device selection information and the mobile device 72;

The recorder 71 is further configured to determine, according to the audio/video device selection information and the audio/video device information table, a target video acquisition device 731 and a target audio acquisition device 741, acquire first target data acquired by the target video acquisition device 731 and the target audio acquisition device 741, and process the first target data according to the received data processing instruction;

the mobile device 72 is further configured to obtain, according to the audio and video device information table, second target data acquired by the video acquisition device 73 and the audio acquisition device 74 corresponding to the audio and video device selection information, and process the second target data according to the received data processing instruction.

The technical scheme of the embodiment of the invention solves the problem that the calculation capability of the recorder is completely depended on in the existing recording and broadcasting process, reduces the data processing pressure of the recorder in the recording and broadcasting system and the data quantity required to be transmitted by the recorder in the data processing process, improves the data processing efficiency, reduces the construction cost of the recording and broadcasting system and improves the user experience.

Further, when the mobile device 72 is a teacher mobile terminal, the mobile device 72 is further configured to determine a storage path of the teacher mobile terminal as a target path, process the second target data, and store the second target data according to the target path.

The recording and broadcasting system provided by the embodiment of the invention can execute the data cooperative processing method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.

In some embodiments, the data co-processing method may be implemented as a computer program tangibly embodied on a computer-readable storage medium, such as a storage unit. In some embodiments, part or all of the computer program may be loaded and/or installed onto the data co-processing device via the ROM and/or the communication unit. One or more of the steps of the data co-processing method described above may be performed when the computer program is loaded into RAM and executed by a processor. Alternatively, in other embodiments, the processor may be configured to perform the data co-processing method in any other suitable manner (e.g., by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.

A computer program for carrying out methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be implemented. The computer program may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) through which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.

The computing system may include clients and servers. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical hosts and VPS service are overcome.

It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present invention may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present invention are achieved, and the present invention is not limited herein.

The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.

Claims

1. A method for collaborative processing of data, applied to a recorder of a recorder system, the method comprising:

generating an audio and video equipment information table according to the acquired address information of each video acquisition equipment and each audio acquisition equipment in the recording and playing system, and respectively transmitting the audio and video equipment information table to each mobile equipment in the recording and playing system;

receiving audio and video equipment selection information of each mobile equipment, and determining target video acquisition equipment and target audio acquisition equipment according to the audio and video equipment selection information and the audio and video equipment information table;

2. The method of claim 1, wherein determining the target video capture device and the target audio capture device based on each of the audio video device selection information and the audio video device information table comprises:

determining video acquisition equipment which is not contained in each piece of audio and video equipment selection information in the audio and video equipment list as target video acquisition equipment;

And determining the audio acquisition equipment which is not contained in the audio and video equipment selection information in the audio and video equipment list as target audio acquisition equipment.

3. The method of claim 1, wherein upon receiving the audiovisual device selection information for each of the mobile devices, further comprising:

and labeling the video acquisition equipment and the audio acquisition equipment corresponding to the audio and video equipment selection information according to the corresponding relation between the audio and video equipment selection information and the mobile equipment.

4. The method according to claim 1, wherein the data processing instruction includes at least scene information, and the processing the first target data according to the received data processing instruction includes:

determining a target path according to scene information in a data processing instruction, processing the first target data, and storing or pushing the first target data according to the target path;

the data processing instruction is an instruction for directly inputting the recorder or an instruction sent by the mobile equipment.

5. The method of claim 4, wherein determining a target path according to scene information in the data processing instruction, and storing or pushing the processed first target data according to the target path, comprises:

If the scene information is a recording scene, determining a storage path of the recorder as a target path, processing the first target data and then storing the first target data according to the target path;

if the scene information is a live broadcast scene, determining a public network path corresponding to the live broadcast scene as a target path, processing the first target data, and pushing according to the target path;

if the scene information is a guide scene, determining data to be displayed from the processed first target data according to the guide scene, determining a public network path corresponding to the guide scene as a target path, and pushing the data to be displayed according to the target path.

6. The method of claim 4, wherein if the data processing instruction further includes a video image processing instruction, before determining the target path according to the scene information in the data processing instruction, further comprising:

and carrying out watermark adding and/or filter adding on the first target data according to the video image processing instruction, and determining the first target data subjected to watermark adding and/or filter adding as new first target data.

7. The method of claim 1, further comprising, after said receiving audiovisual device selection information for each of said mobile devices:

and acquiring data to be processed, which corresponds to the audio and video equipment selection information, and forwarding the data to be processed to mobile equipment corresponding to the audio and video equipment selection information, so that the mobile equipment processes the data to be processed.

8. The method of claim 1, further comprising, after said receiving audiovisual device selection information for each of said mobile devices:

and receiving and storing the processed data fed back by each mobile device.

9. The data cooperative processing method is characterized by being applied to mobile equipment of a recording and broadcasting system, and comprises the following steps:

generating audio and video equipment selection information according to the equipment selection instruction, and sending the audio and video equipment selection information to a recorder of the recording and broadcasting system so that the recorder marks video acquisition equipment and audio acquisition equipment corresponding to the audio and video equipment selection information;

10. The method of claim 9, further comprising, after transmitting the audiovisual device selection information to a recorder of the recorder system:

and receiving second target data which are transmitted by the recorder, are acquired by the video acquisition equipment and the audio acquisition equipment corresponding to the audio and video equipment selection information, and processing the second target data according to the received data processing instruction.

11. The method according to claim 9 or 10, wherein the data processing instruction includes at least scene information, and the processing the second target data according to the received data processing instruction includes:

determining a target path according to scene information in a data processing instruction, processing the second target data, and storing or pushing the second target data according to the target path;

the data processing instruction is an instruction directly input to the mobile terminal or an instruction sent by the recorder.

12. The method of claim 11, wherein determining a target path according to the scene information in the data processing instruction, and storing or pushing the second target data according to the target path after processing, comprises:

if the scene information is a recording scene, determining a transmission path of the recorder and the player as a target path, processing the second target data, and pushing the second target data to the recorder and the player according to the target path so that the recorder and the player store the processed second target data;

if the scene information is a live broadcast scene, determining a public network path corresponding to the live broadcast scene as a target path, processing the second target data, and pushing according to the target path;

if the scene information is a guide scene, determining data to be displayed from the processed second target data according to the guide scene, determining a public network path corresponding to the guide scene as a target path, and pushing the data to be displayed according to the target path.

13. The method of claim 11, wherein if the data processing instruction further includes a video image processing instruction, before determining the target path according to the scene information in the data processing instruction, further comprising:

And carrying out watermark adding and/or filter adding on the second target data according to the video image processing instruction, and determining the second target data subjected to watermark adding and/or filter adding as new second target data.

14. The method of claim 12, wherein if the mobile device is a teacher mobile terminal, determining a target path according to the scene information in the data processing instruction when the scene information is a recorded scene, and storing or pushing the second target data according to the target path after processing the second target data, further comprising:

15. A data co-processing apparatus for use in a recorder of a recorder system, the apparatus comprising:

16. A data co-processing apparatus for use in a mobile device of a recording and playing system, the apparatus comprising:

the instruction receiving module is used for receiving an audio and video equipment information table and an equipment selection instruction corresponding to the audio and video equipment information table;

and the second data processing module is used for acquiring second target data acquired by the video acquisition equipment and the audio acquisition equipment corresponding to the audio and video equipment selection information according to the audio and video equipment information table, and processing the second target data according to the received data processing instruction.

17. A recording and broadcasting system, comprising: the system comprises a recording and broadcasting machine, at least one mobile device, at least one video acquisition device and at least one audio acquisition device, wherein all devices in the recording and broadcasting system are positioned in the same local area network;

the recorder is used for acquiring address information of each video acquisition device and each audio acquisition device, generating an audio and video device information table, and respectively transmitting the audio and video device information table to each mobile device;

the mobile equipment is used for receiving the audio and video equipment information table and equipment selection instructions corresponding to the audio and video equipment information table, generating audio and video equipment selection information according to the equipment selection instructions, and sending the audio and video equipment selection information to a recorder;

the recorder is used for marking the video acquisition equipment and the audio acquisition equipment corresponding to the audio and video equipment selection information according to the received corresponding relation between the audio and video equipment selection information and the mobile equipment;

the recording and broadcasting machine is further used for determining target video acquisition equipment and target audio acquisition equipment according to the audio and video equipment selection information and the audio and video equipment information table, acquiring first target data acquired by the target video acquisition equipment and the target audio acquisition equipment, and processing the first target data according to the received data processing instruction;

The mobile device is further configured to obtain, according to the audio and video device information table, second target data acquired by the video acquisition device and the audio acquisition device corresponding to the audio and video device selection information, and process the second target data according to the received data processing instruction.

18. A computer readable storage medium storing computer instructions for causing a processor to perform the data co-processing method of any one of claims 1-14.