CN111131727A - Video data processing method and device - Google Patents
Video data processing method and device Download PDFInfo
- Publication number
- CN111131727A CN111131727A CN201811290245.7A CN201811290245A CN111131727A CN 111131727 A CN111131727 A CN 111131727A CN 201811290245 A CN201811290245 A CN 201811290245A CN 111131727 A CN111131727 A CN 111131727A
- Authority
- CN
- China
- Prior art keywords
- video
- mixed
- flow
- participants
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
- G06V20/53—Recognition of crowd images, e.g. recognition of crowd congestion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
- H04N19/467—Embedding additional information in the video signal during the compression process characterised by the embedded information being invisible, e.g. watermarking
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a video data processing method and device. The method comprises the following steps: detecting whether the number of participants of the mixed video flow changes or not after the mixed video flow starts; when the number of participants of the mixed video flow changes, determining a corresponding template from preset mixed video flow templates according to the number of the participants of the mixed video flow after the change; replacing the position occupying information in the determined template with the identification information of the video of the participant waiting for the mixed video flow; and performing mixed flow synthesis on the video information in the video template. By the method and the device, the effect of dynamic video mixing is achieved according to the change of the number of participants in the remote video court trial.
Description
Technical Field
The present invention relates to the field of video processing, and in particular, to a method and an apparatus for processing video data.
Background
In the process of the remote court trial, the video streams of different participants are independent video streams, and in the process of the remote court trial or the video recorded in the remote court trial, it is difficult or impossible to visually distinguish each video stream corresponding to a specific role of a court trial participant, such as remote court trial role information of a judge, a notice, a source notice, a technical survey officer and the like. Secondly, for the mixed flow synthesis of the videos of all the participants in the remote court trial, the mixed flow setting of the video streams can be performed only after all the video streams of the participants exist, and the dynamic video mixed flow can not be performed according to the opportunity or state of the participants entering the court trial in the related technology.
Aiming at the problem that dynamic video mixing can not be carried out according to the change of the number of participants in the remote video court trial in the related technology, an effective solution is not provided at present.
Disclosure of Invention
The invention mainly aims to provide a video data processing method and a video data processing device, which are used for solving the problem that dynamic video mixing cannot be carried out according to the change of the number of participants in a remote video court trial.
In order to achieve the above object, according to an aspect of the present invention, there is provided a video data processing method including: detecting whether the number of participants of the mixed video flow changes or not after the mixed video flow starts; when the number of participants of the mixed video flow changes, determining a corresponding template from preset mixed video flow templates according to the number of the participants of the mixed video flow after the change; replacing the position occupying information in the determined template with the identification information of the video of the participant waiting for the mixed video flow; and performing mixed flow synthesis on the video information in the video template.
Further, determining a corresponding template from preset video mixed flow templates according to the number of the participants of the changed video mixed flow comprises: acquiring role identification information of participants of the mixed video stream; determining the roles of the participants of the changed video mixed flow according to the role identification information; and determining a corresponding template according to the number and roles of the participants of the changed video mixed flow.
Further, before determining the corresponding template according to the number and roles of the participants of the changed mixed video stream, the method further comprises: and judging whether the roles of the participants of the changed mixed video stream contain judges, wherein if the roles contain judges, the corresponding templates are determined according to the number and the roles of the participants of the changed mixed video stream, and if the roles do not contain judges, the corresponding templates are not determined.
Further, before determining the corresponding template according to the number and roles of the participants of the changed mixed video stream, the method further comprises: judging whether the current court trial state is an ongoing state; and if the video mixed flow is in the ongoing state, determining a corresponding template according to the number and the role of the participants of the changed video mixed flow, and if the video mixed flow is not in the ongoing state, not determining the corresponding template.
Further, before the video mixing starts, the method further comprises: receiving a video mixed flow triggering instruction; acquiring role information of all participants of which the video data are transmitted to the server in response to the trigger instruction; judging whether the role contains a judge or not; if the judge is included, video mixing is started.
Further, before the video mixing starts, the method further comprises: acquiring role information of a participant to be subjected to video mixing; determining corresponding watermark identification information according to the role information; and overlaying the watermark identification information to each frame of the video of the corresponding participant.
In order to achieve the above object, according to another aspect of the present invention, there is also provided a video data processing apparatus including: the detection unit is used for detecting whether the number of participants of the mixed video flow changes or not after the mixed video flow starts; the determining unit is used for determining a corresponding template from preset mixed video flow templates according to the number of the participants of the mixed video flow after the change when the number of the participants of the mixed video flow changes; the replacing unit is used for replacing the position occupying information in the determined template with the identification information of the video of the participant to be subjected to the mixed video flow; and the synthesizing unit is used for performing mixed flow synthesis on the video information in the video template.
Further, the determining unit includes: the acquisition module is used for acquiring role identification information of participants of the mixed video stream; the first determining module is used for determining the roles of the participants of the video mixed flow after the change according to the role identification information; and the second determining module is used for determining the corresponding template according to the number and the role of the participants of the changed mixed video stream.
In order to achieve the above object, according to another aspect of the present invention, there is also provided a storage medium including a stored program, wherein when the program runs, an apparatus in which the storage medium is located is controlled to execute the video data processing method of the present invention.
In order to achieve the above object, according to another aspect of the present invention, there is also provided a processor for executing a program, wherein the program executes to perform the video data processing method of the present invention.
According to the method, after the video mixed flow starts, whether the number of participants of the video mixed flow changes or not is detected; when the number of participants of the mixed video flow changes, determining a corresponding template from preset mixed video flow templates according to the number of the participants of the mixed video flow after the change; replacing the position occupying information in the determined template with the identification information of the video of the participant waiting for the mixed video flow; the video information in the video template is mixed and synthesized, so that the problem that the video mixing of the videos of all participants of the remote video court trial cannot be carried out is solved, and the effect of realizing dynamic video mixing according to the change of the number of participants of the remote video court trial is further achieved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments of the invention and, together with the description, serve to explain the invention and not to limit the invention. In the drawings:
fig. 1 is a flowchart of a video data processing method according to an embodiment of the present invention;
FIG. 2 is a flow chart of video watermarking and dynamic streaming according to an embodiment of the present invention;
FIG. 3 is a diagram of a forensic one-way video streaming effect according to an embodiment of the present invention;
FIG. 4 is a diagram of the effect of streaming a single video on a bill of lading according to an embodiment of the invention;
FIG. 5 is a flow diagram of mixed flow participant list screening and mixed flow condition checking logic according to an embodiment of the present invention;
FIG. 6 is a diagram illustrating the actual effect after mixing according to the embodiment of the present invention;
fig. 7 is a schematic diagram of a video data processing apparatus according to an embodiment of the present invention.
Detailed Description
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present invention will be described in detail below with reference to the embodiments with reference to the attached drawings.
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It should be understood that the data so used may be interchanged under appropriate circumstances such that embodiments of the application described herein may be used. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
For convenience of description, several terms referred to in the embodiments of the present application are explained below:
video mixed flow: the multiple video streams are mixed into one video stream according to a certain layout.
Video watermarking: the function of adding unique video mark information in the original video stream.
The embodiment of the invention provides a video data processing method.
Fig. 1 is a flowchart of a video data processing method according to an embodiment of the present invention, as shown in fig. 1, the method including the steps of:
step S102: detecting whether the number of participants of the mixed video flow changes or not after the mixed video flow starts;
step S104: when the number of participants of the mixed video flow changes, determining a corresponding template from preset mixed video flow templates according to the number of the participants of the mixed video flow after the change;
step S106: replacing the position occupying information in the determined template with the identification information of the video of the participant waiting for the mixed video flow;
step S108: and performing mixed flow synthesis on the video information in the video template.
The embodiment adopts the steps that after the video mixed flow starts, whether the number of participants of the video mixed flow changes or not is detected; when the number of participants of the mixed video flow changes, determining a corresponding template from preset mixed video flow templates according to the number of the participants of the mixed video flow after the change; replacing the position occupying information in the determined template with the identification information of the video of the participant waiting for the mixed video flow; the video information in the video template is mixed and synthesized, so that the problem that the video mixing of the videos of all participants of the remote video court trial cannot be carried out is solved, and the effect of realizing dynamic video mixing according to the change of the number of participants of the remote video court trial is achieved.
In the embodiment of the invention, the video mix-flow can be a video file synthesized by multi-end video data streams, wherein one application scene can be a remote court trial, one remote court trial can comprise a plurality of roles such as a judge, a plurality of parties and attorneys of the parties, and after normal video mix-flow is started, people may be accessed or offline from time to time, at this time, real-time video mix-flow needs to be performed according to the change of the number of people, otherwise, video content of a newly accessed user cannot be recorded in the court trial video, so that much information is lost, or if a certain user is offline, the video position of the user becomes a black screen, so that the overall effect of the court trial video is also affected, the technical scheme of the embodiment of the invention detects the change of the number of participants after the start of the mix-flow video, determines a new template according to the changed number, performs the video mix-flow by using the new template, can solve the problem caused by no dynamic flow mixing in the related technology.
Optionally, determining a corresponding template from the preset mixed video stream templates according to the number of participants of the changed mixed video stream includes: acquiring role identification information of participants of the mixed video stream; determining the roles of the participants of the changed video mixed flow according to the role identification information; and determining a corresponding template according to the number and roles of the participants of the changed video mixed flow.
After the number of participants of the mixed video stream changes, a new template can be determined according to the number and roles of new participants when the template is reselected, so that the arrangement of each role in the mixed video stream conforms to a preset rule, for example, a judge is on the left side, a principal and an agent thereof are always in a line, and the like.
Optionally, before determining the corresponding template according to the number and the role of the participants of the changed mixed video stream, determining whether the role of the participants of the changed mixed video stream includes a judge, wherein if the judge includes the judge, the corresponding template is determined according to the number and the role of the participants of the changed mixed video stream, and if the judge does not include the judge, the corresponding template is not determined.
Due to the identity particularity of the judges, in the court trial process, if no judge participates, the whole court trial video is invalid, so that whether the current participants contain the judges or not needs to be judged before the templates are determined again after the number of people changes, if yes, the templates can be selected for mixing, if not, the next step is not executed, and after the judges are accessed, the templates are determined and mixed.
Optionally, before determining a corresponding template according to the number and roles of the participants of the changed mixed video stream, judging whether the current court trial state is an ongoing state; and if the video mixed flow is in the ongoing state, determining a corresponding template according to the number and the role of the participants of the changed video mixed flow, and if the video mixed flow is not in the ongoing state, not determining the corresponding template.
When the number of the participants in the mixed video stream changes, the mixed video stream may be in a state of finishing a court trial or pausing, and the like, and when the number of the participants changes in the abnormal court trial, the template does not need to be determined again for dynamic mixing, so that whether the current court trial state is the ongoing state or not needs to be judged before the template is determined, if so, the template is adjusted according to the change of the number of the participants, and if not, the template is not determined again.
Optionally, before the video mixing starts, receiving a video mixing triggering instruction; acquiring role information of all participants of which the video data are transmitted to the server in response to a trigger instruction; judging whether the role contains a judge or not; if the judge is included, video mixing is started.
Before a new mixed video stream starts, but not in the process of adjusting the template midway, whether the video data of the role of the judge has been successfully transmitted to the server needs to be judged, if the video data has been successfully transmitted to the server, the stream pushing is successful, the mixed video stream can be started only if the role of the stream pushing success contains the judge, and otherwise, the mixed video stream is not performed.
Optionally, before the video mixing flow starts, role information of a participant to be subjected to the video mixing flow is acquired; determining corresponding watermark identification information according to the role information; and overlaying the watermark identification information to each frame of the video of the corresponding participant.
Before video mixing and before video data are transmitted to a server, watermark identification is marked on the video data of each role, so that the video position of each role in the mixed video has corresponding role watermark information, the subsequent reading of files is convenient for distinguishing different roles, the superposed role watermarks can be watermarks in a preset picture form or pure character watermarks, and the preset watermark information is superposed on each frame of video pictures of the corresponding roles.
According to the technical scheme of the embodiment of the invention, when each path of video stream is rendered, the role information watermark is added to each frame of video, so that the problem that different participant video streams cannot be distinguished in the remote court trial process and the mixed video recording process is solved; the problems that the number of participants and the video stream state are calculated, and the mixed stream recording template is dynamically calculated and selected are solved, so that the participants cannot be dynamically loaded in the mixed stream recording in the remote court trial, and the mixed stream recording template cannot be matched.
Therefore, the technical scheme of the embodiment of the invention can effectively solve the problem of role differentiation in the remote court trial and the video recorded in the video of the video court trial, and the problem of mixed-flow video recording scheme for dynamically loading a plurality of people in the remote court trial, and effectively solve the problem of pain points in the remote court trial about mixed-flow video dynamic loading and video recording, wherein the pain points can not distinguish court trial roles.
The embodiment of the invention also provides a preferred implementation mode.
Fig. 2 is a flow chart of video watermarking and dynamic streaming according to an embodiment of the present invention. As shown in fig. 2, the method includes the following steps:
1. in the remote court trial, a judge clicks to start the court trial through a client, triggers the judge end and other participants (parties or agents and the like) to perform video plug-streaming, different clients screen corresponding watermark role information resources through court trial roles of different loggers, the client performs video plug-streaming, watermark resource information is added for each frame of video stream, then each frame of video stream after synthesis is pushed to a mixed flow service module, video stream pictures with watermarks of different role information added can be seen in the pictures of the remote court trial, and the single-path video stream watermark effect is shown in fig. 3 and 4.
2. After different party ends and judge ends successfully push streams, the push stream state of each court trial participant is recorded by calling a rear-end service interface, and a polling module of the rear-end service inquires the push stream state of the local remote court trial to acquire list information of all participants in the remote court trial.
3. Screening a remote court trial participant list through mixed flow screening logic to obtain participant list information with a successful plug flow state; and judging whether the mixed flow condition is met; and screening the corresponding mixed flow template according to the total number of the screened participants who accord with the mixed flow condition.
FIG. 5 is a flow chart of the mixed flow participant list screening and mixed flow condition checking logic according to an embodiment of the invention, as shown in FIG. 5: the mixed flow check logic mainly comprises the following steps:
1) judging the plug flow state of each participant, and screening out remote trial participant list information with the plug flow state of 1 (plug flow success), wherein the list information comprises basic information such as role information, plug flow Id, role Id and the like.
2) And checking the current remote court trial conference state, and directly returning without performing mixed flow subsequent operation when the current conference state is a pause state, an end state, a cancel state and a non-start state.
3) And after the judgment of the state of the remote court trial meeting, checking whether the current mixed flow list personnel contain the information of a judge, if so, executing subsequent mixed flow logic, and if not, not executing the subsequent mixed flow logic. The forensic officer information needs to be checked, and the purpose is that mixed video is equivalent to the video stream composition of multiple videos, and other video streams need to be mixed on the video stream of one path of basis based on one path of video stream to achieve the mixed video effect of the multiple paths of video streams.
4. Obtaining an appointed mixed flow template, associating video streams of a personnel list needing mixed flow to a template position corresponding to the mixed flow template according to matching of role information in the personnel list in the remote court trial and key placeholders in the mixed flow template, enabling each mixed flow template to contain placeholder information such as main video stream placeholder, party placeholder and other person placeholder, performing matching according to the personnel list meeting mixed flow conditions in the remote court trial, enabling a judge role to match the main video stream placeholder, enabling an original notice, a notice, an agent to match the party placeholder, a technical survey officer to match the other person placeholder, calculating a real video stream ID of each participant, and replacing the real video stream ID with the placeholder ID corresponding to the mixed flow template.
5. And calling an execution mixed flow interface to perform mixed flow setting according to the mixed flow template data after actual replacement, and performing video flow mixed flow through an API (application program interface) of mixed flow service.
6. And the judge end and the party end call the rear end interface to reset the plug-flow state information of the participant in the current remote court trial when the client end is quitted or the video stream is closed. When the participants start by a judge or a client of the party or the judge controls the operations of beginning court trial, opening again after a court, and the like, the plug flow is executed again and the plug flow state is updated to trigger the mixed flow request, so as to achieve the operations of mixed flow again and mixed flow again.
7. After a remote court trial is started, after current mixed flow is successfully executed, when the situation that a party is disconnected or newly added exists, the party logs in through a client to trigger a flow pushing operation, after the flow pushing is successful, the back end is informed of the existence of the new operation or the operation of re-entering, the back end executes mixed flow related logic according to a newly inquired mixed flow state personnel list, an actually required mixed flow rendering template is modified, and the functions of dynamically selecting the mixed flow template and dynamically mixing the flow are achieved.
8. After the mixed flow is successful, each path of video stream is typeset and rendered according to the typesetting of the mixed flow template and contains watermark role information of the remote court trial, and the actual effect graph after the mixed flow is shown in fig. 6.
The scheme effectively solves the problem that the role affiliation of each video stream in the remote court trial cannot be distinguished in the process of the remote court trial and in the video recording, so that the recorded content of the remote court trial video can become legal and effective electronic file information and basis. The remote court trial dynamic mixed flow algorithm effectively solves the problem of video recording when a party is newly added or disconnected in the court trial process, improves the accuracy of video recording in the remote court trial, and improves the flexibility of video recording in the remote court trial. And dynamically selecting a template according to the actual mixed-flow participant list, improving the display of the remote court trial video mixed-flow template to the maximum extent, and adjusting the occupation matching of the video stream template according to actual needs.
It should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowcharts, in some cases, the steps illustrated or described may be performed in an order different than presented herein.
Embodiments of the present invention provide a video data processing apparatus, which may be used to execute a video data processing method according to an embodiment of the present invention.
Fig. 7 is a schematic diagram of a video data processing apparatus according to an embodiment of the present invention, as shown in fig. 7, the apparatus including:
the detecting unit 10 is used for detecting whether the number of participants of the mixed video flow changes after the mixed video flow starts;
the determining unit 20 is configured to determine, when the number of participants of the mixed video stream changes, a corresponding template from preset mixed video stream templates according to the number of participants of the mixed video stream after the change;
a replacing unit 30, configured to replace the position-occupying information in the determined template with identification information of a video of a participant to be video mixed flow;
and the synthesizing unit 40 is used for performing mixed flow synthesis on the video information in the video template.
The embodiment adopts a detection unit 10 for detecting whether the number of participants of the mixed video flow changes after the mixed video flow starts; the determining unit 20 is configured to determine, when the number of participants of the mixed video stream changes, a corresponding template from preset mixed video stream templates according to the number of participants of the mixed video stream after the change; a replacing unit 30, configured to replace the position-occupying information in the determined template with identification information of a video of a participant to be video mixed flow; and the synthesizing unit 40 is used for performing mixed flow synthesis on the video information in the video template, so that the problem that video mixing of videos of all participants of the remote video court trial cannot be performed is solved, and the effect of realizing dynamic video mixing according to the change of the number of participants of the remote video court trial is achieved.
Optionally, the determining unit 20 includes: the acquisition module is used for acquiring role identification information of participants of the mixed video stream; the first determining module is used for determining the roles of the participants of the video mixed flow after the change according to the role identification information; and the second determining module is used for determining the corresponding template according to the number and the role of the participants of the changed mixed video stream.
The video data processing device comprises a processor and a memory, wherein the detection unit, the determination unit and the like are stored in the memory as program units, and the processor executes the program units stored in the memory to realize corresponding functions.
The processor comprises a kernel, and the kernel calls the corresponding program unit from the memory. One or more than one inner core can be set, and dynamic video mixing is realized according to the change of the number of participants in the remote video court trial by adjusting the inner core parameters.
The memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.
An embodiment of the present invention provides a storage medium having a program stored thereon, which when executed by a processor implements the video data processing method.
The embodiment of the invention provides a processor, which is used for running a program, wherein the video data processing method is executed when the program runs.
The embodiment of the invention provides equipment, which comprises a processor, a memory and a program which is stored on the memory and can run on the processor, wherein the processor executes the program and realizes the following steps: detecting whether the number of participants of the mixed video flow changes or not after the mixed video flow starts; when the number of participants of the mixed video flow changes, determining a corresponding template from preset mixed video flow templates according to the number of the participants of the mixed video flow after the change; replacing the position occupying information in the determined template with the identification information of the video of the participant waiting for the mixed video flow; and performing mixed flow synthesis on the video information in the video template. The device herein may be a server, a PC, a PAD, a mobile phone, etc.
The present application further provides a computer program product adapted to perform a program for initializing the following method steps when executed on a data processing device: detecting whether the number of participants of the mixed video flow changes or not after the mixed video flow starts; when the number of participants of the mixed video flow changes, determining a corresponding template from preset mixed video flow templates according to the number of the participants of the mixed video flow after the change; replacing the position occupying information in the determined template with the identification information of the video of the participant waiting for the mixed video flow; and performing mixed flow synthesis on the video information in the video template.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (10)
1. A method of processing video data, comprising:
detecting whether the number of participants of the mixed video flow changes or not after the mixed video flow starts;
when the number of participants of the mixed video flow changes, determining a corresponding template from preset mixed video flow templates according to the number of the participants of the mixed video flow after the change;
replacing the position occupying information in the determined template with the identification information of the video of the participant waiting for the mixed video flow;
and performing mixed flow synthesis on the video information in the video template.
2. The method of claim 1, wherein determining the corresponding template from the preset mixed video stream templates according to the number of participants of the changed mixed video stream comprises:
acquiring role identification information of participants of the mixed video stream;
determining the roles of the participants of the changed video mixed flow according to the role identification information;
and determining a corresponding template according to the number and roles of the participants of the changed video mixed flow.
3. The method of claim 2, wherein prior to determining the corresponding template based on the number and role of participants in the changed video mix, the method further comprises:
judging whether the roles of the participants of the video mixed flow after change contain judges,
and if the judge is included, determining the corresponding template according to the number and the role of the participants of the changed video mixed flow, and if the judge is not included, not determining the corresponding template.
4. The method of claim 1, wherein prior to determining the corresponding template based on the number and role of participants in the changed video mix, the method further comprises:
judging whether the current court trial state is an ongoing state;
and if the video mixed flow is in the ongoing state, determining a corresponding template according to the number and the role of the participants of the changed video mixed flow, and if the video mixed flow is not in the ongoing state, not determining the corresponding template.
5. The method of claim 1, wherein before the video blending begins, the method further comprises:
receiving a video mixed flow triggering instruction;
acquiring role information of all participants of which the video data are transmitted to the server in response to the trigger instruction;
judging whether the role contains a judge or not;
if the judge is included, video mixing is started.
6. The method of claim 1, wherein before the video blending begins, the method further comprises:
acquiring role information of a participant to be subjected to video mixing;
determining corresponding watermark identification information according to the role information;
and overlaying the watermark identification information to each frame of the video of the corresponding participant.
7. A video data processing apparatus, comprising:
the detection unit is used for detecting whether the number of participants of the mixed video flow changes or not after the mixed video flow starts;
the determining unit is used for determining a corresponding template from preset mixed video flow templates according to the number of the participants of the mixed video flow after the change when the number of the participants of the mixed video flow changes;
the replacing unit is used for replacing the position occupying information in the determined template with the identification information of the video of the participant to be subjected to the mixed video flow;
and the synthesizing unit is used for performing mixed flow synthesis on the video information in the video template.
8. The apparatus of claim 7, wherein the determining unit comprises:
the acquisition module is used for acquiring role identification information of participants of the mixed video stream;
the first determining module is used for determining the roles of the participants of the video mixed flow after the change according to the role identification information;
and the second determining module is used for determining the corresponding template according to the number and the role of the participants of the changed mixed video stream.
9. A storage medium, characterized in that the storage medium includes a stored program, wherein an apparatus in which the storage medium is located is controlled to execute the video data processing method according to any one of claims 1 to 6 when the program is executed.
10. A processor, characterized in that the processor is configured to run a program, wherein the program is configured to execute the video data processing method according to any one of claims 1 to 6 when running.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811290245.7A CN111131727A (en) | 2018-10-31 | 2018-10-31 | Video data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811290245.7A CN111131727A (en) | 2018-10-31 | 2018-10-31 | Video data processing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111131727A true CN111131727A (en) | 2020-05-08 |
Family
ID=70494374
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811290245.7A Pending CN111131727A (en) | 2018-10-31 | 2018-10-31 | Video data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111131727A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112261316A (en) * | 2020-09-22 | 2021-01-22 | 深圳市奥拓电子股份有限公司 | Method, device and system for switching scenes by video stitching processor |
| CN115209215A (en) * | 2021-04-09 | 2022-10-18 | 北京字跳网络技术有限公司 | Video processing method, device and equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040257433A1 (en) * | 2003-06-20 | 2004-12-23 | Lia Tom Erik | Method and apparatus for video conferencing having dynamic picture layout |
| CN101945245A (en) * | 2010-09-06 | 2011-01-12 | 华为终端有限公司 | Realizing method, device and system of video conference application |
| JP2016001443A (en) * | 2014-06-12 | 2016-01-07 | 日本電信電話株式会社 | Meeting support system, control device therefor, meeting support method and program |
| CN106878658A (en) * | 2011-02-09 | 2017-06-20 | 宝利通公司 | Automatic video layout for multi-stream multi-site telepresence conferencing systems |
| CN108391078A (en) * | 2018-02-26 | 2018-08-10 | 苏州科达科技股份有限公司 | Determination method, system, equipment and the storage medium of watermark embedded location in video |
-
2018
- 2018-10-31 CN CN201811290245.7A patent/CN111131727A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040257433A1 (en) * | 2003-06-20 | 2004-12-23 | Lia Tom Erik | Method and apparatus for video conferencing having dynamic picture layout |
| CN101945245A (en) * | 2010-09-06 | 2011-01-12 | 华为终端有限公司 | Realizing method, device and system of video conference application |
| CN106878658A (en) * | 2011-02-09 | 2017-06-20 | 宝利通公司 | Automatic video layout for multi-stream multi-site telepresence conferencing systems |
| JP2016001443A (en) * | 2014-06-12 | 2016-01-07 | 日本電信電話株式会社 | Meeting support system, control device therefor, meeting support method and program |
| CN108391078A (en) * | 2018-02-26 | 2018-08-10 | 苏州科达科技股份有限公司 | Determination method, system, equipment and the storage medium of watermark embedded location in video |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112261316A (en) * | 2020-09-22 | 2021-01-22 | 深圳市奥拓电子股份有限公司 | Method, device and system for switching scenes by video stitching processor |
| CN115209215A (en) * | 2021-04-09 | 2022-10-18 | 北京字跳网络技术有限公司 | Video processing method, device and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11562021B2 (en) | Coordinating communication and/or storage based on image analysis | |
| CN109660823A (en) | Video distribution method, apparatus, electronic equipment and storage medium | |
| CN108683826B (en) | Video data processing method, video data processing device, computer equipment and storage medium | |
| US20180225854A1 (en) | Picture processing method and apparatus | |
| US11196962B2 (en) | Method and a device for a video call based on a virtual image | |
| CN110418153B (en) | Watermark adding method, device, equipment and storage medium | |
| CN110826799B (en) | Service prediction method, device, server and readable storage medium | |
| CN109388620A (en) | A kind of method and the first electronic equipment of striding equipment access data | |
| CN107104923B (en) | Account binding and service processing method and device | |
| CN113163153A (en) | Method, device, medium and electronic equipment for processing violation information in video conference | |
| CN112468883A (en) | Video stream playing method and video stream playing equipment | |
| EP3061214B1 (en) | Method and apparatus for displaying image | |
| CN111131727A (en) | Video data processing method and device | |
| CN115484086B (en) | Cloud mobile phone screen sharing method and electronic equipment and computer-readable storage media | |
| WO2018188541A1 (en) | Task processing method, apparatus, computer device and storage medium | |
| CN111294500B (en) | Image shooting method, terminal device and medium | |
| US20230206634A1 (en) | Blockchain recordation and validation of video data | |
| CN110990601A (en) | Image processing method and device | |
| US9076207B1 (en) | Image processing method, system and electronic device | |
| CN109618226A (en) | Video reviewing method, device, electronic equipment and storage medium | |
| CN112672102B (en) | Video generation method and device | |
| CN115270177A (en) | Interaction method and device based on user access authority and electronic equipment | |
| CN115410075A (en) | Method, system and storage medium for dynamically configurable detection of tampering of photographed image | |
| CN113379582A (en) | Information adding method, information extracting device and electronic equipment | |
| CN109214474B (en) | Behavior analysis and information coding risk analysis method and device based on information coding |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200508 |