CN112383793A - Picture synthesis method and device, electronic equipment and storage medium - Google Patents
Picture synthesis method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN112383793A CN112383793A CN202011264683.3A CN202011264683A CN112383793A CN 112383793 A CN112383793 A CN 112383793A CN 202011264683 A CN202011264683 A CN 202011264683A CN 112383793 A CN112383793 A CN 112383793A
- Authority
- CN
- China
- Prior art keywords
- layer
- picture
- content
- client
- contents
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001308 synthesis method Methods 0.000 title claims 5
- 238000000034 method Methods 0.000 claims abstract description 40
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 25
- 238000004590 computer program Methods 0.000 claims description 14
- 230000015572 biosynthetic process Effects 0.000 claims description 4
- 238000003786 synthesis reaction Methods 0.000 claims description 4
- 239000000203 mixture Substances 0.000 claims description 3
- 238000012163 sequencing technique Methods 0.000 claims 3
- 239000002131 composite material Substances 0.000 abstract description 18
- 230000003993 interaction Effects 0.000 abstract description 15
- 230000002452 interceptive effect Effects 0.000 abstract description 8
- 230000001360 synchronised effect Effects 0.000 abstract description 5
- 238000004891 communication Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/458—Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations
- H04N21/4586—Content update operation triggered locally, e.g. by comparing the version of software modules in a DVB carousel to the version stored locally
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/835—Generation of protective data, e.g. certificates
- H04N21/8352—Generation of protective data, e.g. certificates involving content or source identification data, e.g. Unique Material Identifier [UMID]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- General Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本发明实施例公开了一种画面的合成方法、装置、电子设备及存储介质,所述方法包括:接收各客户端发送的图层相关信息,图层相关信息包括直播间ID、图层ID、图层内容、帧序号SN和视频流ID;根据直播间ID和图层ID,对来自各客户端的图层内容进行合并,得到图层合并内容;根据视频流ID和帧序号SN,从源视频文件中获取目标视频帧,并将图层合并内容与目标视频帧进行合并,得到合成画面。本发明实施例,各客户端可以在同步直播画面下实现多人的互动,不仅丰富了直播的互动方式,而且提高了互动和观看直播的用户体验。
The embodiment of the present invention discloses a method, device, electronic device and storage medium for synthesizing a picture. The method includes: receiving layer-related information sent by each client, where the layer-related information includes a live room ID, a layer ID, Layer content, frame serial number SN and video stream ID; according to the live room ID and layer ID, the layer content from each client is merged to obtain the layer merged content; according to the video stream ID and frame serial number SN, from the source video Obtain the target video frame from the file, and combine the layer merge content with the target video frame to obtain a composite picture. In the embodiment of the present invention, each client can realize multi-person interaction under the synchronous live broadcast screen, which not only enriches the interactive mode of live broadcast, but also improves the user experience of interacting and watching live broadcast.
Description
技术领域technical field
本发明涉及互联网技术领域,具体涉及一种画面的合成方法、装置、电子设备及存储介质。The present invention relates to the field of Internet technologies, and in particular, to a method, device, electronic device and storage medium for synthesizing pictures.
背景技术Background technique
在视频直播领域,互动方式主要集中在聊天室文字互动、送礼互动等独立于视频直播流的方法。即互动对象(文字、送礼消息)从客户端发出后,通过服务端单独的服务,下发给直播间的其他客户端,其他客户端接收消息后将互动对象加以展现。此服务与视频直播流本身不产生交互。其中,用户通过文字、礼物消息等方式进行互动,互动的方式玩法尚不够丰富,缺乏自由度,无论互动如何进行,都不影响视频直播流画面本身;同时由于上述互动均由独立的服务承载,与视频直播流本身是双线运作,容易出现互动与画面不同步的情况。例如:在实时性较强的足球赛事直播中,几名观众想要讨论战术路线,就无法直接在直播间通过“画战术板”的方式直观互动;若用文字互动方式讨论,由于部分观众直播流存在延迟,则可能出现一端观众看到进球并文字互动,另一端直播流有延迟的观众会先看到文字互动说进球,过一段时间后才看到画面中进球。影响用户观看、互动体验。In the field of live video, the interaction methods mainly focus on methods independent of live video streams, such as text interaction in chat rooms and gift-giving interaction. That is, after the interactive object (text, gift-giving message) is sent from the client, it is sent to other clients in the live broadcast room through a separate service of the server, and other clients will display the interactive object after receiving the message. This service does not interact with the live video stream itself. Among them, users interact through text, gift messages, etc., and the interactive methods are not rich enough to play and lack freedom. No matter how the interaction is carried out, it does not affect the live video streaming screen itself; at the same time, because the above interactions are carried by independent services, The live video stream itself is a two-line operation, and it is prone to the situation that the interaction and the picture are out of sync. For example: in the live broadcast of a football match with strong real-time, if several viewers want to discuss the tactical route, they cannot directly interact directly in the live broadcast room by "drawing a tactical board"; If there is a delay in the stream, it may happen that the audience on one end sees the goal and interacts with the text, and the audience with a delay in the live stream on the other end will first see the text interaction and say the goal, and then see the goal on the screen after a period of time. Affect users' viewing and interactive experience.
发明内容SUMMARY OF THE INVENTION
基于现有技术中存在的问题,本发明实施例提出一种画面的合成方法、装置、电子设备及存储介质。Based on the problems existing in the prior art, the embodiments of the present invention provide a method, apparatus, electronic device, and storage medium for synthesizing a picture.
第一方面,本发明实施例提供了一种画面的合成方法,包括:In a first aspect, an embodiment of the present invention provides a method for synthesizing a picture, including:
接收各客户端发送的图层相关信息,其中,所述图层相关信息包括直播间ID、图层ID、图层内容、帧序号SN和视频流ID;Receive layer-related information sent by each client, wherein the layer-related information includes live room ID, layer ID, layer content, frame serial number SN and video stream ID;
根据所述直播间ID和图层ID,对来自各客户端的图层内容进行合并,得到图层合并内容;According to the live room ID and the layer ID, the layer contents from each client are combined to obtain the layer combined contents;
根据所述视频流ID和所述帧序号SN,从源视频文件中获取目标视频帧,并将所述图层合并内容与所述目标视频帧进行合并,得到合成画面。According to the video stream ID and the frame serial number SN, the target video frame is obtained from the source video file, and the layer combination content and the target video frame are combined to obtain a composite picture.
进一步地,所述根据所述直播间ID和图层ID,对来自各客户端的图层内容进行合并,得到图层合并内容,包括:Further, according to the live room ID and the layer ID, the layer contents from each client are combined to obtain the layer combined contents, including:
判断直播间中是否存在所述图层ID;Determine whether the layer ID exists in the live room;
如果存在所述图层ID,则对存储的图层内容进行更新;If the layer ID exists, update the stored layer content;
对存储的图层内容进行叠加合并,得到所述图层合并内容。The stored layer content is superimposed and merged to obtain the layer merged content.
进一步地,在判断直播间中是否存在所述图层ID之前,还包括:判断是否存在所述直播间ID对应的直播间;如果不存在所述直播间,则预先创建所述直播间。Further, before judging whether the layer ID exists in the live broadcast room, the method further includes: judging whether the live broadcast room corresponding to the live broadcast room ID exists; if the live broadcast room does not exist, creating the live broadcast room in advance.
进一步地,所述对存储的图层内容进行叠加合并,得到所述图层合并内容,包括:Further, the superimposing and merging of the stored layer content to obtain the layer merging content includes:
获取各客户端对应的各用户信息,其中,所述用户信息包括用户类型、用户等级和本次播放时间;Obtain each user information corresponding to each client, wherein the user information includes the user type, the user level and the current play time;
根据所述用户类型、用户等级和本次播放时间对来自各客户端的图层内容进行排序,得到图层内容的排序结果;Sort the layer contents from each client according to the user type, user level and the current playing time, and obtain the sorting result of the layer contents;
根据所述图层内容的排序结果,对存储的图层内容进行叠加合并,得到所述图层合并内容。According to the sorting result of the layer contents, the stored layer contents are superimposed and merged to obtain the layer merged contents.
进一步地,所述根据视频流ID和所述帧序号SN,从源视频文件中获取目标视频帧,并将所述图层合并内容与目标视频帧进行合并,得到合成画面,包括:Further, according to the video stream ID and the frame sequence number SN, the target video frame is obtained from the source video file, and the layer merged content is merged with the target video frame to obtain a composite picture, including:
根据所述视频流ID,得到所述源视频文件;Obtain the source video file according to the video stream ID;
从所述源视频文件中提取所述帧序号SN对应的视频帧,并将所述视频帧作为所述目标视频帧;Extract the video frame corresponding to the frame sequence number SN from the source video file, and use the video frame as the target video frame;
将所述图层合并内容与目标视频帧进行叠加合并,得到合成画面,并将所述合成画面推送给预先创建好的流地址中,以便各客户端从所述流地址中同步获取所述合成画面。The combined layer content and the target video frame are superimposed and merged to obtain a composite image, and the composite image is pushed to a pre-created stream address, so that each client can obtain the composite image from the stream address synchronously screen.
进一步地,在将所述合成画面推送给预先创建好的流地址中之前,还包括:Further, before pushing the composite picture to the pre-created stream address, the method further includes:
根据所述直播间ID,为所述直播间创建所述流地址,并向所述各客户端发送预定时间后从所述流地址中同步获取所述合成画面的通知。Create the stream address for the live studio according to the live studio ID, and send to each client a notification of synchronously acquiring the composite picture from the stream address after a predetermined time.
进一步地,所述图层内容包括各客户端在对应的绘图画面中的涂鸦内容,其中,所述各客户端通过创建覆盖在直播画面区域上的绘图画面进行涂鸦得到所述涂鸦内容。Further, the layer content includes the graffiti content of each client in the corresponding drawing screen, wherein each client obtains the graffiti content by creating a drawing screen overlaid on the live screen area for graffiti.
第二方面,本发明实施例还提供了一种画面的合成装置,包括:In a second aspect, an embodiment of the present invention further provides an apparatus for synthesizing a picture, including:
接收模块,用于接收各客户端发送的图层相关信息,其中,所述图层相关信息包括直播间ID、图层ID、图层内容、帧序号SN和视频流ID;a receiving module, configured to receive layer-related information sent by each client, wherein the layer-related information includes live room ID, layer ID, layer content, frame serial number SN and video stream ID;
图层合并模块,用于根据所述直播间ID和图层ID,对来自各客户端的图层内容进行合并,得到图层合并内容;The layer merging module is used for merging the layer contents from each client according to the live room ID and the layer ID to obtain the layer merging contents;
画面合成模块,用于根据所述视频流ID和所述帧序号SN,从源视频文件中获取目标视频帧,并将所述图层合并内容与所述目标视频帧进行合并,得到合成画面。The picture synthesis module is configured to obtain the target video frame from the source video file according to the video stream ID and the frame serial number SN, and combine the layer combination content with the target video frame to obtain a composite picture.
第三方面,本发明实施例还提供了一种电子设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现如第一方面所述的画面的合成方法。In a third aspect, an embodiment of the present invention further provides an electronic device, including a memory, a processor, and a computer program stored in the memory and running on the processor, the processor implementing the computer program as described in the first In one aspect, the method for synthesizing a picture is described.
第四方面,本发明实施例还提供了一种非暂态计算机可读存储介质,其上存储有计算机程序,该计算机程序被处理器执行时实现如第一方面所述的画面的合成方法。In a fourth aspect, an embodiment of the present invention further provides a non-transitory computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the method for synthesizing a picture according to the first aspect.
由上述技术方案可知,本发明实施例提供的画面的合成方法、装置、电子设备及存储介质,当用户在直播间中观看直播时,可以在直播画面进行任意涂鸦得到图层内容,服务器可以对各客户端的图层内容进行合并,并与直播画面一并下发给各客户端,由此,各客户端可以在同步直播画面下实现多人的互动,不仅丰富了直播的互动方式,而且提高了互动和观看直播的用户体验。It can be seen from the above technical solutions that with the method, device, electronic device, and storage medium for synthesizing a picture provided in the embodiment of the present invention, when a user watches a live broadcast in the live broadcast room, he can do any graffiti on the live broadcast picture to obtain the layer content, and the server can compose the layer content. The layer content of each client is merged and sent to each client together with the live broadcast screen, so that each client can realize multi-person interaction under the synchronous live broadcast screen, which not only enriches the interactive mode of live broadcast, but also improves the It improves the user experience of interacting and watching live broadcasts.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些图获得其他的附图。In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative efforts.
图1是本发明一实施例提供的画面的合成方法的流程图;1 is a flowchart of a method for synthesizing a picture provided by an embodiment of the present invention;
图2是本发明一实施例提供的画面的合成方法的图层内容的存储结构示意图;2 is a schematic diagram of a storage structure of layer content of a method for synthesizing a picture provided by an embodiment of the present invention;
图3是本发明一实施例提供的画面的合成装置的结构框图;3 is a structural block diagram of an apparatus for synthesizing a picture provided by an embodiment of the present invention;
图4是本发明一实施例提供的电子设备的结构示意图。FIG. 4 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention.
具体实施方式Detailed ways
下面结合附图,对本发明的具体实施方式作进一步描述。以下实施例仅用于更加清楚地说明本发明的技术方案,而不能以此来限制本发明的保护范围。The specific embodiments of the present invention will be further described below with reference to the accompanying drawings. The following examples are only used to illustrate the technical solutions of the present invention more clearly, and cannot be used to limit the protection scope of the present invention.
以下结合附图描述根据本发明实施例的画面的合成方法、装置、电子设备及存储介质。The following describes a method, an apparatus, an electronic device, and a storage medium for synthesizing a picture according to the embodiments of the present invention with reference to the accompanying drawings.
图1示出了本发明一实施例提供的画面的合成方法的流程图。如图1所示,本发明实施例提供的画面的合成方法,具体包括如下内容:FIG. 1 shows a flowchart of a method for synthesizing a picture provided by an embodiment of the present invention. As shown in FIG. 1 , the method for synthesizing a picture provided by an embodiment of the present invention specifically includes the following content:
S101:接收各客户端发送的图层相关信息,其中,图层相关信息包括直播间ID、图层ID、图层内容、帧序号SN和视频流ID。S101: Receive layer-related information sent by each client, where the layer-related information includes a live room ID, a layer ID, a layer content, a frame serial number SN, and a video stream ID.
本示例中,各客户端指进入同一直播间中参与直播的多个用户的客户端。客户端可以是一种安装在智能手机、平板电脑等设备上的应用程序APP,如直播软件。In this example, each client refers to the clients of multiple users who enter the same live broadcast room and participate in the live broadcast. The client can be an application APP installed on a device such as a smartphone, a tablet computer, etc., such as a live broadcast software.
作为一个具体的示例,多人通过各自的客户端连入直播间同看直播时,各客户端的画面包含直播画面与多人实时绘图画面,绘图画面叠加于直播画面。例如:As a specific example, when multiple people connect to the live broadcast room through their respective clients to watch the live broadcast simultaneously, the pictures of each client terminal include the live broadcast picture and the multi-person real-time drawing picture, and the drawing picture is superimposed on the live broadcast picture. E.g:
用户点击客户端中的绘图按钮,此时,客户端创建一个背景透明的绘图层(即:绘图画面)覆盖在直播画面的区域上,并定时上传绘图层中的信息(即:图层相关信息)到服务器。The user clicks the drawing button in the client. At this time, the client creates a drawing layer with a transparent background (ie: drawing screen) to cover the area of the live screen, and regularly uploads the information in the drawing layer (ie: layer-related information) ) to the server.
在该示例中,用户可以在绘图层上任意涂鸦,即:图层内容包括各客户端在对应的绘图画面中的涂鸦内容,其中,各客户端通过创建覆盖在直播画面区域上的绘图画面进行涂鸦得到涂鸦内容。In this example, the user can doodle arbitrarily on the drawing layer, that is, the content of the layer includes the graffiti content of each client in the corresponding drawing screen, wherein each client performs the drawing by creating a drawing screen overlaid on the live screen area. Graffiti gets the graffiti content.
客户端定时(如每间隔40毫秒,即:每秒产生25帧)上传一次图层相关信息到服务器。The client uploads layer-related information to the server at regular intervals (for example, every 40 milliseconds, that is, 25 frames per second).
其中,上传的图层相关信息包含但不限于:图层的ID(如由“直播间ID和用户ID组成)、经过压缩后的图层内容、当前帧序号(即视频流播放到了第几帧)、视频流ID、直播间ID、用户token等信息。其中,压缩可以数据传输量,提升传输效率。The uploaded layer-related information includes, but is not limited to: layer ID (for example, consisting of "live room ID and user ID"), compressed layer content, and current frame serial number (that is, which frame is the video stream played to? ), video stream ID, live room ID, user token, etc. Among them, compression can increase the amount of data transmission and improve transmission efficiency.
S102:根据直播间ID和图层ID,对来自各客户端的图层内容进行合并,得到图层合并内容。S102: Combine the layer contents from each client according to the live room ID and the layer ID to obtain the layer combined contents.
在具体示例中,该步骤具体包括:判断直播间中是否存在所述图层ID;如果存在所述图层ID,则判断是否已存有所述图层ID对应的图层内容;如果未存储有所述图层内容,则对存储的图层内容进行更新;对存储的图层内容进行叠加合并,得到所述图层合并内容。In a specific example, this step specifically includes: judging whether the layer ID exists in the live room; if the layer ID exists, judging whether the layer content corresponding to the layer ID has been stored; If the layer content exists, the stored layer content is updated; and the stored layer content is superimposed and merged to obtain the layer merged content.
在该示例中,当确定未存储有图层内容,表示该图层内容为新的图层内容,因此,对图层内容进行更新,也就是说,存储更新后的图层内容,这样,后续可以读取出存储的图层内容,并进行叠加合并,进而得到图层合并内容。In this example, when it is determined that there is no layer content stored, it means that the layer content is new layer content. Therefore, the layer content is updated, that is, the updated layer content is stored. In this way, subsequent The stored layer content can be read out and superimposed and merged to obtain the layer merged content.
进一步地,在判断直播间中是否存在所述图层ID之前,还包括:判断是否存在所述直播间ID对应的直播间;如果不存在所述直播间,则预先创建所述直播间。Further, before judging whether the layer ID exists in the live broadcast room, the method further includes: judging whether the live broadcast room corresponding to the live broadcast room ID exists; if the live broadcast room does not exist, creating the live broadcast room in advance.
作为一个具体的示例,当服务器收到客户端发送过来的图层相关信息后,首先取出直播间ID、图层ID、图层内容;判断内存中是否存在该直播间ID,即:判断是否存在该直播间ID对应的直播间,若没有则创建一个直播间;判断该直播间中是否存在该图层ID,如果有,则从内存中取出该图层ID对应的图层内容,判断与客户端传入的图层内容是否相同,如果不同,则更新图层内容,然后继续下一步;没有则将该图层内容存入该直播间的内存中,继续下一步;取出该直播间内的所有的画布内容,进行图层叠加合并,将合并后的内容(图层合并内容)存储到该直播间中。As a specific example, when the server receives the layer-related information sent by the client, it first takes out the live room ID, layer ID, and layer content; judges whether the live room ID exists in the memory, that is, judges whether the live room ID exists. The live room corresponding to the live room ID, if not, create a live room; determine whether the layer ID exists in the live room; Check whether the content of the layer passed in from the terminal is the same, if it is different, update the content of the layer, and then continue to the next step; if not, store the content of the layer in the memory of the live room and continue to the next step; take out the content of the layer in the live room All canvas contents are layered and combined, and the combined contents (layer combined contents) are stored in the live studio.
其中,主要作用是将多人提交的画布层叠加混合在一起生成一个画布混合层。每当用户提交画布层内容时都会触发此算法来更新混合层内容。其存储结构如图2所示,在图2中,如对于直播间1来说,各客户端发送的图层内容称为画布层1内容、画布层2内容等,图层合并内容称为混合后的画布内容。即:在服务器的内存中以直播间ID进行分组,直播间内又存储了与该直播间相关的所有画布层信息和混合后的图层信息。Among them, the main function is to superimpose and mix the canvas layers submitted by multiple people to generate a canvas mixed layer. This algorithm is triggered to update the blend layer content whenever the user submits the canvas layer content. Its storage structure is shown in Figure 2. In Figure 2, for live room 1, the layer content sent by each client is called canvas layer 1 content, canvas layer 2 content, etc., and the layer combined content is called mixed. After the canvas content. That is: in the memory of the server, the groups are grouped by the ID of the live broadcast room, and all the canvas layer information and mixed layer information related to the live broadcast room are stored in the live broadcast room.
S103:根据视频流ID和帧序号SN,从源视频文件中获取目标视频帧,并将图层合并内容与目标视频帧进行合并,得到合成画面。S103: Obtain a target video frame from the source video file according to the video stream ID and the frame serial number SN, and combine the layer combination content with the target video frame to obtain a composite picture.
具体而言,该步骤具体包括:根据所述视频流ID,得到所述源视频文件;从所述源视频文件中提取所述帧序号SN对应的视频帧,并将所述视频帧作为所述目标视频帧;将所述图层合并内容与目标视频帧进行叠加合并,得到合成画面,并将合成画面推送给预先创建好的流地址中,以便各客户端从所述流地址中同步获取所述合成画面。Specifically, this step specifically includes: obtaining the source video file according to the video stream ID; extracting the video frame corresponding to the frame serial number SN from the source video file, and using the video frame as the target video frame; superimpose and merge the layer combination content and the target video frame to obtain a composite picture, and push the composite picture to the pre-created stream address, so that each client can obtain all the data from the stream address synchronously. Describe the composite screen.
其中,在将所述合成画面推送给预先创建好的流地址中之前,还包括:根据所述直播间ID,为所述直播间创建所述流地址,并向所述各客户端发送预定时间后从所述流地址中同步获取所述合成画面的通知。Wherein, before pushing the composite picture to the pre-created stream address, the method further includes: creating the stream address for the live studio according to the live studio ID, and sending a predetermined time to each client Then, the notification of the composite picture is obtained synchronously from the stream address.
作为一个具体的示例,该步骤通过如下方式实施:As a specific example, this step is implemented as follows:
1、获取客户端传过来的帧序号SN、直播间ID、视频流ID。1. Obtain the frame serial number SN, live room ID, and video stream ID sent by the client.
2、为该直播间创建新的流地址,通知客户端40毫秒后从新的流地址中拉流。其中,40毫秒仅是示例性的,可以根据需要自行设定。2. Create a new stream address for the live studio, and notify the client to pull the stream from the new stream address after 40 milliseconds. Among them, 40 milliseconds is only an example, and can be set according to needs.
3、从源视频文件中抽取帧序号为SN的帧。3. Extract the frame whose frame number is SN from the source video file.
4、从内存中获取该直播间对应的混合后的画布内容。4. Obtain the mixed canvas content corresponding to the live room from the memory.
5、将画布内容与帧内容进行叠加合并,将混合后的帧编码压缩后推送到新的流地址中。5. Superimpose and merge the canvas content and the frame content, and compress the mixed frame encoding and push it to a new stream address.
6、将帧序号SN设置为:SN=SN+1。6. Set the frame sequence number SN as: SN=SN+1.
7、循环执行上述的3-6步骤,直播处理完最后一帧为止。7. Execute the above steps 3-6 in a loop until the last frame is processed by the live broadcast.
由此,各客户端可以进行同步直播,并且,能够同步显示各客户端在直播间上进行的互动。Therefore, each client can perform synchronous live broadcast, and the interaction of each client in the live broadcast room can be displayed synchronously.
根据本发明实施例的画面的合成方法,当用户在直播间中观看直播时,可以在直播画面进行任意涂鸦得到图层内容,服务器可以对各客户端的图层内容进行合并,并与直播画面一并下发给各客户端,由此,各客户端可以在同步直播画面下实现多人的互动,不仅丰富了直播的互动方式,而且提高了互动和观看直播的用户体验。According to the method for synthesizing a picture in the embodiment of the present invention, when a user watches a live broadcast in the live broadcast room, he can do any graffiti on the live broadcast picture to obtain the layer content, and the server can combine the layer content of each client and combine it with the live broadcast picture. And distributed to each client, thus, each client can realize multi-person interaction under the synchronous live broadcast screen, which not only enriches the interactive mode of live broadcast, but also improves the user experience of interaction and watching live broadcast.
在本发明的一个实施例中,所述对存储的图层内容进行叠加合并,得到所述图层合并内容,包括:获取各客户端对应的各用户信息,其中,所述用户信息包括用户类型、用户等级和本次播放时间;根据所述用户类型、用户等级和本次播放时间对来自各客户端的图层内容进行排序,得到图层内容的排序结果;根据所述图层内容的排序结果,对存储的图层内容进行叠加合并,得到所述图层合并内容。其中,根据所述图层内容的排序结果,对存储的图层内容进行叠加合并,得到所述图层合并内容,可以通过以下两种方式实现:In an embodiment of the present invention, the superimposing and merging of the stored layer contents to obtain the layer merged content includes: acquiring each user information corresponding to each client, wherein the user information includes a user type , user level and this play time; sort the layer content from each client according to the user type, user level and this play time, and obtain the sorting result of the layer content; according to the sorting result of the layer content , and superimpose and merge the stored layer content to obtain the layer merged content. Wherein, according to the sorting result of the layer contents, superimposing and merging the stored layer contents to obtain the layer merging contents can be realized in the following two ways:
获取排序靠前的图层内容中与排序靠后的图层内容中发生重叠的内容,并由排序靠前的图层内容中的重叠的内容覆盖所述排序靠后的图层内容中的重叠的内容;或者,Obtain the overlapping content in the content of the layer in the top sorting and the content in the layer in the later sorting, and cover the overlapping content in the content of the layer in the later sorting by the overlapping content in the content of the layer in the sorting earlier. content; or,
图层内容除涂鸦部分,均为透明区域,并且,排序靠后的图层内容先进行叠加,然后再进行排序靠前的图层内容的叠加。由于图层内容除涂鸦部分,均为透明区域,因此,在叠加后的图层内容中,排序靠前的图层内容与排序靠后的图层内容发生重叠时,仅在重叠的部分显示出排序靠前的图层内容。例如:在同一区域,排序靠前的图层内容的涂鸦为“加油”,排序靠后的图层内容的涂鸦为“6666”,则叠加后,该区域只显示“加油”。Except for the graffiti part, the layer contents are all transparent areas, and the layer contents in the lower order are superimposed first, and then the layer contents in the front order are superimposed. Since the layer contents except the graffiti part are all transparent areas, therefore, in the superimposed layer contents, when the layer contents in the first order and the layer contents in the rear order overlap, only the overlapping part will be displayed. Sort the top layer contents. For example: in the same area, the graffiti of the layer content in the top order is "Come on", and the graffiti of the layer content in the lower order is "6666", then after superimposing, only "Come on" is displayed in this area.
也就是说,各绘图层间有层级排列顺序的区别。排序越靠前,绘图层叠加时展现越靠上。例如:排序1、2、3的三个绘图层,3在最底层,2叠加在3上,1叠加在2上。上层的非透明部分绘图会对下层产生遮盖。That is to say, there are differences in the arrangement order of the layers among the drawing layers. The higher the sorting, the higher the display will be when the drawing layers are superimposed. For example: sort three drawing layers of 1, 2, 3, 3 on the bottom layer, 2 on top of 3, 1 on top of 2. Drawing on the non-transparent part of the upper layer will obscure the lower layer.
绘图层的排序由其关联的用户数据决定,由三个参数联合控制:是否为直播间房主,用户等级,用户最近一次进入直播间的时间点。The ordering of the drawing layer is determined by its associated user data, which is jointly controlled by three parameters: whether it is the owner of the live room, the user level, and the last time the user entered the live room.
其中,直播间房主定义为开启本次直播间的用户,为本直播间的拥有者。Among them, the owner of the live broadcast room is defined as the user who opened the live broadcast room, and is the owner of the live broadcast room.
用户等级定义:用户在产品中的等级,该等级由用户在产品中的活跃度决定。等级随经验值累积提升,活跃行为可获得经验值。活跃行为包括但不限于观看直播,开启直播,聊天文字互动等。User level definition: the level of the user in the product, which is determined by the user's activity in the product. The level increases with the accumulation of experience points, and active behaviors can obtain experience points. Active behaviors include but are not limited to watching live broadcasts, starting live broadcasts, chatting and text interaction, etc.
三个参数的作用逻辑如下:若为直播间房主,则始终排序最靠前,为1;若非直播间房主,则进行下一步判断;非房主用户中,按用户等级由高至低排序,一一对应2、3、4等序号;若有用户等级相同者,对其进行下一步判断;用户等级相同者中,按其最近一次进入直播间的时间由早至晚排序,赋予对应序号,时间精确至秒;若时间也相同,则随机排序。所有绘图层尺寸均按直播流画面尺寸生成,二者宽高相等。设定直播画面左上角定位为锚点,坐标[0,0],使绘图层左上角顶点对齐[0,0],实现绘图层与直播画面区域重合。The function logic of the three parameters is as follows: if it is the owner of the live broadcast room, it will always be ranked at the top, which is 1; if it is not the owner of the live broadcast room, the next step will be judged; among non-homeowner users, the user level is ranked from high to low. Sorting, one-to-one corresponding serial numbers such as 2, 3, 4; if there are users with the same level, the next step will be judged; among those with the same user level, they will be sorted from early to late according to the time they last entered the live broadcast room, and the corresponding Serial number, the time is accurate to the second; if the time is the same, it will be sorted randomly. All drawing layer sizes are generated according to the live stream screen size, with the same width and height. Set the upper left corner of the live screen as the anchor point, with coordinates [0, 0], so that the top left corner of the drawing layer is aligned with [0, 0], so that the drawing layer and the live screen area overlap.
图3示出了本发明一实施例提供的画面的合成装置的结构示意图,如图3所示,本发明实施例提供的画面的合成装置,包括:接收模块310、图层合并模块320和画面合成模块330。其中:FIG. 3 shows a schematic structural diagram of an apparatus for synthesizing a picture provided by an embodiment of the present invention. As shown in FIG. 3 , the apparatus for synthesizing a picture provided by an embodiment of the present invention includes: a receiving
接收模块310,用于接收各客户端发送的图层相关信息,其中,所述图层相关信息包括直播间ID、图层ID、图层内容、帧序号SN和视频流ID;The receiving
图层合并模块320,用于根据所述直播间ID和图层ID,对来自各客户端的图层内容进行合并,得到图层合并内容;The
画面合成模块330,用于根据所述视频流ID和所述帧序号SN,从源视频文件中获取目标视频帧,并将所述图层合并内容与所述目标视频帧进行合并,得到合成画面。The
根据本发明实施例的画面的合成装置,当用户在直播间中观看直播时,可以在直播画面进行任意涂鸦得到图层内容,服务器可以对各客户端的图层内容进行合并,并与直播画面一并下发给各客户端,由此,各客户端可以在同步直播画面下实现多人的互动,不仅丰富了直播的互动方式,而且提高了互动和观看直播的用户体验。According to the device for synthesizing images in the embodiment of the present invention, when a user watches a live broadcast in the live broadcast room, he can do any graffiti on the live broadcast image to obtain layer contents, and the server can combine the layer contents of each client and combine them with the live broadcast image. And distributed to each client, thus, each client can realize multi-person interaction under the synchronous live broadcast screen, which not only enriches the interactive mode of live broadcast, but also improves the user experience of interaction and watching live broadcast.
需要说明的是,本发明实施例的画面的合成装置的具体实现方式与本发明实施例的画面的合成方法的具体实现方式类似,具体请参见方法部分的描述,为了减少冗余,具体此处不做赘述。It should be noted that the specific implementation of the apparatus for synthesizing a picture in the embodiment of the present invention is similar to the specific implementation of the method for synthesizing a picture in the embodiment of the present invention. For details, please refer to the description in the method section. I won't go into details.
基于相同的发明构思,本发明又一实施例提供了一种电子设备,参见图4,所述电子设备具体包括如下内容:处理器401、存储器402、通信接口403和通信总线404;Based on the same inventive concept, another embodiment of the present invention provides an electronic device, see FIG. 4 , the electronic device specifically includes the following: a
其中,所述处理器401、存储器402、通信接口403通过所述通信总线404完成相互间的通信;所述通信接口403用于实现各设备之间的信息传输;Wherein, the
所述处理器401用于调用所述存储器402中的计算机程序,所述处理器执行所述计算机程序时实现上述画面的合成方法的全部步骤,例如,所述处理器执行所述计算机程序时实现下述步骤:播间ID、图层ID、图层内容、帧序号SN和视频流ID;根据所述直播间ID和图层ID,对来自各客户端的图层内容进行合并,得到图层合并内容;根据所述视频流ID和所述帧序号SN,从源视频文件中获取目标视频帧,并将所述图层合并内容与所述目标视频帧进行合并,得到合成画面。The
基于相同的发明构思,本发明又一实施例提供了一种非暂态计算机可读存储介质,该计算机可读存储介质上存储有计算机程序,该计算机程序被处理器执行时实现上述画面的合成方法的全部步骤,例如,所述处理器执行所述计算机程序时实现下述步骤:播间ID、图层ID、图层内容、帧序号SN和视频流ID;根据所述直播间ID和图层ID,对来自各客户端的图层内容进行合并,得到图层合并内容;根据所述视频流ID和所述帧序号SN,从源视频文件中获取目标视频帧,并将所述图层合并内容与所述目标视频帧进行合并,得到合成画面。Based on the same inventive concept, another embodiment of the present invention provides a non-transitory computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the above-mentioned pictures are synthesized All steps of the method, for example, the processor implements the following steps when executing the computer program: studio ID, layer ID, layer content, frame serial number SN and video stream ID; Layer ID, merge the layer contents from each client to obtain the layer merge content; according to the video stream ID and the frame serial number SN, obtain the target video frame from the source video file, and combine the layers The content is combined with the target video frame to obtain a composite picture.
此外,上述的存储器中的逻辑指令可以通过软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。In addition, the above-mentioned logic instructions in the memory can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solution of the present invention can be embodied in the form of a software product in essence, or the part that contributes to the prior art or the part of the technical solution. The computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, Read-Only Memory (ROM, Read-Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes .
以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本发明实施例方案的目的。本领域普通技术人员在不付出创造性的劳动的情况下,即可以理解并实施。The device embodiments described above are only illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed over multiple network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solutions of the embodiments of the present invention. Those of ordinary skill in the art can understand and implement it without creative effort.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到各实施方式可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件。基于这样的理解,上述技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在计算机可读存储介质中,如ROM/RAM、磁碟、光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行各个实施例或者实施例的某些部分所述的指标监控方法。From the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and certainly can also be implemented by hardware. Based on this understanding, the above-mentioned technical solutions can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products can be stored in computer-readable storage media, such as ROM/RAM, magnetic A disc, an optical disc, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the indicator monitoring method described in each embodiment or some part of the embodiment.
此外,在本发明中,诸如“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。在本发明的描述中,“多个”的含义是至少两个,例如两个,三个等,除非另有明确具体的限定。In addition, in the present invention, such as "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implying the number of indicated technical features. Thus, a feature delimited with "first", "second" may expressly or implicitly include at least one of that feature. In the description of the present invention, "plurality" means at least two, such as two, three, etc., unless otherwise expressly and specifically defined.
此外,在本发明中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。Furthermore, in the present invention, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply existence between these entities or operations any such actual relationship or sequence. Moreover, the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device that includes a list of elements includes not only those elements, but also includes not explicitly listed or other elements inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.
此外,在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外,在不相互矛盾的情况下,本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。In addition, in the description of this specification, reference to the terms "one embodiment," "some embodiments," "example," "specific example," or "some examples" and the like means description in conjunction with the embodiment or example. A particular feature, structure, material or characteristic is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, those skilled in the art may combine and combine the different embodiments or examples described in this specification, as well as the features of the different embodiments or examples, without conflicting each other.
最后应说明的是:以上实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, but not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that it can still be The technical solutions described in the foregoing embodiments are modified, or some technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011264683.3A CN112383793B (en) | 2020-11-12 | 2020-11-12 | Screen composition method, device, electronic device and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011264683.3A CN112383793B (en) | 2020-11-12 | 2020-11-12 | Screen composition method, device, electronic device and storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112383793A true CN112383793A (en) | 2021-02-19 |
CN112383793B CN112383793B (en) | 2023-07-07 |
Family
ID=74583532
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202011264683.3A Active CN112383793B (en) | 2020-11-12 | 2020-11-12 | Screen composition method, device, electronic device and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112383793B (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115379250A (en) * | 2022-07-22 | 2022-11-22 | 广州博冠信息科技有限公司 | Video processing method, device, computer equipment and storage medium |
CN116112729A (en) * | 2023-02-02 | 2023-05-12 | 咪咕视讯科技有限公司 | Video playing method, device, equipment and storage medium |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105187930A (en) * | 2015-09-18 | 2015-12-23 | 广州酷狗计算机科技有限公司 | Video live broadcasting-based interaction method and device |
CN107331222A (en) * | 2016-04-29 | 2017-11-07 | 北京学而思教育科技有限公司 | A kind of image processing method and device |
US20180035169A1 (en) * | 2016-07-28 | 2018-02-01 | Beijing Xiaomi Mobile Software Co., Ltd. | Method, apparatus, host terminal and system for processing live broadcasting information |
WO2018094814A1 (en) * | 2016-11-28 | 2018-05-31 | 深圳Tcl数字技术有限公司 | Video synthesizing method and device |
CN108966031A (en) * | 2017-05-18 | 2018-12-07 | 腾讯科技(深圳)有限公司 | Method and device, the electronic equipment of broadcasting content control are realized in video session |
CN111147880A (en) * | 2019-12-30 | 2020-05-12 | 广州华多网络科技有限公司 | Interaction method, device and system for live video, electronic equipment and storage medium |
-
2020
- 2020-11-12 CN CN202011264683.3A patent/CN112383793B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105187930A (en) * | 2015-09-18 | 2015-12-23 | 广州酷狗计算机科技有限公司 | Video live broadcasting-based interaction method and device |
CN107331222A (en) * | 2016-04-29 | 2017-11-07 | 北京学而思教育科技有限公司 | A kind of image processing method and device |
US20180035169A1 (en) * | 2016-07-28 | 2018-02-01 | Beijing Xiaomi Mobile Software Co., Ltd. | Method, apparatus, host terminal and system for processing live broadcasting information |
WO2018094814A1 (en) * | 2016-11-28 | 2018-05-31 | 深圳Tcl数字技术有限公司 | Video synthesizing method and device |
CN108966031A (en) * | 2017-05-18 | 2018-12-07 | 腾讯科技(深圳)有限公司 | Method and device, the electronic equipment of broadcasting content control are realized in video session |
CN111147880A (en) * | 2019-12-30 | 2020-05-12 | 广州华多网络科技有限公司 | Interaction method, device and system for live video, electronic equipment and storage medium |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115379250A (en) * | 2022-07-22 | 2022-11-22 | 广州博冠信息科技有限公司 | Video processing method, device, computer equipment and storage medium |
CN115379250B (en) * | 2022-07-22 | 2024-06-11 | 广州博冠信息科技有限公司 | Video processing method, device, computer equipment and storage medium |
CN116112729A (en) * | 2023-02-02 | 2023-05-12 | 咪咕视讯科技有限公司 | Video playing method, device, equipment and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN112383793B (en) | 2023-07-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7594642B2 (en) | Simulating local experiences by live streaming a shareable perspective of a live event | |
CN108574879B (en) | Combined live broadcast method and device and electronic equipment | |
CN103634681B (en) | Living broadcast interactive method, device, client, server and system | |
CN109327741B (en) | Game live broadcast method, device and system | |
US8522160B2 (en) | Information processing device, contents processing method and program | |
RU2672620C2 (en) | System and method for interactive remote movie watching, scheduling and social connection | |
CN112929684B (en) | Video superimposed information updating method and device, electronic equipment and storage medium | |
CN109874059A (en) | Method for showing interface, client and storage medium, computer equipment is broadcast live | |
JP6473262B1 (en) | Distribution server, distribution program, and terminal | |
CN102893299A (en) | Editable bookmarks shared via a social network | |
CN113905265B (en) | Video data processing method and device and storage medium | |
CN108769824A (en) | A kind of video mixed flow method, apparatus, system, equipment and medium | |
CN111432284B (en) | Bullet screen interaction method of multimedia terminal and multimedia terminal | |
CN108833809A (en) | A kind of video mixed flow control method, device, system, equipment and medium | |
CN112383793B (en) | Screen composition method, device, electronic device and storage medium | |
CN107066102A (en) | Support the method and device of multiple VR users viewing simultaneously | |
CN113031906A (en) | Audio playing method, device, equipment and storage medium in live broadcast | |
CN114430494B (en) | Interface display method, device, equipment and storage medium | |
WO2025066479A1 (en) | Interaction method and apparatus based on video live streaming, device, storage medium, and computer program product | |
CN105721923A (en) | Television program transmission terminal and interactive information processing method and system during broadcasting | |
US10375447B1 (en) | Asynchronous video conversation systems and methods | |
CN111526410A (en) | Movie information-based cinema real-time social interaction system | |
CN114760520A (en) | Live small and medium video shooting interaction method, device, equipment and storage medium | |
CN108846707A (en) | Interactive advertisement playback method and system | |
CN115048069B (en) | Cloud conference content sharing method and device, electronic equipment and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |