[go: up one dir, main page]

CN103997616B - A method, device and conference terminal for processing video conference images - Google Patents

A method, device and conference terminal for processing video conference images Download PDF

Info

Publication number
CN103997616B
CN103997616B CN201310710567.3A CN201310710567A CN103997616B CN 103997616 B CN103997616 B CN 103997616B CN 201310710567 A CN201310710567 A CN 201310710567A CN 103997616 B CN103997616 B CN 103997616B
Authority
CN
China
Prior art keywords
image information
image
video conference
instant
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201310710567.3A
Other languages
Chinese (zh)
Other versions
CN103997616A (en
Inventor
曹长刚
梁昕
刘帅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201310710567.3A priority Critical patent/CN103997616B/en
Priority to PCT/CN2014/073182 priority patent/WO2015089944A1/en
Publication of CN103997616A publication Critical patent/CN103997616A/en
Application granted granted Critical
Publication of CN103997616B publication Critical patent/CN103997616B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/272Means for inserting a foreground image in a background image, i.e. inlay, outlay

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Image Processing (AREA)

Abstract

The application discloses a method and a device for processing video conference pictures and a conference terminal, wherein the method comprises the following steps: acquiring background picture information of a video conference; when a video conference is carried out, the instant image information of a video conference system is segmented; obtaining foreground picture information as a picture center from the segmented instant image information; and superposing the foreground picture information to the background picture information to generate video image information with a centered picture. The method and the device divide the instant image of the video conference system of the personnel participating in the video conference to obtain the foreground picture, and generate the video image with a centered picture by overlapping the foreground picture to the background picture, so that the video conference participant is positioned at the centered position of the video image, and the user experience of the video conference system is improved.

Description

一种处理视频会议画面的方法、装置及会议终端A method, device and conference terminal for processing video conference images

技术领域technical field

本发明涉及视频会议领域,尤指一种处理视频会议画面的方法、装置及会议终端。The present invention relates to the field of video conferences, in particular to a method, a device and a conference terminal for processing video conference images.

背景技术Background technique

视频会议是利用视讯技术和设备,通过现代通讯网络,实现远程异地的实时、双向、交互式的多媒体会议方式。Video conferencing is a real-time, two-way, interactive multimedia conference method that uses video technology and equipment to achieve remote remote locations through modern communication networks.

目前,多屏视频会议系统采用多屏环境布局,以高清、全景、多屏等显示特点给视频会议带来了良好的用户体验。多屏环境布局采用多个固定摄像头对应多个固定坐席的方式实现,对于系统的单摄像头,其拍摄画面一般摄像的范围是一个坐席的位置,即为两个座位或三个座位。这样在使用系统时,由于采用的摄像头摄像的位置为固定的一个坐席,但是在参加会议的人员位于坐席的左侧位置或右侧位置时,未对视频画面进行处理,总是出现一个位置是空的情景,影响幻真系统视频会议的使用体验。At present, the multi-screen video conference system adopts a multi-screen environment layout, which brings a good user experience to the video conference with display features such as high-definition, panoramic, and multi-screen. The multi-screen environment layout is realized by using multiple fixed cameras corresponding to multiple fixed seats. For the single camera of the system, the general shooting range of the shooting picture is the position of one seat, that is, two seats or three seats. In this way, when the system is used, since the position of the camera used is a fixed seat, but when the person participating in the conference is located at the left or right position of the seat, the video image is not processed, and a position always appears: The empty scene affects the experience of using the virtual reality system video conference.

发明内容SUMMARY OF THE INVENTION

为了解决上述技术问题,本发明公开了一种处理视频会议画面的方法、装置及会议终端,能够实现对参与视频会议人员的图像显示的画面居中,改善视频会议系统用户体验。In order to solve the above technical problems, the present invention discloses a method, a device and a conference terminal for processing video conference images, which can realize the centering of the images displayed on the images of participants in the video conference and improve the user experience of the video conference system.

为了达到本申请的目的,本发明提供一种处理视频会议画面的方法,包括:In order to achieve the purpose of this application, the present invention provides a method for processing video conference images, including:

获取视频会议的背景画面信息;Get the background picture information of the video conference;

当进行视频会议时,分割视频会议系统的即时图像信息;When conducting a video conference, segment the instant image information of the video conference system;

从分割的即时图像信息中获取作为画面居中的前景画面信息;Obtain the foreground image information as the center of the image from the segmented real-time image information;

叠加前景画面信息到背景画面信息中,生成画面居中的视频图像信息。The foreground image information is superimposed on the background image information to generate video image information with the image centered.

进一步地,获取视频会议的背景画面信息包括:通过视频会议摄像头获取实际会议场景的无座位图像信息,或获取其他符合实际会议场景的静态图像信息作为背景画面信息。Further, acquiring the background image information of the video conference includes: acquiring the seatless image information of the actual conference scene through the video conference camera, or acquiring other static image information conforming to the actual conference scene as the background image information.

进一步地,分割视频会议系统的即时图像信息包括:Further, the instant image information of the segmented video conference system includes:

当视频会议系统获取的是摄像位置为两个座位的即时图像信息时,沿所述获得的即时图像的中间的坐标位置进行分割;When the video conferencing system obtains the instant image information whose camera positions are two seats, the segmentation is performed along the coordinate position in the middle of the obtained instant image;

当视频会议系统获取的是摄像位置为三个座位的即时图像信息时,沿所述获得的即时图像的三分之一和三分之二的坐标位置进行分割;When the video conferencing system obtains the instant image information whose camera positions are three seats, segmenting is performed along the coordinate positions of one-third and two-thirds of the obtained instant image;

当视频会议系统获取的摄像位置为其他规格的即时图像信息时,按照外部指令确定的尺寸及位置,沿所述获得的即时图像的相应坐标位置进行分割。When the camera position obtained by the video conferencing system is the instant image information of other specifications, according to the size and position determined by the external instruction, it is divided along the corresponding coordinate position of the obtained instant image.

进一步地,从分割的即时图像信息中获取作为画面居中的前景画面信息包括:Further, obtaining the foreground image information as the center of the image from the segmented real-time image information includes:

通过外部指令,从分割的即时图像信息中获取视频会议参与视频会议参与者所在的座位位置对应的图像信息作为画面居中的前景画面;或,Obtain the image information corresponding to the seat position of the video conference participant from the segmented real-time image information through an external command as the foreground image in the center of the image; or,

通过图像匹配的方法,从分割的即时图像信息中获取视频会议参与者所在的座位位置对应的图像信息作为画面居中的前景画面。Through the method of image matching, the image information corresponding to the seat position of the video conference participant is obtained from the segmented real-time image information as the foreground image in the center of the image.

另一方面,本发明提供一种处理视频会议画面的装置,包括:背景单元、画面分割单元、采集单元及叠加单元;其中,In another aspect, the present invention provides a device for processing video conference images, including: a background unit, a screen segmentation unit, a collection unit, and a superimposition unit; wherein,

背景单元,用于采集视频会议的背景画面信息;The background unit is used to collect the background picture information of the video conference;

画面分割单元,用于分割视频会议系统的即时图像信息;A screen splitting unit, used for splitting real-time image information of the video conferencing system;

采集单元,用于从画面分割单元分割后的图像信息中采集作为画面居中的前景画面信息;an acquisition unit, configured to collect foreground image information as the center of the image from the image information segmented by the image segmentation unit;

叠加单元,用于将获取单元得到的前景画面信息叠加到、背景单元的背景画面信息中,以生成画面居中的视频图像信息。The superimposing unit is configured to superimpose the foreground image information obtained by the acquiring unit into the background image information of the background unit, so as to generate video image information with the image centered.

进一步地,获取视频会议的背景画面信息包括:通过视频会议摄像头采集实际会议场景的无座位图像信息;Further, acquiring the background picture information of the video conference includes: collecting the no-seat image information of the actual conference scene through the video conference camera;

或,采集其他符合实际会议场景的静态图像信息设置为背景画面信息。Or, collect other static image information that conforms to the actual conference scene and set it as the background image information.

进一步地,画面分割单元具体用于:Further, the picture segmentation unit is specifically used for:

当视频会议系统获取的是摄像位置为两个座位的即时图像信息时,沿所述获得的即时图像的中间的坐标位置进行分割;When the video conferencing system obtains the instant image information whose camera positions are two seats, the segmentation is performed along the coordinate position in the middle of the obtained instant image;

当视频会议系统获取的是摄像位置为三个座位的即时图像信息时,沿所述获得的即时图像的三分之一和三分之二的坐标位置进行分割;When the video conferencing system obtains the instant image information whose camera positions are three seats, segmenting is performed along the coordinate positions of one-third and two-thirds of the obtained instant image;

当视频会议系统获取的摄像位置为其他规格的即时图像信息时,按照外部指令确定的尺寸及位置,沿所述获得的即时图像的相应坐标位置进行分割。When the camera position obtained by the video conferencing system is the instant image information of other specifications, according to the size and position determined by the external instruction, it is divided along the corresponding coordinate position of the obtained instant image.

进一步地,采集单元具体用于:Further, the collection unit is specifically used for:

通过外部指令,从画面分割单元分割的即时图像信息中,采集视频会议参与视频会议参与者所在的座位位置对应的图像信息,作为画面居中的前景画面;或,Through an external command, collect the image information corresponding to the seat position of the video conference participant from the real-time image information segmented by the image segmentation unit, as the foreground image in the center of the image; or,

通过图像匹配的方法,从分割的即时图像信息中,采集视频会议参与者所在的座位位置对应的图像信息,作为画面居中的前景画面。Through the method of image matching, the image information corresponding to the seat position of the video conference participant is collected from the segmented real-time image information, and used as the foreground image in the center of the image.

再一方面,本发明提供一种处理视频会议画面的会议终端,包括:采集单元、画面分割单元及叠加单元;其中,In another aspect, the present invention provides a conference terminal for processing video conference images, including: a collection unit, a screen segmentation unit, and a superimposition unit; wherein,

画面分割单元,用于将视频会议的会议参与者的即时图像信息进行分割;a picture segmentation unit, used for segmenting the instant image information of the conference participants of the video conference;

采集单元,用于从画面分割单元分割的即时图像信息中,获取作为画面居中的前景画面信息;an acquisition unit, configured to acquire foreground image information as the center of the image from the real-time image information segmented by the image segmentation unit;

叠加单元,用于将获取的前景画面信息叠加到视频会议的背景画面信息中,生成视频会议参与者的画面居中的视频图像信息。A superimposing unit, configured to superimpose the acquired foreground image information into the background image information of the video conference, to generate video image information in which the images of the video conference participants are centered.

进一步地,会议终端还包括获取单元,用于获取所述视频会议的背景画面信息。Further, the conference terminal further includes an acquisition unit for acquiring background picture information of the video conference.

进一步地,视频会议的背景画面信息包括:通过视频会议系统直接获得,作为背景画面的图像信息;或,Further, the background picture information of the video conference includes: directly obtained through the video conference system as the image information of the background picture; or,

通过采集符合实际会议场景的静态图像信息的装置获得后,发送到会议终端,作为背景画面的图像信息。After being obtained by a device for collecting static image information conforming to the actual conference scene, it is sent to the conference terminal as the image information of the background image.

进一步地,画面分割单元具体用于:Further, the picture segmentation unit is specifically used for:

当视频会议的会议参与者的即时图像信息为两个座位的摄像位置的即时图像信息时,沿所述获得的即时图像的中间的坐标位置进行分割;When the real-time image information of the conference participants of the video conference is the real-time image information of the camera positions of the two seats, the segmentation is performed along the middle coordinate position of the obtained real-time image;

当视频会议的会议参与者的即时图像信息为三个座位的摄像位置的即时图像信息时,沿所述获得的即时图像的三分之一和三分之二的坐标位置进行分割;When the instant image information of the conference participants of the video conference is the instant image information of the camera positions of the three seats, the segmentation is performed along the coordinate positions of one-third and two-thirds of the obtained instant image;

当视频会议的会议参与者的即时图像信息为其他规格的摄像位置的即时图像信息时,按照会议参与者设置的外部指令确定的尺寸及位置,沿所述获得的即时图像的相应坐标位置进行分割。When the real-time image information of the conference participant of the video conference is the real-time image information of the camera position of other specifications, according to the size and position determined by the external instructions set by the conference participant, the segmentation is performed along the corresponding coordinate position of the obtained real-time image. .

进一步地,采集单元具体用于:Further, the collection unit is specifically used for:

通过外部指令,从画面分割单元分割的即时图像信息中,采集视频会议参与者所在的座位位置对应的图像信息,作为画面居中的前景画面信息;或,Through an external command, collect image information corresponding to the seat position of the video conference participant from the real-time image information segmented by the image segmentation unit, as the foreground image information in the center of the image; or,

通过图像匹配的方法,从分割的即时图像信息中,采集视频会议参与者所在的座位位置对应的相应的图像信息,作为的画面居中的前景画面信息。Through the image matching method, the corresponding image information corresponding to the seat position of the video conference participant is collected from the segmented real-time image information, as the foreground image information in the center of the image.

本申请提供一种技术方案包括:获取视频会议的背景画面信息;当进行视频会议时,分割视频会议系统的即时图像信息;从分割的即时图像信息中获取作为画面居中的前景画面信息;叠加前景画面信息到背景画面信息中,生成画面居中的视频图像信息。本申请还包括与方法相对应的装置及会议终端。通过本发明方法及装置,实现对参与视频会议人员的视频会议系统的即时图像进行分割以获得前景画面,通过将前景画面叠加到背景画面中,生成画面居中的视频图像,使视频会议参与者处于视频图像的居中位置,改善视频会议系统用户体验。The present application provides a technical solution including: acquiring background image information of a video conference; when conducting a video conference, segmenting the instant image information of the video conferencing system; acquiring foreground image information as the center of the image from the segmented instant image information; overlaying the foreground The picture information is added to the background picture information to generate the video image information in the center of the picture. The present application also includes a device and a conference terminal corresponding to the method. With the method and device of the present invention, the instant image of the video conference system of the participants in the video conference can be segmented to obtain a foreground image, and by superimposing the foreground image on the background image, a video image with the image in the center is generated, so that the video conference participants are in the The central position of the video image improves the user experience of the video conferencing system.

附图说明Description of drawings

此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:The accompanying drawings described herein are used to provide a further understanding of the present invention and constitute a part of the present application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the attached image:

图1为本发明处理视频会议画面的方法流程图;1 is a flowchart of a method for processing a video conference screen according to the present invention;

图2为本发明处理视频会议画面的装置的结构框图。FIG. 2 is a structural block diagram of an apparatus for processing video conference images according to the present invention.

具体实施方式Detailed ways

图1为本发明处理视频会议画面的方法流程图,如图1所示,一种视频会议画面居中的方法包括:FIG. 1 is a flowchart of a method for processing a video conference screen according to the present invention. As shown in FIG. 1 , a method for centering a video conference screen includes:

步骤100、获取视频会议的背景画面信息。Step 100: Acquire background picture information of the video conference.

本步骤中,获取视频会议的背景画面信息包括:通过视频会议摄像头获取实际会议场景的无座位图像信息,或获取其他符合实际会议场景的静态图像信息作为背景画面信息。In this step, acquiring the background image information of the video conference includes: acquiring the no-seat image information of the actual conference scene through the video conference camera, or acquiring other static image information conforming to the actual conference scene as the background image information.

步骤101、当进行视频会议时,分割视频会议系统的即时图像信息;Step 101, when conducting a video conference, segment the real-time image information of the video conference system;

本步骤中,分割视频会议系统的即时图像信息包括:In this step, the instant image information of the segmented video conference system includes:

当视频会议系统获取的是摄像位置为两个座位的即时图像信息时,沿所述获得的即时图像的中间的坐标位置进行分割;When the video conferencing system obtains the instant image information whose camera positions are two seats, the segmentation is performed along the coordinate position in the middle of the obtained instant image;

当视频会议系统获取的是摄像位置为三个座位的即时图像信息时,沿所述获得的即时图像的三分之一和三分之二的坐标位置进行分割;When the video conferencing system obtains the instant image information whose camera positions are three seats, segmenting is performed along the coordinate positions of one-third and two-thirds of the obtained instant image;

当视频会议系统获取的摄像位置为其他规格的即时图像信息时,按照外部指令确定的尺寸及位置,沿所述获得的即时图像的相应坐标位置进行分割。When the camera position obtained by the video conferencing system is the instant image information of other specifications, according to the size and position determined by the external instruction, it is divided along the corresponding coordinate position of the obtained instant image.

步骤102、从分割的即时图像信息中获取作为画面居中的前景画面信息。Step 102: Obtain the foreground image information as the center of the image from the segmented real-time image information.

本步骤中,从分割的即时图像信息中获取作为画面居中的前景画面信息包括:In this step, obtaining the foreground image information as the center of the image from the segmented real-time image information includes:

通过外部指令,从分割的即时图像信息中获取视频会议参与视频会议参与者所在的座位位置对应的图像信息作为画面居中的前景画面;或,Obtain the image information corresponding to the seat position of the video conference participant from the segmented real-time image information through an external command as the foreground image in the center of the image; or,

通过图像匹配的方法,从分割的即时图像信息中获取视频会议参与者所在的座位位置对应的图像信息作为画面居中的前景画面。Through the method of image matching, the image information corresponding to the seat position of the video conference participant is obtained from the segmented real-time image information as the foreground image in the center of the image.

需要说明的是,采用外部指令或者图像匹配的方法确定参与者所在的座位位置的图像座位前景画面,只是针对目前的系统进行的设置,如果采用限定图像的大小和检测一定数量设定的标识信息进行前景画面的获取,其实现原理和图像匹配类似,或者说是图像匹配的一个分支,属于本发明的保护范围。It should be noted that the use of external instructions or image matching methods to determine the image seat foreground screen of the seat position of the participant is only a setting for the current system. The realization principle of acquiring the foreground picture is similar to that of image matching, or it is a branch of image matching, which belongs to the protection scope of the present invention.

步骤103、叠加前景画面信息到背景画面信息中,生成画面居中的视频图像信息。Step 103 , superimposing the foreground image information into the background image information to generate video image information with the image centered.

需要说明的是,叠加方法采用现场可编程门阵列(FPGA)硬件;或数字信号处理器(DSP)的硬件或软件算法实现,具体实现在图像处理和视频应用领域都有应用,属于本领域的公知常识。It should be noted that the superposition method is realized by hardware of Field Programmable Gate Array (FPGA), or hardware or software of Digital Signal Processor (DSP). common sense.

图2为本发明处理视频会议画面的装置的结构框图,如图2所示,包括:背景单元、画面分割单元、采集单元及叠加单元;其中,FIG. 2 is a structural block diagram of an apparatus for processing video conference images according to the present invention. As shown in FIG. 2 , it includes: a background unit, an image segmentation unit, a collection unit and a superimposition unit; wherein,

背景单元,用于采集视频会议的背景画面信息。The background unit is used to collect background picture information of the video conference.

获取视频会议的背景画面信息包括:通过视频会议摄像头采集实际会议场景的无座位图像信息;Obtaining the background image information of the video conference includes: collecting the no-seat image information of the actual conference scene through the video conference camera;

或,采集其他符合实际会议场景的静态图像信息设置为背景画面信息。Or, collect other static image information that conforms to the actual conference scene and set it as the background image information.

画面分割单元,用于分割视频会议系统的即时图像信息。The picture dividing unit is used to divide the instant image information of the video conference system.

进一步地,画面分割单元具体用于:Further, the picture segmentation unit is specifically used for:

当视频会议系统获取的是摄像位置为两个座位的即时图像信息时,沿所述获得的即时图像的中间的坐标位置进行分割;When the video conferencing system obtains the instant image information whose camera positions are two seats, the segmentation is performed along the coordinate position in the middle of the obtained instant image;

当视频会议系统获取的是摄像位置为三个座位的即时图像信息时,沿所述获得的即时图像的三分之一和三分之二的坐标位置进行分割;When the video conferencing system obtains the instant image information whose camera positions are three seats, segmenting is performed along the coordinate positions of one-third and two-thirds of the obtained instant image;

当视频会议系统获取的摄像位置为其他规格的即时图像信息时,按照外部指令确定的尺寸及位置,沿所述获得的即时图像的相应坐标位置进行分割。When the camera position obtained by the video conferencing system is the instant image information of other specifications, according to the size and position determined by the external instruction, it is divided along the corresponding coordinate position of the obtained instant image.

采集单元,用于从画面分割单元分割后的图像信息中采集作为画面居中的前景画面信息。The collection unit is configured to collect foreground image information as the center of the image from the image information segmented by the image segmentation unit.

进一步地,采集单元具体用于:Further, the collection unit is specifically used for:

通过外部指令,从分割的即时图像信息中,采集视频会议参与视频会议参与者所在的座位位置对应的图像信息,作为画面居中的前景画面;或,Through an external command, from the segmented real-time image information, the image information corresponding to the seat position of the participants in the video conference is collected as the foreground image in the center of the image; or,

通过图像匹配的方法,从分割的即时图像信息中,采集视频会议参与者所在的座位位置对应的图像信息,作为画面居中的前景画面。Through the method of image matching, the image information corresponding to the seat position of the video conference participant is collected from the segmented real-time image information, and used as the foreground image in the center of the image.

叠加单元,用于将获取单元得到的前景画面信息叠加到、背景单元的背景画面信息中,以生成画面居中的视频图像信息。The superimposing unit is configured to superimpose the foreground image information obtained by the acquiring unit into the background image information of the background unit, so as to generate video image information with the image centered.

需要说明的是,叠加方法采用现场可编程门阵列(FPGA)硬件;或数字信号处理器DSP的硬件或软件算法实现,具体实现在图像处理和视频应用领域都有应用,属于本领域的公知常识。It should be noted that the superposition method is implemented by hardware of field programmable gate array (FPGA); or by hardware or software algorithm of digital signal processor DSP. The specific implementation has applications in the fields of image processing and video applications, and belongs to common knowledge in the field. .

一种处理视频会议画面的会议终端,包括:采集单元、画面分割单元及叠加单元;其中,A conference terminal for processing video conference images, comprising: a collection unit, an image segmentation unit and a superimposition unit; wherein,

画面分割单元,用于将视频会议的会议参与者的即时图像信息进行分割。The picture segmentation unit is used for segmenting the instant image information of the conference participants of the video conference.

需要说明的是,视频会议的会议参与者的即时图像信息为通过现有技术视频会议的摄像装置获得,该部分为公知常识,在此不再赘述。It should be noted that the real-time image information of the conference participants of the video conference is obtained through the camera device of the video conference in the prior art, and this part is common knowledge and will not be repeated here.

画面分割单元具体用于:The screen splitting unit is specifically used for:

当视频会议的会议参与者的即时图像信息为两个座位摄像位置的即时图像信息时,沿所述获得的即时图像的中间的坐标位置进行分割;When the real-time image information of the conference participants of the video conference is the real-time image information of the two seat camera positions, the segmentation is performed along the middle coordinate position of the obtained real-time image;

当视频会议的会议参与者的即时图像信息为两个座位摄像位置的即时图像信息时,沿所述获得的即时图像的三分之一和三分之二的坐标位置进行分割;When the instant image information of the conference participants of the video conference is the instant image information of the two seat camera positions, the segmentation is performed along the coordinate positions of one-third and two-thirds of the obtained instant image;

当视频会议的会议参与者的即时图像信息为两个座位摄像位置的即时图像信息时,按照会议参与者设置的外部指令确定的尺寸及位置,沿所述获得的即时图像的相应坐标位置进行分割。When the real-time image information of the conference participants of the video conference is the real-time image information of the two seat camera positions, according to the size and position determined by the external instructions set by the conference participants, the segmentation is performed along the corresponding coordinate positions of the obtained real-time image. .

采集单元,用于从画面分割单元分割的即时图像信息中,获取作为画面居中的前景画面信息。The acquisition unit is configured to acquire foreground image information as the center of the image from the real-time image information segmented by the image segmentation unit.

采集单元具体用于:The acquisition unit is specifically used for:

通过外部指令,从画面分割单元分割的即时图像信息中,采集视频会议参与者所在的座位位置对应的图像信息,作为画面居中的前景画面信息;或,Through an external command, collect image information corresponding to the seat position of the video conference participant from the real-time image information segmented by the image segmentation unit, as the foreground image information in the center of the image; or,

通过图像匹配的方法,从分割的即时图像信息中,采集视频会议参与者所在的座位位置对应的相应的图像信息,作为的画面居中的前景画面信息。Through the image matching method, the corresponding image information corresponding to the seat position of the video conference participant is collected from the segmented real-time image information, as the foreground image information in the center of the image.

叠加单元,用于将获取的前景画面信息叠加到视频会议的背景画面信息中,生成视频会议参与者的画面居中的视频图像信息。A superimposing unit, configured to superimpose the acquired foreground image information into the background image information of the video conference, to generate video image information in which the images of the video conference participants are centered.

需要说明的是,即时图像信息的分割、叠加及画面居中的视频图像信息的生成等,主要通过图像处理软件或者视频会议系统加载相应的软件处理程序即可实现。It should be noted that the segmentation and superposition of real-time image information, and the generation of video image information in the center of the screen, etc., can be realized mainly by loading corresponding software processing programs through image processing software or a video conference system.

会议终端还包括获取单元,用于获取所述视频会议的背景画面信息。The conference terminal further includes an acquisition unit configured to acquire background picture information of the video conference.

视频会议的背景画面信息包括:通过视频会议系统直接获得,作为背景画面的图像信息;或,The background picture information of the video conference includes: image information obtained directly through the video conference system and used as the background picture; or,

通过采集符合实际会议场景的静态图像信息的装置获得后,发送到会议终端,以作为背景画面的图像信息。After the device is obtained by collecting static image information conforming to the actual conference scene, it is sent to the conference terminal to be used as the image information of the background image.

需要说明的是,背景画面信息通过视频会议系统直接获得是指,通过视频会议系统的摄像装置直接获取。另外,采集符合实际会议场景的静态图像信息的装置。可以是现有技术常见的摄像机、照相机、普通的摄像装置、带有摄像功能的设备及可以获取到静态图片的存储设备或者网络访问设备,只有具备这样的功能,就是符合本发明所需的装置。另外这类装置与会议终端通过有线或者无线的方式实现数据传输。该部分为公知常识,在此不再赘述。It should be noted that, the background picture information is directly obtained through the video conference system means that it is directly obtained through the camera device of the video conference system. In addition, a device for collecting static image information conforming to the actual meeting scene. It can be a common video camera, a camera, an ordinary camera device, a device with a camera function, a storage device or a network access device that can obtain static pictures, and only with such a function is the device required by the present invention. . In addition, such devices and conference terminals realize data transmission through wired or wireless means. This part is common knowledge and will not be repeated here.

以上所述,仅为本发明的较佳实例而已,并非用于限定本发明的保护范围,对于摄像位置为其他座位图像,实现方法与本发明原理一致,另外对于图像分割叠加等方法,本发明只是列举常用方法,可以实现分割和叠加的方法很多。凡在本发明的精神和原则之内,所做的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above is only a preferred example of the present invention, and is not intended to limit the protection scope of the present invention. For the camera position of other seat images, the implementation method is consistent with the principle of the present invention. In addition, for methods such as image segmentation and stacking, the present invention Just to list the common methods, there are many ways to achieve segmentation and stacking. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included within the protection scope of the present invention.

Claims (3)

1.一种处理视频会议画面的方法,其特征在于,包括:1. a method for processing video conference picture, is characterized in that, comprises: 通过视频会议摄像头获取实际会议场景的无座位图像信息作为背景画面信息;Obtain the seatless image information of the actual conference scene through the video conference camera as the background image information; 当进行视频会议时,分割视频会议系统的即时图像信息;所述分割视频会议系统的即时图像信息包括:当视频会议系统获取的是摄像位置为两个座位的即时图像信息时,沿获得的即时图像的中间的坐标位置进行分割;当视频会议系统获取的是摄像位置为三个座位的即时图像信息时,沿获得的即时图像的三分之一和三分之二的坐标位置进行分割;当视频会议系统获取的摄像位置为其他规格的即时图像信息时,按照外部指令确定的尺寸及位置,沿获得的即时图像的相应坐标位置进行分割;When conducting a video conference, the instant image information of the video conferencing system is divided; the instant image information of the divided video conferencing system includes: when the video conferencing system obtains the instant image information with the camera positions of two seats, along the obtained instant image information The coordinate position in the middle of the image is divided; when the video conference system obtains the instant image information with the camera position of three seats, it is divided along the coordinate positions of one-third and two-thirds of the obtained instant image; When the camera position obtained by the video conferencing system is the instant image information of other specifications, it shall be divided along the corresponding coordinate position of the obtained instant image according to the size and position determined by the external instruction; 从分割的即时图像信息中获取作为画面居中的前景画面信息,包括:通过外部指令,从分割的即时图像信息中获取视频会议参与者所在的座位位置对应的图像信息作为画面居中的前景画面;或,通过图像匹配的方法,从分割的即时图像信息中获取视频会议参与者所在的座位位置对应的图像信息作为画面居中的前景画面;Obtaining the foreground image information as the center of the image from the segmented real-time image information includes: obtaining, from the segmented real-time image information, image information corresponding to the seat position of the video conference participant as the image centering foreground image from the segmented real-time image information; or , by the method of image matching, obtain the image information corresponding to the seat position of the video conference participant from the segmented real-time image information as the foreground image in the center of the image; 叠加前景画面信息到背景画面信息中,生成画面居中的视频图像信息。The foreground image information is superimposed on the background image information to generate video image information with the image centered. 2.一种处理视频会议画面的装置,其特征在于,包括:背景单元、画面分割单元、采集单元及叠加单元;其中,2. A device for processing video conference images, comprising: a background unit, an image segmentation unit, a collection unit and a superimposition unit; wherein, 背景单元,用于通过视频会议摄像头采集实际会议场景的无座位图像信息作为背景画面信息;The background unit is used to collect the no-seat image information of the actual conference scene as the background image information through the video conference camera; 画面分割单元,用于分割视频会议系统的即时图像信息,具体用于,当视频会议系统获取的是摄像位置为两个座位的即时图像信息时,沿获得的即时图像的中间的坐标位置进行分割;当视频会议系统获取的是摄像位置为三个座位的即时图像信息时,沿获得的即时图像的三分之一和三分之二的坐标位置进行分割;当视频会议系统获取的摄像位置为其他规格的即时图像信息时,按照外部指令确定的尺寸及位置,沿获得的即时图像的相应坐标位置进行分割;The screen splitting unit is used to split the instant image information of the video conferencing system, and is specifically used for splitting the instant image information along the middle of the obtained instant image when the video conferencing system obtains the instant image information with the camera positions of two seats. ; When the video conferencing system obtains the instant image information with the camera position of three seats, it is divided along the coordinate positions of one-third and two-thirds of the obtained instant image; when the camera position obtained by the video conferencing system is For real-time image information of other specifications, according to the size and position determined by external instructions, it is divided along the corresponding coordinate position of the obtained real-time image; 采集单元,用于从画面分割单元分割后的图像信息中采集作为画面居中的前景画面信息,具体用于:通过外部指令,从画面分割单元分割的即时图像信息中,采集视频会议参与者所在的座位位置对应的图像信息,作为画面居中的前景画面;或,通过图像匹配的方法,从分割的即时图像信息中,采集视频会议参与者所在的座位位置对应的图像信息,作为画面居中的前景画面;The collection unit is used to collect the foreground image information as the center of the image from the image information divided by the image segmentation unit, and is specifically used for: through an external instruction, from the real-time image information divided by the image segmentation unit, collect the video conference participant's location. The image information corresponding to the seat position is used as the foreground image in the center of the screen; or, through the method of image matching, the image information corresponding to the seat position of the video conference participant is collected from the segmented real-time image information, as the foreground image in the center of the image. ; 叠加单元,用于将获取单元得到的前景画面信息叠加到、背景单元的背景画面信息中,以生成画面居中的视频图像信息。The superimposing unit is configured to superimpose the foreground image information obtained by the acquiring unit into the background image information of the background unit, so as to generate video image information with the image centered. 3.一种处理视频会议画面的会议终端,其特征在于,包括:获取单元、采集单元、画面分割单元及叠加单元;其中,3. A conference terminal for processing video conference images, comprising: an acquisition unit, a collection unit, an image segmentation unit and a superimposition unit; wherein, 获取单元,用于通过视频会议摄像头采集实际会议场景的无座位图像信息作为背景画面信息;an acquisition unit, used for collecting the no-seat image information of the actual conference scene through the video conference camera as the background image information; 画面分割单元,用于将视频会议的会议参与者的即时图像信息进行分割,具体用于,当视频会议的会议参与者的即时图像信息为两个座位的摄像位置的即时图像信息时,沿获得的即时图像的中间的坐标位置进行分割;当视频会议的会议参与者的即时图像信息为三个座位的摄像位置的即时图像信息时,沿获得的即时图像的三分之一和三分之二的坐标位置进行分割;当视频会议的会议参与者的即时图像信息为其他规格的摄像位置的即时图像信息时,按照会议参与者设置的外部指令确定的尺寸及位置,沿获得的即时图像的相应坐标位置进行分割;The screen segmentation unit is used to segment the instant image information of the meeting participants of the video conference, and is specifically used for, when the instant image information of the meeting participants of the video conference is the instant image information of the camera positions of the two seats, along with the obtained image information. When the instant image information of the meeting participants of the video conference is the instant image information of the camera positions of the three seats, one-third and two-thirds of the instant image obtained along the When the real-time image information of the conference participants of the video conference is the real-time image information of the camera positions of other specifications, the size and position determined by the external instructions set by the conference participants are determined along the corresponding real-time image information obtained by the conference participants. The coordinate position is divided; 采集单元,用于从画面分割单元分割的即时图像信息中,获取作为画面居中的前景画面信息,具体用于:通过外部指令,从画面分割单元分割的即时图像信息中,采集视频会议参与者所在的座位位置对应的图像信息,作为画面居中的前景画面信息;或,通过图像匹配的方法,从分割的即时图像信息中,采集视频会议参与者所在的座位位置对应的相应的图像信息,作为的画面居中的前景画面信息;The acquisition unit is used to acquire the foreground image information as the center of the image from the real-time image information divided by the image segmentation unit, and is specifically used to: collect the location of the video conference participant from the real-time image information divided by the image segmentation unit through an external instruction. The image information corresponding to the seat position of the video conference participant is used as the foreground image information in the center of the screen; or, through the method of image matching, from the segmented real-time image information, the corresponding image information corresponding to the seat position of the video conference participant is collected as the Information about the foreground screen in the center of the screen; 叠加单元,用于将获取的前景画面信息叠加到视频会议的背景画面信息中,生成视频会议参与者的画面居中的视频图像信息。A superimposing unit, configured to superimpose the acquired foreground image information into the background image information of the video conference, to generate video image information in which the images of the video conference participants are centered.
CN201310710567.3A 2013-12-20 2013-12-20 A method, device and conference terminal for processing video conference images Active CN103997616B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201310710567.3A CN103997616B (en) 2013-12-20 2013-12-20 A method, device and conference terminal for processing video conference images
PCT/CN2014/073182 WO2015089944A1 (en) 2013-12-20 2014-03-11 Method and device for processing picture of video conference, and conference terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310710567.3A CN103997616B (en) 2013-12-20 2013-12-20 A method, device and conference terminal for processing video conference images

Publications (2)

Publication Number Publication Date
CN103997616A CN103997616A (en) 2014-08-20
CN103997616B true CN103997616B (en) 2019-02-05

Family

ID=51311605

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310710567.3A Active CN103997616B (en) 2013-12-20 2013-12-20 A method, device and conference terminal for processing video conference images

Country Status (2)

Country Link
CN (1) CN103997616B (en)
WO (1) WO2015089944A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9282287B1 (en) * 2014-09-09 2016-03-08 Google Inc. Real-time video transformations in video conferences
JP6399606B2 (en) * 2016-07-12 2018-10-03 Necプラットフォームズ株式会社 Video conference system and video conference method
CN110456907A (en) * 2019-07-24 2019-11-15 广东虚拟现实科技有限公司 Virtual screen control method, device, terminal equipment and storage medium
TWI749391B (en) * 2019-10-30 2021-12-11 緯創資通股份有限公司 Video conferencing system and video conferencing method
CN113723397B (en) * 2020-05-26 2023-07-25 华为技术有限公司 Screen capturing method and electronic equipment

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102177711A (en) * 2008-10-07 2011-09-07 坦德伯格电信公司 Method, device and computer program for processing images during video conferencing

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100416991B1 (en) * 2001-01-11 2004-02-05 삼성전자주식회사 Video terminal apparatus having displaying virtual background and implementing method thereof
US20090028432A1 (en) * 2005-12-30 2009-01-29 Luca Rossato Segmentation of Video Sequences
EP2597868B1 (en) * 2007-09-24 2017-09-13 Qualcomm Incorporated Enhanced interface for voice and video communications
TWI364725B (en) * 2008-05-06 2012-05-21 Primax Electronics Ltd Video processing method and video processing system
US8073243B2 (en) * 2008-05-30 2011-12-06 General Instrument Corporation Replacing image information in a captured image
US8432431B2 (en) * 2008-06-30 2013-04-30 Hewlett-Packard Development Company, L.P. Compositing video streams
CN101753851B (en) * 2008-12-17 2011-12-28 华为终端有限公司 Method for replacing background, method for synthesizing virtual scene, as well as relevant system and equipment
CN102663757A (en) * 2012-04-20 2012-09-12 西安电子科技大学 Semi-automatic image cutting method based on nuclear transfer

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102177711A (en) * 2008-10-07 2011-09-07 坦德伯格电信公司 Method, device and computer program for processing images during video conferencing

Also Published As

Publication number Publication date
CN103997616A (en) 2014-08-20
WO2015089944A1 (en) 2015-06-25

Similar Documents

Publication Publication Date Title
KR102375307B1 (en) Method, apparatus, and system for sharing virtual reality viewport
CN103607568B (en) Stereo street scene video projection method and system
US8970704B2 (en) Network synchronized camera settings
JP6918455B2 (en) Image processing equipment, image processing methods and programs
CN103997616B (en) A method, device and conference terminal for processing video conference images
CN106548517B (en) Method and device for carrying out video conference based on augmented reality technology
CN109257559A (en) A kind of image display method, device and the video conferencing system of panoramic video meeting
WO2018101652A1 (en) Device for providing realistic media image
WO2018214746A1 (en) Video conference realization method, device and system, and computer storage medium
CN105872386A (en) Panoramic camera device and panoramic picture generation method
CN106331529A (en) Image shooting method and device
CN106254784A (en) A kind of method and device of Video processing
JP2009089324A (en) Video conference system and program, and recoding medium
CN108616733A (en) A kind of joining method and panorama camera of full-view video image
CN105933637A (en) Video communication method and system
US9848168B2 (en) Method, synthesizing device, and system for implementing video conference
US10788888B2 (en) Capturing and rendering information involving a virtual environment
CN108769648A (en) A kind of 3D scene rendering methods based on 720 degree of panorama VR
WO2016192467A1 (en) Method and device for playing videos
CN107426561B (en) 3D 360-degree virtual reality live broadcasting method and device
CN109698927A (en) Conference management method, device and storage medium
WO2019061020A1 (en) Image generation method, image generation device, and machine readable storage medium
CN113038262B (en) A panoramic live broadcast method and device
TW201620291A (en) Somatosensory visual communication system and method
CN110297581A (en) A kind of computer room cruising inspection system based on computer room crusing robot

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant