WO2023225910A1

WO2023225910A1 - Video display method and apparatus, terminal device, and computer storage medium

Info

Publication number: WO2023225910A1
Application number: PCT/CN2022/095020
Authority: WO
Inventors: 彭聪
Original assignee: 北京小米移动软件有限公司
Priority date: 2022-05-25
Filing date: 2022-05-25
Publication date: 2023-11-30
Also published as: CN117480772A

Abstract

The present disclosure provides a video display method and apparatus, a terminal device, and a computer storage medium. The video display method is applied to the terminal device, and comprises: when video acquisition is performed, obtaining an initial cropping box (S101); on the basis of the initial cropping box, cropping a preview picture acquired when the terminal device starts a camera (S102); and displaying the cropped picture (S103).

Description

Video display method and device, terminal equipment and computer storage medium

Technical field

本公开涉及无线通信及视频通信领域，尤其涉及一种视频显示方法及装置、终端设备及计算机存储介质。The present disclosure relates to the fields of wireless communications and video communications, and in particular, to a video display method and device, terminal equipment and computer storage media.

Background technique

随着电子产品行业的持续发展，智能终端的许多功能也被设计开发和投入使用。在无线通信领域中，手机等智能终端作为通讯工具不仅可以满足人们的语音通话需求，还可以支持视频通话或视频会议等。With the continuous development of the electronic product industry, many functions of smart terminals have also been designed, developed and put into use. In the field of wireless communications, smart terminals such as mobile phones serve as communication tools that can not only meet people's needs for voice calls, but can also support video calls or video conferencing.

目前，视频通话和视频会议承载着当代人非常多工作和通讯场景。并且，随着疫情的影响，居家办公的时间变得越来越多，对视频会议和视频通话的使用也越来越频繁。在视频会议或视频通话的场景中，智能终端通过摄像头进行视频采集，并显示在显示屏上或通过云端服务器同步给通讯用户。然而，用户在使用智能终端进行视频会议或视频通话时，视频画面的大小无法调整，摄像头取景范围大容易暴露用户的隐私，影响用户的使用体验。Currently, video calls and video conferences carry many work and communication scenarios for contemporary people. Moreover, with the impact of the epidemic, more and more time is spent working from home, and video conferencing and video calls are used more and more frequently. In a video conference or video call scenario, the smart terminal collects video through the camera and displays it on the display or synchronizes it to the communicating user through a cloud server. However, when users use smart terminals for video conferencing or video calls, the size of the video screen cannot be adjusted, and the large viewing range of the camera can easily expose the user's privacy and affect the user experience.

发明内容Contents of the invention

本公开实施例提供一种视频显示方法及装置、终端设备及计算机存储介质。Embodiments of the present disclosure provide a video display method and device, terminal equipment and computer storage media.

本公开实施例第一方面提供一种视频显示方法，应用在终端设备中，所述方法包括：A first aspect of the embodiment of the present disclosure provides a video display method applied in a terminal device. The method includes:

在进行视频采集时，获取初始裁剪框；When collecting video, obtain the initial cropping frame;

基于所述初始裁剪框，对所述终端设备启动摄像头时采集的预览画面进行裁剪；Based on the initial cropping frame, crop the preview image collected when the terminal device starts the camera;

显示裁剪后的画面。Display the cropped image.

在一些实施例中，所述方法还包括：In some embodiments, the method further includes:

在所述终端设备发生运动的情况下，基于所述初始裁剪框，得到目标裁剪框；其中，所述初始裁剪框的框选内容与所述目标裁剪框的框选内容包括同一目标对象；When the terminal device moves, a target cropping frame is obtained based on the initial cropping frame; wherein the frame selection content of the initial cropping frame and the frame selection content of the target cropping frame include the same target object;

基于所述目标裁剪框和所述终端设备运动后采集的目标采集画面，得到目标视频画面；Obtain the target video picture based on the target cropping frame and the target collection picture collected after the movement of the terminal device;

所述显示裁剪后的画面，包括：The cropped picture includes:

显示所述目标视频画面。Display the target video picture.

在一些实施例中，所述基于所述初始裁剪框，得到目标裁剪框，包括：In some embodiments, obtaining a target cropping frame based on the initial cropping frame includes:

获取所述终端设备运动时的运动信息；Obtain motion information when the terminal device is in motion;

基于所述运动信息，对所述初始裁剪框进行调整得到所述目标裁剪框。Based on the motion information, the initial cropping frame is adjusted to obtain the target cropping frame.

在一些实施例中，所述运动信息包括：所述终端设备相对于所述目标对象移动的移动距离和/或所述终端设备相对于所述目标对象旋转的旋转角度；In some embodiments, the motion information includes: a movement distance of the terminal device relative to the target object and/or a rotation angle of the terminal device relative to the target object;

所述基于所述运动信息，对所述初始裁剪框进行调整得到所述目标裁剪框，包括：The step of adjusting the initial cropping frame to obtain the target cropping frame based on the motion information includes:

基于所述移动距离，调整所述初始裁剪框的尺寸，得到所述目标裁剪框；和/或Based on the movement distance, adjust the size of the initial cropping frame to obtain the target cropping frame; and/or

基于所述旋转角度，调整所述初始裁剪框的位置，得到所述目标裁剪框。Based on the rotation angle, the position of the initial cropping frame is adjusted to obtain the target cropping frame.

在一些实施例中，所述基于所述目标裁剪框和所述终端设备运动后采集的目标采集画面，得到目标视频画面，包括：In some embodiments, obtaining the target video picture based on the target cropping frame and the target collection picture collected after the movement of the terminal device includes:

对所述目标裁剪框外的画面进行遮盖，并将遮盖后的画面和所述目标裁剪框内的画面作为所述目标视频画面；Cover the picture outside the target cropping frame, and use the covered picture and the picture within the target cropping frame as the target video picture;

或者，or,

基于所述目标裁剪框对所述目标采集画面进行裁剪得到裁剪画面；并对所述裁剪画面进行放大处理得到所述目标视频画面。The target collection picture is cropped based on the target cropping frame to obtain a cropped picture; and the cropped picture is enlarged to obtain the target video picture.

在一些实施例中，所述获取初始裁剪框，包括：In some embodiments, obtaining the initial cropping frame includes:

基于作用于所述预览画面上的移动轨迹确定所述初始裁剪框；Determine the initial cropping frame based on the movement trajectory acting on the preview screen;

或者，or,

对所述预览画面进行目标检测，将检测得到的目标对象所对应的显示框作为所述初始裁剪框。Target detection is performed on the preview screen, and the display frame corresponding to the detected target object is used as the initial cropping frame.

在所述目标裁剪框部分位于所述目标采集画面内的情况下，缩小所述目标裁剪框的尺寸，并基于缩小后的裁剪框得到所述目标视频画面。When the target cropping frame is partially located within the target capture frame, the size of the target cropping frame is reduced, and the target video frame is obtained based on the reduced cropping frame.

在一些实施例中，所述显示裁剪后的画面，包括：In some embodiments, displaying the cropped picture includes:

确定所述裁剪后的画面是否存在敏感对象；Determine whether there are sensitive objects in the cropped picture;

在所述裁剪后的画面存在所述敏感对象的情况下，对所述敏感对象进行模糊处理或裁剪所述敏感对象所在的画面。When the sensitive object exists in the cropped picture, the sensitive object is blurred or the picture in which the sensitive object is located is cropped.

对所述裁剪后的画面进行纠偏，并显示纠偏后的画面。Deskew the cropped picture and display the corrected picture.

本公开实施例第二方面提供一种视频显示装置，其中，应用于终端设备中，所述装置包括：A second aspect of the embodiment of the present disclosure provides a video display device, which is used in a terminal device, and the device includes:

获取模块，被配置为在视频采集时，获取初始裁剪框；The acquisition module is configured to obtain the initial cropping frame during video capture;

裁剪模块，被配置为基于所述初始裁剪框，对所述终端设备启动摄像头时采集的预览画面进行裁剪；A cropping module configured to crop the preview image collected when the terminal device starts the camera based on the initial cropping frame;

显示模块，被配置为显示裁剪后的画面。The display module is configured to display the cropped picture.

在一些实施例中，所述装置还包括：In some embodiments, the device further includes:

调整模块，被配置为在所述终端设备发生运动的情况下，基于所述初始裁剪框，得到目标裁剪框；其中，所述初始裁剪框的框选内容与所述目标裁剪框的框选内容包括同一目标对象；an adjustment module configured to obtain a target cropping frame based on the initial cropping frame when the terminal device moves; wherein the frame selection content of the initial cropping frame and the frame selection content of the target cropping frame Include the same target audience;

所述裁剪模块还被配置为：基于所述目标裁剪框和所述终端设备运动后采集的目标采集画面，得到目标视频画面；The cropping module is also configured to: obtain a target video picture based on the target cropping frame and the target collection picture collected after the movement of the terminal device;

所述显示模块，还被配置为：显示所述目标视频画面。The display module is also configured to display the target video picture.

在一些实施例中，所述调整模块包括：In some embodiments, the adjustment module includes:

检测单元，被配置为获取所述终端设备运动时的运动信息；A detection unit configured to obtain motion information when the terminal device moves;

调整单元，被配置为基于所述运动信息，对所述初始裁剪框进行调整得到所述目标裁剪框。The adjustment unit is configured to adjust the initial cropping frame to obtain the target cropping frame based on the motion information.

在一些实施例中，所述运动信息包括：所述终端设备相对于所述目标对象移动的移动距离和/或所述终端设备相对于所述目标对象旋转的旋转角度：In some embodiments, the motion information includes: a movement distance of the terminal device relative to the target object and/or a rotation angle of the terminal device relative to the target object:

所述调整单元，还被配置为基于所述移动距离，调整所述初始裁剪框的尺寸，得到所述目标裁剪框；和/或The adjustment unit is further configured to adjust the size of the initial cropping frame based on the movement distance to obtain the target cropping frame; and/or

在一些实施例中，所述裁剪模块还被配置为：In some embodiments, the cropping module is further configured to:

或者，or,

在一些实施例中，所述获取模块还被配置为：In some embodiments, the acquisition module is further configured to:

或者，or,

在一些实施例中，所述显示模块还被配置为：In some embodiments, the display module is further configured to:

在所述裁剪后的画面存在所述敏感对象的情况下，对敏感对象进行模糊处理或裁剪所述敏感对象所在的画面。When the sensitive object exists in the cropped picture, the sensitive object is blurred or the picture in which the sensitive object is located is cropped.

本公开实施例第三方面提供一种终端设备，包括处理器、存储器及存储在存储器上并能够有所述处理器运行的可执行程序，其中，所述处理器运行所述可执行程序时执行如前述第一方面提供的视频显示方法。A third aspect of the embodiment of the present disclosure provides a terminal device, including a processor, a memory, and an executable program stored in the memory and capable of being run by the processor, wherein when the processor runs the executable program, Such as the video display method provided in the first aspect.

本公开实施例第四方面提供一种计算机存储介质，所述计算机存储介质存储有可执行程序；所述可执行程序被处理器执行后，能够实现前述第一方面提供的视频显示方法。A fourth aspect of the embodiments of the present disclosure provides a computer storage medium that stores an executable program; after the executable program is executed by a processor, the video display method provided in the first aspect can be implemented.

本公开实施例提供的技术方案，在进行视频采集时，获取初始裁剪框，能够精准且有效的确定用户需要显示的视频画面区域；基于初始裁剪框去裁剪终端设备启动摄像头时采集的预览画面，能够调整显示画面的大小和显示内容，有效的满足用户需求，减轻摄像头取景范围过大所引起的用户的隐私暴露，保证用户的使用安全和使用体验。The technical solution provided by the embodiment of the present disclosure obtains an initial cropping frame during video collection, which can accurately and effectively determine the video image area that the user needs to display; and based on the initial cropping frame, the preview image collected when the terminal device starts the camera is cropped. It can adjust the size and display content of the display screen to effectively meet user needs, reduce user privacy exposure caused by excessive camera viewing range, and ensure user safety and experience.

应当理解的是，以上的一般描述和后文的细节描述仅是示例性和解释性的，并不能限制本公开实施例。It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and do not limit the embodiments of the present disclosure.

Description of the drawings

此处的附图被并入说明书中并构成本说明书的一部分，示出了符合本发明实施例，并与说明书一起用于解释本发明实施例的原理。The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description serve to explain the principles of the embodiments of the invention.

图1是根据一示例性实施例示出的一种视频显示方法的流程示意图一；Figure 1 is a schematic flowchart 1 of a video display method according to an exemplary embodiment;

图2是根据一示例性实施例示出的一种视频显示方法的流程示意图二；Figure 2 is a schematic flowchart 2 of a video display method according to an exemplary embodiment;

图3是根据一示例性实施例示出的一种视频显示方法的流程示意图三；Figure 3 is a schematic flowchart 3 of a video display method according to an exemplary embodiment;

图4是根据一示例性实施例示出的终端设备采集的预览画面的示意图；Figure 4 is a schematic diagram of a preview screen collected by a terminal device according to an exemplary embodiment;

图5是根据一示例性实施例示出的终端设备采集的目标采集画面的示意图；Figure 5 is a schematic diagram of a target collection screen collected by a terminal device according to an exemplary embodiment;

图6是根据一示例性实施例示出的一种在视频通信场景下的视频显示方法的流程示意图；Figure 6 is a schematic flowchart of a video display method in a video communication scenario according to an exemplary embodiment;

图7是根据一示例性实施例示出的一种视频显示装置的结构示意图；Figure 7 is a schematic structural diagram of a video display device according to an exemplary embodiment;

图8是根据一示例性实施例示出的一种终端设备的框图。Figure 8 is a block diagram of a terminal device according to an exemplary embodiment.

Detailed ways

这里将详细地对示例性实施例进行说明，其示例表示在附图中。下面的描述涉及附图时，除非另有表示，不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本发明实施例相一致的所有实施方式。相反，它们仅是本发明实施例的一些方面相一致的装置和方法的例子。Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with embodiments of the invention. Rather, they are merely examples of apparatus and methods consistent with some aspects of embodiments of the invention.

在本公开实施例使用的术语是仅仅出于描述特定实施例的目的，而非旨在限制本公开实施例。在本公开所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式，除非上下文清楚地表示其他含义。还应当理解，本文中使用的术语“和/或”是指并包含一个或多个相关联的列出项目的任何或所有可能组合。The terminology used in the embodiments of the present disclosure is for the purpose of describing specific embodiments only and is not intended to limit the embodiments of the present disclosure. As used in this disclosure, the singular forms "a," "the" and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It will also be understood that the term "and/or" as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.

应当理解，尽管在本公开实施例可能采用术语第一、第二、第三等来描述各种信息，但这些信息不应限于这些术语。这些术语仅用来将同一类型的信息彼此区分开。例如，在不脱离本公开实施例范围的情况下，第一信息也可以被称为第二信息，类似地，第二信息也可以被称为第一信息。取决于语境，如在此所使用的词语“如果”可以被解释成为“在……时”或“当……时”或“响应于确定”。It should be understood that although the terms first, second, third, etc. may be used to describe various information in the embodiments of the present disclosure, the information should not be limited to these terms. These terms are only used to distinguish information of the same type from each other. For example, without departing from the scope of the embodiments of the present disclosure, the first information may also be called second information, and similarly, the second information may also be called first information. Depending on the context, the word "if" as used herein may be interpreted as "when" or "when" or "in response to determination."

本公开实施例提供一种视频显示方法，图1是根据一示例性实施例示出的一种视频显示方法的流程示意图一，该视频显示方法应用在终端设备中，下面将结合图1中示出的步骤S101-S103进行说明：Embodiments of the present disclosure provide a video display method. Figure 1 is a schematic flowchart 1 of a video display method according to an exemplary embodiment. The video display method is applied in a terminal device. The following will be shown in conjunction with Figure 1 Steps S101-S103 are explained:

步骤S101，在进行视频采集时，获取初始裁剪框；Step S101, when collecting video, obtain the initial cropping frame;

步骤S102，基于初始裁剪框，对终端设备启动摄像头时采集的预览画面进行裁剪；Step S102, based on the initial cropping frame, crop the preview image collected when the terminal device starts the camera;

步骤S103，显示裁剪后的画面。Step S103: Display the cropped image.

这里，本公开提出的终端设备可以是智能终端，包括：移动终端或便携式电子设备，该移动终端包括但不限于手机、平板电脑；该便携式电子设备包括但不限于智能手表，本公开实施例对此不做限制。Here, the terminal device proposed in this disclosure may be a smart terminal, including: a mobile terminal or a portable electronic device. The mobile terminal includes but is not limited to a mobile phone and a tablet computer; the portable electronic device includes but is not limited to a smart watch. The embodiments of the present disclosure are suitable for There is no restriction on this.

本公开实施例中，在步骤S101之前，本公开实施例提供的视频显示方法还包括：In the embodiment of the present disclosure, before step S101, the video display method provided by the embodiment of the present disclosure further includes:

在获取初始裁剪框之前，启动终端设备的摄像头。Before obtaining the initial cropping frame, start the camera of the terminal device.

这里，本公开提出的终端设备包括显示屏和进行图像采集的摄像头。Here, the terminal device proposed by the present disclosure includes a display screen and a camera for image collection.

上述摄像头按照设置位置可以分为：位于终端设备显示屏一侧的前置摄像头或者位于终端设备显示屏另一侧的后置摄像头；上述摄像头按照功能可以分为：长焦摄像头、广角摄像头或者超广角摄像头等。According to the setting position, the above-mentioned cameras can be divided into: front-facing cameras located on one side of the terminal device display screen or rear-facing cameras located on the other side of the terminal device display screen; according to functions, the above-mentioned cameras can be divided into: telephoto cameras, wide-angle cameras or super cameras. Wide angle camera etc.

需要说明的是，本公开提出的视频显示方法可以应用在不同的视频采集场景中。具体的，视频采集可以是单机场景，例如：利用手机进行视频拍摄和视频录制，显示的拍摄画面和录制画面是基于初始裁剪框裁剪后的画面；视频采集场景也可以是多设备交互的场景，例如：多个终端进行视频会议或者视频通话等，显示的视频通信画面是基于初始裁剪框进行裁剪后的、同步给各个终端的画面。It should be noted that the video display method proposed in this disclosure can be applied in different video collection scenarios. Specifically, video collection can be a stand-alone scene, for example: using a mobile phone for video shooting and video recording, and the displayed shooting and recording images are the images cropped based on the initial cropping frame; the video collection scene can also be a multi-device interaction scene. For example, if multiple terminals conduct a video conference or video call, the displayed video communication picture is a picture that is cropped based on the initial cropping frame and synchronized to each terminal.

本公开在使用终端设备视频通信(例如视频通话或者视频会议)的情况下，终端设备的视频采集摄像头是前置摄像头中的超广角镜头；相应的，前置摄像头中的超广角镜头所采集的目标对象是终端设备的使用用户自己。In the present disclosure, when terminal equipment is used for video communication (such as video calls or video conferencing), the video collection camera of the terminal equipment is an ultra-wide-angle lens in the front camera; correspondingly, the target object captured by the ultra-wide-angle lens in the front camera It is the user of the terminal device himself.

显示屏用于显示摄像头采集的画面，并且，所述显示屏可以是触控显示屏；触控显示屏通过感应用户作用在所触控显示屏上的触控操作，实现与触控操作相对应的功能。示例性的，触控显示屏上能够显示终端设备摄像头采集的预览画面，终端设备能够感应到使用终端设备的用户在触控屏上对画面的放大、缩小或选定目标对象等触控操作，将预览画面放大、缩小后显示在触控显示屏上或单独显示用户触控的目标对象。The display screen is used to display the picture collected by the camera, and the display screen can be a touch display screen; the touch display screen realizes corresponding to the touch operation by sensing the user's touch operation on the touch display screen. function. For example, the touch screen can display the preview image collected by the camera of the terminal device, and the terminal device can sense the touch operations of the user using the terminal device such as zooming in, zooming out, or selecting a target object on the touch screen. The preview screen is enlarged or reduced and then displayed on the touch screen or the target object touched by the user is displayed individually.

在一些实施例中，图2是根据一示例性实施例示出的一种视频显示方法的流程示意图二，下面将结合图2中示出的步骤S104-S105进行说明本公开提出的视频显示方法。In some embodiments, FIG. 2 is a schematic flowchart 2 of a video display method according to an exemplary embodiment. The video display method proposed by the present disclosure will be described below in conjunction with steps S104-S105 shown in FIG. 2 .

步骤S104，在终端设备发生运动的情况下，基于初始裁剪框，得到目标裁剪框；其中，初始裁剪框的框选内容述目标裁剪框的框选内容包括同一目标对象；Step S104, when the terminal device moves, obtain the target cropping frame based on the initial cropping frame; wherein, the frame selection content of the initial cropping frame and the frame selection content of the target cropping frame include the same target object;

步骤S105，基于目标裁剪框和终端设备运动后采集的目标采集画面，得到目标视频画面；Step S105, obtain the target video picture based on the target cropping frame and the target collection picture collected after the terminal device moves;

步骤S103中的显示裁剪后的画面可以是：Displaying the cropped picture in step S103 may be:

步骤S1031，显示目标视频画面。Step S1031, display the target video screen.

需要说明的是，在终端设备发生运动的情况下，基于初始裁剪框，得到目标裁剪框，可以通过以下示例实施：It should be noted that when the terminal device moves, the target cropping frame is obtained based on the initial cropping frame, which can be implemented through the following example:

在一些示例中，在进行视频采集时，步骤S104中终端设备运动前的位置是终端设备首次开启摄像头的位置，摄像头首次采集目标对象所产生并显示的预览画面显示摄像头拍摄的全部内容，需要在摄像头拍摄的全部内容中选择目标对象，并基于目标对象在预览画面中设置包括目标对象的初始裁剪框；本公开中步骤S104中的基于初始裁剪框得到目标裁剪框，可以是：对初始裁剪框进行调整，直接得到目标裁剪框。In some examples, when performing video collection, the position of the terminal device before movement in step S104 is the position where the terminal device first turns on the camera. The preview screen generated and displayed by the camera when collecting the target object for the first time displays all the content captured by the camera. It needs to be Select the target object from all the content captured by the camera, and set an initial cropping frame including the target object in the preview screen based on the target object; in step S104 in this disclosure, the target cropping frame is obtained based on the initial cropping frame, which can be: Make adjustments to get the target cropping frame directly.

在另一些示例中，在进行视频采集时，步骤S104中终端设备运动前的位置，是终端设备经历过至少一次运动后的位置；对于终端设备经历过至少一次运动后采集的过渡画面，需要基于初始裁剪框进行调整得到过渡裁剪框，并基于过渡裁剪框对过渡画面进行裁剪并显示；基于此，本公开步骤S104中的基于初始裁剪框得到目标裁剪框，可以是：对初始裁剪框进行调整，间接得到目标裁剪框。具体的：基于对初始裁剪框进行调整得到的过渡裁剪框，再对过渡裁剪框进行调整得到目标裁剪框。In other examples, when collecting video, the position of the terminal device before movement in step S104 is the position after the terminal device has experienced at least one movement; for the transition picture collected after the terminal device has experienced at least one movement, it needs to be based on The initial cropping frame is adjusted to obtain a transitional cropping frame, and the transitional picture is cropped and displayed based on the transitional cropping frame; based on this, obtaining the target cropping frame based on the initial cropping frame in step S104 of the disclosure may be: adjusting the initial cropping frame , indirectly obtain the target cropping frame. Specifically: based on the transition cropping frame obtained by adjusting the initial cropping frame, the transition cropping frame is then adjusted to obtain the target cropping frame.

需要说明的是，终端设备发生运动可以是：用户触碰终端设备发生翻转、偏移等情况，引起了终端设备运动。It should be noted that the movement of the terminal device may be caused by the user touching the terminal device and causing it to flip or shift, causing the terminal device to move.

本公开实施例中，在终端设备发生运动后，终端设备的摄像头的取景范围改变，目标对象在取景范围内被采集到的采集画面中的状态也相应改变，为了适应目标对象状态的改变，调整初始裁剪框得到目标裁剪框，使得目标裁剪框内包含初始裁剪框内的目标对象。In the embodiment of the present disclosure, after the terminal device moves, the viewing range of the camera of the terminal device changes, and the state of the target object in the collection picture captured within the viewing range also changes accordingly. In order to adapt to the change in the state of the target object, adjust The initial cropping frame obtains the target cropping frame, so that the target cropping frame contains the target object in the initial cropping frame.

这里，目标对象的状态，可以是目标对象的尺寸、目标对象的位置或目标对象的姿态等，本公开对此不作限制。Here, the state of the target object may be the size of the target object, the position of the target object, or the posture of the target object, etc., which is not limited by the present disclosure.

示例性的，终端设备的摄像头在运动前的取景范围中，目标对象位于正中央，终端设备采集的预览画面中，目标对象也会位于正中央；在终端设备旋转了预设角度后，终端设备的摄像头运动后的取景范围中，目标对象位于边缘处，终端设备采集的目标采集画面中目标对象也会位于边缘处；因此，为了适应目标对象的位置改变，将初始裁剪框的位置调整后得到目标裁剪框。For example, in the viewing range of the terminal device's camera before movement, the target object is located in the center, and in the preview image collected by the terminal device, the target object will also be located in the center; after the terminal device rotates the preset angle, the terminal device In the viewing range after the camera moves, the target object is located at the edge, and the target object will also be located at the edge in the target acquisition picture collected by the terminal device; therefore, in order to adapt to the change in the position of the target object, the position of the initial cropping frame is adjusted to obtain Target cropping box.

这里，目标裁剪框和初始裁剪框的形状均可以是规则形状的裁剪框，也可以依据裁剪框内的对象的轮廓形成的，本公开对此不做限制。Here, the shape of the target cropping frame and the initial cropping frame may both be a regular-shaped cropping frame, or may be formed according to the outline of the object within the cropping frame, and the present disclosure does not limit this.

通过本公开实施例提出的上述方案，在进行采集时，获取初始裁剪框，能够精准且有效的确定用户需要显示的视频画面区域；并且，在终端设备发生运动的情况下，将初始裁剪框调整为目标裁剪框，并基于目标裁剪框和终端设备运动后采集的画面，得到显示的目标视频画面，既能够调整显示画面的大小和显示内容，有效的满足用户需求，又能够减少用户误碰终端设备，导致终端设备的摄像头取景范围改变引起的用户的隐私暴露，保证用户的使用安全和使用体验。Through the above solution proposed by the embodiment of the present disclosure, when collecting, the initial cropping frame is obtained, and the area of the video picture that the user needs to display can be accurately and effectively determined; and, in the case of movement of the terminal device, the initial cropping frame is adjusted is the target cropping frame, and based on the target cropping frame and the image collected after the terminal device moves, the displayed target video image is obtained, which can not only adjust the size and display content of the display image, effectively meet user needs, but also reduce users from accidentally touching the terminal. equipment, resulting in user privacy exposure caused by changes in the viewing range of the terminal device's camera, ensuring the user's safety and experience.

在一些实施例中，参见图3，图3是根据一示例性实施例示出的一种视频显示方法的流程示意图三。步骤S104中的,基于初始裁剪框，得到目标裁剪框，可以通过图3中的步骤S1041和步骤S1042实现：In some embodiments, see FIG. 3 , which is a flowchart 3 of a video display method according to an exemplary embodiment. In step S104, obtaining the target cropping frame based on the initial cropping frame can be achieved through steps S1041 and S1042 in Figure 3:

步骤S1041，获取终端设备运动时的运动信息；Step S1041, obtain motion information when the terminal device is moving;

步骤S1042，基于运动信息，对初始裁剪框进行调整得到目标裁剪框。Step S1042: Based on the motion information, the initial cropping frame is adjusted to obtain the target cropping frame.

本公开实施例中，终端设备运动时的运动信息，可以是终端设备的运动位移、终端设备的旋转角度、终端设备的运动速率、终端设备的运动方向；还可以是终端设备相对于目标对象移动的移动距离或终端设备相对于目标对象旋转的旋转角度等，本公开对此不作限制。In the embodiment of the present disclosure, the motion information when the terminal device is moving may be the motion displacement of the terminal device, the rotation angle of the terminal device, the motion rate of the terminal device, and the motion direction of the terminal device; it may also be the movement of the terminal device relative to the target object. The moving distance or the rotation angle of the terminal device relative to the target object, etc., are not limited by this disclosure.

具体的，参见图4，图4是根据一示例性实施例示出的终端设备采集的预览画面的示意图；图5是图5是根据一示例性实施例示出的终端设备采集的目标采集画面的示意图。图4示出了终端设备在运动前摄像头采集的预览画面A以及用户选择的初始裁剪框X1；图5示出了终端设备运动后摄像头采集的目标采集画面B以及调整后的目标裁剪框X2。Specifically, see FIG. 4 , which is a schematic diagram of a preview screen collected by a terminal device according to an exemplary embodiment; FIG. 5 is a schematic diagram of a target collection screen collected by a terminal device according to an exemplary embodiment. . Figure 4 shows the preview image A captured by the camera before the terminal device moves and the initial cropping frame X1 selected by the user; Figure 5 shows the target collection image B captured by the camera after the terminal device moves and the adjusted target cropping frame X2.

结合图4和图5，初始裁剪框X1内包含用户在预览画面A内选择的画面内容，所述画面内容包含目标对象；随着终端设备的运动，终端设备的摄像头的取景位置和取景范围改变，目标对象在不同取景范围下被采集到的采集画面中的状态发生了改变；例如，目标对象的位置改变，或目标对象的尺寸改变等。根据终端设备的运动信息，得到目标对象从预览画面A到目标采集画面B中的状态的变化，基于此，将初始裁剪框X1相应的调整为目标裁剪框X2，使得目标裁剪框X2内包含目标对象，以保证目标对象能够显示在最后的目标视频画面中。Combining Figures 4 and 5, the initial cropping frame X1 contains the screen content selected by the user in preview screen A, and the screen content contains the target object; as the terminal device moves, the viewing position and viewing range of the camera of the terminal device change. , the state of the target object in the collection picture captured under different viewing ranges has changed; for example, the position of the target object changes, or the size of the target object changes, etc. According to the motion information of the terminal device, the state change of the target object from the preview screen A to the target acquisition screen B is obtained. Based on this, the initial cropping frame X1 is correspondingly adjusted to the target cropping frame X2, so that the target cropping frame X2 contains the target. Object to ensure that the target object can be displayed in the final target video screen.

本公开通过获取终端设备运动时的运动信息，并基于该运动信息对初始裁剪框进行调整得到目标裁剪框，使得终端设备运动的情况下，能够基于目标裁剪框对采集的目标采集画面进行修剪，有效的显示包含目标对象的内容，最大程度减少因取景范围改变造成的隐私暴露情况。This disclosure obtains the motion information when the terminal device is moving, and adjusts the initial cropping frame based on the motion information to obtain the target cropping frame, so that when the terminal device is moving, the collected target collection picture can be trimmed based on the target cropping frame. Effectively display content that includes the target object, minimizing privacy exposure caused by changes in viewing range.

在一些实施例中，运动信息包括：终端设备相对于目标对象移动的移动距离和/或终端设备相对于目标对象旋转的旋转角度；步骤S1042中的对初始裁剪框进行调整得到目标裁剪框可以通过下述具体的步骤实现：In some embodiments, the motion information includes: the movement distance of the terminal device relative to the target object and/or the rotation angle of the terminal device relative to the target object; in step S1042, the initial cropping frame is adjusted to obtain the target cropping frame by The following specific steps are implemented:

基于移动距离，调整初始裁剪框的尺寸，得到目标裁剪框；和/或Based on the movement distance, adjust the size of the initial cropping frame to obtain the target cropping frame; and/or

基于旋转角度，调整初始裁剪框的位置，得到目标裁剪框。Based on the rotation angle, adjust the position of the initial cropping frame to obtain the target cropping frame.

本公开中，终端设备能够通过检测和计算得到终端设备相对于目标对象移动的移动距离。In the present disclosure, the terminal device can obtain the movement distance of the terminal device relative to the movement of the target object through detection and calculation.

在一些示例中，终端设备包括距离传感器，终端设备能够分别在运动前和运动后通过距离传感器检测到终端设备与目标对象的距离，并通过计算得到终端设备相对于目标对象运动的移动距离。In some examples, the terminal device includes a distance sensor. The terminal device can detect the distance between the terminal device and the target object through the distance sensor before and after the movement, and calculate the movement distance of the terminal device relative to the movement of the target object.

这里，距离传感器可以是红外测距传感器、超声探测传感器或者毫米雷达波传感器，对此，本公开不做限制。Here, the distance sensor may be an infrared ranging sensor, an ultrasonic detection sensor or a millimeter radar wave sensor, to which the disclosure is not limited.

在另一些示例中，终端设备还能通过采集的画面中的景深，能够得到目标对象与终端设备的距离，进而通过计算能够得到终端设备相对于目标对象的移动距离。In other examples, the terminal device can also obtain the distance between the target object and the terminal device through the depth of field in the collected picture, and then obtain the movement distance of the terminal device relative to the target object through calculation.

在本公开实施例中，当终端设备的摄像头与所朝向的目标对象的距离发生了远近关系变化时，即终端设备相对于目标对象产生移动距离时，目标对象在摄像头采集的画面中也会相应的放大或者缩小；也就是说，终端设备的摄像头在运动后所采集的目标采集画面中的目标对象的尺寸，与终端设备的摄像头在运动前采集的预览画面中的目标对象的尺寸相比，会相应的放大或者缩小；所以，为了适应目标对象的尺寸变化，初始裁剪框的尺寸也要同倍数的放大和缩小，以得到目标裁剪框。In the embodiment of the present disclosure, when the distance between the camera of the terminal device and the target object it is facing changes, that is, when the terminal device moves relative to the target object, the target object will also appear correspondingly in the picture captured by the camera. enlargement or reduction; that is to say, the size of the target object in the target acquisition picture captured by the terminal device's camera after movement is compared with the size of the target object in the preview picture collected by the terminal device's camera before movement. will be enlarged or reduced accordingly; therefore, in order to adapt to the size change of the target object, the size of the initial cropping frame must also be enlarged and reduced by the same multiple to obtain the target cropping frame.

具体的，终端设备的移动距离能够确定目标采集画面中的目标对象相对于预览画面中的目标对象的放大倍数或缩小倍数，继而，将终端设备中初始裁剪框的尺寸放大或缩小相应的倍数，得到目标裁剪框。Specifically, the movement distance of the terminal device can determine the magnification or reduction factor of the target object in the target acquisition screen relative to the target object in the preview screen, and then, the size of the initial cropping frame in the terminal device is enlarged or reduced by the corresponding multiple, Get the target cropping box.

本公开提出的终端设备包括加速度传感器和陀螺仪；加速度传感器和陀螺仪用于检测终端设备运动后的设备旋转角度。由此，得到终端设备朝向目标对象的旋转角度。The terminal device proposed in this disclosure includes an acceleration sensor and a gyroscope; the acceleration sensor and the gyroscope are used to detect the rotation angle of the device after the terminal device moves. Thus, the rotation angle of the terminal device toward the target object is obtained.

本公开实施例中，检测终端设备运动后的移动距离和旋转角度还可以通过如下方式实现：终端设备还可以包括指南针传感器，指南针传感器通过检测手机相对于地面坐标系的坐标变化，得到终端设备的位移和设备旋转角度。In the embodiment of the present disclosure, detecting the moving distance and rotation angle of the terminal device after movement can also be implemented in the following manner: the terminal device can also include a compass sensor. The compass sensor detects the coordinate changes of the mobile phone relative to the ground coordinate system to obtain the coordinates of the terminal device. Displacement and device rotation angle.

本公开实施例中，当终端设备的摄像头的与朝向的目标对象的旋转角度变化时，目标对象在摄像头采集的画面中位置发生了改变。示例性的，终端设备以朝向地面的边框为轴，向第一方向旋转15度时，摄像头的取景范围向第一方向旋转了15度，在摄像头采集的目标采集画面中，包含目标对象的初始裁剪框在目标采集画面中向第二方向旋转了15度，得到目标裁剪框。这里，第一方向和第二方向是相反的方向。In the embodiment of the present disclosure, when the rotation angle of the camera of the terminal device to the target object changes, the position of the target object in the picture captured by the camera changes. For example, when the terminal device rotates 15 degrees to the first direction with the frame facing the ground as the axis, the viewing range of the camera rotates 15 degrees to the first direction. The target acquisition picture captured by the camera includes the initial image of the target object. The cropping frame is rotated 15 degrees to the second direction in the target acquisition screen to obtain the target cropping frame. Here, the first direction and the second direction are opposite directions.

本公开实施例中，若终端设备朝向目标对象的角度和距离都发生改变，可以基于上述移动距离和旋转角度，对初始裁剪框的位置和尺寸都进行调整，得到目标裁剪框。In the embodiment of the present disclosure, if the angle and distance of the terminal device toward the target object change, the position and size of the initial cropping frame can be adjusted based on the above-mentioned movement distance and rotation angle to obtain the target cropping frame.

通过本公开实施例，能够在终端设备发生角度变化或者产生距离移动时，基于终端设备相对于目标对象的移动距离和旋转角度调整裁剪框，有效适应摄像头取景范围的改变，并显示包含目标对象的内容；在实际应用时，最大程度减少用户因不小碰触终端设备造成的隐私暴露情况。Through the embodiments of the present disclosure, when the angle of the terminal device changes or distance movement occurs, the cropping frame can be adjusted based on the movement distance and rotation angle of the terminal device relative to the target object, effectively adapting to changes in the camera's viewing range, and displaying images containing the target object. Content; in actual application, the user's privacy exposure caused by excessive touching of the terminal device is minimized.

在一些实施例中，步骤S105中的基于目标裁剪框和终端设备运动后采集的目标采集画面，得到目标视频画面，可以通过下述具体的步骤实现：In some embodiments, obtaining the target video picture based on the target cropping frame and the target collection picture collected after the terminal device moves in step S105 can be achieved through the following specific steps:

对目标裁剪框外的画面进行遮盖，并将遮盖后的画面和目标裁剪框内的画面作为目标视频画面；Cover the picture outside the target cropping frame, and use the covered picture and the picture within the target cropping frame as the target video picture;

或者，or,

基于目标裁剪框对目标采集画面进行裁剪得到裁剪画面；并对裁剪画面进行放大处理得到目标视频画面。The target acquisition picture is cropped based on the target cropping frame to obtain the cropped picture; and the cropped picture is enlarged to obtain the target video picture.

结合图5，基于目标裁剪框X2，目标采集画面B被分为B1和B2两个区域，B2区域是目标裁剪框X2内框选的画面内容，包含目标对象；B1区域是目标裁剪框X2外的画面内容；对B1区域的画面进行遮盖处理，并将遮盖后的B1区域的画面和B2区域的画面作为目标视频画面。Combined with Figure 5, based on the target cropping frame content of the picture; cover the picture in the B1 area, and use the covered picture in the B1 area and the picture in the B2 area as the target video picture.

这里，本公开中的遮盖处理是不显示B1区域的画面，在一些示例中，遮盖处理可以是将B1区域的画面的亮度值调整为0；在另一些示例中，遮盖处理还可以是对B1区域的画面以单色填充，例如以黑色填充B1区域的画面；在另一些示例中，遮盖处理还可以是将新图层覆盖在B1区域的画面上。Here, the masking process in this disclosure is not to display the picture in the B1 area. In some examples, the masking process can be to adjust the brightness value of the picture in the B1 area to 0; in other examples, the masking process can also be to adjust the brightness value of the B1 area. The area of the picture is filled with a single color, for example, the picture of the B1 area is filled with black; in other examples, the masking process can also be to cover the picture of the B1 area with a new layer.

通过将目标裁剪框外的画面进行遮盖，能够定向的显示用户选择显示的内容；在视频会议或者视频通话的场景下，减少因用户不小碰触终端设备，引起终端设备的取景范围改变造成的多余画面内容的暴露，保证用户的安全性和隐私性。By covering the picture outside the target cropping frame, the content selected by the user can be displayed in a directional manner; in the scenario of video conference or video call, it can reduce the risk of the user touching the terminal device causing the viewing range of the terminal device to change. Exposure of redundant screen content ensures user security and privacy.

结合图5，基于目标裁剪框X2对目标采集画面B进行裁剪得到裁剪画面，这里，裁剪画面是目标裁剪框X2内框选的画面内容B2；对裁剪画面进行放大处理得到目标视频画面。Combined with Figure 5, the target acquisition screen B is cropped based on the target cropping frame X2 to obtain a cropped screen. Here, the cropped screen is the screen content B2 selected in the target cropping frame X2; the cropped screen is enlarged to obtain the target video screen.

这里，对裁剪画面进行放大处理得到目标视频画面可以通过以下具体的方式实现：在一些示例中，将裁剪画面等比例放大；其中，等比例放大后画面的尺寸不能超过显示屏上视频显示区域的尺寸；在另一些示例中，将裁剪画面进行拉伸或者平铺处理，使得处理后的画面能够充满显示屏上的视频显示区域。Here, amplifying the cropped image to obtain the target video image can be achieved in the following specific ways: in some examples, the cropped image is enlarged in equal proportions; among them, the size of the image after enlarging in equal proportions cannot exceed the video display area on the display screen. Size; in other examples, the cropped image is stretched or tiled so that the processed image can fill the video display area on the display screen.

通过对裁剪画面进行放大处理得到目标视频画面，能够保证视频显示画面的美观性，提高用户的使用体验。By enlarging the cropped image to obtain the target video image, the aesthetics of the video display image can be ensured and the user experience can be improved.

在一些实施例中，步骤S105中的基于目标裁剪框和终端设备运动后的目标采集画面，得到目标视频画面，还可以通过下述具体的步骤实现：In some embodiments, obtaining the target video picture based on the target cropping frame and the target acquisition picture after the movement of the terminal device in step S105 can also be achieved through the following specific steps:

在目标裁剪框部分位于目标采集画面内的情况下，缩小目标裁剪框的尺寸，并基于缩小后的裁剪框得到目标视频画面。When the target cropping frame is partially located within the target acquisition frame, the size of the target cropping frame is reduced, and the target video frame is obtained based on the reduced cropping frame.

本公开中，在终端设备发生运动时，终端设备摄像头的取景范围改变；当目标对象部分显示在摄像头运动后的取景范围中，即目标对象部分显示在目标采集画面中时，目标裁剪框部分位于目标采集画面内，此时，缩小目标裁剪框的尺寸，使得缩小后的目标裁剪框内包含部分显示的目标对象。In this disclosure, when the terminal device moves, the viewing range of the terminal device camera changes; when the target object is partially displayed in the viewing range after the camera moves, that is, when the target object is partially displayed in the target acquisition screen, the target cropping frame is partially located In the target acquisition screen, at this time, the size of the target cropping frame is reduced so that the reduced target cropping frame contains part of the displayed target object.

通过本公开实施例，能够适应终端设备偏离目标对象进行图像采集的情况，减少隐私画面暴露，保证用户的使用体验。Through the embodiments of the present disclosure, it is possible to adapt to the situation when the terminal device deviates from the target object for image collection, reduce the exposure of private images, and ensure the user experience.

在一些实施例中，步骤S101中的获取初始裁剪框，可以通过下述具体的步骤实现：In some embodiments, obtaining the initial cropping frame in step S101 can be achieved through the following specific steps:

基于作用于预览画面上的移动轨迹确定初始裁剪框；Determine the initial cropping frame based on the movement trajectory acting on the preview screen;

或者，or,

对预览画面进行目标检测，将检测得到的目标对象所对应的显示框作为初始裁剪框。Perform target detection on the preview screen, and use the display frame corresponding to the detected target object as the initial cropping frame.

本公开实施例中，终端设备的使用用户能够在触控显示屏上进行触控操作。这里，基于预览画面的画面内容，用户在触控显示屏生成触控的移动轨迹，以确定初始裁剪框。具体的，用户可以选定目标对象，在显示屏上通过包括目标对象的封闭的移动轨迹形成裁剪框，例如，在触控显示屏上的预览画面中，在目标对象周围圈出一个正方形裁剪框。In the embodiment of the present disclosure, the user of the terminal device can perform touch operations on the touch display screen. Here, based on the screen content of the preview screen, the user generates a touch movement trajectory on the touch display screen to determine the initial cropping frame. Specifically, the user can select the target object and form a cropping frame on the display screen by including the closed movement trajectory of the target object. For example, in the preview screen on the touch screen, a square cropping frame is circled around the target object. .

通过作用于预览画面上的移动轨迹确定初始裁剪框，能够合理满足用户的画面展示需求，保证用户的使用体验。The initial cropping frame is determined by the movement trajectory acting on the preview screen, which can reasonably meet the user's screen display needs and ensure the user's experience.

本公开实施例中，对预览画面进行目标检测，得到多个采集对象，以及多个采集对象对应的取景框，将多个采集对象中目标对象对应的取景框作为初始裁剪框。In this disclosed embodiment, target detection is performed on the preview screen to obtain multiple collection objects and viewfinders corresponding to the multiple collection objects, and the viewfinder frames corresponding to the target objects among the multiple collection objects are used as initial cropping frames.

这里，将多个采集对象中目标对象对应的取景框作为初始裁剪框可以是，将多个采集对象中尺寸最大的采集对象确定为目标对象，将目标对象的取景框作为初始裁剪框；将多个采集对象中目标对象对应的取景框作为初始裁剪框也可以是，通过用户作用在触控显示屏上的触控操作在多个采集对象中确定目标对象，并将目标对象的取景框作为初始裁剪框。Here, using the viewfinder frame corresponding to the target object among the multiple collection objects as the initial cropping frame may include determining the collection object with the largest size among the multiple collection objects as the target object, and using the viewfinder frame of the target object as the initial cropping frame; The viewfinder frame corresponding to the target object in the collection objects can also be used as the initial cropping frame. The target object is determined among multiple collection objects through the user's touch operation on the touch screen, and the viewfinder frame of the target object is used as the initial cropping frame. Crop box.

通过对预览画面进行目标检测，节省用户选择裁剪框的时间，也能够使得初始裁剪框的获取更加灵活和智能。By performing target detection on the preview screen, it saves the user's time in selecting the cropping frame, and also makes the acquisition of the initial cropping frame more flexible and intelligent.

在一些实施例中，在步骤S103中的显示裁剪后的画面，可以通过下述的具体步骤实现：In some embodiments, displaying the cropped image in step S103 can be achieved through the following specific steps:

确定裁剪后的画面中是否存在敏感对象；Determine whether there are sensitive objects in the cropped picture;

在裁剪后的画面存在敏感对象的情况下，对敏感对象进行模糊处理或裁剪敏感对象所在的画面。If there are sensitive objects in the cropped picture, blur the sensitive objects or crop the picture where the sensitive objects are located.

这里，裁剪后的画面可以是根据初始裁剪框对终端设备运动前采集的预览画面进行裁剪得到的画面，也可以是基于目标裁剪框对终端设备运动后采集的目标采集画面进行裁剪得到的目标视频画面。Here, the cropped picture can be a picture obtained by cropping the preview picture collected before the terminal device moves based on the initial cropping frame, or it can be a target video obtained by clipping the target collection picture collected after the terminal device moves based on the target cropping frame. picture.

需要说明的是，敏感对象是不同于目标对象、用户不想展示的其他对象。It should be noted that sensitive objects are objects that are different from the target object and that the user does not want to display.

还需要说明的是，以裁剪后的画面是目标视频画面为例，预览画面中的初始裁剪框内包括目标对象和初始背景；在目标采集画面内，目标裁剪框内包括目标对象和目标背景。这里，根据目标裁剪框裁剪目标采集画面得到的目标视频画面内也包括目标对象和目标背景。所以，确定目标视频画面中是否存在敏感对象可以是，对目标背景进行目标检测，确定目标背景中是否存在敏感对象。It should also be noted that, taking the cropped picture as a target video picture as an example, the initial cropping frame in the preview picture includes the target object and the initial background; in the target acquisition picture, the target cropping frame includes the target object and the target background. Here, the target video picture obtained by cropping the target collection picture according to the target cropping frame also includes the target object and the target background. Therefore, determining whether there is a sensitive object in the target video picture can be performed by performing target detection on the target background and determining whether there is a sensitive object in the target background.

本公开实施例中，在目标视频画面存在敏感对象的情况下，对敏感对象进行模糊处理，可以实施为虚化处理或遮盖处理，此处，遮盖处理的方式参见本公开实施例上文所述，此处不再赘述；裁剪敏感对象所在的画面可以是将包含敏感对象的目标背景替换为初始背景。In the embodiment of the present disclosure, when there is a sensitive object in the target video picture, the sensitive object is blurred, which can be implemented as blur processing or masking process. Here, the method of masking processing is as described above in the embodiment of the present disclosure. , no further details will be given here; cropping the picture where the sensitive object is located may be to replace the target background containing the sensitive object with the initial background.

通过检测并处理画面中的敏感对象，较少敏感对象的暴露，有效保护用户隐私。By detecting and processing sensitive objects in the picture, the exposure of sensitive objects is reduced, effectively protecting user privacy.

在一些实施例中，步骤S103中的显示裁剪后的画面，还可以通过下述的具体步骤实现：In some embodiments, displaying the cropped image in step S103 can also be implemented through the following specific steps:

对裁剪后的画面进行纠偏，并显示纠偏后的画面。Correct the cropped image and display the corrected image.

以裁剪后的画面是目标视频画面为例，由于终端设备的移动，摄像头的取景范围改变，摄像头采集的画面边缘以及画面内的对象可能存在一定程度的畸变，本公开可以对目标视频画面进行检测，若目标视频画面发生畸变，对目标视频画面的画面边缘和画面内的对象进行纠偏，并显示纠偏后的画面。通过纠偏处理，保证画面显示的美观性。Taking the cropped picture as the target video picture as an example, due to the movement of the terminal device and the change of the viewing range of the camera, there may be a certain degree of distortion in the edges of the picture captured by the camera and the objects in the picture. This disclosure can detect the target video picture. , if the target video picture is distorted, correct the edges of the target video picture and the objects in the picture, and display the corrected picture. Through correction processing, the aesthetics of the screen display can be ensured.

图6是根据一示例性实施例示出的一种在视频通信场景下的视频显示方法的流程示意图；图6中，使用第一终端设备的第一用户和使用第二终端设备的第二用户进行视频通信。视频通信可以是视频通话或者视频会议，本公开不做限制。服务器可以通过有线和无线的方式将第一终端设备和第二终端设备进行直接或者间接的连接，服务器可以是一个单一的服务器、云服务器或者是服务器集群。这里，第一终端设备和第二终端设备具有内置的处理模组，可以完成单机的视频采集和视频裁剪。具体的，参见图6，本公开实施例提供的视频通信场景下的视频显示方法可以通过以下步骤实现：Figure 6 is a schematic flow chart of a video display method in a video communication scenario according to an exemplary embodiment; in Figure 6, a first user using a first terminal device and a second user using a second terminal device perform Video communication. Video communication can be a video call or a video conference, which is not limited by this disclosure. The server can directly or indirectly connect the first terminal device and the second terminal device through wired or wireless methods. The server can be a single server, a cloud server or a server cluster. Here, the first terminal device and the second terminal device have built-in processing modules, which can complete stand-alone video collection and video cropping. Specifically, referring to Figure 6, the video display method in the video communication scenario provided by the embodiment of the present disclosure can be implemented through the following steps:

步骤601，开启前置超广角摄像头；Step 601, turn on the front ultra-wide-angle camera;

步骤602，基于前置超广角摄像头采集并预览显示第一预览画面；Step 602: Collect and preview the first preview image based on the front ultra-wide-angle camera;

步骤603，在第一预览画面中获取第一初始裁剪框，其中，第一初始裁剪框内包含使用第一终端设备的第一用户；Step 603: Obtain the first initial cropping frame in the first preview screen, where the first initial cropping frame contains the first user using the first terminal device;

步骤604，基于第一初始裁剪框和第一预览画面，得到第一显示视频画面，并向服务器发送第一显示视频画面；Step 604: Obtain the first display video frame based on the first initial cropping frame and the first preview frame, and send the first display video frame to the server;

这里，第一显示视频画面是本公开上文实施例提出的裁剪后的画面；Here, the first displayed video picture is the cropped picture proposed in the above embodiment of the present disclosure;

步骤605，开启前置超广角摄像头；Step 605, turn on the front ultra-wide-angle camera;

步骤606，基于前置超广角摄像头采集并预览显示第二预览画面；Step 606: Collect and preview the second preview image based on the front ultra-wide-angle camera;

步骤607，在第二预览画面中获取第二初始裁剪框，其中，第二初始裁剪框内包含使用第二终端设备的第二用户；Step 607: Obtain the second initial cropping frame in the second preview screen, where the second initial cropping frame contains the second user using the second terminal device;

步骤608，基于第二初始裁剪框和第二预览画面，得到第二显示视频画面，并向服务器发送第二视频显示画面；Step 608: Obtain the second display video image based on the second initial cropping frame and the second preview image, and send the second video display image to the server;

这里，第二显示视频画面是本公开上文实施例提出的裁剪后的画面；Here, the second display video picture is the cropped picture proposed in the above embodiment of the present disclosure;

步骤609，对第一显示视频画面和第二显示视频画面进行拼接，得到第一通话画面；Step 609: Splice the first display video picture and the second display video picture to obtain the first call picture;

步骤610，将第一通话画面发送至第一终端设备；Step 610: Send the first call screen to the first terminal device;

步骤611，将第一通话画面发送至第二终端设备；Step 611: Send the first call screen to the second terminal device;

步骤612，显示第一通话画面；Step 612, display the first call screen;

步骤613，显示第一通话画面；Step 613, display the first call screen;

步骤614，获取第一终端设备运动的运动信息；在终端设备发生运动的情况下，基于初始裁剪框，得到目标裁剪框；基于目标裁剪框和终端设备运动后采集的目标采集画面，得到目标视频画面，并将向服务器发送目标视频画面；Step 614: Obtain motion information about the movement of the first terminal device; when the terminal device moves, obtain the target cropping frame based on the initial cropping frame; obtain the target video based on the target cropping frame and the target collection picture collected after the movement of the terminal device screen and will send the target video screen to the server;

步骤615，将第一终端设备发送的目标视频画面和第二终端设备发送的第二视频画面进行拼接，得到第二通话画面；Step 615: Splice the target video picture sent by the first terminal device and the second video picture sent by the second terminal device to obtain a second call picture;

步骤616，将第二通话画面发送至第一终端设备；Step 616: Send the second call screen to the first terminal device;

步骤617，将第二通话画面发送至第二终端设备；Step 617: Send the second call screen to the second terminal device;

步骤618，显示第二通话画面；Step 618, display the second call screen;

步骤619，显示第二通话画面。Step 619: Display the second call screen.

这里，终端设备可以是本公开上文提出的第一终端设备和第二终端设备。Here, the terminal device may be the first terminal device and the second terminal device proposed above in this disclosure.

本公开实施例提供一种视频显示装置。在一些实施例中，参见图7，图7是根据一示例性实施例示出的一种视频显示装置的结构示意图，视频显示装置，应用于终端设备中，包括：An embodiment of the present disclosure provides a video display device. In some embodiments, see FIG. 7 , which is a schematic structural diagram of a video display device according to an exemplary embodiment. The video display device is used in terminal equipment and includes:

获取模块701，被配置为在视频采集时，获取初始裁剪框；The acquisition module 701 is configured to acquire the initial cropping frame during video collection;

裁剪模块702，被配置为基于初始裁剪框，对终端设备启动摄像头时采集的预览画面进行裁剪；The cropping module 702 is configured to crop the preview image collected when the terminal device starts the camera based on the initial cropping frame;

显示模块703，被配置为显示裁剪后的画面。The display module 703 is configured to display the cropped picture.

在一些实施例中，装置还包括：In some embodiments, the device further includes:

调整模块704，被配置为在终端设备发生运动的情况下，基于初始裁剪框，得到目标裁剪框；其中，初始裁剪框的框选内容与目标裁剪框的框选内容包括同一目标对象；The adjustment module 704 is configured to obtain the target cropping frame based on the initial cropping frame when the terminal device moves; wherein the frame selection content of the initial cropping frame and the frame selection content of the target cropping frame include the same target object;

裁剪模块702还被配置为：基于目标裁剪框和终端设备运动后采集的目标采集画面，得到目标视频画面；The cropping module 702 is also configured to: obtain the target video picture based on the target cropping frame and the target collection picture collected after the terminal device moves;

显示模块703，还被配置为：显示目标视频画面。The display module 703 is also configured to display the target video picture.

在一些实施例中，调整模块704包括：In some embodiments, the adjustment module 704 includes:

检测单元7041，被配置为获取终端设备运动时的运动信息；The detection unit 7041 is configured to obtain motion information when the terminal device moves;

调整单元7042，被配置为基于运动信息，对初始裁剪框进行调整得到目标裁剪框。The adjustment unit 7042 is configured to adjust the initial cropping frame to obtain the target cropping frame based on the motion information.

在一些实施例中，运动信息包括：终端设备相对于目标对象移动的移动距离和/或终端设备相对于目标对象旋转的旋转角度：In some embodiments, the motion information includes: the movement distance of the terminal device relative to the target object and/or the rotation angle of the terminal device relative to the target object:

调整单元7042，还被配置为基于移动距离，调整初始裁剪框的尺寸，得到目标裁剪框；和/或The adjustment unit 7042 is also configured to adjust the size of the initial cropping frame based on the movement distance to obtain the target cropping frame; and/or

在一些实施例中，裁剪模块702还被配置为：In some embodiments, the cropping module 702 is further configured to:

或者，or,

在一些实施例中，获取模块701还被配置为：In some embodiments, the acquisition module 701 is further configured to:

或者，or,

在一些实施例中，显示模块703还被配置为：In some embodiments, display module 703 is further configured to:

确定裁剪后的画面是否存在敏感对象；Determine whether there are sensitive objects in the cropped picture;

本公开实施例提供一种终端设备，包括：An embodiment of the present disclosure provides a terminal device, including:

用于存储处理器可执行指令的存储器；Memory used to store instructions executable by the processor;

处理器，分别存储器连接；Processor, memory connection respectively;

其中，处理器被配置为执行前述任意技术方案提供的视频显示方法。Wherein, the processor is configured to execute the video display method provided by any of the foregoing technical solutions.

处理器可包括各种类型的存储介质，该存储介质为非临时性计算机存储介质，在终端设备掉电之后能够继续记忆存储其上的信息。The processor may include various types of storage media, which are non-transitory computer storage media that can continue to store information stored thereon after the terminal device is powered off.

所述处理器可以通过总线等与存储器连接，用于读取存储器上存储的可执行程序，例如，本公开上述实施例提出的视频显示方法的至少其中之一。The processor may be connected to the memory through a bus or the like, and be used to read the executable program stored on the memory, for example, at least one of the video display methods proposed in the above embodiments of the present disclosure.

图8是根据一示例性实施例示出的一种终端设备的框图。例如，终端设备800可以是移动电话，计算机，数字广播用户设备，消息收发设备，游戏控制台，平板设备，医疗设备，健身设备，个人数字助理等。Figure 8 is a block diagram of a terminal device according to an exemplary embodiment. For example, the terminal device 800 may be a mobile phone, a computer, a digital broadcast user device, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

参照图8，终端设备800可以包括以下一个或多个组件：处理组件802，存储器804，电源组件806，多媒体组件808，音频组件810，输入/输出(I/O)的接口812，传感器组件814，以及通信组件816。Referring to FIG. 8 , the terminal device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power supply component 806 , a multimedia component 808 , an audio component 810 , an input/output (I/O) interface 812 , and a sensor component 814 , and communication component 816.

处理组件802通常控制终端设备800的整体操作，诸如与显示，电话呼叫，数据通信，相机操作和记录操作相关联的操作。处理组件802可以包括一个或多个处理器820来执行指令，以生成上述的方法的全部或部分步骤。此外，处理组件802可以包括一个或多个模块，便于处理组件802和其他组件之间的交互。例如，处理组件802可以包括多媒体模块，以方便多媒体组件808和处理组件802之间的交互。The processing component 802 generally controls the overall operations of the terminal device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to generate all or part of the steps of the methods described above. Additionally, processing component 802 may include one or more modules that facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.

存储器804被配置为存储各种类型的数据以支持在终端设备800的操作。这些数据的示例包括用于在终端设备800上操作的任何应用程序或方法的指令，联系人数据，电话簿数据，消息，图片，视频等。存储器804可以由任何类型的易失性或非易失性存储设备或者它们的组合实现，如静态随机存取存储器(SRAM)，电可擦除可编程只读存储器(EEPROM)，可擦除可编程只读存储器(EPROM)，可编程只读存储器(PROM)，只读存储器(ROM)，磁存储器，快闪存储器，磁盘或光盘。The memory 804 is configured to store various types of data to support operations at the terminal device 800 . Examples of such data include instructions for any application or method operating on the terminal device 800, contact data, phonebook data, messages, pictures, videos, etc. Memory 804 may be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EEPROM), Programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

电源组件806为终端设备800的各种组件提供电力。电源组件806可以包括电源管理系统，一个或多个电源，及其他与为终端设备800生成、管理和分配电力相关联的组件。Power supply component 806 provides power to various components of terminal device 800 . Power supply components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to end device 800 .

多媒体组件808包括在所述终端设备800和用户之间的提供一个输出接口的屏幕。在一些实施例中，屏幕可以包括液晶显示器(LCD)和触摸面板(TP)。如果屏幕包括触摸面板，屏幕可以被实现为触摸屏，以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。所述触摸传感器可以不仅感测触摸或滑动动作的边界，而且还检测与所述触摸或滑动操作相关的持续时间和压力。在一些实施例中，多媒体组件808包括一个前置摄像头和/或后置摄像头。这里，前置摄像头包括超广角摄像头；当终端设备800处于操作模式，如拍摄模式或视频模式时，前置摄像头和/或后置摄像头可以接收外部的多媒体数据。每个前置摄像头和后置摄像头可以是一个固定的光学透镜系统或具有焦距和光学变焦能力。Multimedia component 808 includes a screen providing an output interface between the terminal device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide action. In some embodiments, multimedia component 808 includes a front-facing camera and/or a rear-facing camera. Here, the front camera includes an ultra-wide-angle camera; when the terminal device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front-facing camera and rear-facing camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.

音频组件810被配置为输出和/或输入音频信号。例如，音频组件810包括一个麦克风(MIC)，当终端设备800处于操作模式，如呼叫模式、记录模式和语音识别模式时，麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器804或经由通信组件816发送。在一些实施例中，音频组件810还包括一个扬声器，用于输出音频信号。Audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a microphone (MIC) configured to receive external audio signals when the terminal device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may be further stored in memory 804 or sent via communication component 816 . In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

I/O接口812为处理组件802和外围接口模块之间提供接口，上述外围接口模块可以是键盘，点击轮，按钮等。这些按钮可包括但不限于：主页按钮、音量按钮、启动按钮和锁定按钮。The I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module, which may be a keyboard, a click wheel, a button, etc. These buttons may include, but are not limited to: Home button, Volume buttons, Start button, and Lock button.

传感器组件814包括一个或多个传感器，用于为终端设备800提供各个方面的状态评估。例如，传感器组件814可以检测到设备800的打开/关闭状态，组件的相对定位，例如所述组件为终端设备800的显示器和小键盘，传感器组件814还可以检测终端设备800或终端设备800一个组件的位置改变，用户与终端设备800接触的存在或不存在，终端设备800方位或加速/减速和终端设备800的温度变化。传感器组件814可以包括接近传感器，被配置用来在没有任何的物理接触时检测附近物体的存在。传感器组件814还可以包括光传感器，如CMOS或CCD图像传感器，用于在成像应用中使用。在一些实施例中，该传感器组件814还可以包括加速度传感器，陀螺仪传感器，磁传感器，压力传感器或温度传感器。Sensor component 814 includes one or more sensors for providing various aspects of status assessment for terminal device 800 . For example, the sensor component 814 can detect the open/closed state of the device 800 and the relative positioning of components, such as the display and keypad of the terminal device 800. The sensor component 814 can also detect the terminal device 800 or a component of the terminal device 800. position changes, presence or absence of user contact with the terminal device 800 , orientation or acceleration/deceleration of the terminal device 800 and temperature changes of the terminal device 800 . Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

通信组件816被配置为便于终端设备800和其他设备之间有线或无线方式的通信。终端设备800可以接入基于通信标准的无线网络，如WiFi，2G或3G，或它们的组合。在一个示例性实施例中，通信组件816经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中，所述通信组件816还包括近场通信(NFC)模块，以促进短程通信。例如，在NFC模块可基于射频识别(RFID)技术，红外数据协会(IrDA)技术，超宽带(UWB)技术，蓝牙(BT)技术和其他技术来实现。The communication component 816 is configured to facilitate wired or wireless communication between the terminal device 800 and other devices. The terminal device 800 can access a wireless network based on communication standards, such as WiFi, 2G or 3G, or a combination thereof. In one exemplary embodiment, the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communications component 816 also includes a near field communications (NFC) module to facilitate short-range communications. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

在示例性实施例中，终端设备800可以被一个或多个应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现，用于执行上述方法。In an exemplary embodiment, the terminal device 800 may be configured by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation is used to perform the above method.

在示例性实施例中，还提供了一种包括指令的非临时性计算机可读存储介质，例如包括指令的存储器804，上述指令可由终端设备800的处理器820执行以生成上述方法。例如，所述非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions, such as a memory 804 including instructions, which are executable by the processor 820 of the terminal device 800 to generate the above method is also provided. For example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

本领域技术人员在考虑说明书及实践这里公开的发明后，将容易想到本发明的其它实施方案。本公开旨在涵盖本发明的任何变型、用途或者适应性变化，这些变型、用途或者适应性变化遵循本发明的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的，本发明的真正范围和精神由下面的权利要求指出。Other embodiments of the invention will be readily apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. The present disclosure is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common common sense or customary technical means in the technical field that are not disclosed in the present disclosure. . It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

应当理解的是，本发明并不局限于上面已经描述并在附图中示出的精确结构，并且可以在不脱离其范围进行各种修改和改变。本发明的范围仅由所附的权利要求来限制。It is to be understood that the present invention is not limited to the precise construction described above and illustrated in the accompanying drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Claims

A video display method, applied in a terminal device, the method includes:

When collecting video, obtain the initial cropping frame;

Based on the initial cropping frame, crop the preview image collected when the terminal device starts the camera;

Display the cropped image.

The method of claim 1, further comprising:

When the terminal device moves, a target cropping frame is obtained based on the initial cropping frame; wherein the frame selection content of the initial cropping frame and the frame selection content of the target cropping frame include the same target object;

Obtain the target video picture based on the target cropping frame and the target collection picture collected after the movement of the terminal device;

The cropped picture includes:

Display the target video picture.

The video display method according to claim 2, wherein obtaining the target cropping frame based on the initial cropping frame includes:

Obtain motion information when the terminal device is in motion;

Based on the motion information, the initial cropping frame is adjusted to obtain the target cropping frame.

The video display method according to claim 3, wherein the motion information includes: a moving distance of the terminal device relative to the target object and/or a rotation angle of the terminal device relative to the target object. ;

The step of adjusting the initial cropping frame to obtain the target cropping frame based on the motion information includes:

Based on the movement distance, adjust the size of the initial cropping frame to obtain the target cropping frame; and/or

Based on the rotation angle, the position of the initial cropping frame is adjusted to obtain the target cropping frame.

The video display method according to any one of claims 2 to 4, wherein obtaining the target video picture based on the target cropping frame and the target collection picture collected after the movement of the terminal device includes:

Cover the picture outside the target cropping frame, and use the covered picture and the picture within the target cropping frame as the target video picture;

or,

The target collection picture is cropped based on the target cropping frame to obtain a cropped picture; and the cropped picture is enlarged to obtain the target video picture.

The video display method according to any one of claims 1 to 4, wherein said obtaining the initial cropping frame includes:

Determine the initial cropping frame based on the movement trajectory acting on the preview screen;

or,

Target detection is performed on the preview screen, and the display frame corresponding to the detected target object is used as the initial cropping frame.

The video display method according to any one of claims 2 to 4, wherein obtaining the target video picture based on the target cropping frame and the target collection picture collected by the terminal device after movement includes:

When the target cropping frame is partially located within the target capture frame, the size of the target cropping frame is reduced, and the target video frame is obtained based on the reduced cropping frame.

The video display method according to any one of claims 1 to 4, wherein the displaying the cropped picture includes:

Determine whether there are sensitive objects in the cropped picture;

When the sensitive object exists in the cropped picture, the sensitive object is blurred or the picture in which the sensitive object is located is cropped.

Deskew the cropped picture and display the corrected picture.

A video display device, which is used in terminal equipment, and the device includes:

The acquisition module is configured to obtain the initial cropping frame when collecting video;

A cropping module configured to crop the preview image collected when the terminal device starts the camera based on the initial cropping frame;

The display module is configured to display the cropped picture.

A terminal device, which includes a processor, a memory, and an executable program stored in the memory and capable of being run by the processor, wherein when the processor runs the executable program, it executes claims 1 to 9 Any of the methods provided.

A computer storage medium, wherein the computer storage medium stores an executable program; after the executable program is executed by a processor, the method as provided in any one of claims 1 to 9 can be implemented.