[go: up one dir, main page]

WO2023225910A1 - Procédé et appareil d'affichage vidéo, dispositif terminal et support de stockage informatique - Google Patents

Procédé et appareil d'affichage vidéo, dispositif terminal et support de stockage informatique Download PDF

Info

Publication number
WO2023225910A1
WO2023225910A1 PCT/CN2022/095020 CN2022095020W WO2023225910A1 WO 2023225910 A1 WO2023225910 A1 WO 2023225910A1 CN 2022095020 W CN2022095020 W CN 2022095020W WO 2023225910 A1 WO2023225910 A1 WO 2023225910A1
Authority
WO
WIPO (PCT)
Prior art keywords
target
picture
cropping frame
terminal device
frame
Prior art date
Application number
PCT/CN2022/095020
Other languages
English (en)
Chinese (zh)
Inventor
彭聪
Original Assignee
北京小米移动软件有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京小米移动软件有限公司 filed Critical 北京小米移动软件有限公司
Priority to CN202280004304.8A priority Critical patent/CN117480772A/zh
Priority to PCT/CN2022/095020 priority patent/WO2023225910A1/fr
Publication of WO2023225910A1 publication Critical patent/WO2023225910A1/fr

Links

Images

Definitions

  • the present disclosure relates to the fields of wireless communications and video communications, and in particular, to a video display method and device, terminal equipment and computer storage media.
  • smart terminals such as mobile phones serve as communication tools that can not only meet people's needs for voice calls, but can also support video calls or video conferencing.
  • video calls and video conferences carry many work and communication scenarios for contemporary people. Moreover, with the impact of the epidemic, more and more time is spent working from home, and video conferencing and video calls are used more and more frequently.
  • the smart terminal collects video through the camera and displays it on the display or synchronizes it to the communicating user through a cloud server.
  • the size of the video screen cannot be adjusted, and the large viewing range of the camera can easily expose the user's privacy and affect the user experience.
  • Embodiments of the present disclosure provide a video display method and device, terminal equipment and computer storage media.
  • a first aspect of the embodiment of the present disclosure provides a video display method applied in a terminal device.
  • the method includes:
  • the method further includes:
  • a target cropping frame is obtained based on the initial cropping frame; wherein the frame selection content of the initial cropping frame and the frame selection content of the target cropping frame include the same target object;
  • the cropped picture includes:
  • obtaining a target cropping frame based on the initial cropping frame includes:
  • the initial cropping frame is adjusted to obtain the target cropping frame.
  • the motion information includes: a movement distance of the terminal device relative to the target object and/or a rotation angle of the terminal device relative to the target object;
  • the step of adjusting the initial cropping frame to obtain the target cropping frame based on the motion information includes:
  • the position of the initial cropping frame is adjusted to obtain the target cropping frame.
  • obtaining the target video picture based on the target cropping frame and the target collection picture collected after the movement of the terminal device includes:
  • the target collection picture is cropped based on the target cropping frame to obtain a cropped picture; and the cropped picture is enlarged to obtain the target video picture.
  • obtaining the initial cropping frame includes:
  • Target detection is performed on the preview screen, and the display frame corresponding to the detected target object is used as the initial cropping frame.
  • obtaining the target video picture based on the target cropping frame and the target collection picture collected after the movement of the terminal device includes:
  • the target cropping frame When the target cropping frame is partially located within the target capture frame, the size of the target cropping frame is reduced, and the target video frame is obtained based on the reduced cropping frame.
  • displaying the cropped picture includes:
  • the sensitive object exists in the cropped picture
  • the sensitive object is blurred or the picture in which the sensitive object is located is cropped.
  • displaying the cropped picture includes:
  • a second aspect of the embodiment of the present disclosure provides a video display device, which is used in a terminal device, and the device includes:
  • the acquisition module is configured to obtain the initial cropping frame during video capture
  • a cropping module configured to crop the preview image collected when the terminal device starts the camera based on the initial cropping frame
  • the display module is configured to display the cropped picture.
  • the device further includes:
  • an adjustment module configured to obtain a target cropping frame based on the initial cropping frame when the terminal device moves; wherein the frame selection content of the initial cropping frame and the frame selection content of the target cropping frame Include the same target audience;
  • the cropping module is also configured to: obtain a target video picture based on the target cropping frame and the target collection picture collected after the movement of the terminal device;
  • the display module is also configured to display the target video picture.
  • the adjustment module includes:
  • a detection unit configured to obtain motion information when the terminal device moves
  • the adjustment unit is configured to adjust the initial cropping frame to obtain the target cropping frame based on the motion information.
  • the motion information includes: a movement distance of the terminal device relative to the target object and/or a rotation angle of the terminal device relative to the target object:
  • the adjustment unit is further configured to adjust the size of the initial cropping frame based on the movement distance to obtain the target cropping frame;
  • the position of the initial cropping frame is adjusted to obtain the target cropping frame.
  • the cropping module is further configured to:
  • the target collection picture is cropped based on the target cropping frame to obtain a cropped picture; and the cropped picture is enlarged to obtain the target video picture.
  • the acquisition module is further configured to:
  • Target detection is performed on the preview screen, and the display frame corresponding to the detected target object is used as the initial cropping frame.
  • the cropping module is further configured to:
  • the target cropping frame When the target cropping frame is partially located within the target capture frame, the size of the target cropping frame is reduced, and the target video frame is obtained based on the reduced cropping frame.
  • the display module is further configured to:
  • the sensitive object exists in the cropped picture
  • the sensitive object is blurred or the picture in which the sensitive object is located is cropped.
  • the display module is further configured to:
  • a third aspect of the embodiment of the present disclosure provides a terminal device, including a processor, a memory, and an executable program stored in the memory and capable of being run by the processor, wherein when the processor runs the executable program, Such as the video display method provided in the first aspect.
  • a fourth aspect of the embodiments of the present disclosure provides a computer storage medium that stores an executable program; after the executable program is executed by a processor, the video display method provided in the first aspect can be implemented.
  • the technical solution provided by the embodiment of the present disclosure obtains an initial cropping frame during video collection, which can accurately and effectively determine the video image area that the user needs to display; and based on the initial cropping frame, the preview image collected when the terminal device starts the camera is cropped. It can adjust the size and display content of the display screen to effectively meet user needs, reduce user privacy exposure caused by excessive camera viewing range, and ensure user safety and experience.
  • Figure 1 is a schematic flowchart 1 of a video display method according to an exemplary embodiment
  • Figure 2 is a schematic flowchart 2 of a video display method according to an exemplary embodiment
  • Figure 3 is a schematic flowchart 3 of a video display method according to an exemplary embodiment
  • Figure 4 is a schematic diagram of a preview screen collected by a terminal device according to an exemplary embodiment
  • Figure 5 is a schematic diagram of a target collection screen collected by a terminal device according to an exemplary embodiment
  • Figure 6 is a schematic flowchart of a video display method in a video communication scenario according to an exemplary embodiment
  • Figure 7 is a schematic structural diagram of a video display device according to an exemplary embodiment
  • Figure 8 is a block diagram of a terminal device according to an exemplary embodiment.
  • first, second, third, etc. may be used to describe various information in the embodiments of the present disclosure, the information should not be limited to these terms. These terms are only used to distinguish information of the same type from each other.
  • first information may also be called second information, and similarly, the second information may also be called first information.
  • word “if” as used herein may be interpreted as "when” or "when” or "in response to determination.”
  • FIG. 1 is a schematic flowchart 1 of a video display method according to an exemplary embodiment.
  • the video display method is applied in a terminal device. The following will be shown in conjunction with Figure 1 Steps S101-S103 are explained:
  • Step S101 when collecting video, obtain the initial cropping frame
  • Step S102 based on the initial cropping frame, crop the preview image collected when the terminal device starts the camera;
  • Step S103 Display the cropped image.
  • the terminal device proposed in this disclosure may be a smart terminal, including: a mobile terminal or a portable electronic device.
  • the mobile terminal includes but is not limited to a mobile phone and a tablet computer; the portable electronic device includes but is not limited to a smart watch.
  • the embodiments of the present disclosure are suitable for There is no restriction on this.
  • the video display method provided by the embodiment of the present disclosure further includes:
  • the terminal device proposed by the present disclosure includes a display screen and a camera for image collection.
  • the above-mentioned cameras can be divided into: front-facing cameras located on one side of the terminal device display screen or rear-facing cameras located on the other side of the terminal device display screen; according to functions, the above-mentioned cameras can be divided into: telephoto cameras, wide-angle cameras or super cameras. Wide angle camera etc.
  • video collection can be a stand-alone scene, for example: using a mobile phone for video shooting and video recording, and the displayed shooting and recording images are the images cropped based on the initial cropping frame; the video collection scene can also be a multi-device interaction scene.
  • the displayed video communication picture is a picture that is cropped based on the initial cropping frame and synchronized to each terminal.
  • the video collection camera of the terminal equipment is an ultra-wide-angle lens in the front camera; correspondingly, the target object captured by the ultra-wide-angle lens in the front camera It is the user of the terminal device himself.
  • the display screen is used to display the picture collected by the camera, and the display screen can be a touch display screen; the touch display screen realizes corresponding to the touch operation by sensing the user's touch operation on the touch display screen. function.
  • the touch screen can display the preview image collected by the camera of the terminal device, and the terminal device can sense the touch operations of the user using the terminal device such as zooming in, zooming out, or selecting a target object on the touch screen.
  • the preview screen is enlarged or reduced and then displayed on the touch screen or the target object touched by the user is displayed individually.
  • the technical solution provided by the embodiment of the present disclosure obtains an initial cropping frame during video collection, which can accurately and effectively determine the video image area that the user needs to display; and based on the initial cropping frame, the preview image collected when the terminal device starts the camera is cropped. It can adjust the size and display content of the display screen to effectively meet user needs, reduce user privacy exposure caused by excessive camera viewing range, and ensure user safety and experience.
  • FIG. 2 is a schematic flowchart 2 of a video display method according to an exemplary embodiment.
  • the video display method proposed by the present disclosure will be described below in conjunction with steps S104-S105 shown in FIG. 2 .
  • Step S104 when the terminal device moves, obtain the target cropping frame based on the initial cropping frame; wherein, the frame selection content of the initial cropping frame and the frame selection content of the target cropping frame include the same target object;
  • Step S105 obtain the target video picture based on the target cropping frame and the target collection picture collected after the terminal device moves;
  • Displaying the cropped picture in step S103 may be:
  • Step S1031 display the target video screen.
  • the target cropping frame is obtained based on the initial cropping frame, which can be implemented through the following example:
  • the position of the terminal device before movement in step S104 is the position where the terminal device first turns on the camera.
  • the preview screen generated and displayed by the camera when collecting the target object for the first time displays all the content captured by the camera. It needs to be Select the target object from all the content captured by the camera, and set an initial cropping frame including the target object in the preview screen based on the target object; in step S104 in this disclosure, the target cropping frame is obtained based on the initial cropping frame, which can be: Make adjustments to get the target cropping frame directly.
  • the position of the terminal device before movement in step S104 is the position after the terminal device has experienced at least one movement; for the transition picture collected after the terminal device has experienced at least one movement, it needs to be based on
  • the initial cropping frame is adjusted to obtain a transitional cropping frame, and the transitional picture is cropped and displayed based on the transitional cropping frame; based on this, obtaining the target cropping frame based on the initial cropping frame in step S104 of the disclosure may be: adjusting the initial cropping frame , indirectly obtain the target cropping frame. Specifically: based on the transition cropping frame obtained by adjusting the initial cropping frame, the transition cropping frame is then adjusted to obtain the target cropping frame.
  • the movement of the terminal device may be caused by the user touching the terminal device and causing it to flip or shift, causing the terminal device to move.
  • the viewing range of the camera of the terminal device changes, and the state of the target object in the collection picture captured within the viewing range also changes accordingly.
  • adjust The initial cropping frame obtains the target cropping frame, so that the target cropping frame contains the target object in the initial cropping frame.
  • the state of the target object may be the size of the target object, the position of the target object, or the posture of the target object, etc., which is not limited by the present disclosure.
  • the target object in the viewing range of the terminal device's camera before movement, the target object is located in the center, and in the preview image collected by the terminal device, the target object will also be located in the center; after the terminal device rotates the preset angle, the terminal device In the viewing range after the camera moves, the target object is located at the edge, and the target object will also be located at the edge in the target acquisition picture collected by the terminal device; therefore, in order to adapt to the change in the position of the target object, the position of the initial cropping frame is adjusted to obtain Target cropping box.
  • the shape of the target cropping frame and the initial cropping frame may both be a regular-shaped cropping frame, or may be formed according to the outline of the object within the cropping frame, and the present disclosure does not limit this.
  • the initial cropping frame when collecting, the initial cropping frame is obtained, and the area of the video picture that the user needs to display can be accurately and effectively determined; and, in the case of movement of the terminal device, the initial cropping frame is adjusted is the target cropping frame, and based on the target cropping frame and the image collected after the terminal device moves, the displayed target video image is obtained, which can not only adjust the size and display content of the display image, effectively meet user needs, but also reduce users from accidentally touching the terminal. equipment, resulting in user privacy exposure caused by changes in the viewing range of the terminal device's camera, ensuring the user's safety and experience.
  • step S104 obtaining the target cropping frame based on the initial cropping frame can be achieved through steps S1041 and S1042 in Figure 3:
  • Step S1041 obtain motion information when the terminal device is moving
  • Step S1042 Based on the motion information, the initial cropping frame is adjusted to obtain the target cropping frame.
  • the motion information when the terminal device is moving may be the motion displacement of the terminal device, the rotation angle of the terminal device, the motion rate of the terminal device, and the motion direction of the terminal device; it may also be the movement of the terminal device relative to the target object.
  • the moving distance or the rotation angle of the terminal device relative to the target object, etc., are not limited by this disclosure.
  • FIG. 4 is a schematic diagram of a preview screen collected by a terminal device according to an exemplary embodiment
  • FIG. 5 is a schematic diagram of a target collection screen collected by a terminal device according to an exemplary embodiment.
  • Figure 4 shows the preview image A captured by the camera before the terminal device moves and the initial cropping frame X1 selected by the user
  • Figure 5 shows the target collection image B captured by the camera after the terminal device moves and the adjusted target cropping frame X2.
  • the initial cropping frame X1 contains the screen content selected by the user in preview screen A, and the screen content contains the target object; as the terminal device moves, the viewing position and viewing range of the camera of the terminal device change. , the state of the target object in the collection picture captured under different viewing ranges has changed; for example, the position of the target object changes, or the size of the target object changes, etc. According to the motion information of the terminal device, the state change of the target object from the preview screen A to the target acquisition screen B is obtained. Based on this, the initial cropping frame X1 is correspondingly adjusted to the target cropping frame X2, so that the target cropping frame X2 contains the target. Object to ensure that the target object can be displayed in the final target video screen.
  • This disclosure obtains the motion information when the terminal device is moving, and adjusts the initial cropping frame based on the motion information to obtain the target cropping frame, so that when the terminal device is moving, the collected target collection picture can be trimmed based on the target cropping frame. Effectively display content that includes the target object, minimizing privacy exposure caused by changes in viewing range.
  • the motion information includes: the movement distance of the terminal device relative to the target object and/or the rotation angle of the terminal device relative to the target object; in step S1042, the initial cropping frame is adjusted to obtain the target cropping frame by The following specific steps are implemented:
  • the terminal device can obtain the movement distance of the terminal device relative to the movement of the target object through detection and calculation.
  • the terminal device includes a distance sensor.
  • the terminal device can detect the distance between the terminal device and the target object through the distance sensor before and after the movement, and calculate the movement distance of the terminal device relative to the movement of the target object.
  • the distance sensor may be an infrared ranging sensor, an ultrasonic detection sensor or a millimeter radar wave sensor, to which the disclosure is not limited.
  • the terminal device can also obtain the distance between the target object and the terminal device through the depth of field in the collected picture, and then obtain the movement distance of the terminal device relative to the target object through calculation.
  • the target object when the distance between the camera of the terminal device and the target object it is facing changes, that is, when the terminal device moves relative to the target object, the target object will also appear correspondingly in the picture captured by the camera. enlargement or reduction; that is to say, the size of the target object in the target acquisition picture captured by the terminal device's camera after movement is compared with the size of the target object in the preview picture collected by the terminal device's camera before movement. will be enlarged or reduced accordingly; therefore, in order to adapt to the size change of the target object, the size of the initial cropping frame must also be enlarged and reduced by the same multiple to obtain the target cropping frame.
  • the movement distance of the terminal device can determine the magnification or reduction factor of the target object in the target acquisition screen relative to the target object in the preview screen, and then, the size of the initial cropping frame in the terminal device is enlarged or reduced by the corresponding multiple, Get the target cropping box.
  • the terminal device proposed in this disclosure includes an acceleration sensor and a gyroscope; the acceleration sensor and the gyroscope are used to detect the rotation angle of the device after the terminal device moves. Thus, the rotation angle of the terminal device toward the target object is obtained.
  • the terminal device can also include a compass sensor.
  • the compass sensor detects the coordinate changes of the mobile phone relative to the ground coordinate system to obtain the coordinates of the terminal device. Displacement and device rotation angle.
  • the position of the target object in the picture captured by the camera changes.
  • the viewing range of the camera rotates 15 degrees to the first direction.
  • the target acquisition picture captured by the camera includes the initial image of the target object.
  • the cropping frame is rotated 15 degrees to the second direction in the target acquisition screen to obtain the target cropping frame.
  • the first direction and the second direction are opposite directions.
  • the position and size of the initial cropping frame can be adjusted based on the above-mentioned movement distance and rotation angle to obtain the target cropping frame.
  • the cropping frame when the angle of the terminal device changes or distance movement occurs, the cropping frame can be adjusted based on the movement distance and rotation angle of the terminal device relative to the target object, effectively adapting to changes in the camera's viewing range, and displaying images containing the target object. Content; in actual application, the user's privacy exposure caused by excessive touching of the terminal device is minimized.
  • obtaining the target video picture based on the target cropping frame and the target collection picture collected after the terminal device moves in step S105 can be achieved through the following specific steps:
  • the target acquisition picture is cropped based on the target cropping frame to obtain the cropped picture; and the cropped picture is enlarged to obtain the target video picture.
  • the masking process in this disclosure is not to display the picture in the B1 area.
  • the masking process can be to adjust the brightness value of the picture in the B1 area to 0; in other examples, the masking process can also be to adjust the brightness value of the B1 area.
  • the area of the picture is filled with a single color, for example, the picture of the B1 area is filled with black; in other examples, the masking process can also be to cover the picture of the B1 area with a new layer.
  • the content selected by the user can be displayed in a directional manner; in the scenario of video conference or video call, it can reduce the risk of the user touching the terminal device causing the viewing range of the terminal device to change. Exposure of redundant screen content ensures user security and privacy.
  • the target acquisition screen B is cropped based on the target cropping frame X2 to obtain a cropped screen.
  • the cropped screen is the screen content B2 selected in the target cropping frame X2; the cropped screen is enlarged to obtain the target video screen.
  • amplifying the cropped image to obtain the target video image can be achieved in the following specific ways: in some examples, the cropped image is enlarged in equal proportions; among them, the size of the image after enlarging in equal proportions cannot exceed the video display area on the display screen. Size; in other examples, the cropped image is stretched or tiled so that the processed image can fill the video display area on the display screen.
  • obtaining the target video picture based on the target cropping frame and the target acquisition picture after the movement of the terminal device in step S105 can also be achieved through the following specific steps:
  • the target cropping frame When the target cropping frame is partially located within the target acquisition frame, the size of the target cropping frame is reduced, and the target video frame is obtained based on the reduced cropping frame.
  • the viewing range of the terminal device camera changes; when the target object is partially displayed in the viewing range after the camera moves, that is, when the target object is partially displayed in the target acquisition screen, the target cropping frame is partially located In the target acquisition screen, at this time, the size of the target cropping frame is reduced so that the reduced target cropping frame contains part of the displayed target object.
  • obtaining the initial cropping frame in step S101 can be achieved through the following specific steps:
  • the user of the terminal device can perform touch operations on the touch display screen.
  • the user based on the screen content of the preview screen, the user generates a touch movement trajectory on the touch display screen to determine the initial cropping frame.
  • the user can select the target object and form a cropping frame on the display screen by including the closed movement trajectory of the target object. For example, in the preview screen on the touch screen, a square cropping frame is circled around the target object. .
  • the initial cropping frame is determined by the movement trajectory acting on the preview screen, which can reasonably meet the user's screen display needs and ensure the user's experience.
  • target detection is performed on the preview screen to obtain multiple collection objects and viewfinders corresponding to the multiple collection objects, and the viewfinder frames corresponding to the target objects among the multiple collection objects are used as initial cropping frames.
  • using the viewfinder frame corresponding to the target object among the multiple collection objects as the initial cropping frame may include determining the collection object with the largest size among the multiple collection objects as the target object, and using the viewfinder frame of the target object as the initial cropping frame;
  • the viewfinder frame corresponding to the target object in the collection objects can also be used as the initial cropping frame.
  • the target object is determined among multiple collection objects through the user's touch operation on the touch screen, and the viewfinder frame of the target object is used as the initial cropping frame. Crop box.
  • displaying the cropped image in step S103 can be achieved through the following specific steps:
  • the cropped picture can be a picture obtained by cropping the preview picture collected before the terminal device moves based on the initial cropping frame, or it can be a target video obtained by clipping the target collection picture collected after the terminal device moves based on the target cropping frame. picture.
  • sensitive objects are objects that are different from the target object and that the user does not want to display.
  • the initial cropping frame in the preview picture includes the target object and the initial background; in the target acquisition picture, the target cropping frame includes the target object and the target background.
  • the target video picture obtained by cropping the target collection picture according to the target cropping frame also includes the target object and the target background. Therefore, determining whether there is a sensitive object in the target video picture can be performed by performing target detection on the target background and determining whether there is a sensitive object in the target background.
  • the sensitive object when there is a sensitive object in the target video picture, the sensitive object is blurred, which can be implemented as blur processing or masking process.
  • the method of masking processing is as described above in the embodiment of the present disclosure. , no further details will be given here; cropping the picture where the sensitive object is located may be to replace the target background containing the sensitive object with the initial background.
  • displaying the cropped image in step S103 can also be implemented through the following specific steps:
  • the cropped picture can be a picture obtained by cropping the preview picture collected before the terminal device moves based on the initial cropping frame, or it can be a target video obtained by clipping the target collection picture collected after the terminal device moves based on the target cropping frame. picture.
  • the cropped picture as the target video picture as an example, due to the movement of the terminal device and the change of the viewing range of the camera, there may be a certain degree of distortion in the edges of the picture captured by the camera and the objects in the picture.
  • This disclosure can detect the target video picture. , if the target video picture is distorted, correct the edges of the target video picture and the objects in the picture, and display the corrected picture. Through correction processing, the aesthetics of the screen display can be ensured.
  • FIG. 6 is a schematic flow chart of a video display method in a video communication scenario according to an exemplary embodiment; in Figure 6, a first user using a first terminal device and a second user using a second terminal device perform Video communication.
  • Video communication can be a video call or a video conference, which is not limited by this disclosure.
  • the server can directly or indirectly connect the first terminal device and the second terminal device through wired or wireless methods.
  • the server can be a single server, a cloud server or a server cluster.
  • the first terminal device and the second terminal device have built-in processing modules, which can complete stand-alone video collection and video cropping.
  • the video display method in the video communication scenario provided by the embodiment of the present disclosure can be implemented through the following steps:
  • Step 601 turn on the front ultra-wide-angle camera
  • Step 602 Collect and preview the first preview image based on the front ultra-wide-angle camera
  • Step 603 Obtain the first initial cropping frame in the first preview screen, where the first initial cropping frame contains the first user using the first terminal device;
  • Step 604 Obtain the first display video frame based on the first initial cropping frame and the first preview frame, and send the first display video frame to the server;
  • the first displayed video picture is the cropped picture proposed in the above embodiment of the present disclosure
  • Step 605 turn on the front ultra-wide-angle camera
  • Step 606 Collect and preview the second preview image based on the front ultra-wide-angle camera
  • Step 607 Obtain the second initial cropping frame in the second preview screen, where the second initial cropping frame contains the second user using the second terminal device;
  • Step 608 Obtain the second display video image based on the second initial cropping frame and the second preview image, and send the second video display image to the server;
  • the second display video picture is the cropped picture proposed in the above embodiment of the present disclosure.
  • Step 609 Splice the first display video picture and the second display video picture to obtain the first call picture
  • Step 610 Send the first call screen to the first terminal device
  • Step 611 Send the first call screen to the second terminal device
  • Step 612 display the first call screen
  • Step 613 display the first call screen
  • Step 614 Obtain motion information about the movement of the first terminal device; when the terminal device moves, obtain the target cropping frame based on the initial cropping frame; obtain the target video based on the target cropping frame and the target collection picture collected after the movement of the terminal device screen and will send the target video screen to the server;
  • Step 615 Splice the target video picture sent by the first terminal device and the second video picture sent by the second terminal device to obtain a second call picture;
  • Step 616 Send the second call screen to the first terminal device
  • Step 617 Send the second call screen to the second terminal device
  • Step 618 display the second call screen
  • Step 619 Display the second call screen.
  • the terminal device may be the first terminal device and the second terminal device proposed above in this disclosure.
  • FIG. 7 is a schematic structural diagram of a video display device according to an exemplary embodiment.
  • the video display device is used in terminal equipment and includes:
  • the acquisition module 701 is configured to acquire the initial cropping frame during video collection
  • the cropping module 702 is configured to crop the preview image collected when the terminal device starts the camera based on the initial cropping frame;
  • the display module 703 is configured to display the cropped picture.
  • the device further includes:
  • the adjustment module 704 is configured to obtain the target cropping frame based on the initial cropping frame when the terminal device moves; wherein the frame selection content of the initial cropping frame and the frame selection content of the target cropping frame include the same target object;
  • the cropping module 702 is also configured to: obtain the target video picture based on the target cropping frame and the target collection picture collected after the terminal device moves;
  • the display module 703 is also configured to display the target video picture.
  • the adjustment module 704 includes:
  • the detection unit 7041 is configured to obtain motion information when the terminal device moves;
  • the adjustment unit 7042 is configured to adjust the initial cropping frame to obtain the target cropping frame based on the motion information.
  • the motion information includes: the movement distance of the terminal device relative to the target object and/or the rotation angle of the terminal device relative to the target object:
  • the adjustment unit 7042 is also configured to adjust the size of the initial cropping frame based on the movement distance to obtain the target cropping frame; and/or
  • the cropping module 702 is further configured to:
  • the target acquisition picture is cropped based on the target cropping frame to obtain the cropped picture; and the cropped picture is enlarged to obtain the target video picture.
  • the acquisition module 701 is further configured to:
  • the cropping module 702 is further configured to:
  • the target cropping frame When the target cropping frame is partially located within the target acquisition frame, the size of the target cropping frame is reduced, and the target video frame is obtained based on the reduced cropping frame.
  • display module 703 is further configured to:
  • display module 703 is further configured to:
  • An embodiment of the present disclosure provides a terminal device, including:
  • Memory used to store instructions executable by the processor
  • the processor is configured to execute the video display method provided by any of the foregoing technical solutions.
  • the processor may include various types of storage media, which are non-transitory computer storage media that can continue to store information stored thereon after the terminal device is powered off.
  • the processor may be connected to the memory through a bus or the like, and be used to read the executable program stored on the memory, for example, at least one of the video display methods proposed in the above embodiments of the present disclosure.
  • Figure 8 is a block diagram of a terminal device according to an exemplary embodiment.
  • the terminal device 800 may be a mobile phone, a computer, a digital broadcast user device, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
  • the terminal device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power supply component 806 , a multimedia component 808 , an audio component 810 , an input/output (I/O) interface 812 , and a sensor component 814 , and communication component 816.
  • the processing component 802 generally controls the overall operations of the terminal device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations.
  • the processing component 802 may include one or more processors 820 to execute instructions to generate all or part of the steps of the methods described above. Additionally, processing component 802 may include one or more modules that facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.
  • the memory 804 is configured to store various types of data to support operations at the terminal device 800 . Examples of such data include instructions for any application or method operating on the terminal device 800, contact data, phonebook data, messages, pictures, videos, etc.
  • Memory 804 may be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EEPROM), Programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read-only memory
  • EEPROM erasable programmable read-only memory
  • EPROM Programmable read-only memory
  • PROM programmable read-only memory
  • ROM read-only memory
  • magnetic memory flash memory, magnetic or optical disk.
  • Power supply component 806 provides power to various components of terminal device 800 .
  • Power supply components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to end device 800 .
  • Multimedia component 808 includes a screen providing an output interface between the terminal device 800 and the user.
  • the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user.
  • the touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide action.
  • multimedia component 808 includes a front-facing camera and/or a rear-facing camera.
  • the front camera includes an ultra-wide-angle camera; when the terminal device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data.
  • an operating mode such as a shooting mode or a video mode
  • the front camera and/or the rear camera can receive external multimedia data.
  • Each front-facing camera and rear-facing camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.
  • Audio component 810 is configured to output and/or input audio signals.
  • the audio component 810 includes a microphone (MIC) configured to receive external audio signals when the terminal device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode.
  • the received audio signal may be further stored in memory 804 or sent via communication component 816 .
  • audio component 810 also includes a speaker for outputting audio signals.
  • the I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module, which may be a keyboard, a click wheel, a button, etc. These buttons may include, but are not limited to: Home button, Volume buttons, Start button, and Lock button.
  • Sensor component 814 includes one or more sensors for providing various aspects of status assessment for terminal device 800 .
  • the sensor component 814 can detect the open/closed state of the device 800 and the relative positioning of components, such as the display and keypad of the terminal device 800.
  • the sensor component 814 can also detect the terminal device 800 or a component of the terminal device 800. position changes, presence or absence of user contact with the terminal device 800 , orientation or acceleration/deceleration of the terminal device 800 and temperature changes of the terminal device 800 .
  • Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact.
  • Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
  • the sensor component 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
  • the communication component 816 is configured to facilitate wired or wireless communication between the terminal device 800 and other devices.
  • the terminal device 800 can access a wireless network based on communication standards, such as WiFi, 2G or 3G, or a combination thereof.
  • the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel.
  • the communications component 816 also includes a near field communications (NFC) module to facilitate short-range communications.
  • NFC near field communications
  • the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra-wideband
  • Bluetooth Bluetooth
  • the terminal device 800 may be configured by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation is used to perform the above method.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGA field programmable A programmable gate array
  • controller microcontroller, microprocessor or other electronic component implementation is used to perform the above method.
  • a non-transitory computer-readable storage medium including instructions such as a memory 804 including instructions, which are executable by the processor 820 of the terminal device 800 to generate the above method is also provided.
  • the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

Landscapes

  • Studio Devices (AREA)

Abstract

La présente divulgation concerne un procédé et un appareil d'affichage vidéo, un dispositif terminal et un support de stockage informatique. Le procédé d'affichage vidéo est appliqué au dispositif terminal et comprend : lors de l'acquisition d'une vidéo, l'obtention d'une boîte de recadrage initial (S101) ; sur la base de la boîte de recadrage initial, le recadrage d'une image de prévisualisation acquise lorsque le dispositif terminal démarre une caméra (S102) ; et l'affichage de l'image recadrée (S103).
PCT/CN2022/095020 2022-05-25 2022-05-25 Procédé et appareil d'affichage vidéo, dispositif terminal et support de stockage informatique WO2023225910A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202280004304.8A CN117480772A (zh) 2022-05-25 2022-05-25 视频显示方法及装置、终端设备及计算机存储介质
PCT/CN2022/095020 WO2023225910A1 (fr) 2022-05-25 2022-05-25 Procédé et appareil d'affichage vidéo, dispositif terminal et support de stockage informatique

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2022/095020 WO2023225910A1 (fr) 2022-05-25 2022-05-25 Procédé et appareil d'affichage vidéo, dispositif terminal et support de stockage informatique

Publications (1)

Publication Number Publication Date
WO2023225910A1 true WO2023225910A1 (fr) 2023-11-30

Family

ID=88918022

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/095020 WO2023225910A1 (fr) 2022-05-25 2022-05-25 Procédé et appareil d'affichage vidéo, dispositif terminal et support de stockage informatique

Country Status (2)

Country Link
CN (1) CN117480772A (fr)
WO (1) WO2023225910A1 (fr)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009171428A (ja) * 2008-01-18 2009-07-30 Nec Corp デジタルカメラ装置および電子ズームの制御方法およびプログラム
CN104731494A (zh) * 2013-12-23 2015-06-24 中兴通讯股份有限公司 一种预览界面选定区域放大的方法和装置
CN106358069A (zh) * 2016-10-31 2017-01-25 维沃移动通信有限公司 一种视频数据处理方法及移动终端
KR20190048291A (ko) * 2017-10-31 2019-05-09 삼성에스디에스 주식회사 영상 클리핑을 이용한 화상 회의 시스템 및 방법
WO2020093799A1 (fr) * 2018-11-06 2020-05-14 华为技术有限公司 Procédé et appareil de traitement d'image
CN112347849A (zh) * 2020-09-29 2021-02-09 咪咕视讯科技有限公司 视频会议处理方法、电子设备及存储介质
CN113014793A (zh) * 2019-12-19 2021-06-22 华为技术有限公司 一种视频处理方法及电子设备

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009171428A (ja) * 2008-01-18 2009-07-30 Nec Corp デジタルカメラ装置および電子ズームの制御方法およびプログラム
CN104731494A (zh) * 2013-12-23 2015-06-24 中兴通讯股份有限公司 一种预览界面选定区域放大的方法和装置
CN106358069A (zh) * 2016-10-31 2017-01-25 维沃移动通信有限公司 一种视频数据处理方法及移动终端
KR20190048291A (ko) * 2017-10-31 2019-05-09 삼성에스디에스 주식회사 영상 클리핑을 이용한 화상 회의 시스템 및 방법
WO2020093799A1 (fr) * 2018-11-06 2020-05-14 华为技术有限公司 Procédé et appareil de traitement d'image
CN113014793A (zh) * 2019-12-19 2021-06-22 华为技术有限公司 一种视频处理方法及电子设备
CN112347849A (zh) * 2020-09-29 2021-02-09 咪咕视讯科技有限公司 视频会议处理方法、电子设备及存储介质

Also Published As

Publication number Publication date
CN117480772A (zh) 2024-01-30

Similar Documents

Publication Publication Date Title
EP3010226B1 (fr) Procédé et appareil d'obtention de photographie
WO2021047077A1 (fr) Procédé, appareil et dispositif de traitement d'images basés sur de multiples modules photographiques et support
CN108419016B (zh) 拍摄方法、装置及终端
JP6348611B2 (ja) 自動ピント合わせ方法、装置、プログラム及び記録媒体
CN105282441B (zh) 拍照方法及装置
WO2019033411A1 (fr) Procédé et dispositif de prise de vue d'images panoramiques
JP2012239150A (ja) 手持ち式電子装置、それに適用される二重像取得方法及びそれにロードされるコンピュータプログラム製品
CN105260732A (zh) 图片处理方法及装置
WO2021238564A1 (fr) Dispositif d'affichage et procédé, appareil et système de détermination de paramètre de distorsion associés, ainsi que support d'informations
KR101788496B1 (ko) 단말 및 비디오 이미지를 제어하는 장치 및 방법
CN113364965A (zh) 基于多摄像头的拍摄方法、装置及电子设备
US11425305B2 (en) Control method and apparatus, electronic device, and storage medium
WO2018053722A1 (fr) Procédé et dispositif de capture de photo panoramique
CN115134505B (zh) 预览画面生成方法及装置、电子设备、存储介质
CN114422687B (zh) 预览图像切换方法及装置、电子设备及存储介质
CN112799522A (zh) 移动终端控制方法及装置、移动终端及存储介质
CN114979321A (zh) 通知信息的显示方法、装置、终端及存储介质
CN112188096A (zh) 拍照方法及装置、终端及存储介质
CN113099113B (zh) 电子终端、拍照方法及装置、存储介质
WO2023225910A1 (fr) Procédé et appareil d'affichage vidéo, dispositif terminal et support de stockage informatique
CN114943791A (zh) 动画播放方法、装置、设备及存储介质
CN107295229B (zh) 移动终端的拍照方法和装置
WO2019134513A1 (fr) Procédé de mise au point de cliché, dispositif, support d'informations, et dispositif électronique
CN115118844B (zh) 一种移动设备
CN112346795B (zh) 图片处理方法、装置及存储介质

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 202280004304.8

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE