CN112995418B - Video color ring playing method, sending method and related equipment - Google Patents

Abstract

The present application provides a video color ring back tone playing method, sending method and related equipment. Wherein, the video CRBT playing method includes: obtaining the first video stream intercepted from the played first video CRBT; determining P core elements according to the first video stream, where P is a positive integer; sending the P core elements to the CRBT platform A core element: playing a second video CRBT sent by the CRBT platform, and the second video CRBT is determined based on the P core elements. It can be seen that the video CRBT played by the terminal of the present application can be updated based on P core elements, so that the video CRBT played by the terminal is more in line with user preferences, thereby improving the flexibility and reliability of video CRBT playback.

Description

Video ring tone playing method, sending method and related equipment

technical field

The embodiments of the present application relate to the technical field of communications, and in particular, to a method for playing a video ring tone, a sending method, and related equipment.

Background technique

With the continuous development of communication technology, the video ring back tone service appears. At present, when the called party subscribes to the video ring back tone service, the calling terminal plays the video ring back tone subscribed by the called party before the called party picks up the hook during the process of calling the called party by the calling party. It can be seen that the method of playing the video ring back tone by the existing calling terminal is fixed.

Contents of the invention

Embodiments of the present application provide a method for playing a video color ring tone, a method for sending it, and related equipment, so as to solve the problem of a fixed way for an existing calling terminal to play a video color ring tone.

In order to solve the above problems, the application is implemented as follows:

In the first aspect, the embodiment of the present application provides a method for playing video ring back tones, the method comprising:

Obtain the first video stream intercepted from the played first video CRBT;

According to the first video stream, determine P core elements, where P is a positive integer;

Send the P core elements to the CRBT platform;

Playing the second video CRBT sent by the CRBT platform, where the second video CRBT is determined based on the P core elements.

In the second aspect, the embodiment of the application provides a method for sending a video ring back tone, the method comprising:

Send the first video ring back tone to the terminal;

receiving P core elements sent by the terminal, the P core elements are determined based on the first video stream intercepted from the first video CRBT, and P is a positive integer;

Sending a second video color ring back to the terminal, where the second video color ring back is determined based on the P core elements.

In the third aspect, the embodiment of the present application also provides a communication device, including a transceiver, a memory, a processor, and programs or instructions stored in the memory and operable on the processor; the processor uses The steps in the method described in the first aspect are realized by reading the programs or instructions in the memory, or the steps in the method described in the second aspect are realized.

In the fourth aspect, the embodiments of the present application further provide a readable storage medium for storing programs or instructions, and when the programs or instructions are executed by a processor, the steps in the method as described in the first aspect are implemented, or, A step in the method as described in the second aspect.

In this embodiment of the application, after the terminal obtains the first video stream intercepted from the played first video CRBT, it can determine P core elements based on the first video stream, and send the P core elements to the video CRBT platform. core elements; after acquiring the P core elements, the CRBT platform may send a second video CRBT determined based on the P core elements to the terminal, so that the terminal plays the second video CRBT. It can be seen that in the embodiment of the present application, the video CRBT played by the terminal can be updated based on P core elements, so that the video CRBT played by the terminal is more in line with user preferences, thereby improving the flexibility and reliability of video CRBT playback.

Description of drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that need to be used in the description of the embodiments of the present application will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained based on these drawings without any creative effort.

FIG. 1 is a communication system applicable to the embodiment of the present application;

FIG. 2 is a schematic flow diagram of a method for playing a video ring back tone provided by an embodiment of the present application;

Fig. 3 is one of the display schematic diagrams provided by the embodiment of the present application;

Figure 4a is the second schematic diagram of the display provided by the embodiment of the present application;

Figure 4b is the third schematic diagram of the display provided by the embodiment of the present application;

Figure 4c is the fourth schematic diagram of the display provided by the embodiment of the present application;

FIG. 5 is a schematic flowchart of a method for sending a video ring back tone provided in an embodiment of the present application;

Figure 6 is the fifth schematic diagram of the display provided by the embodiment of the present application;

Fig. 7 is a schematic structural diagram of a video CRBT playback device provided by an embodiment of the present application;

FIG. 8 is a schematic structural diagram of a video ring back tone sending device provided by an embodiment of the present application;

FIG. 9 is a schematic structural diagram of a communication device provided by an embodiment of the present application.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

The terms "first", "second", etc. in the present application are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. Furthermore, the terms "comprising" and "having", as well as any variations thereof, are intended to cover a non-exclusive inclusion, for example, a process, method, system, product or device comprising a sequence of steps or elements is not necessarily limited to the expressly listed instead, may include other steps or elements not explicitly listed or inherent to the process, method, product or apparatus. In addition, the use of "and/or" in this application means at least one of the connected objects, such as A and/or B and/or C, means that A alone, B alone, C alone, and both A and B exist, Both B and C exist, both A and C exist, and there are 7 situations where A, B, and C all exist.

First, the application scenario of the technical solution provided by the embodiment of the present application is introduced:

FIG. 1 shows a communication system to which this embodiment of the present application is applicable. As shown in FIG. 1 , the communication system may include a terminal 11 and a CRBT platform 12 . The terminal 11 may also be called a terminal device or a user terminal (User Equipment, UE), and the terminal 11 may be a mobile phone, a computer, a wearable device, and the like. The CRBT platform 12 may also be called a video CRBT playing platform or a CRBT playing platform, and the CRBT platform 12 may be a device such as a server.

In practical applications, the CRBT platform 12 can be used to store and generate a video CRBT, and send the video CRBT to the terminal 11; the terminal 11 can be used to play the video CRBT. It should be noted that the terminal 11 may be a calling terminal or a called terminal.

Referring to FIG. 2 , FIG. 2 is a schematic flowchart of a method for playing a video ring back tone provided by an embodiment of the present application. The method for playing a video CRBT provided in the embodiment of the present application may be executed by a terminal.

As shown in Figure 2, the method for playing video ring back tones may include the following steps:

Step 201. Obtain a first video stream intercepted from a played first video color ring back tone.

During specific implementation, during the call process of the terminal, the CRBT platform may send the first video CRBT to the terminal, so that the terminal plays the first video CRBT. During watching the first video CRBT, the user may intercept one or more (at least two) video streams from the played first video CRBT. The first video stream may include all or part of the video stream intercepted from the played first video ring back tone.

It should be noted that the embodiment of the present application does not limit the method of intercepting the video stream, and any method that can intercept the video stream from the video can fall within the protection scope of the embodiment of the present application.

Step 202: Determine P core elements according to the first video stream.

In the embodiment of the present application, P is a positive integer. The specific value of P can be set based on requirements, which is not limited in this embodiment of the present application, but it can be understood that the value of P is less than or equal to the number of all elements included in the first video stream, that is, the The P core elements are all or part of the elements included in the first video stream.

In this embodiment of the present application, in the first case, the terminal may regard the first video stream as a segment that the user is interested in in the first video CRBT, in this case, the P core elements may be regarded as P elements that the user is interested in.

In the second case, the terminal may regard the first video stream as a segment in which the user is not interested in the first video CRBT, and in this case, the P core elements may be P elements in which the user is not interested.

During specific implementation, in one implementation manner, the P core elements may be the P elements that appear most frequently in the first video stream; in another implementation manner, the P core elements may be the The P elements with the longest appearing time in the first video stream, but not limited thereto.

Step 203, sending the P core elements to the CRBT platform.

After the terminal determines the P core elements, it can send the P core elements to the CRBT platform, so that the CRBT platform can obtain the elements that the user is interested in or the elements that the user is not interested in, so that based on the P core elements, the adjustment The CRBT video sent to the terminal, so that the video CRBT played by the terminal is more in line with user preferences, thereby improving the flexibility and reliability of video CRBT playback.

Step 204: Play the second video CRBT sent by the CRBT platform, the second video CRBT is determined based on the P core elements.

In this step, the determination of the second video CRBT based on the P core elements can be specifically expressed as:

In the case that the P core elements are P elements that the user is interested in, the second video ring back tone includes some or all of the P core elements;

In the case that the P core elements are P elements that are not of interest to the user, the second video ring tone does not include the P core elements.

In the video CRBT playing method of this embodiment, after the terminal acquires the first video stream intercepted from the played first video CRBT, it can determine P core elements based on the first video stream, and send the P core elements to the video CRBT platform The P core elements; afterward, the terminal can play the second video color ring determined by the color ring platform based on the P core elements. It can be seen that the video CRBT played by the terminal can be updated based on the P core elements, so that the video CRBT played by the terminal is more in line with the user's preferences, thereby improving the flexibility and reliability of playing the video CRBT.

The determination of the P core elements is described below:

Optionally, the determining the P core elements according to the first video stream includes:

Identify M elements included in the first video frame of the first video stream, where M is an integer greater than or equal to P;

Obtain the target eigenvalue corresponding to each element of the M elements to obtain M target eigenvalues, wherein the target eigenvalue corresponding to the element is determined based on the first eigenvalue corresponding to the element and the second eigenvalue corresponding to the element, and the element The corresponding first eigenvalue is used to represent the total display size of the element in the first video stream, and the second eigenvalue corresponding to the element is used to represent the relative size of the element in all display positions of the first video stream relative to the element in the first video stream. The total offset value of the display position of a video frame;

Determining P elements corresponding to the largest P target eigenvalues among the M target eigenvalues as P core elements.

In this optional implementation manner, the terminal takes the first video frame of the first video stream as the basic frame, and after identifying the M elements included in the first video, can obtain each Relevant information of elements in the first video stream, such as the total display size, the total offset value of the display position compared with the basic frame, etc.; then, based on the above-mentioned relevant information, select P elements from the M elements as a core element.

In practical applications, the selection of the first video frame may be determined based on actual requirements, which is not limited in this embodiment of the present application. For example, the first video frame may be the first video frame of the first video stream, or the last video frame of the first video stream.

For the acquisition of the first eigenvalue, the description is as follows:

Optionally, after identifying the M elements included in the first video frame of the first video stream, and before acquiring the target feature value corresponding to each of the M elements, the method further includes:

Determine that the first video stream includes Q video frames of the i-th element of the M elements, i is a positive integer less than or equal to M, and Q is a positive integer;

Perform grid division on the Q video frames in the same manner;

Obtain the number of grids occupied by the i-th element in each video frame of the Q video frames to obtain Q grid numbers;

Determine the first eigenvalue corresponding to the i-th element according to the Q grid numbers.

In this optional step, the division method of the video frames is not limited, but the division methods of the Q video frames need to be the same. For example, the terminal may use a coordinate interval of 1 millimeter (mm) to perform grid division on the Q video frames, but it is not limited thereto. It can be understood that the Q video frames include the first video frame.

The terminal may determine the first eigenvalue corresponding to the i-th element through the following formula:

M _i ＝f(x ₁ )+f(x ₂ )+...f(x _Q )

Wherein, M _i represents the first eigenvalue corresponding to the i-th element; x _Q represents the number of grids occupied by the i-th element in the Q-th video frame of the Q-th video frames.

Further, f(x) may be equal to x, and in this case, the terminal directly determines the sum of the Q grid numbers as the first eigenvalue corresponding to the i-th element. Of course, f(x) may not be equal to x, and the specific expression form of f(x) may be determined according to actual needs, which is not limited in this embodiment of the present application.

It should be noted that the above manner of determining the first feature value is only an example, and does not therefore limit the manner of determining the first feature value. For example: in other implementation manners, the terminal may detect the display size of the i-th element in each of the Q video frames, and then obtain the i-th element's display size in the first video frame through statistics. The total display size of the video stream, and determining the total display size of the i-th element in the first video stream as the first feature value corresponding to the i-th element.

For the acquisition of the second eigenvalue, the description is as follows:

After determining that the first video stream includes Q video frames of the i-th element of the M elements, the terminal may use the same coordinate axis to obtain each of the i-th elements in the Q video frames The coordinates of the video frames; afterward, the second feature value corresponding to the i element can be determined according to the coordinates of each video frame of the i element in the Q video frames.

The terminal may determine the second eigenvalue corresponding to the i-th element through the following formula:

N _i =V ₁ +V ₂ +...V _Q

V _Q ＝ E(Yu) ²

Wherein, N _i represents the second eigenvalue corresponding to the i-th element; V _Q represents the display position of the i-th element in the Q-th video frame of the Q-th video frames, relative to the i-th The offset value of the display position of the element in the first video frame; E is a constant, which can be set according to the actual situation, which is not limited in the embodiment of the present application; Y indicates that the i-th element is in the All coordinates (or center coordinates) of Q video frames; u represents all coordinates (or center coordinates) of the i-th element in the first video frame.

The following describes the interception of the first video stream:

Optionally, at least part of the video frames of the first video CRBT include at least one clipping control, and the at least one clipping control is used to intercept a video stream;

The acquisition of the first video stream intercepted from the played first video CRBT includes:

receiving a first input to a first clipping control included in a second video frame of the first video CRBT, where the first input is used to draw a first closed frame;

In response to the first input, determine the video stream played in the first display area corresponding to the first closed frame in the first time period as the first video stream intercepted from the played first video CRBT;

Wherein, the start time of the first time period is the start time of the first input, and the end time of the first time period is the end time of the first input.

In this optional implementation manner, the first video CRBT sent by the CRBT platform includes a clipping control. The user can intercept the first video stream from the first video CRBT by means of a clipping control. During specific implementation, the user realizes the interception of the video stream by using the clip control to draw a closed frame. It should be noted that, when the start position and end position of the first input are smaller than the preset distance value, the input track of the first input can be regarded as a closed box.

For the convenience of understanding, the description is as follows in conjunction with the example in Figure 3:

In FIG. 3 , the playing area of the first video CRBT is marked as 31 , and the user performs a first input through a clipping control 32 to draw a first closed frame 33 . Assuming that the content played in the first display area corresponding to the first closed frame 33 during the input time period of the first input is content one, then the first video stream is content one.

In FIG. 3, the clip control is displayed as a pen, but it can be understood that the display form of the clip control in FIG. 3 is only an example, and does not limit the display form of the clip control. The display form may be scissors, but is not limited thereto.

It should be noted that, in other implementation manners, the first video CRBT may not include a clipping control, and the user may also intercept the first video stream from the first video CRBT in other ways. Optionally, the user may intercept the first video stream from the first video CRBT through voice input, for example, the user may input "intercept the first third of the currently playing video CRBT" to trigger the terminal to intercept the currently played video CRBT The first third of the video ring back tone is used as the first video stream.

In the embodiment of the present application, the first video ring back tone may be the initial video ring back tone sent by the color screen platform during the call process of the terminal, or may be an adjusted video color tone sent by the color screen platform during the call process of the terminal. ring tones. For the latter, the instructions are as follows:

Optionally, before receiving the first input of the first clip control included in the second video frame of the first video ring tone, the method further includes:

Play the third video CRBT sent by the CRBT platform;

Determining T elements that the user is interested in in the third video CRBT, where T is a positive integer;

sending the T elements to the CRBT platform;

receiving the first video CRBT sent by the CRBT platform, and determining a display position of the at least one editing control in the first video CRBT based on the T elements.

In this optional implementation manner, after the terminal plays the third video CRBT, it can determine the elements that the user is interested in in the third video CRBT, and then send these elements to the CRBT platform, so that the CRBT platform can based on the T elements, generate the first video CRBT, and send the first video CRBT to the terminal.

In this optional implementation manner, implementation manner 1, the difference between the first video CRBT and the second video CRBT is that: compared with the third video CRBT, the first video CRBT is added with the at least one Clipping control, the video frame content remains unchanged except for the clipping control; implementation mode 2, compared with the above-mentioned implementation mode 1, the video frame content of the first video CRBT has also changed except for the clipping control. Optionally, the The first video CRBT is determined based on the T elements, for example, the first video CRBT includes part or all of the T elements.

The display position of the at least one editing control in the first video ring tone is determined based on the T elements. Optionally, the distance between the display position of the clipping control and the display position of the target element is smaller than a preset distance value, and the target element is any element in the T elements. That is to say, for a video frame including the target element in the first video CRBT, a clipping control may be displayed near the target element for the user to clip the video stream.

Regarding the determination of the T elements, in a specific implementation, in the first implementation manner, the terminal may determine the T elements that the user is interested in in the third video CRBT based on the user's voice input. For example, the user can directly input "interested in the last third of the third video CRBT", triggering the terminal to determine that the T elements that the user is interested in in the third video CRBT are the third video CRBT the last third of the

In the second implementation manner, optionally, the determination of the T elements that the user is interested in in the third video CRBT includes:

determining an area of interest of the user for the third video ring back tone;

According to the second video stream played in the third display area corresponding to the interest area in the second time period, T elements that the user is interested in in the third video color ring back tone are determined.

During specific implementation, the T elements may include all or part of the elements included in the second video stream, which may be determined according to actual requirements, which is not limited in this embodiment of the present application. That is to say, the terminal may determine all or part of elements appearing in the second video stream as the T elements.

During specific implementation, the terminal may generate a focus map based on the second video stream, the focus map includes all elements included in the second video stream, and the display saturation of the elements is the same as that of the elements in the second video stream. The number of occurrences is positively correlated, that is, the more times an element appears in the second video stream, the higher the display saturation of the element in the focus map. In this way, the terminal may sequentially select elements as the T elements in which the user is interested in the third video CRBT according to the descending order of the display saturation of the elements in the focus map.

For the region of interest, the terminal may collect the facial image of the user through the image collection device for determination. Optionally, the terminal may determine the user's gazing position on the third video CRBT based on the line of sight corresponding to the user's eye image, and may determine the user's interest area on the third video CRBT based on the gazing position.

In an implementation manner, the terminal may directly determine the display area corresponding to the determined gaze position as the user's area of interest in the third video color ring back tone.

In another implementation manner, the terminal may also obtain the pupil radius when the user gazes at the gaze position, and the pupil radius may be used to reflect the user's degree of interest in the content appearing at the gaze position. Generally, if the user is interested in the content at the gaze position, the pupil radius will become larger; if the user is not interested in the content at the gaze position, the pupil radius will become smaller. Therefore, in this implementation, the terminal may determine the display area corresponding to the target gaze position as the region of interest, and the pupil radius corresponding to the target gaze position is greater than a preset threshold, that is, the target gaze position is an area of interest to the user. s position.

The starting moment of the second time period may be the moment when the region of interest is determined, and the length of the second time period may be preset, but not limited thereto.

In this embodiment of the present application, optionally, the playing the second video CRBT sent by the CRBT platform includes:

Playing the second video CRBT sent by the CRBT platform in the first display area;

Execute a first operation on the second display area, where the first operation is any of the following:

controlling the second display area to be in a screen-off state;

Playing a fourth video CRBT sent by the CRBT platform in the second display area, where the fourth video CRBT is determined based on the P core elements.

Wherein, the second display area is a display area other than the first display area. Specifically, the second display area may be part or all of the display area except the first display area. In practical applications, the first display area and the second display area may be different display areas of the same display screen of the terminal, or the first display area and the second display area may be different display areas of the terminal. display area of the display.

In this optional implementation manner, the playing position of the second video color ring tone may be located in the first display area.

As for other display areas, in an implementation manner, the terminal can control it to be in a screen-off state, so that on the one hand, the power consumption of the terminal can be reduced, and on the other hand, the attention of the second video ring tone can be increased.

In another implementation, the CRBT platform may generate a fourth video CRBT based on the P core elements in addition to sending the second video CRBT to the terminal, and send the fourth video CRBT to the terminal, so that the terminal The fourth video CRBT is played in other display areas except the first display area to realize vertical push of the video CRBT, so that the video CRBT played by the terminal can further improve the video CRBT under the condition that the video CRBT played by the terminal meets the user's preference. Flexibility and richness of playback.

It can be understood that since both the fourth video CRBT and the second video CRBT are determined based on the P core elements, the content of the fourth video CRBT and the second video CRBT may be the same or similar, specifically It can be determined according to actual requirements, which is not limited in this embodiment of the present application. It should be noted that the fourth video CRBT is generated in a manner similar to that of the second video CRBT, for details, please refer to the foregoing description, which will not be repeated here. The fourth video CRBT may include one or more video CRBTs.

In addition, the user can perform a second input to a certain display area to trigger the electronic device to play the video ring back tones currently played in the display area in full screen, so as to improve the flexibility of playing the video ring back tones. Certainly, after triggering the electronic device to display the video ring tone currently played in the display area in full screen, the user can perform a third input to trigger the electronic device to return to the display mode before receiving the second input, or trigger the electronic device to exit the full screen display mode, and will control the display area corresponding to the second input to be in a screen-off state.

For easy understanding, please refer to Fig. 4a to Fig. 4c. In FIG. 4 a , the terminal plays the second video color ring in the first display area 41 , plays the fourth video color ring in the second display area 42 , and the other display areas are in an off-screen state. After receiving the second input to the first display area 41 , as shown in FIG. 4 b , the terminal plays the second video CRBT in full screen. After receiving the third input, as shown in FIG. 4 c , the terminal only plays the fourth video color ring tone in the second display area 42 , and the other display areas are in a screen-off state.

Referring to FIG. 5 , FIG. 5 is a schematic flowchart of a method for sending a video ring back tone provided by an embodiment of the present application. The method for sending a video CRBT provided in the embodiment of the present application may be executed by a CRBT platform.

As shown in Figure 5, the video color ring back tone sending method may include the following steps:

Step 501: Send the first video ring back tone to the terminal.

Step 502: Receive P core elements sent by the terminal, the P core elements are determined based on the first video stream intercepted from the first video CRBT, and P is a positive integer.

Step 503: Send a second video color ring back to the terminal, where the second video color ring back is determined based on the P core elements.

Optionally, after receiving the P core elements sent by the terminal and before sending the second video CRBT to the terminal, the method further includes:

Extracting R video frames from at least one video ring back tone;

Generate a second video ring back, the second video ring includes the R video frames;

Wherein, in the case that the P core elements are P elements that the user is interested in, each video frame of the R video frames includes at least one element in the P core elements, or, the R Each of the video frames includes elements whose matching degree with the P core elements is greater than a preset value;

In the case that the P core elements are P elements that are not of interest to the user, the R video frames do not include the P core elements.

During specific implementation, the at least one video ring back tone may be any at least one video stored on the ring back tone platform. Optionally, the at least one video CRBT may include the first video CRBT.

In the case that the P core elements are the P elements that the user is interested in, the R video frames may include the same or similar elements as the P core elements, so that the user is interested in the second video color ring The degree of interest of is higher than that of the first video ring back tone.

In the case that the P core elements are P elements that are not of interest to the user, the R video frames do not include the P core elements, so that the user is more interested in the second video ring tone than The first video ring tone.

Optionally, at least part of the video frames of the first video CRBT include at least one clipping control, and the at least one clipping control is used to intercept a video stream.

Optionally, before sending the first video ring back to the terminal, the method further includes:

sending a third video ring back tone to the terminal;

receiving T elements sent by the terminal that the user is interested in the third video CRBT;

Wherein, the first video CRBT is determined based on the T elements, and the at least one editing control is determined based on the T elements.

Optionally, after receiving T elements sent by the terminal that the user is interested in the third video CRBT and before sending the first video CRBT to the terminal, the method further includes:

Generate a first video ring tone according to the T elements;

Adding a second editing control corresponding to the target element at the target position of the video frame of the target element included in the first video ring tone;

Wherein, the target element belongs to the T elements, and the distance between the target position and the display position of the target element is smaller than a preset threshold.

It should be noted that the principle of generating the first video CRBT is similar to that of the second video CRBT. For details, refer to the foregoing description about the second video CRBT, which will not be repeated here. The video frame of the first video CRBT may include the same or similar elements as the T core elements, so that the user is more interested in the first video CRBT than the third video CRBT.

Optionally, adding a second editing control corresponding to the target element at the target position of the video frame of the target element in the first video ringtone includes:

Acquiring a focus value corresponding to the target element, where the focus value corresponding to the target element is determined based on the number of times the CRBT platform receives the target element;

determining the target display size of the second clip control corresponding to the target element according to the focus value corresponding to the target element;

Adding the second clipping control of the target display size at the target position of the video frame including the target element in the first video CRBT.

In this optional implementation manner, the display size of the clipping control corresponding to the element is determined based on the focus value corresponding to the element, and the focus value corresponding to the element is determined based on the reception times of the CRBT platform. Optionally, the display size of the clip control corresponding to the element is positively correlated with the focus value corresponding to the element; the focus value corresponding to the element is positively correlated with the corresponding receiving times. That is to say, the more times the CRBT platform receives an element, the greater the focus value corresponding to the element, and the larger the display size of the clip control corresponding to the element, and vice versa.

The more times the CRBT platform receives an element, the higher the user's attention to the element. Therefore, the display size of the editing control corresponding to the element can be controlled to be larger, so that the user can quickly focus on the video in the video CRBT. The video stream including this element is intercepted, so as to improve the fit between the video ring tone and the user's preferences.

For the convenience of understanding, the description is as follows in conjunction with the example in Figure 6:

Assume that the current video frame includes the first element 611, the second element 612 and the third element 613 in the T elements, and the focus value corresponding to the first element 611>the focus value corresponding to the second element 61>the third element 613 The corresponding focus value. Then, as shown in FIG. 6 , the display size of the clip control 621 corresponding to the first element 611 > the display size of the clip control 622 corresponding to the second element 61 > the display size of the clip control 623 corresponding to the third element 613 .

It should be noted that this embodiment is an embodiment of the CRBT platform corresponding to the method embodiment in FIG. 2 , therefore, reference may be made to the relevant description in the method embodiment in FIG. 2 , and the same beneficial effect can be achieved. In order to avoid repeated description, details are not repeated here.

In the video CRBT sending method of this embodiment, after the CRBT platform sends the first video CRBT to the terminal, it can receive P core elements sent by the terminal, and the P core elements are based on the first video CRBT intercepted from the first video CRBT A video stream is determined, and P is a positive integer; then, based on the P core elements, a second video ring tone is sent to the terminal. It can be seen that the video CRBT played by the terminal can be updated based on the P core elements, so that the video CRBT played by the terminal is more in line with the user's preferences, thereby improving the flexibility and reliability of playing the video CRBT.

It should be noted that the various optional implementation manners introduced in the embodiments of the present application can be implemented in combination with each other without conflicting with each other, or can be implemented independently, which is not limited in the embodiments of the present application.

In the embodiment where the terminal sends P core elements and T elements to the CRBT platform, since the terminal determines the P core elements and T elements may be different; the CRBT platform obtains the P core elements and T elements , the action performed may be different. When the terminal sends P core elements and T elements, it can distinguish the P core elements from the T elements, so that the ring tone platform can distinguish the P core elements from the T elements, so that based on the T elements, it can send The terminal sends the first video CRBT including editing controls; and the second video CRBT may be sent to the terminal based on the P core elements.

In addition, before the CRBT platform receives the P core elements, it may be based on the T elements fed back by the terminal according to a preset frequency (it can be understood that the number of elements fed back for different times may be different, and the elements fed back may also be different), update the video ring back tone sent to the terminal.

In the embodiment of this application, during the playback of video ring back tones, the terminal can intercept the modules and features of the video according to user instructions, track and learn the features of the modules, delete the video ring back tones, and complete the content of other modules filling.

During the playback of the video CRBT, the user intercepts the content video of interest, and provides a method for intercepting the core elements of the video. Specifically, it may include determining the benchmark of the core elements, calculating the degree of deviation, and finally obtaining the key information intercepted by the user.

The specific process is as follows:

Step 1. The calling party dials the called phone, the calling mobile phone terminal plays a video ring back tone, and the ring back tone platform initiates user behavior monitoring. The main monitoring objects may include: user concentration, pupil radius, and user image focus. According to the above three kinds of monitoring data, it is determined what the user is interested in in the video. And upload the content that the user is interested in to the video CRBT playback platform.

For the detection of user behavior, the terminal in the hand explores the user's pupil focus image through the camera, and continuously performs focus prediction for 4 seconds. Form the focus map of the user's pupils, analyze the focus picture, and upload the content that the user is interested in to the video CRBT playback platform.

Step 2: The CRBT playback platform receives the user's focus lens transmitted by the mobile phone terminal, marks the focus lens, and extracts modules with the same or similar focus content from the entire video CRBT content.

Step 3: The CRBT playback platform locates the user's focused content, and marks the focused content with small scissors on the user's mobile phone terminal. And during the playback of the terminal video ring tone, the position of the small scissors is changed in real time according to the position of the focused content, and the user is prompted to edit the focused content for viewing.

In the process of small scissors marking, the CRBT platform sorts the video content played by the user terminal according to the focus value, and distributes small scissors of different sizes for the user to select the screen: the higher the focus value, the larger the scissors at that part, Conversely, the smaller the focus value, the smaller the scissors for that part.

When the user triggers the small scissors on the screen of the mobile terminal, the mobile terminal initiates real-time communication with the video CRBT playback platform, and notifies the CRBT platform of the trigger message.

Step 4: During the playback of the video ring back tone on the mobile phone terminal, the user edits the content he is interested in, either individually or multiple times at the same time. The specific editing block diagram is as follows:

Step 5. When the terminal detects that the starting point of the small scissors triggered by the user coincides with the position of the terminal, the user's mobile phone terminal automatically analyzes the editing window, analyzes the core content that appears in the window during the editing time period of the user, and saves the core content Mark it and send it to the video CRBT playback platform.

When the user triggers the editing function from the starting point until the user's editing is completed, the mobile terminal keeps playing the video ring back tones, and the mobile terminal records the frame drawn by the user, and analyzes the video stream passing through this frame within the user's editing time, and analyzes the video The top three elements appear in the stream, and the elements are fed back to the CRBT playback platform. The specific implementation is as follows:

A. Video stream acquisition method:

Take the frame that the user has completed to intercept, for example: it took the user 9 seconds from triggering the scissors to completing the closed frame. The mobile terminal intercepts the video that passes through the frame drawn by the user within 9 seconds.

B. The method of finding the most elements

The terminal sorts the 9-second video by frame, takes the first frame as the reference frame, analyzes the elements appearing in the first frame of the picture, divides the first frame of the picture at a coordinate interval of 1 mm, and marks the symbols: for example, in the first frame of the picture When there are three elements of banana, pineapple, and water cup, the banana is marked as J; the pineapple is marked as B; the water glass is marked as C.

Then put each picture that appears in the 9-second video into a 1mm coordinate paper for symbol marking. After the marking is completed, count the number of occurrences of various symbols and record it as M.

Construct the coordinate axis, determine the position of the elements in the reference image, mark the coordinates of the corresponding points in each element, and mark them with (X,Y). Then mark the element coordinates of each picture;

After marking the elements, determine the coordinate point where each element appears on the 9s video, and calculate the deviation probability of the coordinate reference point, which is recorded as N, and finally calculate the proportion of each reference element with M+N, and obtain the user's circle The benchmark elements in the CRBT and feed back to the CRBT playback platform.

The specific implementation is as follows:

(1) Calculate the number of squares corresponding to each element

M _i ＝f(x ₁ )+f(x ₂ )+...f(x _Q )

(2) Calculate the deviation probability of the same element

N _i =V ₁ +V ₂ +...V _Q

V _Q ＝ E(Yu) ²

(3) Calculate the ranking value of core elements

Step 6: The video CRBT playback platform receives the core focused content sent by the terminal, and starts to analyze the same or highly similar content in the video, and reassembles it into a new video CRBT after intercepting.

Step 7, the video ring back tone platform sends the new video content to the mobile terminal, and the mobile terminal screen plays the new video ring back tone (guaranteeing that the video ring back tone is played in the small frame delineated by the user), while other parts of the content are blackened (disappeared).

Step 8: In the blackened part of the screen, the shape captured by the user is used as the playback frame, and the content similar to the content focused on by the user is delivered to the user terminal screen and pushed to the user. The vertical push method is adopted to push the user's content.

Step 9. At this time, design a touch screen operation scheme for the user:

A: When the user clicks on a play box, the video playback content can be converted to full-screen playback.

B: The user can return to the multi-window preview mode after double-clicking the video that has been played in full screen.

When the user clicks on a certain video to zoom in and returns to the main screen, the terminal can automatically delete the content and notify the video CRBT playing platform, and the video CRBT playing platform sends new video content to the user terminal for the user to continue watching.

The implementation of this application can realize automatic cutting, core element selection and tracking playback in the process of playing video color ring back tones.

The embodiment of the present application also provides a video ring tone playing device capable of executing the foregoing method embodiment. Since the problem-solving principle of the video CRBT playback device is similar to the video CRBT playback method in the embodiment of the present application, the implementation of the video CRBT playback device can refer to the implementation of the method, and repeated descriptions will not be repeated.

Referring to FIG. 7, FIG. 7 is a structural diagram of a device for playing video ring back tones provided by an embodiment of the present application. As shown in Figure 7, the video ring back tone playing device 700 may include:

An acquisition module 701, configured to acquire the first video stream intercepted from the played first video ring back tone;

The first determination module 702 is configured to determine P core elements according to the first video stream, where P is a positive integer;

The first sending module 703 is configured to send the P core elements to the CRBT platform;

The first playing module 704 is configured to play the second video ring back tone sent by the ring back tone platform, and the second video ring back tone is determined based on the P core elements.

Optionally, the first determining module 702 includes:

An identifying unit, configured to identify M elements included in the first video frame of the first video stream, where M is an integer greater than or equal to P;

The first acquisition unit is configured to acquire the target eigenvalue corresponding to each element of the M elements to obtain M target eigenvalues, wherein the target eigenvalue corresponding to the element is based on the first eigenvalue corresponding to the element and the corresponding first eigenvalue of the element The second eigenvalue is determined. The first eigenvalue corresponding to the element is used to represent the total display size of the element in the first video stream, and the second eigenvalue corresponding to the element is used to represent all the displays of the element in the first video stream. The total offset value of the position relative to the display position of the element in the first video frame;

The first determining unit is configured to determine P elements corresponding to the largest P target feature values among the M target feature values as P core elements.

Optionally, the first determining module 702 also includes:

The sixth determination unit is configured to determine that the first video stream includes Q video frames of the i-th element of the M elements, i is a positive integer less than or equal to M, and Q is a positive integer;

A division unit, configured to perform grid division on the Q video frames in the same manner;

The third acquisition unit is used to acquire the number of grids occupied by the i-th element in each video frame of the Q video frames to obtain Q grid numbers;

The seventh determining unit is configured to determine the first eigenvalue corresponding to the i-th element according to the Q grid numbers.

Optionally, at least part of the video frames of the first video CRBT include at least one clipping control, and the at least one clipping control is used to intercept a video stream;

The obtaining module 701 includes:

A receiving unit, configured to receive a first input to the first clipping control included in the second video frame of the first video CRBT, and the first input is used to draw a first closed frame;

The second determining unit is configured to, in response to the first input, determine the video stream played in the first display area corresponding to the first closed frame in the first time period as the first video stream intercepted from the played first video CRBT a video stream;

Wherein, the start time of the first time period is the start time of the first input, and the end time of the first time period is the end time of the first input.

Optionally, the video ring tone playback device also includes:

The second playing module is used to play the third video ring tone sent by the ring tone platform;

The second determining module is configured to determine T elements that the user is interested in in the third video color ring back, where T is a positive integer;

A second sending module, configured to send the T elements to the CRBT platform;

The first receiving module is configured to receive the first video CRBT sent by the CRBT platform, and the display position of the at least one editing control in the first video CRBT is determined based on the T elements.

Optionally, the second determination module includes:

A third determining unit, configured to determine an area of interest of the user to the third video ring back tone;

The fourth determining unit is configured to determine T elements that the user is interested in in the third video CRBT according to the second video stream played in the second time period in the third display area corresponding to the interest area.

Optionally, the first playing module 704 includes:

a playing unit, configured to play the second video CRBT sent by the CRBT platform in the first display area;

An executing unit, configured to execute a first operation on the second display area, where the first operation is any of the following:

controlling the second display area to be in a screen-off state;

Playing a fourth video CRBT sent by the CRBT platform in the second display area, the fourth video CRBT is determined based on the P core elements;

Wherein, the second display area is a display area other than the first display area.

The video CRBT playing device 700 provided in the embodiment of the present application can execute the above method embodiment in FIG. 2 , and its implementation principle and technical effect are similar, and details will not be repeated here in this embodiment.

Referring to FIG. 8, FIG. 8 is a structural diagram of an apparatus for sending a video color ring back tone provided by an embodiment of the present application. As shown in Figure 8, the apparatus 800 for sending a video ring back tone may include:

The second sending module 801 is configured to send the first video ring tone to the terminal;

The second receiving module 802 is configured to receive P core elements sent by the terminal, the P core elements are determined based on the first video stream intercepted from the first video CRBT, and P is a positive integer;

The third sending module 803 is configured to send a second video CRBT to the terminal, where the second video CRBT is determined based on the P core elements.

Optionally, the device 800 for sending video ring back tones also includes:

Extraction module, for extracting R video frames from at least one video ring back tone;

A first generating module, configured to generate a second video ring back, where the second video ring includes the R video frames;

Wherein, in the case that the P core elements are P elements that the user is interested in, each video frame of the R video frames includes at least one element in the P core elements, or, the R Each of the video frames includes elements whose matching degree with the P core elements is greater than a preset value;

In the case that the P core elements are P elements that are not of interest to the user, the R video frames do not include the P core elements.

Optionally, at least part of the video frames of the first video CRBT include at least one clipping control, and the at least one clipping control is used to intercept a video stream.

Optionally, the device 800 for sending video ring back tones also includes:

A fourth sending module, configured to send a third video ring back tone to the terminal;

A third receiving module, configured to receive T elements sent by the terminal that the user is interested in the third video CRBT;

Wherein, the first video CRBT is determined based on the T elements, and the at least one editing control is determined based on the T elements.

Optionally, the device 800 for sending video ring back tones also includes:

The second generation module is used to generate the first video ring tone according to the T elements;

An adding module, configured to add a second editing control corresponding to the target element at the target position of the video frame including the target element in the first video CRBT;

Wherein, the target element belongs to the T elements, and the distance between the target position and the display position of the target element is smaller than a preset threshold.

Optionally, the added modules include:

The second acquiring unit is configured to acquire a focus value corresponding to the target element, where the focus value corresponding to the target element is determined based on the number of times the CRBT platform receives the target element;

A fifth determining unit, configured to determine the target display size of the second clip control corresponding to the target element according to the focus value corresponding to the target element;

An adding unit, configured to add the second clipping control of the target display size at a target position of a video frame including a target element in the first video color ring tone.

The apparatus 800 for sending a video CRBT provided in the embodiment of the present application can execute the above-mentioned method embodiment in FIG. 5 , and its implementation principle and technical effect are similar, and details will not be repeated here in this embodiment.

Referring to FIG. 9, FIG. 9 is a schematic structural diagram of a communication device provided by an embodiment of the present application. As shown in FIG. 9 , the communication device may include: a processor 901 , a memory 902 and a transceiver 903 .

In the case where the communication device is a terminal, the processor 901 is used to read the program in the memory 902, and execute each process in the method embodiment in FIG. 2 , the implementation principle and technical effect of which are similar, and will not be repeated here in this embodiment. .

In the case that the communication device is a CRBT platform, the processor 901 is used to read the program in the memory 902, and execute each process in the method embodiment in FIG. repeat.

Transceiver 903 for receiving and sending data under the control of process 901.

Wherein, in FIG. 9 , the bus architecture may include any number of interconnected buses and bridges, specifically one or more processors represented by the processor 901 and various circuits of the memory represented by the memory 902 are linked together. The bus architecture can also link together various other circuits such as peripherals, voltage regulators, and power management circuits, etc., which are well known in the art and therefore will not be further described herein. The bus interface provides the interface. Transceiver 903 may be a plurality of elements, including a transmitter and a transceiver, providing means for communicating with various other devices over a transmission medium. The processor 901 is responsible for managing the bus architecture and general processing, and the memory 902 can store data used by the processor 901 when performing operations.

The processor 901 is responsible for managing the bus architecture and general processing, and the memory 902 can store data used by the processor 901 when performing operations.

In addition, the readable storage medium in the embodiment of the present application is used to store a program or an instruction, and the program or instruction can be executed by the processor in the steps in the method embodiment in FIG. 2 or FIG. 5 .

In the several embodiments provided in this application, it should be understood that the disclosed methods and devices may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may be physically included separately, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware, or in the form of hardware plus software functional units.

The above-mentioned integrated units implemented in the form of software functional units may be stored in a computer-readable storage medium. The above-mentioned software functional units are stored in a storage medium, and include several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) to execute some steps of the method for playing video ring back tones in various embodiments of the present application. The aforementioned storage medium includes: various media that can store program codes such as U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk.

The above description is the preferred implementation mode of the present application. It should be pointed out that for those of ordinary skill in the art, some improvements and modifications can also be made without departing from the principles described in the application. These improvements and modifications are also It should be regarded as the protection scope of this application.

Claims (12)

1. A method for playing video color ring tones, performed by a terminal, is characterized in that, comprising: Obtain the first video stream intercepted from the played first video CRBT; According to the first video stream, determine P core elements, P is a positive integer, and the P core elements are P elements that the user is interested in; Send the P core elements to the CRBT platform; Play the second video CRBT sent by the CRBT platform, and the second video CRBT is determined based on the P core elements; wherein, when the P core elements are P elements that the user is interested in, the The second video CRBT includes some or all of the P core elements; in the case that the P core elements are P elements that the user is not interested in, the second video CRBT does not include the P core elements element; The determining P core elements according to the first video stream includes: Identify M elements included in the first video frame of the first video stream, where M is an integer greater than or equal to P; Obtain the target eigenvalue corresponding to each element of the M elements to obtain M target eigenvalues, wherein the target eigenvalue corresponding to the element is determined based on the first eigenvalue corresponding to the element and the second eigenvalue corresponding to the element, and the element The corresponding target eigenvalue is the sum of the first eigenvalue and the second eigenvalue, the first eigenvalue corresponding to the element is used to represent the total display size of the element in the first video stream, and the second eigenvalue corresponding to the element The characteristic value is used to characterize the total offset value of all display positions of the element in the first video stream relative to the display position of the element in the first video frame; Determining P elements corresponding to the largest P target eigenvalues among the M target eigenvalues as P core elements. 2. The method according to claim 1, characterized in that, after identifying the M elements included in the first video frame of the first video stream, the acquisition of each element corresponding to the M elements Before the target feature value, the method also includes: Determine that the first video stream includes Q video frames of the i-th element of the M elements, i is a positive integer less than or equal to M, and Q is a positive integer; Perform grid division on the Q video frames in the same manner; Obtain the number of grids occupied by the i-th element in each video frame of the Q video frames to obtain Q grid numbers; Determine the first eigenvalue corresponding to the i-th element according to the Q grid numbers. 3. The method according to claim 1, wherein at least part of the video frames of the first video CRBT include at least one clipping control, and the at least one clipping control is used to intercept the video stream; The acquisition of the first video stream intercepted from the played first video CRBT includes: receiving a first input to a first clipping control included in a second video frame of the first video CRBT, where the first input is used to draw a first closed frame; In response to the first input, determine the video stream played in the first display area corresponding to the first closed frame in the first time period as the first video stream intercepted from the played first video CRBT; Wherein, the start time of the first time period is the start time of the first input, and the end time of the first time period is the end time of the first input. 4. The method according to claim 3, characterized in that, before receiving the first input of the first clip control included in the second video frame of the first video CRBT, the method further comprises: Play the third video CRBT sent by the CRBT platform; Determining T elements that the user is interested in in the third video CRBT, where T is a positive integer; sending the T elements to the CRBT platform; receiving the first video CRBT sent by the CRBT platform, and determining a display position of the at least one editing control in the first video CRBT based on the T elements. 5. The method according to claim 4, wherein the playing the second video CRBT sent by the CRBT platform comprises: Playing the second video CRBT sent by the CRBT platform in the first display area; Execute a first operation on the second display area, where the first operation is any of the following: controlling the second display area to be in a screen-off state; Playing a fourth video CRBT sent by the CRBT platform in the second display area, the fourth video CRBT is determined based on the P core elements; Wherein, the second display area is a display area other than the first display area. 6. A method for sending video ring back tones, performed by a ring tones platform, characterized in that it comprises: Send the first video ring back tone to the terminal; Receiving P core elements sent by the terminal, the P core elements are determined based on the first video stream intercepted from the first video color ring back tone, P is a positive integer, and the P core elements are the P core elements that the user is interested in elements; Sending a second video ring back to the terminal, where the second video ring back is determined based on the P core elements; wherein, when the P core elements are P elements that the user is interested in, the second The video CRBT includes some or all of the P core elements; when the P core elements are P elements that are not of interest to the user, the second video CRBT does not include the P core elements; Wherein, the P core elements are determined based on the first video stream intercepted from the first video CRBT: including: Identifying the M elements included in the first video frame of the first video stream, where M is an integer greater than or equal to P; obtaining the target feature value corresponding to each element of the M elements to obtain M target feature values, Wherein, the target eigenvalue corresponding to the element is determined based on the first eigenvalue corresponding to the element and the second eigenvalue corresponding to the element, the target eigenvalue corresponding to the element is the sum of the first eigenvalue and the second eigenvalue, and the element The corresponding first eigenvalue is used to represent the total display size of the element in the first video stream, and the second eigenvalue corresponding to the element is used to represent the relative size of the element in all display positions of the first video stream relative to the element in the first video stream. A total offset value of the display position of a video frame; determining P elements corresponding to the largest P target feature values among the M target feature values as P core elements. 7. The method according to claim 6, wherein after receiving the P core elements sent by the terminal and before sending the second video ring back to the terminal, the method further comprises: Extracting R video frames from at least one video ring back tone; Generate a second video ring back, the second video ring includes the R video frames; Wherein, in the case that the P core elements are P elements that the user is interested in, each video frame of the R video frames includes at least one element in the P core elements, or, the R The matching degree of elements included in each of the video frames and the P core elements is greater than a preset value; In the case that the P core elements are P elements that are not of interest to the user, the R video frames do not include the P core elements. 8. The method according to claim 6, characterized in that at least part of the video frames of the first video CRBT include at least one clipping control, and the at least one clipping control is used to intercept the video stream; Before sending the first video ring back to the terminal, the method also includes: sending a third video ring back tone to the terminal; receiving T elements sent by the terminal that the user is interested in the third video CRBT; Wherein, the first video CRBT is determined based on the T elements, and the at least one editing control is determined based on the T elements. 9. The method according to claim 8, characterized in that, after receiving T elements sent by the terminal that the user is interested in the third video CRBT, sending the first video CRBT to the terminal Previously, the method further included: Generate a first video ring tone according to the T elements; Adding a second editing control corresponding to the target element at the target position of the video frame of the target element included in the first video ring tone; Wherein, the target element belongs to the T elements, and the distance between the target position and the display position of the target element is smaller than a preset threshold. 10. The method according to claim 9, wherein the adding a second editing control corresponding to the target element at the target position of the video frame of the target element in the first video color ring tone includes: Acquiring a focus value corresponding to the target element, where the focus value corresponding to the target element is determined based on the number of times the CRBT platform receives the target element; determining the target display size of the second clip control corresponding to the target element according to the focus value corresponding to the target element; Adding the second clipping control of the target display size at the target position of the video frame including the target element in the first video CRBT. 11. A communication device, comprising a transceiver, a memory, a processor, and programs or instructions stored on the memory and operable on the processor; it is characterized in that the processor is used to read the memory The programs or instructions in the method realize the steps in the method according to any one of claims 1 to 5, or realize the steps in the method according to any one of claims 6 to 10. 12. A readable storage medium for storing programs or instructions, characterized in that, when the programs or instructions are executed by a processor, the steps in the method according to any one of claims 1 to 5 are implemented, or , realizing the steps in the method as described in any one of claims 6 to 10.

Images