CN109120979B - Video enhancement control method and device and electronic equipment - Google Patents

Abstract

The embodiments of the present application disclose a video enhancement control method, device, and electronic device. The method includes: detecting whether the electronic device is in a video playback state; if the electronic device is detected to be in the video playback state, detecting the state of a control control, the control control is used to control turning on or off visual enhancement; if the state of the control control is detected to indicate turning on video enhancement, visual enhancement is performed on the played video. This method allows the user to turn on or off the visual enhancement of the played video by touching the control control during video playback, thereby providing convenience for the user to control whether to perform visual enhancement, thereby improving the user experience.

Description

Video enhancement control method, device and electronic device

technical field

The present application relates to the technical field of image processing, and more particularly, to a video enhancement control method, apparatus, and electronic device.

Background technique

With the development of society, the application of electronic equipment with a screen has been continuously expanded. For example, it is beneficial to display images such as pictures and videos on the screen. However, the display quality of most electronic devices will be seriously affected by changes in the surrounding light source or the quality of the video source displayed.

SUMMARY OF THE INVENTION

In view of the above problems, the present application proposes a video enhancement control method, apparatus, and electronic device to improve the above problems.

In a first aspect, the present application provides a video enhancement control method, which is applied to an electronic device. The method includes: detecting whether the electronic device is in a video playing state; if it is detected that the electronic device is in the video playing state, detecting and controlling The state of the control, which is used to control turning on or off the visual enhancement; if it is detected that the state of the control indicates that the video enhancement is turned on, the played video is visually enhanced.

In a second aspect, the present application provides a video enhancement control device, which is applied to an electronic device. The device includes: a playback state detection unit for detecting whether the electronic device is in a video playback state; a control state detection unit for detecting if the electronic device is in a video playback state When the electronic device is in the video playback state, the state of the control control is detected, and the control control is used to control to turn on or turn off the visual enhancement; the video enhancement unit is used for turning on the video enhancement if the state of the control control is detected. , which visually enhances the video being played.

In a third aspect, the present application provides an electronic device comprising one or more processors and a memory; one or more programs, wherein the one or more programs are stored in the memory and configured to be The one or more processors are executed, and the one or more programs are configured to perform the above-described method.

In a fourth aspect, the present application provides a computer-readable storage medium, where a program code is stored in the computer-readable storage medium, wherein the above method is executed when the program code is executed.

The present application provides a video enhancement control method, device and electronic device, by detecting whether the electronic device is in the video playback state, if it is detected that the electronic device is in the video playback state, the state of the control control is detected, and the control control It is used to control the visual enhancement to be turned on or off in response to the touch operation. If it is detected that the state of the control control indicates that the video enhancement is turned on, the video enhancement is performed on the played video. Therefore, during the video playback process, the user can turn on or off the visual enhancement of the played video by performing a touch operation on the control controls, thereby providing convenience for the user to control whether to perform the visual enhancement and improving the user experience.

These and other aspects of the present application will be more clearly understood in the description of the following embodiments.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained from these drawings without creative effort.

1 shows a flowchart of another video decoding proposed by the present application;

2 shows a flowchart of a video enhancement control method proposed by the present application;

3 shows a schematic interface diagram in a video enhancement control method proposed by the present application;

4 shows a schematic diagram of a playback interface in a video enhancement control method proposed by the present application;

FIG. 5 shows a flowchart of another video enhancement control method proposed by the present application;

6 shows a schematic diagram of the control controls in another video enhancement control method proposed by the present application;

Fig. 7 shows the schematic diagram that the control controls are hidden in another video enhancement control method proposed by the present application;

FIG. 8 shows a schematic diagram of another control control being hidden in another video enhancement control method proposed by the present application;

9 shows a schematic diagram of a sharpness switching control in another video enhancement control method proposed by the present application;

FIG. 10 shows a schematic diagram of a clarity alternative control in another video enhancement control method proposed by the present application;

FIG. 11 shows a flowchart of yet another video enhancement control method proposed by the present application;

12 shows a structural block diagram of a video enhancement control device proposed by the present application;

FIG. 13 shows a structural block diagram of another video enhancement control device proposed by the present application;

FIG. 14 shows a structural block diagram of still another video enhancement control device proposed by the present application;

FIG. 15 shows a structural block diagram of the electronic device of the present application for executing the video enhancement control method according to the embodiment of the present application.

FIG. 16 is a storage unit for storing or carrying a program code for implementing the image processing method according to the embodiment of the present application according to the embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

With the improvement of the hardware performance of electronic devices, more electronic devices can support video playback. For example, the electronic device may run a video playback client, and then use the video playback client to play the video requested from the network, or may run a web browser, and then play the video in the web browser, or the electronic device The device can play the locally stored video files through the video playing software.

Regardless of whether the video is transmitted and played on the network or the video stored locally, when the video is generated, in order to reduce the occupation of storage space and facilitate transmission on the network, the generated video will be compressed. Correspondingly, when the electronic device obtains the video, the first obtained video will also be the video after compression encoding, then in this case, the electronic device will first perform video decoding on the video that has been compressed and encoded.

Generally, as shown in FIG. 1 , an electronic device can perform video decoding in two ways: hard decoding and soft decoding. Among them, hard decoding refers to using non-CPU for decoding, such as GPU (Graphics Processing Unit), dedicated DSP, FPGA, ASIC chip, and so on. And soft decoding refers to using the CPU to decode.

Specifically, as shown in FIG. 1 , MediaFramework acquires the video file to be played through an API interface with a client or a web browser, and submits it to Video Decode, where Media Framework is a multimedia framework in an operating system. The Video Decode is a video decoder for decoding video data.

Whether it is hard decoding or soft decoding, after decoding the video data, the decoded video data will be sent to SurfaceFlinger, and SurfaceFlinger will render and synthesize the decoded video data and display it on the screen. Among them, SurfaceFlinger is an independent Service, which receives all Surfaces as input, calculates the position of each Surface in the final composite image according to ZOrder, transparency, size, position and other parameters, and then passes it to HWComposer or OpenGL to generate the final Display the Buffer, and then display it on a specific display device.

The inventor found that a visual enhancement process can be added in either the hard decoding or the soft decoding process, so that the subsequently played video has a higher visual effect. For example, based on the HQV (hollywood quality video) technology, the video can be de-dried, the exposure can be adjusted, or the definition can be improved. In addition, the visual experience of the video being played can also be improved in other ways, for example, enhancing the vividness of the colors and the like.

However, the inventor further found that the control method for whether to perform visual enhancement on the played video still needs to be improved. Therefore, the application provides a video enhancement control method, device and electronic device that can improve control convenience and intelligence.

The content of the present application will be introduced below with reference to specific embodiments.

Referring to FIG. 2, a video enhancement control method provided by the present application is applied to an electronic device, and the method includes:

Step S110: Detect whether the electronic device is in a video playing state.

In this application, the electronic device can identify whether it is currently in a video playback state through various methods.

As one way, the step of detecting whether the electronic device is in a video playing state includes: detecting whether a set video playing application is running in the electronic device; if it is detected that a set video playing application is running , and determine that the electronic device is in the video playing state. Wherein, the electronic device may establish a list of video playing applications in advance, so as to record the video playing applications in the list. The list may be freely configured by the user of the electronic device, or may be determined according to the usage of a certain video playback application.

For example, as shown in FIG. 3 , the interface shown in FIG. 3 displays a plurality of application programs and the corresponding state of each application program. It can be understood that if the state corresponding to the application is "off" as shown in the figure, it means that the application is removed or not added to the above list, and if the state corresponding to the application is "on" as shown in the figure, it means that the application is removed or not added to the above list. This application is added to the above list. For example, for an application named "TX Video", its corresponding state is "On", which means that the application "TX Video" will exist in the aforementioned list. For an application named "AQY Video", its corresponding state is "Off", which means that the application "AQY Video" will not exist in the aforementioned list.

Furthermore, the electronic device can detect the frequency of use of each video playback application, and if it is detected that the frequency of use of a certain video playback application exceeds the set frequency, the video playback application can be added to the aforementioned list, and the corresponding video playback application can be added to the list. The state corresponding to the name of the video playback application in Figure 3 is configured as "on".

In this case, the electronic device can first detect which application is currently running in the foreground, and then further detect whether the application currently running in the foreground is in the list. . As a method, if the electronic device is an Android operating system, the name of the application currently running in the foreground can be obtained by executing the getRunningTasks method of the ActivityManager. In addition, the electronic device may also obtain a list of programs used by the user through the UsageStatsManager, and identify the most recently used application recorded in the list as the current foreground application. Furthermore, you can also monitor the change of the window focus through the built-in accessibility function of Android, and get the package name corresponding to the focus window as the current application running in the foreground.

As another way, the electronic device can also determine whether there is a video playing in combination with detecting the return value of the AudioManager class. In this case, the electronic device can first detect the return value of the AudioManager class to determine whether there is audio output. If audio output is detected, the electronic device can further determine whether there is a video playback application running according to the aforementioned detection. Whether the device is in video playback state.

Furthermore, as a further way, the electronic device can also detect whether it is in the video playing state by detecting the touch state of the video playing button. For example, as shown in FIG. 4 , a play button 98 is displayed in the video playing interface 99 shown in FIG. 4 , and the interface shown in FIG. 4 is in a state in which the video playing is paused. Then, in this case, when it is detected that the play button 98 is touched, it can be determined that the electronic device is currently in a video playing state. Correspondingly, if it is detected that the play button 98 is touched again after the electronic device is in the video playback state, it can be determined that the electronic device is in the video pause state, thereby canceling the visual enhancement. In this way, during the process of visual enhancement, only the video being played can be visually enhanced, and it is not necessary to visually enhance the picture displayed when the playback is paused, so as to improve the enhancement efficiency.

It should be noted that, as a method, the video enhancement control method provided by the present application may be executed by the aforementioned video playback application, or may be executed by a program in the electronic device independent of the video playback application. Wherein, if the provided video enhancement control method can be executed by the aforementioned video playback application, then the execution of the video enhancement control method can be performed by a subprocess included in the corresponding main process during the operation of the video playback application, so as to The process of executing the video enhancement method avoids affecting other functions of the video playback application. However, if the video enhancement control method is executed by a program in the electronic device that is independent of the video playback application, it can be executed by another application independent of the video playback application.

Step S120: If it is detected that the electronic device is in the video playing state, the state of the control control is detected, and the control control is used to control the visual enhancement to be turned on or off.

Among them, it can be understood that the electronic device may establish a variable, and then use the variable value to identify the state of the control control. For example, if the value of the variable is 0, it means that the control is in a state indicating that the visual enhancement is turned off, and if the value of the variable is 1, it means that the control is in a state indicating that the visual enhancement is turned on. Then in this case, after the electronic device detects that it is in the video playing state, it can detect the value of the variable to determine the state of the control control.

Optionally, the variable value can be stored in a pre-built data table. In this case, after detecting that the electronic device is in the video playing state, it can obtain the aforementioned variable values by looking up a table, and then judge the state of the control controls.

In addition, when an application is installed on the electronic device, the storage location of the corresponding configuration file is relatively fixed. As another way, the variable value can also be stored in the configuration file of the corresponding video playback application. middle. In this case, after the electronic device detects that a video playback application is installed, and detects that the installed video playback application is set as the set video playback application, the electronic device can configure the video playback application in the configuration of the video playback application. Find any file in txt format in the folder, and then add a variable to the found file in txt format, and then use the value of the variable as the aforementioned variable value. In this way, the state detection of the control controls can be realized by using the configuration file of the video playback application without adding a new file, and because it is the configuration file of the video playback application used, then It is very good to distinguish the state of the control controls corresponding to a certain video playback application.

In this case, in order to avoid affecting the original function of the configuration file, as a way, you can add variables to the configuration file in the form of comments. For example, for a file in txt format, the characters beginning with "//" or "/*" are used to annotate the content. Then, in this case, when the variable configured by the electronic device is hqv, the content inserted into the txt file may be "//hqv=1", which means that visual enhancement is turned on.

It should be noted that after some applications are updated or reinstalled, their corresponding configuration files will be modified or replaced by other files. Then in this case, if it is detected that the set video playback application is updated or reinstalled, you can first detect whether the previously selected txt format file still exists, and if it is stored, further detect the updated or reinstalled Whether the previously-inserted variable can still be read from the previously selected txt corresponding to the subsequent video playback application, and if the reading fails, the variable will be re-inserted in the aforementioned manner. If it is detected that the previously selected txt file does not exist, select the txt file again.

The above content will be described below through specific application programs.

If the electronic device detects that a video playback application named TX Video is installed, it will further detect whether TX Video is configured as the set video playback application. If detected TX video is configured as the set video playback application. Then the electronic device will further search for files in txt format in the folder where the configuration files of the TX video are stored. After any search for a name named tx.txt, a piece of data will be inserted into the tx.txt, the content of the data is "//hqv=1", to indicate that the control control corresponding to the TX video is in the state of enabling visual enhancement, Then correspondingly, if it is detected that the control control corresponding to the TX video is touched, the electronic device will correspondingly modify the original inserted content to "//hqv=0" to indicate that the control control corresponding to the TX video is in the closed visual enhancement mode. status. Then, after the electronic device detects that the TX video has been updated or reinstalled, it will detect whether the tx.txt file still exists in the configuration file corresponding to the TX video. The content of "//hqv=1" or "//hqv=1", if possible, indicates that the previous configuration is still valid, if it cannot be read out, insert "//hqv=1" into tx.txt by default . If the electronic device finds that the tx.txt file cannot be found, it can re-select a txt file.

It should be noted that the selected storage variable file corresponding to each video playing application can be stored in the electronic device in the form of a data table, so that the electronic device can search.

It should be noted that the aforementioned files in txt format and variable values are exemplary, and are not specifically limited in this application. The electronic device can be specifically set according to the format file that can be found. For example, you can also use an xml-formatted file to store variable values.

In one approach, the control controls operate independently of the video playback application. Then, step S120 may include detecting the state of the control controls independent of the preset video playback application.

Step S130: If it is detected that the state of the control control indicates that video enhancement is enabled, perform visual enhancement on the played video.

In the present application, the electronic device can visually enhance the played video in various ways. For example, the electronic device may perform visual enhancements based on the properties of the video being played. The attributes include sharpness and color information.

As a way, the electronic device can extract a frame of target image from the played video as a basis for attribute judgment. It is understandable that if an image is already blurred, then if it is blurred again, the high frequency components in the image will not change too much. But if the sharpness of the image itself is high and it is blurred once, the change of high frequency components will be very large. Then, as a way, the electronic device can obtain a degraded image of the image by performing a blurring process (for example, Gaussian blurring) on the target image, and then compare the adjacent pixels of the image before the blurring process and the image after the blurring process. The change of the value determines the level of the sharpness value according to the size of the change. Then in this case, the larger the change, the higher the clarity of the target image.

In addition, in addition to determining the sharpness of the target image by blurring the target image as described above, other methods may also be used to calculate the sharpness. Optionally, it can be calculated by the following formula

D(f)=∑ _y ∑ _x |f(x+2, y)-f(x, y)| ²

to determine clarity. Among them, f(x, y) represents the gray value of the pixel (x, y) corresponding to the image f, and D(f) is the image definition calculation result. Optionally, in this application, f(x, y) can select the high-frequency component area in the real-time preview image.

Then, in this case, if it is detected that the definition of the target image is lower than the set value, then the played video can be visually enhanced in terms of definition.

Furthermore, the color information can be defined by the degree of color shift in this application. As a way, the electronic device can determine the current color shift degree through the chromaticity subdivision and the chromatic average value of the target image. As a method, when the electronic device detects that the chromaticity distribution of the target image is basically a single peak, or the distribution is relatively concentrated, and the average chromaticity is greater than the set value, it is determined that the target image has a color shift. And the value of the obtained color shift can be determined as the color information according to the pre-established corresponding relationship between the chromaticity average value and the color shift.

In addition, the electronic device can also determine which aspects of visual enhancement to perform according to the environment in which the electronic device is located, for example, whether to perform visual enhancement in terms of brightness of the video being played can indeed be performed according to the intensity of the ambient light in which the electronic device is located. .

It should be noted that, if there are two application programs in the foreground of the electronic device for video playback at the same time, the electronic device can select one of them for visual enhancement, or simultaneously play the video of the two application programs displayed on the split screen. Videos are all visually strong. Among them, as a way, if the electronic device is provided with a camera on the same side of the screen, the camera can capture the area of the user's current eyeball attention, so that when the electronic device splits the screen to display the interfaces of the two applications, Visual enhancements can be made to the video displayed by the interface of the application that is closer to the area of interest.

In a video enhancement control method provided by the present application, by detecting whether an electronic device is in a video playing state, if it is detected that the electronic device is in the video playing state, the state of a control control is detected, and the control control is used to respond to a touch The control operation controls the visual enhancement to be turned on or off, and if the state of the control control is detected to indicate that the video enhancement is turned on, the played video is visually enhanced. Therefore, during the video playback process, the user can turn on or off the visual enhancement of the played video by performing a touch operation on the control controls, thereby providing convenience for the user to control whether to perform the visual enhancement and improving the user experience.

Please refer to FIG. 5, a video enhancement control method provided by the present application is applied to an electronic device, and the method includes:

Step S210: Detect whether the electronic device is in a video playing state.

Step S220: If it is detected that the electronic device is in the video playback state, display the control controls in a layered manner on the video playback interface of the electronic device, where the control controls are used to control the visual enhancement to be turned on or off.

As shown in FIG. 6 , if the electronic device detects that the electronic device is in the video playing state, a control control 97 is displayed suspended on the video playing interface 99 shown in the figure. Wherein, by touching the control control 97, the user can make the control control 97 switch before representing the two states of on or off visual enhancement. As an example, after the electronic device displays the control controls 97 , the user can slide the control controls to move the control controls out of the video playback interface 99 . For example, as shown in FIG. 7 , if the control control shown in FIG. 6 is slid upward in FIG. 6 , the control control 97 will slide upward, and will be converted to the logo 96 shown in FIG. 7 after the sliding ends. In this case, if the user slides the marker 96 downward as shown in FIG. 7 , the control control 97 can be triggered to be displayed in the style shown in FIG. 6 again.

In addition, in addition to sliding the control control 97 toward the top shown in FIG. 6 , the control control 97 may also be slid toward other directions. For example, as shown in FIG. 8 , if the control control 97 is slid toward the left side as shown in FIG. 6 , the converted logo 96 will correspondingly appear on the left side of the video playback interface.

There may be various manners for displaying the control controls in layers on the video playback interface of the electronic device at what timing.

As a way, when the user uses the electronic device, the user can log in through the user account so that the electronic device can distinguish different users. Then in this case, the electronic device can determine whether to display the control controls according to the level of the logged-in user account. For example, user account levels from low to high can be pre-divided into first-level, second-level, and third-level, and visual enhancement can be performed only by setting user accounts above level two. Then, after the electronic device detects that it is in the video playback state, it can further detect the level of the currently logged-in user account. The control controls are displayed in layers on the video playback interface. However, if the electronic device detects that the level of the currently logged-in user account is lower than the second level, the electronic device may display prompt information, so as to prompt the user to perform visual enhancement after upgrading the account.

It should be noted that the aforementioned account may be an account for logging in to the operating system of the electronic device, or may be an account for a video playback application that specifically performs video playback.

In one way, the electronic device detects the change frequency of the continuous multiple frames of images included in the video played on the video playback interface; if the change frequency is greater than the set frequency, the video playback interface of the electronic device displays the Control controls.

Wherein, it can be understood that the played video includes images of multiple frames. The content of the video being played is different, and the frequency of change of the corresponding content will be different. For example, if the video being played is a video of a TV series or a movie, because the frequency of changes of pictures in a video of a TV series or a movie is relatively high, in this case, the user expects a better visual experience. For other video scenarios, for example, knowledge explanation or certain course videos, because the picture will remain in the same state for a long time, but only the corresponding audio data will have different changes. For example, in some course video scenes, the picture will be frozen on a PPT page for a long time, and the corresponding audio that explains the content of the PPT page will change continuously. Then in this case, the user pays more attention to the content explained, and the requirements for the visual experience are not too high.

Then, based on the above situation, as a method, obtain the continuous multi-frame images included in the played video, obtain the respective content features of the continuous multi-frame images, and based on the content features, obtain the video represented by the played video. How often the screen content changes.

As one way, the content characteristics of the image can be determined by taking the average value of grayscale. In this manner, the electronic device may acquire the respective grayscale average values of the consecutive multi-frame images, and acquire respective content features of the consecutive multi-frame images based on the grayscale average values.

The above-mentioned acquisition of the respective content features of the consecutive multi-frame images based on the grayscale average value will be described below.

You can start by reducing the image to 8x8 size, for a total of 64 pixels. The function of this step is to remove the differences in various image sizes and image ratios, and only retain basic information such as structure, light and shade. Then convert the reduced image to a 64-level grayscale image. Calculates the grayscale average of all pixels in the picture. The gray level of each pixel is compared with the average value, and if it is greater than or equal to the average value, it is recorded as 1, and if it is less than the average value, it is recorded as 0. Combining the comparison results in the previous step together forms a 64-bit binary integer, which is the fingerprint of this image. After getting the fingerprints of the images, you can compare the fingerprints of different images and calculate how many bits in the 64 bits are different. If the number of different data bits does not exceed 5, it means that the two images are very similar. If it is greater than 10 , indicating that they are two different images. Then, if after continuous detection and collection of n images, after it is detected that the two adjacent images are not similar, the dissimilarity is increased by 1, then the dissimilarity obtained after the comparison of the n images is divided by the aforementioned n, so The resulting value is the frequency of change.

Then in this case, in order to be more flexible to meet the actual needs of the current user, if the detected frequency of change is greater than the set frequency, it means that the currently playing video is a TV series or movie video, which can be displayed in all The control controls are displayed in layers on the video playback interface of the electronic device, so as to remind the user that the electronic device can further perform visual enhancement, thereby improving the visual experience of playing the video.

In addition, as another way, the electronic device can detect the resolution of the video played on the video playing interface; if the resolution of the video played on the video playing interface is the set resolution, the video playing on the electronic device The control controls are displayed in layers on the interface.

It is understandable that when the electronic device plays videos of different resolutions, the resolution presented will be different, and as the resolution increases, the video played by the electronic device will be clearer. Then, in one case, the set resolution is the highest resolution supported by the video played by the video playback interface.

It should be noted that, when an electronic device plays a video, the resolution of the played video will be affected by the resolution supported by the played video itself and the resolution supported by the electronic device itself. For example, if the resolution of the video itself is from low to high, it can be SD, HD, and UHD, and the resolutions supported by electronic devices are also SD, HD, and UHD from low to high. If it is detected that the highest resolution supported by the electronic device is HD, then even if the resolution of the played video supports ultra-high-definition resolution, the highest resolution supported by the played video is still high-definition.

Furthermore, if the highest resolution supported by the video being played is lower than the resolution supported by the electronic device, then in this case, even if the user uses the electronic device to play the video, the highest resolution of the video being played is still the same as the video being played. The highest resolution supported by the video. Then, in order to remind the user that the visual experience of the played video can be further improved, when it is detected that the highest resolution supported by the played video is lower than the highest resolution supported by the electronic device, the The control controls are stacked and displayed on the video playback interface, so that it is convenient for the user to trigger the electronic device to perform visual enhancement through the control, so that the played video can show a better playback effect than the playback effect corresponding to the highest resolution that it can support. Effect.

For example, as shown in FIG. 9 , in the diagram shown in FIG. 9 , a sharpness switching control 95 is shown. When the user clicks the sharpness switching control 95 , as shown in FIG. 10 , the sharpness alternative control can be displayed 94, the definition that can be selected is displayed in the definition alternative control 94, for example, as shown in FIG. 10, the highest resolution supported by the played video is ultra-clear, then in this case , if the highest resolution supported by the electronic device is Ultra HD or even a 4K model with a higher resolution than Ultra HD, control controls 97 may be displayed on the interface. In this way, when the video being played has been played at the highest resolution that it can support, after the control controls are displayed, the user can trigger the control controls to be in a state where visual enhancement is turned on, so that the electronic device can The video is visually enhanced, so that the played video can show a better playback effect than the corresponding playback effect of the highest resolution that it can support.

It can be understood that, when the video playing application can play the video online, the data of the played video is obtained from the network in real time during the online video playing. The size of the storage space occupied by the videos of different resolutions will be different. For example, for the same video content, the video content in SD mode may occupy 200MB of storage space, and the video content in HD mode may occupy 700MB of storage space. The same is true in the transmission process. For video content with a higher resolution, the network bandwidth occupied by the transmission is larger.

In this case, optionally, the electronic device may detect that the resolution of the video played on the video playback interface is the set resolution, and the network quality of the network to which the electronic device is connected is lower than the set resolution. After the conditions are met, the resolution of the played video is reduced; the control controls are displayed in layers on the video playback interface of the electronic device.

Among them, the electronic device can detect the current network quality in various ways. For example, the electronic device can evaluate the quality of the network by the retransmission rate of the network.

It should be noted that if the electronic device is connected to the network based on the TCP protocol, the electronic device uses a sliding window to manage the basic data sending and receiving process, and at the same time ensures the effective and reliable transmission of the data stream, so that the sending rate is not significantly faster than receive rate. Wherein, if the electronic device does not receive the acknowledgment information before the timer expires, it is determined that a retransmission timeout occurs, and the electronic device automatically retransmits the previously sent data over time.

Furthermore, if the electronic device is in the process of playing the video, if there is a freeze during the playback process for many times, it means that the decoding process of the video to be played by the electronic device is stuck, or the receiving network data appears. Caton, which will result in poor user experience. Then, the electronic device can also evaluate the quality of the network by detecting the number of times the video is stuck during the playback of the video within a preset time period.

For example, if the electronic device plays a video in the ultra-HD mode, and the electronic device detects that the network quality is lower than the set condition through the above-mentioned method during the video playback, the sub-ratio of the played video will be reduced to high-definition In this case, the control controls can be stacked and displayed on the video playback interface of the electronic device, so that it is convenient for the user to trigger the visual enhancement of the video played in the high-definition mode through the displayed control controls, and then Although the electronic device plays video in high-definition mode, it can show better visual effects than high-definition.

It should be noted that in the process of visual enhancement, the electronic device will increase the computing resource consumption of the CPU or GPU. If the electronic device detects that the network quality is not lower than the set condition, it can prompt the user whether to switch to a higher level. resolution, and prompt the user whether to turn off visual enhancement, so as to reduce the consumption of computing resources on the CPU or GPU after the network status is restored.

Through the above method, it can be ensured that the electronic device can not only play the video smoothly under the condition of poor network status, but also can achieve a better playback effect than the resolution of the smooth playback supported by the current network status. Effect.

Step S230 : In response to the touch operation acting on the control controls, switch the control controls to a state indicating that video enhancement is enabled.

Step S240: If it is detected that the electronic device is in the video playing state, the state of the control controls is detected.

Step S250: If it is detected that the state of the control control indicates that video enhancement is enabled, perform visual enhancement on the played video.

In a video enhancement control method provided by the present application, by detecting whether an electronic device is in a video playback state, if it is detected that the electronic device is in the video playback state, it can be further determined according to the resolution of the played video and the network of the electronic device. state to determine whether to display the control controls for turning on or off the visual enhancement in response to the touch operation on the screen, and then further detect the state of the control controls. The played video is visually enhanced. Therefore, during the video playback process, the user can turn on or off the visual enhancement of the played video by performing a touch operation on the control controls, thereby providing convenience for the user to control whether to perform the visual enhancement and improving the user experience.

Please refer to FIG. 11 , a video enhancement control method provided by the present application is applied to an electronic device, and the method includes:

Step S310: Detect whether the electronic device is in a video playing state.

Step S320: If it is detected that the electronic device is in the video playing state, the state of a control control is detected, and the control control is used to control turning on or off the visual enhancement.

Step S330: If it is detected that the state of the control control indicates that video enhancement is enabled, perform visual enhancement on the played video.

Step S340: In response to the touch operation acting on the control controls, switch the control controls to a state representing turning off the video enhancement.

Step S350: If it is detected that the state of the control control indicates that the video enhancement is turned off, cancel the visual enhancement of the played video.

In a video enhancement control method provided by the present application, by detecting whether an electronic device is in a video playing state, if it is detected that the electronic device is in the video playing state, the state of a control control is detected, and the control control is used to respond to a touch The control operation controls the visual enhancement to be turned on or off, and if the state of the control control is detected to indicate that the video enhancement is turned on, the played video is visually enhanced. Therefore, during the video playback process, the user can turn on or off the visual enhancement of the played video by performing a touch operation on the control controls, thereby providing convenience for the user to control whether to perform the visual enhancement and improving the user experience.

Referring to FIG. 12 , a video enhancement control apparatus 400 provided by the present application is applied to electronic equipment. The apparatus 400 includes: a playback state detection unit 410 , a control state detection unit 420 , and a video enhancement unit 430 .

The play state detection unit 410 is used to detect whether the electronic device is in a video play state.

In one way, the playback state detection unit 410 is configured to detect whether a set video playback application is running in the electronic device; if it is detected that a set video playback application is running, determine whether the electronic device in the video playback state.

The control state detection unit 420 is configured to detect the state of a control control if it is detected that the electronic device is in the video playing state, and the control control is used to control turning on or off the visual enhancement.

In one approach, the control controls operate independently of the video playback application.

The video enhancement unit 430 is configured to perform visual enhancement on the played video if it is detected that the state of the control control indicates that the video enhancement is turned on.

Referring to FIG. 13 , a video enhancement control device 500 provided by the present application is applied to electronic equipment, and the device 500 includes: a playback state detection unit 510 , a control display unit 520 , a control state switching unit 530 , and a control state detection unit 540 And the video enhancement unit 550.

Playing state detection unit 510, for detecting whether the electronic device is in a video playing state;

The control display unit 520 is configured to display a control control on a video playback interface of the electronic device if it is detected that the electronic device is in a video playback state, where the control control is used to control turning on or off the visual enhancement.

The control state switching unit 530 is configured to switch the control control to a state representing enabling video enhancement in response to a touch operation acting on the control control.

The control state detection unit 540 is configured to detect the state of the control control if it is detected that the electronic device is in the video playing state.

The video enhancement unit 550 is configured to visually enhance the played video if it is detected that the state of the control control indicates that the video enhancement is turned on.

Referring to FIG. 14 , a video enhancement control apparatus 600 provided by the present application is applied to electronic equipment. The apparatus 600 includes: a playback state detection unit 610 , a control state detection unit 620 , a video enhancement unit 630 , and an enhancement cancellation unit 640 .

The play state detection unit 610 is configured to detect whether the electronic device is in a video play state.

In one way, the playback state detection unit 610 is used to detect whether a set video playback application is running in the electronic device; if it is detected that a set video playback application is running, determine that the electronic device is running in the video playback state.

The control state detection unit 620 is configured to detect the state of a control control if it is detected that the electronic device is in the video playing state, and the control control is used to control turning on or off the visual enhancement.

In one approach, the control controls operate independently of the video playback application.

The video enhancement unit 630 is configured to visually enhance the played video if it is detected that the state of the control control indicates that video enhancement is enabled.

The enhancement canceling unit 640 is configured to cancel the visual enhancement of the played video if it is detected that the state of the control control indicates that the video enhancement is turned off.

It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, for the specific working process of the above-described devices and units, reference may be made to the corresponding processes in the foregoing method embodiments, which will not be repeated here. . In several embodiments provided in this application, the coupling between the modules may be electrical, mechanical or other forms of coupling. In addition, each functional module in each embodiment of the present application may be integrated into one processing module, or each module may exist physically alone, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules.

It should be noted that, in this application, how to encode the audio data according to the audio encoding type can adopt the existing technology, which will not be described in detail in this application.

In summary, the present application provides a video enhancement control method, device and electronic device, by detecting whether the electronic device is in the video playback state, if it is detected that the electronic device is in the video playback state, the state of the control control is detected. , the control control is used to control turning on or off the visual enhancement in response to the touch operation, and if it is detected that the state of the control control indicates that the video enhancement is turned on, the played video is visually enhanced. Therefore, during the video playback process, the user can turn on or off the visual enhancement of the played video by performing a touch operation on the control controls, thereby providing convenience for the user to control whether to perform the visual enhancement and improving the user experience.

An electronic device provided by the present application will be described below with reference to FIG. 15 .

Referring to FIG. 15 , based on the above-mentioned image processing method and apparatus, an embodiment of the present application further provides another electronic device 100 that can execute the foregoing terminal control method. The electronic device 100 includes one or more (only one shown in the figure) a processor 102 , a memory 104 , a network module 106 , a video codec 108 , a camera 110 and a screen 112 that are coupled to each other. Wherein, the memory 104 stores a program that can execute the content in the foregoing embodiments, and the processor 102 can execute the program stored in the memory 104 .

The processor 102 may include one or more processing cores. The processor 102 uses various interfaces and lines to connect various parts of the entire electronic device 100, and executes by running or executing the instructions, programs, code sets or instruction sets stored in the memory 104, and calling the data stored in the memory 104. Various functions of the electronic device 100 and processing data. Optionally, the processor 102 may use at least one of a digital signal processing (Digital Signal Processing, DSP), a Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and a Programmable Logic Array (Programmable Logic Array, PLA) implemented in hardware. The processor 102 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU), a modem, and the like. Among them, the CPU mainly handles the operating system, user interface and application programs, etc.; the GPU is used for rendering and drawing of the display content; the modem is used to handle wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the processor 102, and is implemented by a communication chip alone.

The memory 104 may include random access memory (Random Access Memory, RAM), or may include read-only memory (Read-Only Memory). Memory 104 may be used to store instructions, programs, codes, sets of codes, or sets of instructions. The memory 104 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing the operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.) , instructions for implementing the following method embodiments, and the like. The storage data area may also store data created by the terminal 100 during use (such as phone book, audio and video data, chat record data) and the like.

The network module 106 is used for receiving and sending electromagnetic waves, realizing mutual conversion between electromagnetic waves and electrical signals, so as to communicate with a communication network or other devices, such as communication with a wireless access point. The network module 106 may include various existing circuit elements for performing these functions, eg, antennas, radio frequency transceivers, digital signal processors, encryption/decryption chips, subscriber identity module (SIM) cards, memory, etc. . The network module 106 can communicate with various networks such as the Internet, an intranet, a wireless network, or communicate with other devices through a wireless network. The aforementioned wireless network may include a cellular telephone network, a wireless local area network, or a metropolitan area network.

The video codec 108 may be used to encode images captured by the camera 110 or decode data requested from the network by the network module 106 for transmission to the screen 112 for display. Specifically, the video codec 108 may be a GPU, a dedicated DSP, an FPGA, an ASIC chip, or the like.

Please refer to FIG. 16 , which shows a structural block diagram of a computer-readable storage medium provided by an embodiment of the present application. The computer-readable medium 800 stores program codes, and the program codes can be invoked by the processor to execute the methods described in the above method embodiments.

The computer readable storage medium 800 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 800 includes a non-transitory computer-readable storage medium. Computer readable storage medium 800 has storage space for program code 810 to perform any of the method steps in the above-described methods. The program codes can be read from or written to one or more computer program products. Program code 810 may be compressed, for example, in a suitable form.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand: it can still be Modifications are made to the technical solutions described in the foregoing embodiments, or some technical features thereof are equivalently replaced; and these modifications or replacements do not drive the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims (9)

1. A video enhancement control method is applied to an electronic device, and comprises the following steps:

detecting whether the electronic equipment is in a video playing state;

if the electronic equipment is detected to be in the video playing state, detecting the resolution of a video played by a video playing interface;

if the resolution of the video played by the video playing interface is a set resolution, and the set resolution is lower than the highest resolution supported by the electronic equipment, the control is displayed on the video playing interface of the electronic equipment in a stacking manner; the set resolution is the highest resolution supported by the video played by the video playing interface;

detecting the state of a control, wherein the control is used for controlling the opening or closing of visual enhancement;

and if the state representation of the control is detected to start video enhancement, performing visual enhancement on the played video.

2. The method of claim 1, wherein the step of detecting whether the electronic device is in a video playing state comprises:

detecting whether a set video playing application program runs in the electronic equipment;

and if the set video playing application program is detected to be running, judging that the electronic equipment is in the video playing state.

3. The method of claim 2, wherein the control operates independently of the video playback application, and wherein detecting the state of the control comprises:

and detecting the state of a control independent of the preset video playing application program.

4. The method of claim 1, wherein the step of displaying the control in a stack on a video playback interface of the electronic device comprises:

detecting the change frequency of continuous multi-frame images included in the video played by the video playing interface;

and if the change frequency is greater than the set frequency, the control is displayed on a video playing interface of the electronic equipment in a stacking mode.

5. The method according to claim 1, wherein if the resolution of the video played by the video playing interface is a set resolution, the step of displaying the control on the video playing interface of the electronic device in a stack manner comprises:

if the resolution of the video played by the video playing interface is the set resolution, and the network quality of the network accessed by the electronic equipment is detected to be lower than the set condition, the resolution of the played video is reduced;

and displaying the control on a video playing interface of the electronic equipment in a stacking manner.

6. The method according to any of claims 1-5, wherein the step of visually enhancing the played video, if it is detected that the state of the control indicates that video enhancement is enabled, further comprises:

and if the state of the control is detected to represent that the switch closes the video enhancement, the video enhancement on the played video is cancelled.

7. A video enhancement control device applied to an electronic device, the device comprising:

the playing state detection unit is used for detecting whether the electronic equipment is in a video playing state;

the control state detection unit is used for detecting the state of a control if the electronic equipment is detected to be in the video playing state, and the control is used for controlling the opening or closing of the visual enhancement;

and the video enhancement unit is used for carrying out visual enhancement on the played video if the state representation of the control is detected to start the video enhancement.

8. An electronic device comprising one or more processors, a video codec, and a memory;

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the method of any of claims 1-6.

9. A computer-readable storage medium, having a program code stored therein, wherein the program code when executed by a processor performs the method of any of claims 1-6.

Images