CN117156210B - Flicker screen detection method and flicker screen detection device - Google Patents

Abstract

The application provides a splash screen detection method and a splash screen detection device, wherein the method comprises the following steps: acquiring a first brightness value of a first picture displayed by the terminal equipment, a second brightness value of a second picture displayed by the terminal equipment, a third brightness value of a third picture displayed by the terminal equipment and a fourth brightness value of a fourth picture displayed by the terminal equipment, wherein the second picture is a first frame picture after the first picture, the fourth picture is a first frame picture after the third picture, the number of frames at intervals between the fourth picture and the second picture is smaller than or equal to a first numerical value, or the duration of the intervals between the fourth picture and the second picture is smaller than or equal to a duration threshold; if the first jump occurs between the second brightness value and the first brightness value, the second jump occurs between the fourth brightness value and the third brightness value, and the direction of the first jump is opposite to the direction of the second jump, the terminal equipment is determined to have the screen flashing. The method for detecting the splash screen is beneficial to improving the detection accuracy of the splash screen.

Description

Flicker screen detection method and flicker screen detection device

Technical Field

The present application relates to the field of terminal technology, and in particular to a screen flash detection method and a screen flash detection device.

Background technique

During the development or use of terminal devices, due to unreasonable software configuration or hardware failure, when the terminal device plays continuous images, error frames often flash quickly, that is, screen flickering occurs. Screen flickering will seriously affect the user's use of the terminal device. Therefore, it is necessary to detect the problem of screen flickering in the terminal device in time and handle it as soon as possible.

Currently, the detection device usually first obtains the brightness value waveform corresponding to the continuous pictures, and then determines the picture corresponding to the brightness value with a jump in the brightness value waveform as the error frame picture. However, this implementation method has a high false alarm rate.

Summary of the invention

The present application provides a screen flicker detection method and a screen flicker detection device, which are beneficial to improving the accuracy of screen flicker detection.

In a first aspect, a screen flash detection method is provided, including: obtaining a first brightness value of a first picture displayed by a terminal device, a second brightness value of a second picture displayed by the terminal device, a third brightness value of a third picture displayed by the terminal device, and a fourth brightness value of a fourth picture displayed by the terminal device, wherein the second picture is the first frame picture after the first picture, the fourth picture is the first frame picture after the third picture, the number of frames between the fourth picture and the second picture is less than or equal to a first value, or the duration of the interval between the fourth picture and the second picture is less than or equal to a duration threshold; if a first jump occurs between the second brightness value and the first brightness value, a second jump occurs between the fourth brightness value and the third brightness value, and the direction of the first jump is opposite to the direction of the second jump, it is determined that a screen flash has occurred on the terminal device.

The detection device can detect the continuous images displayed by the terminal device to determine whether the terminal device has a screen flicker.

A picture may also be referred to as picture data, an image or image data, which is not limited in this application. The first picture, the second picture, the third picture and the fourth picture are pictures in the continuous pictures displayed by the terminal device. The second picture is the first frame picture after the first picture, that is, the first picture and the second picture are two adjacent pictures, and the terminal device displays the first picture first and then displays the second picture. The fourth picture is the first frame picture after the third picture, that is, the third picture and the fourth picture are two adjacent pictures, and the terminal device displays the third picture first and then displays the fourth picture.

The number of frames between the fourth picture and the second picture is less than or equal to the first value, which means that the number of frames between the fourth picture and the second picture is less than or equal to the preset number of frames. The duration between the fourth picture and the second picture is less than or equal to the duration threshold, which means that the duration between the fourth picture and the second picture is less than or equal to the preset duration.

If the number of frames between the fourth screen and the second screen is less than or equal to the first value, or the duration between the fourth screen and the second screen is less than or equal to the duration threshold, it can be said that the time between displaying the fourth screen and displaying the second screen is relatively close. If a first jump occurs between the second brightness value and the first brightness value, and a second jump occurs between the fourth brightness value and the third brightness value, and the direction of the first jump is opposite to that of the second jump, the detection device can determine that there is a brightness value pulse, and further determine that the terminal device has a screen flicker. In other words, if the detection device detects that the brightness value of the screen displayed by the terminal device jumps twice in a short period of time, and the directions of the two jumps are opposite, it is determined that the terminal device has a screen flicker.

In the screen flicker detection method provided by the present application, a first jump occurs between the second brightness value and the first brightness value, and a second jump occurs between the fourth brightness value and the third brightness value, the direction of the first jump is opposite to the direction of the second jump, and the time interval between the first jump and the second jump meets the requirements. In this way, it can be determined that there is a brightness value pulse, and further it can be determined that a screen flicker has occurred in the terminal device, which is beneficial to improving the detection accuracy of the screen flicker.

In combination with the first aspect, in certain implementations of the first aspect, the direction of the first jump is a direction in which the brightness value increases, and the direction of the second jump is a direction in which the brightness value decreases; or, the direction of the first jump is a direction in which the brightness value decreases, and the direction of the second jump is a direction in which the brightness value increases.

There are two possible situations in which a first jump occurs between the second brightness value and the first brightness value, and a second jump occurs between the fourth brightness value and the third brightness value.

One possible situation is that the second brightness value is much greater than the first brightness value, and when the first brightness value jumps to the second brightness value, the direction of the first jump is the direction of increasing brightness. The fourth brightness value is much less than the third brightness value, and when the third brightness value jumps to the fourth brightness value, the direction of the first jump is the direction of decreasing brightness, and the direction of the second jump is opposite to the direction of the first jump.

Another possible situation is that the second brightness value is much smaller than the first brightness value, and the first brightness value jumps to the second brightness value, then the direction of the first jump is the direction of brightness decrease. The fourth brightness value is much larger than the third brightness value, and the third brightness value jumps to the fourth brightness value, then the direction of the first jump is the direction of brightness increase, and the direction of the second jump is opposite to the direction of the first jump.

The screen flicker detection method provided in the present application distinguishes the direction of the jump based on the increase or decrease of the brightness value, which is conducive to accurately determining the direction of the jump, thereby improving the accuracy of screen flicker detection.

In combination with the first aspect, in some implementations of the first aspect, a product of a brightness transition value of the first transition and a brightness transition value of the second transition is less than 0.

The brightness jump value of the first jump is the difference between the second brightness value and the first brightness value. If the direction of the first jump is the direction of increasing brightness value, the difference between the second brightness value and the first brightness value is greater than 0. The brightness jump value of the second jump is the difference between the fourth brightness value and the third brightness value. If the direction of the second jump is the direction of decreasing brightness value, the difference between the second brightness value and the first brightness value is less than 0. Therefore, the product of the brightness jump value of the first jump and the brightness jump value of the second jump is less than 0.

The brightness jump value of the first jump is the difference between the second brightness value and the first brightness value. If the direction of the first jump is the direction of decreasing brightness value, the difference between the second brightness value and the first brightness value is less than 0. The brightness jump value of the second jump is the difference between the fourth brightness value and the third brightness value. If the direction of the second jump is the direction of increasing brightness value, the difference between the second brightness value and the first brightness value is greater than 0. Therefore, the product of the brightness jump value of the first jump and the brightness jump value of the second jump is less than 0.

The specific implementation method of the detection device determining whether the direction of the first jump is opposite to the direction of the second jump can be: the detection device determines whether the product of the brightness jump value of the first jump and the brightness jump value of the second jump is less than 0. If the product of the brightness jump value of the first jump and the brightness jump value of the second jump is less than 0, the direction of the first jump is opposite to the direction of the second jump; if the product of the brightness jump value of the first jump and the brightness jump value of the second jump is greater than or equal to 0, the direction of the first jump is different from the direction of the second jump.

The screen flash detection method provided in the present application can determine that the direction of the first jump is opposite to the direction of the second jump if the product of the brightness jump value of the first jump and the brightness jump value of the second jump is less than 0. This method is simple and convenient, and is conducive to improving the detection speed.

In combination with the first aspect, in certain implementations of the first aspect, before obtaining a first brightness value of a first picture displayed by the terminal device, a second brightness value of a second picture displayed by the terminal device, a third brightness value of a third picture displayed by the terminal device, and a fourth brightness value of a fourth picture displayed by the terminal device, the method also includes: obtaining at least one of the first picture, the second picture, the third picture, and the fourth picture from the memory space of the terminal device.

The images displayed by the terminal device may be stored in the memory space of the terminal device, wherein the memory space may include the internal memory or the video memory.

The terminal device establishes a connection with the detection device, and the terminal device obtains continuous images from the memory or video memory in real time, and sends the continuous images to the detection device in real time. The continuous images may include at least one of the first image, the second image, the third image, and the fourth image. The terminal device can also obtain continuous images from the memory or video memory in real time and display them on the screen.

The screen flash detection method provided in the present application directly obtains the picture from the memory space, which is helpful to prevent the interference of the screen brightness and is helpful to accurately obtain the brightness value of the picture.

In combination with the first aspect, in certain implementations of the first aspect, before obtaining a first brightness value of a first picture displayed by the terminal device, a second brightness value of a second picture displayed by the terminal device, a third brightness value of a third picture displayed by the terminal device, and a fourth brightness value of a fourth picture displayed by the terminal device, the method also includes: obtaining at least one of the first picture, the second picture, the third picture, and the fourth picture through a camera.

When the terminal device displays continuous image data in real time, the detection device can control a camera, such as a high-speed camera, to capture the continuous images displayed by the terminal device.

The screen flash detection method provided in the present application enables the detection device to detect the screen data displayed by the terminal device without the terminal device being aware of it.

In combination with the first aspect, in certain implementations of the first aspect, obtaining a first brightness value of a first picture displayed by a terminal device, a second brightness value of a second picture displayed by the terminal device, a third brightness value of a third picture displayed by the terminal device, and a fourth brightness value of a fourth picture displayed by the terminal device includes: collecting at least one of the first brightness value, the second brightness value, the third brightness value, and the fourth brightness value through a brightness sensor.

In the flash screen detection method provided in the present application, at least one brightness value among the first brightness value, the second brightness value, the third brightness value and the fourth brightness value can be acquired by a brightness sensor, which can reduce the process of calculating the brightness value by the detection device and is conducive to improving the detection accuracy of the flash screen.

In combination with the first aspect, in certain implementations of the first aspect, the method further includes: calculating the difference between the first brightness value and the second brightness value; if the modulus of the difference is greater than or equal to a brightness difference threshold, determining that a first jump occurs between the second brightness value and the first brightness value.

The difference between the first brightness value and the second brightness value can be the second brightness value minus the first brightness value, or the first brightness value minus the second brightness value, which is not limited in this application. The modulus of the difference can also be called the absolute value of the difference, which is not limited in this application. The brightness difference threshold can also be called a preset threshold or a brightness value threshold, which is not limited in this application. The brightness difference threshold can be calibrated through a large number of experiments, and the specific value of the brightness difference threshold is not limited in this application.

If the modulus of the difference is greater than or equal to the brightness difference threshold, it can be explained that there is a large difference between the first brightness value and the second brightness value, and the detection device can determine that a first jump occurs between the second brightness value and the first brightness value.

It can be understood that if the modulus of the difference between the third brightness value and the fourth brightness value is greater than or equal to the brightness difference threshold, the detection device determines that a second jump occurs between the fourth brightness value and the third brightness value.

The screen flicker detection method provided in the present application can indicate that a brightness jump has occurred if the difference in brightness values between adjacent images is greater than or equal to a brightness difference threshold, which is helpful for accurately detecting that a jump has occurred between the two images, thereby helping to improve the accuracy of screen flicker detection.

In the second aspect, a screen flash detection device is provided, including: an acquisition module and a processing module. The acquisition module is used to: acquire a first brightness value of a first picture displayed by a terminal device, a second brightness value of a second picture displayed by the terminal device, a third brightness value of a third picture displayed by the terminal device, and a fourth brightness value of a fourth picture displayed by the terminal device, wherein the second picture is the first frame picture after the first picture, the fourth picture is the first frame picture after the third picture, the number of frames between the fourth picture and the second picture is less than or equal to the first value, or the duration of the interval between the fourth picture and the second picture is less than or equal to the duration threshold; the processing module is used to: if a first jump occurs between the second brightness value and the first brightness value, a second jump occurs between the fourth brightness value and the third brightness value, and the direction of the first jump is opposite to the direction of the second jump, then it is determined that a screen flash has occurred on the terminal device.

In combination with the second aspect, in certain implementations of the second aspect, the direction of the first jump is the direction of increasing brightness value, and the direction of the second jump is the direction of decreasing brightness value; or, the direction of the first jump is the direction of decreasing brightness value, and the direction of the second jump is the direction of increasing brightness value.

In combination with the second aspect, in some implementations of the second aspect, a product of a brightness transition value of the first transition and a brightness transition value of the second transition is less than 0.

In combination with the second aspect, in some implementations of the second aspect, the acquisition module is further used to: acquire at least one of the first picture, the second picture, the third picture, and the fourth picture from the memory space of the terminal device.

In combination with the second aspect, in some implementations of the second aspect, the acquisition module is further used to: acquire at least one of the first picture, the second picture, the third picture, and the fourth picture through a camera.

In combination with the second aspect, in some implementations of the second aspect, the acquisition module is further used to: collect at least one of the first brightness value, the second brightness value, the third brightness value, and the fourth brightness value through a brightness sensor.

In combination with the second aspect, in certain implementations of the second aspect, the processing module is also used to: calculate the difference between the first brightness value and the second brightness value; if the modulus of the difference is greater than or equal to the brightness difference threshold, determine that a first jump occurs between the second brightness value and the first brightness value.

In a third aspect, the present application provides a network access device, which includes: a processor and a memory; the memory stores computer execution instructions; the processor executes the computer execution instructions stored in the memory, so that the network access executes the method described in the first aspect.

In a fourth aspect, the present application provides a detection device, which can be used to execute the method described in the first aspect.

In a fifth aspect, the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the method described in the first aspect is implemented.

In a sixth aspect, the present application provides a computer program product, which includes a computer program. When the computer program is executed, the computer executes the method described in the first aspect.

In a seventh aspect, the present application provides a chip, the chip comprising a processor, the processor being used to call a computer program in a memory to execute the method described in the first aspect.

It should be understood that the second to seventh aspects of the present application correspond to the technical solutions of the first aspect of the present application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation methods are similar and will not be repeated here.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic diagram of a mobile phone flash screen;

FIG2 is a schematic diagram of a brightness value jump;

FIG3 is a schematic diagram of a brightness value jump provided by an embodiment of the present application;

FIG4 is a schematic diagram of another brightness value pulse provided in an embodiment of the present application;

FIG5 is a schematic flow chart of a screen flash detection method provided in an embodiment of the present application;

FIG6 is a schematic diagram of drawing a brightness value waveform provided by an embodiment of the present application;

FIG7 is a schematic diagram of another method for drawing a brightness value waveform provided by an embodiment of the present application;

FIG8 is a schematic diagram of a method for detecting a narrow pulse of brightness value provided by an embodiment of the present application;

FIG9 is a schematic diagram of a wide pulse for detecting brightness values provided in an embodiment of the present application;

FIG10 is a schematic block diagram of a screen flash detection device provided in an embodiment of the present application;

FIG. 11 is a schematic block diagram of another screen flash detection device provided in an embodiment of the present application.

Detailed ways

The technical solution in this application will be described below in conjunction with the accompanying drawings.

The terminal device involved in the embodiments of the present application may also be referred to as a terminal, user equipment (UE), mobile station (MS), mobile terminal (MT), etc. The terminal device may be a mobile phone, a smart TV, a wearable device, a tablet computer (Pad), a computer with wireless transceiver function, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal in industrial control, a wireless terminal in self-driving, a wireless terminal in remote medical surgery, a wireless terminal in smart grid, a wireless terminal in transportation safety, a wireless terminal in smart city, a wireless terminal in smart home, etc.

During the development or use of terminal devices, due to unreasonable software configuration or hardware failure, when the terminal device plays continuous images, error frames often flash quickly, that is, screen flickering occurs. Screen flickering will cause visual impact to users, causing discomfort to users and seriously affecting users' use of terminal devices. Therefore, it is necessary to detect the problem of screen flickering in terminal devices in a timely manner and handle it as soon as possible.

Exemplarily, due to the persistence of vision of the human eye, the gradually changing image frames will form a coherent picture in the brain, forming a good viewing experience. The sudden flash of abnormal image frames in the continuous picture will cause visual discomfort. For the abnormal frames in the video, it will cause a sense of unsmoothness, causing discomfort to the user, and seriously affecting the user's use of the terminal device. The terminal device can be a mobile phone, and Figure 1 shows a schematic diagram of a mobile phone flash screen. As shown in Figure 1, the a interface, b interface, c interface, d interface, e interface, f interface, g interface, h interface and i interface in Figure 1 form a continuous picture, the a interface is the first frame, the b interface is the second frame, the c interface is the third frame, the d interface is the fourth frame, the e interface is the fifth frame, the f interface is the sixth frame, the g interface is the seventh frame, the h interface is the eighth frame, and the i interface is the ninth frame. The first frame to the third frame are the mobile phone lock screen interface, and the fourth frame to the eighth frame should all be notification message interfaces, but the sixth frame, that is, the f interface, has no display content and is an abnormal picture (or abnormal frame). Abnormal frames will cause a sense of unsmoothness, causing discomfort to users and seriously affecting their use of the phone.

When detecting a picture, the detection device usually first obtains the brightness value waveform corresponding to the continuous pictures, and then determines the picture corresponding to the brightness value with a jump in the brightness value waveform as an error frame picture.

Specifically, when the detection device detects the picture of the terminal device, it can obtain the picture data played by the terminal device in real time, calculate the brightness value corresponding to the picture data, and draw a real-time brightness value waveform based on the brightness value corresponding to the picture data. If there is no abnormal picture data (or abnormal frame) in the picture data, the change trend of the brightness value will be smooth, that is, the brightness value waveform is smooth; if there is abnormal picture data (or abnormal frame) in the picture data, the change trend of the brightness value will be not smooth, that is, the brightness value waveform is not smooth, that is, jump. If a jump in the brightness value is detected, the picture corresponding to the brightness value that jumps is determined as an error frame picture, that is, the splash screen picture is detected and captured.

Exemplarily, FIG2 shows a schematic diagram of a brightness value jump. As shown in FIG2, as the number of frames of the picture increases or as time increases, the brightness value changes continuously. The detection device can calculate the difference between the brightness value of the current picture (or the current frame) and the brightness value of the previous picture (or the previous frame) to determine whether the brightness value jumps. If the difference in brightness value is large, the detection device can determine that the brightness value jumps. In the brightness value waveform shown in FIG2, there are two times when the difference in brightness value is large, and the detection device can determine that the brightness value jumps twice, that is, the screen flashes twice.

However, the method of judging screen flicker by judging the jump of brightness value has a high false alarm rate.

The applicant has found that normal interface switching (such as opening a new window) or switching between different scenes (such as switching scenes in a movie) that often appears on the screen will also result in large brightness value jumps. If the screen flash is judged only by the brightness value jump, there will be a high false alarm rate, resulting in this method not being effectively applied to real scenes.

For example, FIG3 shows another schematic diagram of brightness value jump. As shown in FIG3, as the number of frames of the picture increases or as time increases, the brightness value changes continuously. When the terminal device switches interfaces normally, such as opening a new window, the brightness value jumps, and the detection device determines that a screen flash has occurred, a false alarm occurs, which reduces the accuracy of the screen flash detection.

The applicant also found that the screen flicker that really causes visual discomfort to the user is mostly in the form of pulses in the brightness value waveform, that is, the brightness value suddenly increases (or decreases) and then suddenly decreases (or increases) in a short time. Therefore, by capturing the pulses in the brightness value waveform, it is helpful to accurately capture the screen flicker in the picture.

For example, FIG4 shows a schematic diagram of a brightness value pulse. As shown in FIG4, as the number of frames of the picture increases or as time increases, the brightness value changes continuously. At a certain time point of the picture playback or when a certain frame of the picture is played, the brightness value suddenly increases and then suddenly decreases, and a brightness value pulse occurs.

In view of this, the embodiments of the present application provide a screen flicker detection method and a screen flicker detection device. If a pulse is detected in the brightness value waveform, it is determined that a screen flicker phenomenon has occurred, which is beneficial to improving the accuracy of screen flicker detection.

In order to facilitate the clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "for example" in the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

In the embodiments of the present application, "at least one" refers to one or more, and "more than one" refers to two or more. "And/or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and/or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character "/" generally indicates that the associated objects before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, c can be single or multiple.

It should be noted that the "at..." in the embodiment of the present application can be the instant when a certain situation occurs, or can be a period of time after a certain situation occurs, and the embodiment of the present application does not specifically limit this. In addition, the display interface provided in the embodiment of the present application is only an example, and the display interface can also include more or less content.

The above-mentioned screen data may also be referred to as screen, image data or image, which is not limited in the embodiments of the present application. The flash screen detection method provided in the embodiments of the present application can detect the screen displayed by the terminal device in real time, or can detect the screen displayed by the terminal device, such as a recorded video. The following is an example of detecting the screen data displayed in real time by the terminal device.

Exemplarily, FIG5 shows a schematic flow chart of a screen flash detection method 500. The method 500 may be executed by a detection device, such as a terminal device or a server, etc. As shown in FIG5, the method 500 may include the following steps:

S501. Acquire continuous picture data displayed in real time by a terminal device.

The terminal device may also be referred to as a device under test, which is not limited in the embodiments of the present application.

When the terminal device displays continuous image data, the detection device can obtain the image data displayed by the terminal device in real time.

There are many possible implementations for the detection device to obtain the continuous image data displayed in real time by the terminal device.

In a possible implementation, the detection device receives continuous picture data obtained in real time from a memory or a video memory of the terminal device.

Specifically, the terminal device establishes a connection with the detection device, the terminal device obtains continuous screen data from the memory or video memory in real time, and sends the continuous screen data to the detection device in real time, for example, by transmitting the screen data to the detection device in real time in a streaming manner through a Socket function. At the same time, the terminal device can also transmit the continuous screen data to the screen for display in real time.

It is understandable that if the detection device is a terminal device, the terminal device can obtain continuous picture data from the memory or video memory in real time.

This implementation method is to obtain the brightness value of the picture data before it is displayed, which is beneficial to prevent interference from the screen brightness and to accurately obtain the brightness value of the picture data.

In another possible implementation, the detection device collects screen images showing continuous image data through a high-speed camera.

Specifically, when the terminal device displays continuous picture data in real time, the detection device can control the high-speed camera to collect the continuous picture data displayed by the terminal device.

In this implementation mode, the detection device can detect the screen data displayed by the terminal device without the terminal device being aware of it.

S502: Calculate the difference in brightness values corresponding to adjacent picture data.

The difference between the brightness values corresponding to the adjacent picture data may be the difference between the brightness value corresponding to the picture data of the subsequent frame and the brightness value corresponding to the picture data of the previous frame.

Exemplarily, the detection device can calculate the brightness value corresponding to each picture data, and sequentially calculate the difference between the brightness value corresponding to the picture data of the next frame and the brightness value corresponding to the picture data of the previous frame. Based on the difference in these brightness values, the detection device can draw a brightness value waveform, and the horizontal coordinate of the brightness value waveform can be the number of frames or time, and the vertical coordinate can be brightness. Figure 6 shows a schematic diagram of drawing a brightness value waveform. As shown in Figure 6, the detection device receives continuous picture data obtained from the memory or video memory in real time from the terminal device, and sequentially calculates the difference in brightness values corresponding to adjacent picture data, and based on the difference in these brightness values, the detection device can draw a brightness value waveform in real time. Figure 7 shows another schematic diagram of drawing a brightness value waveform. As shown in Figure 7, the detection device collects screen picture data that displays continuous picture data through a high-speed camera, and obtains the brightness value corresponding to each screen picture data through a brightness sensor, and sequentially calculates the difference in brightness value corresponding to the screen picture data of the next frame and the brightness value corresponding to the screen picture data of the previous frame. Based on the difference in these brightness values, the detection device can draw a brightness value waveform in real time.

The detection device calculates the brightness value of each picture data, which may include: the detection device may divide each picture data into n blocks of sub-picture data, and take the average of the corresponding brightness values of the n blocks of sub-picture data as the brightness value of the picture data.

Exemplarily, after the detection device obtains the continuous picture data, each picture data in the continuous picture data can be divided into n blocks of sub-picture data, and each sub-picture data is decoded into a YUV format, then n sub-picture data in a YUV format are obtained, and the sub-picture data in the n YUV format can be referred to as a sequence in a YUV format. Wherein, Y represents brightness (Luminance or Luma), that is, grayscale value, and U and V represent chromaticity (Chrominance or Chroma), which is used to specify the color of a pixel. The detection device can use the sequence of the Y component as a brightness value sequence or can use the sequence of the UV component as a brightness value sequence. The embodiment of the present application is described by taking the sequence of the Y component as a brightness value sequence as an example.

If the sequence in YUV format is represented by data, the array corresponding to data[0] can store the Y component, and each picture data includes n blocks of sub-picture data, that is, n Y components, then data[0][1] can be used to represent the Y component of the first block of sub-picture data in each picture data, data[0][2] can be used to represent the Y component of the second block of sub-picture data in each picture data, and so on, data[0][n] can be used to represent the Y component of the nth block of sub-picture data in each picture data. The detection device can calculate the average value of data[0][1], data[0][2]...data[0][n], and use the average value as the brightness value of the picture data.

It should be noted that decoding each sub-picture data into the YUV format by the detection device is only one possible implementation method. In another possible implementation method, the detection device can decode each sub-picture data into the RGB format and calculate the brightness value or chromaticity based on at least one component of the RGB format.

The detection device can draw a brightness value waveform according to the brightness value of the picture data and the time when the picture data is displayed (or the number of frames of the picture data). For example, if the brightness value of the picture data is M, the detection device can establish an M-time coordinate system and draw a brightness value curve on the coordinate system to observe the brightness change trend.

S503: If the modulus of the difference between the brightness values corresponding to the adjacent picture data is greater than a preset threshold, a brightness value jump occurs.

The modulus of the difference between the brightness values corresponding to the adjacent picture data may also be referred to as the absolute value of the difference between the brightness values corresponding to the adjacent picture data, which is not limited in the embodiment of the present application.

The detection device can determine in real time whether the modulus of the difference between the brightness values corresponding to the adjacent picture data is greater than a preset threshold. The preset threshold can be calibrated through a large number of experiments, and the specific value of the preset threshold is not limited in the embodiment of the present application.

The modulus of the difference between the brightness values corresponding to adjacent picture data is greater than a preset threshold, which may include two situations: the brightness value corresponding to the picture data of the subsequent frame suddenly increases compared with the brightness value corresponding to the picture data of the previous frame, or the brightness value corresponding to the picture data of the subsequent frame suddenly decreases compared with the brightness value corresponding to the picture data of the previous frame.

S504: If the brightness value jumps again within the preset number of frames or the preset duration after the brightness value jumps, and the direction is opposite to the previous brightness value jump, a brightness value pulse occurs.

The preset number of frames may be 2 frames, 3 frames, or 5 frames, etc., which is not limited in the embodiment of the present application. The preset duration may be 1 millisecond, 2 milliseconds, or 3 milliseconds, etc., which is not limited in the embodiment of the present application. The brightness value jump may include two directions, one direction is rising (or increasing), and the other direction is falling (or decreasing).

If the brightness value jumps again within the preset number of frames or preset duration after the brightness value jumps, that is, the modulus of the difference in brightness values corresponding to adjacent picture data is greater than the preset threshold again, and the direction is opposite to the previous brightness value jump, then a brightness value pulse occurs.

For example, if the first brightness value jump occurs, the brightness value corresponding to the picture data of the next frame suddenly increases compared with the brightness value corresponding to the picture data of the previous frame, that is, the jump direction is increasing, and within 2 frames after the brightness value jump, the brightness value jump occurs again, that is, the modulus of the difference between the brightness values corresponding to the adjacent picture data is greater than the preset threshold again, and the brightness value corresponding to the picture data of the next frame suddenly decreases compared with the brightness value corresponding to the picture data of the previous frame, that is, the jump direction is decreasing, then two jumps occur in a relatively short period of time, and the jump directions are opposite, so a brightness value pulse occurs.

For example, if the first brightness value jump occurs, the brightness value corresponding to the picture data of the subsequent frame suddenly decreases compared with the brightness value corresponding to the picture data of the previous frame, that is, the jump direction is decreasing, and within 1 millisecond after the brightness value jump, the brightness value jump occurs again, that is, the modulus of the difference between the brightness values corresponding to the adjacent picture data is greater than the preset threshold again, and the brightness value corresponding to the picture data of the subsequent frame suddenly increases compared with the brightness value corresponding to the picture data of the previous frame, that is, the jump direction is increasing, then two jumps occur in a relatively short period of time, and the jump directions are opposite, so a brightness value pulse occurs.

S505: Determine whether screen flickering occurs based on the brightness value pulse.

If the detection device detects a brightness value pulse, it can be determined that a screen flicker has occurred, and the number of picture frames at which the screen flicker has occurred or the time at which the screen flicker has occurred can be determined.

It is understandable that the detection device can determine that a screen flash has occurred when the following conditions are met:

Two jumps occurred; the directions of the two jumps are opposite; the difference between the number of picture frames of the two jumps is less than the preset number of frames, or the difference between the time of the two jumps is less than the preset duration.

In one example, after the detection device detects that two jumps have occurred, it can first determine whether the difference in the number of picture frames of the two jumps is less than a preset number of frames, or whether the difference in the time of the two jumps is less than a preset duration. If the conditions are met, it can then determine whether the directions of the two jumps are opposite. This implementation method is conducive to quickly detecting whether multiple jumps have occurred in a short period of time, and can increase the speed of identifying pulses.

The screen flicker detection method provided in the embodiment of the present application determines that a screen flicker phenomenon has occurred if the brightness value undergoes two jumps in opposite directions within a preset number of frames or a preset duration, that is, a brightness value pulse is detected, which is beneficial to improving the accuracy of screen flicker detection.

The above-mentioned preset threshold value can also be called a brightness threshold value, and the preset number of frames or the preset duration can be represented by a pulse width threshold value. If the detection device detects that the modulus of the difference between the brightness values corresponding to the adjacent picture data is greater than the brightness threshold value, a brightness value jump occurs. If the brightness value jump is detected again within the pulse width threshold value, and the brightness value jump direction is opposite, a brightness value pulse occurs. This brightness value pulse can also be called a brightness value narrow pulse.

Exemplarily, FIG8 shows a schematic diagram of detecting a narrow pulse of brightness value. As shown in FIG8 , the brightness threshold is represented by the letter T, and the pulse width threshold is represented by the letter W. In the nth frame or at the time n, the average brightness value of the picture data may be L _n , the average brightness value of the previous frame of picture data may be L _n-1 , the difference in brightness values corresponding to adjacent picture data may be L _n -L _n-1 , L _n -L _n-1 may be recorded as ΔL _n , if the modulus of the difference in brightness values corresponding to adjacent picture data ΔL _n is greater than T, that is, ΔL _n >T, then a brightness value jump occurs, and the detection device may record the n value and ΔL _n . The detection device may look for brightness value jumps in the opposite direction. If the average brightness value of the picture data in the mth frame or at the mth time is _Lm , the average brightness value of the previous frame of picture data is Lm _-1 , the difference in brightness values corresponding to adjacent picture data is Lm _{- Lm-1} , _Lm - _Lm-1 can be recorded as _ΔLm , if the modulus of the difference in brightness values corresponding to adjacent picture data _ΔLm is greater than T, that is, _ΔLm >T, then another brightness value jump occurs. If _ΔLn * _ΔLm <0, it means that the two jump directions are opposite and a pulse occurs. If mn<W, it can be said that it is a narrow pulse, and a flickering screen occurs.

If the detection device detects a wide pulse, it can be determined that no screen flicker occurs and the search for the transition point can continue.

Exemplarily, FIG9 shows a schematic diagram of detecting a brightness value wide pulse. As shown in FIG9 , the brightness threshold is represented by the letter T, and the pulse width threshold is represented by the letter W. In the nth frame or at the time n, if the modulus of the difference in brightness values corresponding to the adjacent picture data is greater than T, a brightness value jump occurs. In the mth frame or at the time m, if the modulus of the difference in brightness values corresponding to the adjacent picture data is greater than T, another brightness value jump occurs. If the direction of the first brightness value jump is increasing, and the direction of the second brightness value jump is decreasing, the two jump directions are opposite, and a pulse occurs. If m-n>W, it can be explained that it is a wide pulse, so no screen flicker occurs.

As an optional embodiment, the above two implementation methods of acquiring continuous picture data displayed in real time by the terminal device can be performed simultaneously to facilitate locating the cause of the screen flickering.

The detection device can receive the continuous picture data obtained from the terminal device in real time from the memory or video memory, and can also collect the screen image showing the continuous picture data through a high-speed camera, and collect the brightness value of the screen through a brightness sensor. It should be noted that the brightness value of the screen collected by the brightness sensor is the superposition of the brightness value of the screen itself and the brightness value of the picture data.

The detection device can calculate the brightness value corresponding to the continuous picture data obtained in real time from the memory or video memory, and draw the brightness value waveform A. The detection device can also draw the brightness value waveform B based on the brightness value of the screen collected by the brightness sensor. The detection device can locate the cause of the screen flicker based on the brightness value waveform A and the brightness value waveform B.

Specifically, if the detection device detects that a pulse appears in the brightness values corresponding to the i-th frame screen data to the j-th frame screen data in the brightness value waveform A, and a pulse also appears in the brightness values corresponding to the i-th frame screen data to the j-th frame screen data in the brightness value waveform B, then the detection device can determine that there is no display problem on the screen, and that the screen flickers due to the screen data, and the specific cause of the screen flicker can be further found in the software configuration of the terminal device.

If the detection device detects that a pulse appears in the brightness values corresponding to the i-th frame data to the j-th frame data in the brightness value waveform A, but no pulse appears in the brightness values corresponding to the i-th frame data to the j-th frame data in the brightness value waveform B, the detection device can determine that there is a display problem with the screen and a possible fault has occurred.

If the detection device detects that there is no pulse in the brightness values corresponding to the i-th frame data to the j-th frame data in the brightness value waveform A, but there is a pulse in the brightness values corresponding to the i-th frame data to the j-th frame data in the brightness value waveform B, the detection device can determine that there is a display problem on the screen.

If the detection device detects that there is no pulse in the brightness values corresponding to the i-th frame picture data to the j-th frame picture data in the brightness value waveform A, but there is no pulse in the brightness values corresponding to the i-th frame picture data to the j-th frame picture data in the brightness value waveform B, then the detection device can determine that the terminal device displays good picture data.

The method provided in the above embodiment of the present application can be executed by a detection device, which may include a display image acquisition module, a flash screen judgment module, and a subsequent processing module. The display image acquisition module is used to acquire screen data, the flash screen judgment module is used to determine whether a flash screen appears in the screen data, and the subsequent processing module is used to process the screen data of the flash screen if a flash screen appears.

Exemplarily, the display image acquisition module can execute the above S501, and the display image acquisition module can send continuous screen data to the flash screen judgment module. After receiving the continuous screen data, the flash screen judgment module can execute the above S502 to S505. After the flash screen judgment module determines that a flash screen has occurred, it can send indication information to the subsequent processing module, and the indication information is used to instruct the subsequent processing module to process the screen data of the flash screen. The flash screen judgment module can generate a system log based on the indication information, so that relevant personnel can use the system log to troubleshoot problems and find faults in the terminal device as soon as possible.

The size of the serial number of each process in the above embodiment does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application.

The method provided in the embodiment of the present application is described in detail above in conjunction with Figures 1 to 9 , and the device provided in the embodiment of the present application will be described in detail below in conjunction with Figures 10 and 11 .

FIG10 shows a schematic block diagram of a screen flash detection device 1000 provided in an embodiment of the present application. As shown in FIG10 , the screen flash detection device 1000 includes: an acquisition module 1010 and a processing module 1020. The acquisition module 1010 is used to: acquire a first brightness value of a first picture displayed by a terminal device, a second brightness value of a second picture displayed by a terminal device, a third brightness value of a third picture displayed by a terminal device, and a fourth brightness value of a fourth picture displayed by a terminal device, wherein the second picture is the first frame picture after the first picture, the fourth picture is the first frame picture after the third picture, the number of frames between the fourth picture and the second picture is less than or equal to the first value, or the duration between the fourth picture and the second picture is less than or equal to the duration threshold; the processing module 1020 is used to: if a first jump occurs between the second brightness value and the first brightness value, a second jump occurs between the fourth brightness value and the third brightness value, and the direction of the first jump is opposite to the direction of the second jump, then it is determined that a screen flash has occurred in the terminal device.

Optionally, the direction of the first jump is a direction in which the brightness value increases, and the direction of the second jump is a direction in which the brightness value decreases; or, the direction of the first jump is a direction in which the brightness value decreases, and the direction of the second jump is a direction in which the brightness value increases.

Optionally, a product of a brightness transition value of the first transition and a brightness transition value of the second transition is less than 0.

Optionally, the acquisition module 1010 is further used to: acquire at least one of the first picture, the second picture, the third picture and the fourth picture from the memory space of the terminal device.

Optionally, the acquisition module 1010 is further used to: acquire at least one of the first picture, the second picture, the third picture and the fourth picture through a camera.

Optionally, the acquisition module 1010 is further configured to: collect at least one of the first brightness value, the second brightness value, the third brightness value, and the fourth brightness value through a brightness sensor.

Optionally, the processing module 1020 is further used to: calculate the difference between the first brightness value and the second brightness value; if the modulus of the difference is greater than or equal to the brightness difference threshold, determine that a first jump occurs between the second brightness value and the first brightness value.

It should be understood that the flash screen detection device 1000 here is embodied in the form of a functional module. The term "module" here may refer to an application specific integrated circuit (ASIC), an electronic circuit, a processor (such as a shared processor, a proprietary processor or a group processor, etc.) and a memory for executing one or more software or firmware programs, a merged logic circuit and/or other suitable components that support the described functions. In an optional example, those skilled in the art may understand that the flash screen detection device 1000 may be specifically the detection device in the above-mentioned method embodiment, or the function of the detection device in the above-mentioned method embodiment may be integrated in the flash screen detection device 1000, and the flash screen detection device 1000 may be used to execute the various processes and/or steps corresponding to the detection device in the above-mentioned method embodiment, and in order to avoid repetition, it will not be repeated here.

The above-mentioned screen flash detection device 1000 has the function of implementing the corresponding steps performed by the detection device in the above-mentioned method embodiment; the above-mentioned function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above-mentioned function.

In an embodiment of the present application, the screen flash detection device 1000 in FIG. 10 may also be a chip or a chip system, for example, a system on chip (SoC).

FIG11 is a schematic block diagram of another flash screen detection device 1100 provided in an embodiment of the present application. As shown in FIG11 , the flash screen detection device 1100 includes: a processor 1110, a transceiver 1120, and a memory 1130. The processor 1110, the transceiver 1120, and the memory 1130 communicate with each other through an internal connection path, the memory 1130 is used to store instructions, and the processor 1110 is used to execute the instructions stored in the memory 1130 to control the transceiver 1120 to send and/or receive signals.

It should be understood that the flash screen detection device 1100 can be specifically the detection device in the above method embodiment, or the function of the detection device in the above method embodiment can be integrated in the flash screen detection device 1100, and the flash screen detection device 1100 can be used to execute the various steps and/or processes corresponding to the detection device in the above method embodiment. Optionally, the memory 1130 may include a read-only memory and a random access memory, and provide instructions and data to the processor 1110. A portion of the memory 1130 may also include a non-volatile random access memory. For example, the memory 1130 may also store information about the device type. The processor 1110 can be used to execute instructions stored in the memory 1130, and when the processor 1110 executes the instruction, the processor 1110 can execute the various steps and/or processes corresponding to the detection device in the above method embodiment.

It should be understood that in the embodiment of the present application, the processor 1110 may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in a processor or an instruction in the form of software. The steps of the method disclosed in conjunction with the embodiment of the present application can be directly embodied as a hardware processor for execution, or a combination of hardware and software modules in a processor for execution. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor executes the instructions in the memory, and completes the steps of the above method in conjunction with its hardware. To avoid repetition, it is not described in detail here.

The present application also provides a computer-readable storage medium, which stores a computer program, and the computer program is used to implement the method corresponding to the detection device in the above method embodiment.

The present application also provides a chip system, which is used to support the detection device in the above method embodiment to implement the functions shown in the embodiment of the present application.

The present application also provides a computer program product, which includes a computer program (also referred to as code or instruction). When the computer program runs on a computer, the computer can execute the method corresponding to the detection device shown in the above method embodiment.

Those of ordinary skill in the art will appreciate that the modules and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and modules described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional module in each embodiment of the present application may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module.

If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

The above is only a specific implementation of the present application, but the protection scope of the embodiments of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the embodiments of the present application, which should be included in the protection scope of the embodiments of the present application. Therefore, the protection scope of the embodiments of the present application should be based on the protection scope of the claims.

Claims (9)

1. The method for detecting the splash screen is characterized by comprising the following steps of:

Acquiring a first brightness value of a first picture displayed by terminal equipment, a second brightness value of a second picture displayed by the terminal equipment, a third brightness value of a third picture displayed by the terminal equipment and a fourth brightness value of a fourth picture displayed by the terminal equipment, wherein the second picture is a first frame picture after the first picture, the fourth picture is a first frame picture after the third picture, the number of frames at intervals between the fourth picture and the second picture is smaller than a first numerical value, or the duration of the intervals between the fourth picture and the second picture is smaller than a duration threshold;

If a first jump occurs between the second brightness value and the first brightness value, a second jump occurs between the fourth brightness value and the third brightness value, and the product of the brightness jump value of the first jump and the brightness jump value of the second jump is smaller than 0, it is determined that the direction of the first jump is opposite to the direction of the second jump, and the terminal device has a screen flashing.

2. The method of claim 1, wherein the direction of the first transition is a direction in which the intensity value increases and the direction of the second transition is a direction in which the intensity value decreases; or alternatively

The first jump direction is the direction in which the brightness value is reduced, and the second jump direction is the direction in which the brightness value is increased.

3. The method according to claim 1 or 2, wherein before the obtaining the first luminance value of the first picture displayed by the terminal device, the second luminance value of the second picture displayed by the terminal device, the third luminance value of the third picture displayed by the terminal device, and the fourth luminance value of the fourth picture displayed by the terminal device, the method further comprises:

and acquiring at least one of the first picture, the second picture, the third picture and the fourth picture from the memory space of the terminal equipment.

4. The method according to claim 1 or 2, wherein before the obtaining the first luminance value of the first picture displayed by the terminal device, the second luminance value of the second picture displayed by the terminal device, the third luminance value of the third picture displayed by the terminal device, and the fourth luminance value of the fourth picture displayed by the terminal device, the method further comprises:

and acquiring at least one of the first picture, the second picture, the third picture and the fourth picture through a camera.

5. The method according to any one of claims 1 to 4, wherein the obtaining a first luminance value of a first picture displayed by a terminal device, a second luminance value of a second picture displayed by the terminal device, a third luminance value of a third picture displayed by the terminal device, and a fourth luminance value of a fourth picture displayed by the terminal device, comprises:

At least one of the first luminance value, the second luminance value, the third luminance value, and the fourth luminance value is acquired by a luminance sensor.

6. The method according to any one of claims 1 to 5, further comprising:

calculating a difference between the first luminance value and the second luminance value;

And if the modulus of the difference value is greater than or equal to a brightness difference threshold value, determining that a first jump occurs between the second brightness value and the first brightness value.

7. A splash screen detection device, comprising: a processor and a memory storing computer-executable instructions that, when executed by the processor, cause the splash screen detection device to perform the method of any one of claims 1 to 6.

8. A computer readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the method according to any one of claims 1 to 6.

9. A computer program product comprising a computer program which, when run, causes a computer to perform the method of any one of claims 1 to 6.