CN116225355B - Multi-screen synchronous display method and system, display and display controller - Google Patents

Abstract

The present invention provides a multi-screen synchronous display method, system, display and display controller, which include the following analysis and judgment steps: S1. Decode display information and obtain synchronization information in the display information of each screen. S2. Determine whether the same signal cycle is consistent, if so, go to step 3, if not, go to step 4. S3. Determine whether the display start time is within an acceptable delay time range. If so, display the current display information, if not, delay the display. S4. Determine whether the abnormal point synchronization information Ax and other screen synchronization information are within an acceptable delay time range, if so, go to step S5, if not, go to step S6. S5. Repeat the display information of the previous time period and display it. S6. Repeat the display information of the previous time period and delay the display. The present invention solves the problem of screen tearing and fragmentation when multiple screens are displayed together.

Description

A multi-screen synchronous display method, system, display and display controller

Technical Field

The present invention relates to the technical field of multi-screen display, and in particular to a multi-screen synchronous display method, system, display and display controller.

Background Art

In order to better display the 3D visual effect, the existing AR/VR technology will mostly use multiple screens for synchronous display, so that the displayed image is closer to the real image from the human visual point of view. However, in the existing technology, with the continuous improvement of the performance of the graphics card, the frame rate of the display screen and the frame rate that the graphics card can provide have gradually become different. So when there is a difference between the refresh rate of the display and the frame rate of the graphics card, it will appear: before the display refreshes the current frame, the graphics card has already drawn the new picture and sent it to the display. At this time, the display will directly start scanning the new frame, so a display screen composed of the old scene and the new scene will flash in front of the user, resulting in screen tearing. The more the graphics card performance exceeds the display, the more obvious and frequent the phenomenon of multi-image splicing will appear, which will lead to a stronger sense of screen tearing. Especially in high-speed motion pictures, the sense of screen tearing will seriously affect the user's viewing experience, and even cause adverse reactions such as dizziness.

For a single-screen display system, the use of vertical synchronization technology can effectively overcome the above-mentioned screen tearing problem. However, for a multi-screen display system, such as an AR/VR display system, the tearing sensation of each screen can be effectively overcome after the vertical synchronization technology is used. However, due to the technical characteristics of the vertical synchronization technology, it will wait until a frame of the display is displayed before receiving new screen information sent by the graphics card. After the high-speed motion picture is split into multiple screens for display information, the frame rate of the high-speed changing display information part and the low-speed changing display information part such as the background will be different. After this frame rate difference is processed by the existing vertical synchronization technology, each screen will display the display information of different time periods at the same time, resulting in a split between the screens, which will also cause discomfort to the user experience.

Summary of the invention

In view of the problems existing in the prior art, the present invention provides a multi-screen synchronous display method, comprising the following steps:

S1. Decode the display information and obtain synchronization information A1, A2, ..., An in the display information of each screen, where n is the sequence number of each screen, and n is a positive integer ≥2.

S2. Determine whether A1, A2 ... An received in the same time period maintain the same signal period as A1, A2 ... An received in the previous time period. If the signal periods are consistent, proceed to step 3; if the signal periods are inconsistent, proceed to step 4.

S3. Determine whether the display start time T1, T2, ... Tn of A1, A2, ... An is within the acceptable delay time range. If so, each screen displays the current display information, if not, the display is delayed.

Return to step S1.

S4. Determine whether the display start time Tx in the synchronization information Ax of the screen whose signal cycle changes and the display start time in the synchronization information of other screens are within the acceptable delay time range, where Ax is one of A1, A2...An, and Tx is one of T1, T2...Tn. If yes, proceed to step S5, if not, proceed to step S6.

S5. Repeat the information displayed in the previous period and display it.

Return to step S1.

S6. Repeat the information displayed in the previous period and delay the display.

Return to step S1.

Furthermore, the synchronization information includes: vertical synchronization information and/or horizontal synchronization information.

Furthermore, the repeating of the display information of the previous time period in steps S5 and S6 is: only the display screen corresponding to Ax repeatedly displays the display information of the previous time period.

Furthermore, the delayed display method described in steps S3 and S6 includes: storing display information of all screens, using the display information of the screen with the latest display start time as the judgment time point L, and delaying the display information of other screens until the display start time and L are within an acceptable delay time range before displaying.

Furthermore, the delayed display start time is synchronously fed back to an external system that provides display information.

The second object of the present invention is to provide a multi-screen synchronous display system, including a data receiving module, a data analyzing module, a data storage module and a data sending module, wherein:

The data receiving module is used to receive each screen display information.

After the data analysis module obtains the display information of the data receiving module, it executes the analysis step in the multi-screen synchronous display method according to any one of claims 1-4.

The data storage module is used to store display information of all screens in at least two consecutive time periods in any one of the multi-screen synchronous display methods of claims 1-4.

The data sending module is used to send corresponding display information to each screen according to the analysis result of the data analysis module.

The third object of the present invention is to provide a display controller, comprising: a microprocessor and a memory, wherein the microprocessor is used to execute the analysis and judgment steps in the above-mentioned multi-screen synchronous display method. The memory is used to store display information.

A fourth object of the present invention is to provide a display comprising at least two display screens and a controller, wherein the controller is used to execute the analysis and judgment steps and information storage in the multi-screen synchronous display method.

The beneficial effect of the present invention is that the present invention overcomes the problem of screen tearing when a single screen displays information, and on this basis further solves the problem of screen fragmentation when multiple screens display together.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a display screen when vertical synchronization is not enabled in an embodiment of the present invention;

FIG2 is a display screen when vertical synchronization is turned on in an embodiment of the present invention;

FIG3 is a flow chart of analysis and judgment of the multi-screen synchronous display method of the present invention;

FIG. 4 is a schematic diagram of a signal point period of the present invention.

DETAILED DESCRIPTION

The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the accompanying drawings in the embodiments of the present invention.

Example 1

A PC external VR display device with dual display screens on the left and right is used as a display system. The multi-screen synchronous display method of the present invention is introduced into the image decoder of the VR display device, so that the VR display device includes the following analysis and judgment process:

S1. Receive display information sent by the PC graphics card, decode the display information and obtain vertical synchronization information A1 and A2 in the display information of each screen.

S2. Determine whether A1 and A2 received in the same time period maintain the same signal period as A1 and A2 received in the previous time period. If the signal periods are consistent, record the normal 0505 judgment code and proceed to step S3. If not, record the abnormal A0A0 judgment code and proceed to step S4.

S3. Determine whether the display start time T1 and T2 of A1 and A2 are within the acceptable delay time range. If yes, store the currently received display information to the Frame buffer and display it on the left and right screens. If no, store the currently received display information of the two screens to the Frame buffer, use the display information of the screen with the latest display start time as the judgment time point L, delay the display information of the other screen until the display start time and L are within the acceptable delay time range, and then display it on the two screens respectively. Then return to step S1.

S4. Determine whether the display start time Tx in the synchronization information Ax of the screen whose signal cycle changes and the display start time in the synchronization information of other screens are within the acceptable delay time range, where Ax is one of A1 and A2, and Tx is one of T1 and T2. If yes, proceed to step S5, otherwise proceed to step S6.

S5. The screen corresponding to Ax displays the display information stored in the Frame buffer during the previous period of time, and then returns to step S1.

S6. The screen corresponding to Ax displays the display information stored in the Frame buffer in the previous period, and the display information of the screen with the latest display start time is used as the judgment time point L. The display information of another screen is delayed until the display start time and L are within the acceptable delay time range, and then displayed. Then return to step S1.

The delayed display start time is synchronously fed back to the graphics card, and the graphics card can adjust the time of sending the display information according to the feedback information, so that the display information of the two screens is synchronized after correction.

The above analysis process can also be simplified into the analysis flow diagram shown in Figure 3. Taking a shooting game as an example, when vertical synchronization is not turned on, the display screen of the VR system at a certain time is shown in Figure 1, where the left screen part of Figure 1 has a screen tearing problem of multiple screens spliced together, and the right screen part of Figure 1 is a normal display of the complete screen. When multiple similar screens appear, the user experience is significantly reduced.

When vertical synchronization is turned on, the screen tearing problem is effectively alleviated. However, for multi-screen display systems, the existing vertical synchronization technology is performed separately for each screen, which easily causes the left screen to display inconsistent images with the right screen when the game characters move quickly or the scenes switch quickly, as shown in Figure 2. The reason is that the existing vertical synchronization technology forces the screen to wait for a frame to be refreshed before connecting to the next frame. In this way, when the game characters move quickly or the scenes switch quickly, the graphics card has high performance and can provide sufficient refresh frame rate to meet the screen change requirements. However, the display screen cannot display these images "on time" under the influence of vertical synchronization technology. Therefore, there will be different degrees of delay or frame skipping depending on the amplitude of the screen change. This easily leads to screen splitting on the left and right screens due to the difference in delay or frame skipping amplitude, that is, the left and right screens display information output by the graphics card at different time periods at the same time.

After adopting the multi-screen synchronous display method of the present invention, the signal cycle change of each screen synchronization information is changed to determine whether the display information currently received by the screen is the display information of the same period. As shown in Figure 4, when the display signal cycle does not change, the display signal cycle meets the screen refresh rate, and the screen can display each frame normally. At this time, the introduction of the display start time judgment can effectively overcome the time difference between the left and right screen display pictures, so that the human eye cannot recognize the display time difference between the left and right screens, thereby improving the integrity and consistency of the picture information received by the user, and improving the user experience. When the signal cycle changes, as shown in I2C_1 in Figure 4, under the support of the powerful performance of the graphics card, the refresh frame rate of the display information exceeds the refresh frame rate of the display screen. At this time, the AOAO point is shorter than the normal 0505-0505 cycle tv due to the signal cycle t`v of the previous 0505 point. If the display information of the AOAO point is displayed at this time, the screen has not yet refreshed the previous 0505 point picture and loads this A0A0 point picture, and the picture tearing problem of multi-picture splicing will occur. However, if AOAO is ignored and the display data of point 0505 in the next frame is waited for before displaying, there may be a long data blank period. When the data blank period exceeds the cache time of the display, the display will prompt a black screen state with no signal access, causing a bad user experience.

The present invention adjusts the signal cycle based on the method of repeated display and delayed display. When an information point with a cycle abnormality as shown in Figure 4 appears, the display data of the previous 0505 point will be repeated at the AOAO point, so that the problem of screen tearing will not occur after the two identical display screens are spliced, and because the normal display is performed at the AOAO point, there will be no uncontrollable data blank period between the next 0505 point. At the same time, when the start time of the two display information of the same period of the two screens differs due to the AOAO point, the display time difference can be controlled within the range that is difficult for the human eye to recognize by delaying the display, thereby improving the user experience. The data blank time generated by the delay is lower than the data cache time of the display. At this time, the display will maintain the original display screen, and will not jump to the prompt screen of the signal access. It can be seen that after adopting the method of the present invention, on the one hand, the problem of splicing the abnormal point screen is overcome, and the problem of screen tearing is eliminated. On the other hand, the screens displayed on the two screens are always the display information of the same cycle, so the problem of screen fragmentation can be eliminated, and the time difference between the two screen display screens can be adjusted by delaying the display, so that the entire time difference can be lower than the difference range that the human eye can recognize, so that the user is not easy to perceive the time difference between the two screen display screens, improving the user experience.

At the same time, the present invention can feed back the display start time after delay correction to the graphics card, and the graphics card can synchronously adjust subsequent display information based on the adjusted display time, thereby further reducing the problem of unsynchronized display between the left and right screens.

Example 2

A multi-screen synchronous display system installed in a dual-screen VR device, the VR device is connected to a PC and displays, the multi-screen synchronous display system includes a data receiving module, a data analysis module, a data storage module and a data sending module, wherein:

The data receiving module is used to receive the display information sent by the PC.

After the data analysis module obtains the display information of the data receiving module, it performs the following analysis and judgment process:

S1. Decode the display information and obtain the vertical synchronization information A1 and A2 in each screen display information.

S2. Determine whether A1 and A2 received in the same time period maintain the same signal period as A1 and A2 received in the previous time period. If the signal periods are consistent, record the normal 0505 judgment code and proceed to step S3. If not, record the abnormal A0A0 judgment code and proceed to step S4.

S3. Determine whether the display start time T1 and T2 of A1 and A2 are within the acceptable delay time range. If yes, store the currently received display information in the data storage module and send the corresponding display instructions to the two screens through the data sending module. After receiving the display instruction, the screen retrieves the display information of the corresponding screen from the data storage module and displays it.

If not, the display information of the two screens currently received is stored in the data storage module, and the display information of the screen with the latest display start time is used as the judgment time point L. When the display information of the other screen is delayed until the display start time and L are within the acceptable delay time range, the corresponding display instructions are sent to the two screens through the data sending module. After receiving the display instruction, the screen retrieves the display information of the corresponding screen from the data storage module and displays it. After the display instruction is sent, return to step S1.

S4. Determine whether the display start time Tx in the synchronization information Ax of the screen whose signal cycle changes and the display start time in the synchronization information of other screens are within the acceptable delay time range, where Ax is one of A1 and A2, and Tx is one of T1 and T2. If yes, proceed to step S5, otherwise proceed to step S6.

S5. The screen corresponding to Ax does not store the current display information, and the other screen stores the current display information and sends a display instruction. After receiving the display instruction, the screen retrieves the display information of the corresponding screen from the data storage module and displays it, and then returns to step S1.

S6. The screen corresponding to Ax does not store the current display information, but retains the display information of the previous period. The display information of the screen with the latest display start time is used as the judgment time point L. When the display information of another screen is delayed until the display start time and L are within the acceptable delay time range, the display instruction is sent. After receiving the display instruction, the screen retrieves the display information of the corresponding screen from the memory and displays it, and then returns to step S1.

The delayed display start time is synchronously fed back to the graphics card on the PC side. The graphics card on the PC side can adjust the time of sending the display information according to the feedback information, so that the display information of the two screens is synchronized after correction.

Example 3

A display controller comprises: a microprocessor and a memory, wherein the microprocessor is used to perform the following analysis and judgment process:

S1. Decode the display information and obtain the vertical synchronization information A1 and A2 in each screen display information.

S2. Determine whether A1 and A2 received in the same time period maintain the same signal period as A1 and A2 received in the previous time period. If the signal periods are consistent, record the normal 0505 judgment code and proceed to step S3. If not, record the abnormal A0A0 judgment code and proceed to step S4.

S3. Determine whether the display start time T1 and T2 of A1 and A2 are within the acceptable delay time range. If yes, store the currently received display information in the memory and send corresponding display instructions to the two screens. After receiving the display instruction, the screen retrieves the display information of the corresponding screen from the memory and displays it.

If not, the display information of the two currently received screens is stored in the memory, and the display information of the screen with the latest display start time is used as the judgment time point L. When the display information of the other screen is delayed until the display start time and L are within the acceptable delay time range, the corresponding display instruction is sent. After receiving the display instruction, the screen retrieves the display information of the corresponding screen from the memory and displays it. After the display instruction is sent, return to step S1.

S4. Determine whether the display start time Tx in the synchronization information Ax of the screen whose signal cycle changes and the display start time in the synchronization information of other screens are within the acceptable delay time range, where Ax is one of A1 and A2, and Tx is one of T1 and T2. If yes, proceed to step S5, otherwise proceed to step S6.

S5. The screen corresponding to Ax does not store the current display information in the memory, and retains the display information of the previous period. The other screen stores the current display information in the memory and sends a display instruction. After receiving the display instruction, the screen retrieves the display information of the corresponding screen from the memory and displays it, and then returns to step S1.

S6. The screen corresponding to Ax does not store the current display information in the memory, and retains the display information of the previous period. The other screen stores the current display information in the memory. The display information of the screen with the latest current display start time is used as the judgment time point L. When the display information of the other screen is delayed until the display start time and L are within the acceptable delay time range, the display instruction is sent. After receiving the display instruction, the screen retrieves the display information of the corresponding screen from the memory and displays it, and then returns to step S1.

The delayed display start time is synchronously fed back to the graphics card on the PC side. The graphics card on the PC side can adjust the time of sending the display information according to the feedback information, so that the display information of the two screens is synchronized after correction.

Example 4

A display includes two display screens and a controller, wherein a signal receiving end of the controller is connected to a graphics card signal of a PC, and the controller is used to perform the following analysis and judgment process:

S1. Decode the display information and obtain the vertical synchronization information A1 and A2 in each screen display information.

S2. Determine whether A1 and A2 received in the same time period maintain the same signal period as A1 and A2 received in the previous time period. If the signal periods are consistent, record the normal 0505 judgment code and proceed to step S3. If not, record the abnormal A0A0 judgment code and proceed to step S4.

S3. Determine whether the display start time T1 and T2 of A1 and A2 are within the acceptable delay time range. If yes, store the currently received display information, and the two display screens obtain the display information and display it.

If not, store the display information of the two currently received screens, use the display information of the screen with the latest display start time as the judgment time point L, delay the display information of the other screen until the display start time and L are within an acceptable delay time range, then obtain the display information from the screen and display it, and then return to step S1.

S4. Determine whether the display start time Tx in the synchronization information Ax of the screen whose signal cycle changes and the display start time in the synchronization information of other screens are within the acceptable delay time range, where Ax is one of A1 and A2, and Tx is one of T1 and T2. If yes, proceed to step S5, otherwise proceed to step S6.

S5. The screen corresponding to Ax does not store the current display information, and the other screen stores the current display information. The screen corresponding to Ax retrieves and displays the display information of the previous period, and the other screen retrieves and displays the current display information, and then returns to step S1.

S6. The screen corresponding to Ax does not store the current display information, and the other screen stores the current display information. The display information of the screen with the latest display start time is used as the judgment time point L. When the display information of the other screen is delayed to the point where the display start time and L are within the acceptable delay time range, the screen corresponding to Ax retrieves the display information of the previous period and displays it, and the other screen retrieves the previous display information and displays it, and then returns to step S1.

The delayed display start time is synchronously fed back to the graphics card on the PC side. The graphics card on the PC side can adjust the time of sending the display information according to the feedback information, so that the display information of the two screens is synchronized after correction.

Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims (8)

1. A multi-screen synchronous display method, comprising the steps of:

s1, decoding display information and acquiring synchronous information A1 and A2. An in the display information of each screen, wherein n is the serial number of each screen, and n is a positive integer more than or equal to 2;

s2, judging whether the A1 and the A2, the An received in the same period maintain the same signal period as the A1 and the A2, the An received in the previous period, if the signal period is consistent, entering the step 3, and if the signal period is inconsistent, entering the step 4;

s3, judging whether the display start time T1, T2 of the A1, A2. An. Tn is within An acceptable delay time range; if yes, each screen displays the current display information, and if not, the display is delayed;

Returning to the step S1;

S4, judging whether display start time Tx in synchronous information Ax of a screen with a signal period changed and display start time in synchronous information of other screens are within An acceptable delay time range, wherein Ax is one of A1 and A2; if yes, entering a step S5, and if not, entering a step S6;

s5, repeating the display information of the previous period and displaying;

Returning to the step S1;

S6, repeating the display information of the previous period and delaying the display;

Returning to step S1.

2. The multi-screen synchronous display method according to claim 1, wherein the synchronous information includes: vertical synchronization information and/or horizontal synchronization information.

3. The multi-screen synchronous display method according to claim 1, wherein the repeating of the previous period of display information of steps S5 and S6 is: only the display screen corresponding to Ax repeatedly displays the display information of the previous period.

4. The multi-screen synchronous display method according to claim 1, wherein the method of delaying display of steps S3 and S6 comprises: and storing display information of all the screens, taking the display information of the screen with the latest display start time as a judgment time point L, and delaying the display information of other screens until the display start time and the display information of other screens are within an acceptable delay time range, and displaying.

5. The multi-screen synchronous display method according to claim 4, wherein the delayed display start time is synchronously fed back to an external system providing display information.

6. The multi-screen synchronous display system is characterized by comprising a data receiving module, a data analyzing module, a data storage module and a data sending module, wherein:

The data receiving module is used for receiving display information of each screen;

After the data analysis module acquires the display information of the data receiving module, executing the analysis steps in the multi-screen synchronous display method according to any one of claims 1 to 5;

The data storage module is used for storing display information of all screens of at least two continuous periods in the multi-screen synchronous display method according to any one of claims 1 to 5;

The data sending module is used for sending corresponding display information to each screen according to the analysis result of the data analysis module.

7. A display controller, comprising: a microprocessor and a memory, wherein the microprocessor is configured to perform the analysis and judgment step in the multi-screen synchronous display method according to any one of claims 1 to 5; the memory is used for storing display information.

8. A display comprising at least two display screens, characterized by comprising a controller for performing the analysis and judgment steps and information storage in the multi-screen synchronous display method of any one of claims 1 to 5.