CN112073725B - Method for supporting local refreshing of arbitrary display area - Google Patents
Method for supporting local refreshing of arbitrary display area Download PDFInfo
- Publication number
- CN112073725B CN112073725B CN202010923997.3A CN202010923997A CN112073725B CN 112073725 B CN112073725 B CN 112073725B CN 202010923997 A CN202010923997 A CN 202010923997A CN 112073725 B CN112073725 B CN 112073725B
- Authority
- CN
- China
- Prior art keywords
- original data
- data block
- pixel
- refreshed
- area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 45
- 238000007906 compression Methods 0.000 abstract description 26
- 230000006835 compression Effects 0.000 abstract description 26
- 230000006837 decompression Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 6
- 230000002159 abnormal effect Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000003709 image segmentation Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/167—Position within a video image, e.g. region of interest [ROI]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
- H04N19/423—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Abstract
The invention discloses a method for supporting local refreshing of any display area, which comprises the steps of dividing an image to be compressed into a plurality of original data blocks, compressing the original data blocks and storing the compressed original data blocks in a frame buffer; acquiring the position and the size of a local refreshing region, judging whether the local refreshing region contains an incompletely refreshed original data block region, if so, receiving image data of the local refreshing region, adjusting the range of the local refreshing region to ensure that the adjusted local refreshing region only contains the completely refreshed original data block region, compressing the display data of the adjusted local refreshing region and storing the compressed display data in a frame buffer, otherwise, directly receiving the image data of the local refreshing region and storing the compressed display data in the frame buffer; the image compression data stored in the frame buffer is decompressed and then the image is displayed in the display system. The invention can enable the display equipment to support the local refreshing of any display area and effectively avoid the problems of messy codes, screen patterns and the like of the display equipment in the image display process.
Description
Technical Field
The invention relates to the technical field of display, in particular to a method for supporting local refreshing of any display area.
Background
The display system includes a display panel and a display driving unit driving the display panel to display an image. In the present display system, a frame buffer for storing an entire frame of an image to be displayed is integrated in many display driving units, and when displaying an image, the display driving unit compresses a picture sent by a video source and stores the compressed picture in the frame buffer, and when displaying the image, obtains compressed data of the image from the frame buffer and decompresses the compressed data to display a corresponding image in a display panel, for example, a detailed description is given of a picture with a resolution of 1920×1080: when the system is initialized, the original data block division of the display image to be compressed is set according to the display requirement, the image to be compressed is divided into M multiplied by N original data blocks according to the resolution (1920 multiplied by 1080) of the image to be compressed, and each data block comprises P rows and Q columns of pixels. The display driving unit or the display bridging chip receives the picture data to be displayed sent by the video source line by line. The display driving unit or the display bridging chip further compresses the original data blocks one by one through a selected compression algorithm, such as a DSC algorithm, after receiving an original data block line of a picture to be displayed, and stores the compressed data of each data block into a corresponding storage space in the frame buffer, and accesses the compressed data in the storage space through a space address, wherein the size of the compressed data is determined by a compression ratio, such as the compression ratio is 3:1, the size of the compressed data is one third of the original data, and when the frame buffer stores the compressed data of all data blocks, the compressed data is continuously written according to the compression sequence, such as the compressed data of the first line of data blocks, and sequentially written into the frame buffer from the first compressed data until all the compressed data of the current line of data blocks are completely written into the frame buffer. And storing the data blocks of the following lines until all the compressed data of the whole frame display picture are written into the frame buffer. The whole display picture can be stored in the frame buffer under the condition of approaching the visual lossless display quality by compression, so that the capacity requirement on the frame buffer is reduced, and the power consumption and the cost are reduced.
When displaying an image, the display driving unit reads all the compressed data blocks of one data block line from the frame buffer according to the mode consistent with the storage rule of the compressed data in the frame buffer, decompresses each compressed data block to obtain display data, then spells all the display data blocks contained in the whole data block line into a complete display picture data line, the line number of the complete display picture data line is the same as the display data line contained in the original data block, and then refreshes the display data of the lines to the display panel line by line for display.
However, the display system or the display data path which needs to compress, store and decompress the original display picture cannot perform local refreshing of any area, that is: when the whole display picture data is stored in the frame buffer, if the whole display picture data is to be locally refreshed, the new display data in the local refreshing area needs to be stored in the storage space of the frame buffer corresponding to the area, the original display data in the area is covered, the original display data in the area and the display data stored in other storage spaces in the frame buffer form a new frame of display picture data, and if the original data is compressed by adopting a compression algorithm and then stored in the frame buffer, the locally refreshed display data also needs to be stored in the corresponding position of the frame buffer after being compressed by the compression algorithm. If the partial refreshing area contains an incompletely refreshed data block area, the compressed data obtained after the partial refreshing area contains the incompletely refreshed data block area is smaller than the compressed data obtained after the whole data block is compressed, the compressed data of the previous frame of picture is stored in the storage space corresponding to the display data of the partial refreshing area, each data block corresponds to the storage space one by one, if the compressed data of the new display data in the incompletely refreshed data block area is stored in the corresponding storage space, only a part of the compressed data of the previous frame of picture stored in the storage space is covered by the compressed data of the new display data, the rest part of the compressed data is kept, and only a part of the original compressed data is included in the storage space, namely, the original compressed data becomes inaccurate and incomplete, the compressed data cannot be decompressed correctly during decompression, the obtained display data is inaccurate, even the difference is large, and the display problems such as screen display, messy code and the like occur. Meanwhile, different compression algorithms or different configurations of the same compression algorithm are adopted for the original data and the local refreshing data, and the data block area is marked and recorded, so that special processing is needed for the data block area in the decompression process, the data compression and decompression become very complex, and finally the area cost of a display driving unit or a display data path (such as a bridging chip and the like) is large, the cost is high, and the power consumption is high.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provide a method for supporting local refreshing of any display area, so that a display system or a display data path which needs to compress, store and decompress an original display picture can support local refreshing of any area, the phenomena of screen display, messy codes and the like are avoided, and the power consumption and the cost are reduced.
In order to achieve the above purpose, the present invention proposes the following technical scheme: a method for supporting local refreshing of an arbitrary display region, the method comprising the steps of:
s100, dividing an image to be compressed into M multiplied by N original data blocks according to the resolution of the image to be compressed, compressing the M multiplied by N original data blocks, and storing the compressed M multiplied by N original data blocks in a frame buffer, wherein M, N is an integer greater than or equal to 1;
s200, acquiring the position and the size of a local refreshing region, judging whether the local refreshing region contains an incompletely refreshed original data block region, if so, receiving image data of the local refreshing region, adjusting the range of the local refreshing region to ensure that the adjusted local refreshing region only contains the completely refreshed original data block region, further compressing and storing a data block corresponding to the adjusted local refreshing region into a storage space corresponding to the original data block in a frame buffer, otherwise, directly receiving the image data block corresponding to the local refreshing region, compressing and storing the compressed image data block into the storage space corresponding to the original data block in the frame buffer;
s300, the compressed data of the display image stored in the frame buffer is read, and the display image is displayed in the display device after decompression.
Preferably, in step S200, adjusting the local refresh zone range includes reducing the local refresh zone range, the reducing the local refresh zone range including
The rows or columns of pixels refreshed within the area of the original data block that was not fully refreshed are discarded.
Preferably, discarding the refreshed pixel rows or columns in the original data block region when the proportion of the refreshed pixel rows or columns in the incompletely refreshed original data block region to the total pixel rows or columns in the original data block region is less than or equal to a preset threshold.
Preferably, in step S200, adjusting the partial refresh zone range includes expanding the partial refresh zone range including
And carrying out expansion refreshing processing on pixel rows or pixel columns which are not refreshed in the original data block area according to the image data in the original data block area which is not completely refreshed in the partial refreshing area, so that the original data block area which is not completely refreshed is changed into an original data block area which is completely refreshed.
Preferably, the extended refresh process includes
The method comprises the steps that when an original data block area which is not completely refreshed is in an expanded pixel row, values of pixel rows to be expanded are copied to values of pixel rows at the outermost side of the original data block area;
When the pixel columns are expanded in the original data block area which is not completely refreshed, the values of the pixel columns to be expanded all duplicate the values of the pixel columns at the outermost side of the original data block area.
Or alternatively
The value of each pixel in the pixel row or the pixel column to be expanded is directly set, and the value of each pixel in the pixel row or the pixel column to be expanded is set to be the same or different.
Preferably, the extended refresh process includes
The method comprises the steps that when an original data block area which is not completely refreshed is in an expanded pixel row, the value of each pixel in the pixel row to be expanded is the average value of refreshed pixels which are in the same column with the pixel in the original data block area;
When the pixel column is expanded, the value of each pixel in the pixel column to be expanded is the average value of the refreshed pixels in the same row as the pixel in the original data block area.
Preferably, the extended refresh process includes
The method comprises the steps that when an original data block area which is not completely refreshed is in an expanded pixel row, the value of each pixel in the pixel row to be expanded is alpha multiplied by P, wherein alpha is the ratio of any two refreshed adjacent pixels which are in the same column with the pixel to be expanded in the original data block area, alpha is a fixed value, and P is the value of the refreshed adjacent pixels which are in the same column with the pixel to be expanded in the original data block area;
when the original data block area with incomplete refreshing is in an expanded pixel column, the value of each pixel in the pixel column to be expanded is alpha multiplied by P, wherein alpha is the ratio of any two refreshed adjacent pixels in the same row of the pixels to be expanded to the inside of the original data block area, alpha is a fixed value, and P is the value of the refreshed adjacent pixels in the same row of the pixels to be expanded to the original data block area.
Preferably, when the proportion of the pixel rows or pixel columns refreshed in the incompletely refreshed original data block area to the total pixel rows or pixel columns in the original data block area is greater than or equal to a preset threshold value, the expansion refresh processing is performed on the pixel rows or pixel columns not refreshed in the original data block area.
Preferably, in step S200, adjusting the local refresh zone range includes
And if the incomplete-refreshing original data block areas where the boundary intersection points of the partial refreshing areas are positioned select to discard or expand the refreshing processing, discarding or expanding the refreshing processing of the pixel rows or the pixel columns refreshed in the incomplete-refreshing original data block areas where the boundary intersection points are positioned.
Preferably, in step S200, adjusting the local refresh zone range includes
For the partial refresh original data block area where the boundary intersection point of the partial refresh area is located, if the partial refresh original data block area where one boundary is located selects discarding processing and the partial refresh original data block area where the other boundary is located selects expanding refresh processing, the partial refresh original data block area where the boundary intersection point is located selects discarding processing and does not perform refreshing.
The beneficial effects of the invention are as follows:
(1) When the local refreshing of any area is carried out, the invention ensures that the adjusted local refreshing area only contains the completely refreshed original data area by adjusting the range of the local refreshing area, and ensures that all data blocks in the local refreshing area can be correctly compressed, stored and decompressed, thereby enabling a system needing to compress, store, decompress and the like the display image to support the local refreshing of any display area and effectively avoiding abnormal effects such as messy codes, screen images and the like in the local refreshing display process of the image.
(2) The invention uses the same compression and decompression algorithm for the data blocks in the local refreshing area and the data blocks outside the local refreshing area, and does not need to additionally add new compression and decompression algorithm and flow, so that the compression and decompression algorithm processing flow of the system is completely unified in different display modes, the complexity of the system is reduced, the storage space of a frame buffer is saved, and the area, the cost and the power consumption of a display driving chip or a display bridging chip are saved.
Drawings
FIG. 1 is a flow diagram illustration of the present invention;
FIG. 2 is a block diagram of a data path architecture supporting partial refresh in accordance with the present invention;
FIG. 3 is a schematic image segmentation of the present invention;
FIG. 4 is a schematic diagram of a partial refresh region containing a fully refreshed original data block region;
FIG. 5 is a schematic diagram of a partial refresh region containing an incomplete refresh of an original data block region;
FIG. 6 is a schematic view of a partial refresh zone formed after the partial refresh zone has been extended in scope;
FIG. 7 is a schematic diagram of a partial refresh zone formed by a combination of partial refresh zone expansion and discard;
FIG. 8 is a schematic diagram of a partial refresh zone formed after the partial refresh zone removes the original data block area at the boundary interaction.
Detailed Description
The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings.
The method for supporting local refreshing of any display area disclosed by the invention is suitable for a display system or a display data path which needs to compress, store and decompress an original display picture, and can enable all data blocks in the adjusted local refreshing area to be correctly compressed, stored and decompressed through adjusting the range of the local refreshing area, so that abnormal effects such as messy codes, a screen and the like of display equipment in the image display process are avoided, the display equipment can support local refreshing of any display area, and the method is suitable for the situation that the display equipment has one local refreshing area or a plurality of local refreshing areas.
Referring to fig. 1 and 2, the method for supporting local refreshing of any display area disclosed by the invention comprises the following steps:
s100, dividing an image to be compressed into M multiplied by N original data blocks according to the resolution of the image to be compressed, compressing the M multiplied by N original data blocks and storing the compressed M multiplied by N original data blocks in a frame buffer;
Specifically, when the system is initialized, the original data block division of the display image to be compressed is set according to the display requirement. Dividing the image to be compressed into M multiplied by N original data blocks according to the resolution of the image to be compressed, wherein M is an integer greater than or equal to 1, and N is an integer greater than or equal to 1. In this embodiment, it is preferable to uniformly divide the image to be compressed into data blocks of equal size, as shown in fig. 3, the resolution of the image to be compressed is 32×32, and the image to be compressed can be divided into 8×8 data blocks, each data block containing 4×4 pixels.
Video sources, such as APs (Application Processor, application processors) and the like, transmit picture data to be displayed to a display device or display bridge chip through corresponding interfaces, such as MIPI (Mobile Industry Processor Interface ), DPI (Display Pixel Interface, display pixel interface) and the like. A display driving chip (DDIC, display Driver IC) or a display bridging chip in the display device receives the picture data to be displayed sent by the video source line by line.
Further, according to a selected compression algorithm, such as DSC algorithm, when each line of receiving an original data block of a picture to be displayed, i.e. 1×n original data blocks, the original data blocks are compressed one by one, and the size of the compressed data is determined by the compression ratio, for example, the compressed data of each original data block is compressed by adopting the compression ratio of 3:1, and the size of the compressed data of each original data block is one third of the original data, which can be selected according to the requirement, and compressed by adopting the compression ratio of 4:1, or other compression ratios.
After the compression of the 1×n original data blocks is completed, storing the compressed data corresponding to each original data block in a corresponding storage space in the frame buffer, where the original data blocks and the compressed data in the frame buffer are in a one-to-one correspondence, and storing the compressed data of each original data block in an independent storage space in the frame buffer, where the compressed data of each original data block can be accessed through an independent storage space address, including writing and reading. After the compression of the current 1×n original data blocks is completed, if the next 1×n original data block line completes reception, the compression and storage of the next 1×n original data blocks may be started.
The compressed storage of the original data blocks and the receiving of the image data can be performed in parallel, that is, when the compressed storage processing is performed on the currently received 1×n original data blocks, the image data of the next original data block row can be received at the same time, so that the compressed storage is performed in parallel until the whole display picture is completely received and compressed and stored in the frame buffer.
In this embodiment, when dividing an original data block region of an image to be compressed, the size of the original data block is divided, and the overhead and the display effect of compressing, storing and decompressing the original data block are considered, and meanwhile, the overhead and the display effect of expanding the data block to be expanded in the local refreshing region and then compressing and decompressing the expanded data block are considered, so that the original data block with a proper size is divided, and the final display effect has no obvious difference.
S200, acquiring the position and the size of a local refreshing region, judging whether the local refreshing region contains an incompletely refreshed original data block region, if so, receiving image data of the local refreshing region, adjusting the range of the local refreshing region to enable the adjusted local refreshing region to only contain the completely refreshed original data block region, further compressing and storing data blocks corresponding to the adjusted local refreshing region into a storage space corresponding to the original data block in a frame buffer, otherwise, directly receiving the image data block corresponding to the local refreshing region, compressing and storing the compressed image data block into the storage space corresponding to the original data block in the frame buffer.
Specifically, before starting to transmit the display image of the local refresh area, the video source first transmits a command to set the position of the local refresh area, typically the start line and end line and the start column and end column of the local refresh area, then sets the system display mode to the local refresh mode, and thereafter transmits the display image of the local refresh area. As shown in fig. 4, the local refresh area is set to be a rectangular area constituted by four original data block areas 1, 2, 3, 4, then the system refresh mode is set to be the local refresh mode, and then the video source transmits the display refresh image of the local refresh area, that is, the updated image data of the original data blocks 1, 2, 3, 4.
Furthermore, the display device, such as a mobile phone screen, can update certain information, such as clock or signal strength in a mobile phone main interface, by local refreshing in the use process, so that the transmitted display data volume can be reduced, and the refreshing power consumption can be reduced. The display device or the display bridge chip firstly needs to acquire the position and the size of the local refreshing region, judges whether the local refreshing region contains an incompletely refreshed original data block region, and finally receives image data of the local refreshing region, and when the display device or the display bridge chip is implemented, the AP sends local refreshing region setting commands which comprise a starting row and an ending row and a starting column and an ending column for setting the position of the local refreshing region, the position and the size of the local refreshing region can be determined through the information, after the position and the size of the local refreshing region are obtained, whether the local refreshing region contains the incompletely refreshed original data block region is further judged, and then the updated image data of the local refreshing region sent by the AP is received. The local refresh area may only include a fully refreshed original data block area, as shown in fig. 4, and is a rectangular area formed by four original data block areas 1, 2, 3, and 4, and all pixels in each original data block area may be refreshed; the partial refresh area may also include an incomplete refresh original data block area, as shown in fig. 5, where the partial refresh area is a rectangular area formed by four completely-refreshed original data block areas 1, 2, 3, and 4 and eight partially-refreshed original data block areas A, B, C, D, E, F, G, H, that is, a rectangular area formed by the original data block areas 1, 2, 3, and 4 and the lower three rows of pixels of the original data block area A, B, C, the right two columns of pixels of the original data block area A, D, E, F, and one row of pixels on the upper side of the original data block area F, G, H.
For the local refreshing region only containing the completely refreshed original data block region, the image data block corresponding to the local refreshing region is directly received without adjusting the local refreshing region, the data block corresponding to the local refreshing region is compressed by adopting a corresponding compression algorithm, such as a DSC algorithm, and the like, and then stored into a storage space corresponding to the original data block region in the frame buffer, so as to cover the compressed data of the original data block region stored in the last refreshing time, as shown in fig. 4, the local refreshing region contains four data blocks which can be completely refreshed, and respectively correspond to the storage spaces corresponding to the original data block regions 1, 2, 3 and 4 in the frame buffer.
And when the local refreshing region contains the incompletely refreshed original data block region, receiving image data of the local refreshing region, and adjusting the local refreshing region to ensure that the adjusted local refreshing region only contains the completely refreshed original data block region, so that all data blocks in the adjusted local refreshing region can be correctly compressed, stored and decompressed, and abnormal effects such as messy codes, screen patterns and the like of the display device in the image display process can be effectively avoided. Adjusting the local refresh area includes narrowing the local refresh area so that the adjusted local refresh area only contains the fully refreshed original data block area. When the range of the local refreshing area is reduced, discarding data in the partial refreshing area, which is located in the original data block area which is not completely refreshed, namely discarding the refreshed pixel rows or pixel columns in the original data block area which is not completely refreshed, and reducing the local refreshing area to only contain the original data block area which is completely refreshed. As shown in fig. 5, when the partial refresh area is narrowed, three rows of pixel data located at the lower side in the original data block area A, B, C in the partial refresh area are discarded, two columns of pixel data located at the right side in the original data block area D, E, F in the partial refresh area are discarded, and one row of pixels located at the upper side in the original data block area G, H in the partial refresh area are discarded, so that the adjusted partial refresh area contains only four original data block areas 1,2, 3, 4 that can be completely refreshed.
Adjusting the local refresh region further includes expanding the local refresh region range such that the adjusted local refresh region includes only the fully refreshed original data block region. When the range of the local refreshing area is expanded, the original data block area is subjected to expansion refreshing processing according to the data in the original data block area which is positioned in the incomplete refreshing area, so that the incomplete refreshing original data block area becomes the original data block area which is completely refreshed, namely, the pixel rows or pixel columns which are not refreshed in the incomplete refreshing original data block area are refreshed, so that all pixels in the incomplete refreshing original data block area can be refreshed, namely, the incomplete refreshing original data block area becomes the original data block area which can be completely refreshed. As shown in fig. 6, one row of pixels not refreshed on the upper side in the incompletely refreshed original data block region A, B, C is refreshed, while two columns of pixels not refreshed on the left side in the incompletely refreshed original data block region A, D, E, F are refreshed, and three rows of pixels on the lower side in the incompletely refreshed original data block region F, G, H are refreshed. By expanding the incompletely refreshed original data block regions, the modified partial refresh regions only contain the completely refreshed original data block regions A, B, C, D, 1,2, 3,4, F, G, H, and no longer include the partially refreshed original data block regions.
Further, when the extended refresh processing is performed on the original data block area that is not completely refreshed in the local refresh area, the extended refresh processing may be performed on the original data block area as follows: in the case of the original data block area that is not completely refreshed, when the pixel row is expanded, the value of each pixel in the pixel row to be expanded replicates the value of the refreshed outermost pixel in the same column as the pixel in the original data block area, when the pixel column is expanded, the value of each pixel in the pixel column to be expanded replicates the value of the refreshed outermost pixel in the same row as the pixel in the original data block area, as shown in fig. 6, the detailed description is given by taking the pixel values of the pixels in the same row in the data block as an example, the original pixel values of the first row to the fourth row in the original data block area A, B, C are P 1 1、P2 1、P3 1、P4 1 respectively, when the partial refresh is performed, the first row is kept not refreshed, the pixel value is kept unchanged, the second row to the fourth row is refreshed, and the new pixel values are P 2 2、P3 2、P4 2 respectively. Expanding by copying the values of the outermost pixel rows so that the pixel values of the pixels in the first row to the fourth row in the original data block area A, B, C are P 2 2、P2 2、P3 2、P4 2 respectively; or the value of each pixel in the pixel row or the pixel column to be expanded can be set to the same value or different values, for example, all pixels in the pixel row to be expanded are set to be full white [255, 255, 255] or black [0, 0], and the like, can also be set to be an intermediate value, and can be set according to actual requirements.
Of course, when the original data block area that is not completely refreshed is expanded by a pixel row or a pixel column, the value of the pixel row or the pixel column to be expanded can also be set as the average value of the pixel values of the row or the column refreshed in the area, that is: the method comprises the steps that when an original data block area which is not completely refreshed is in an expanded pixel row, the value of each pixel in the pixel row to be expanded is the average value of refreshed pixels which are in the same column with the pixel in the original data block area; when the pixel column is expanded, the value of each pixel in the pixel column to be expanded is the average value of the refreshed pixels in the same row as the pixel in the original data block area. As described above, the pixel values of the middle pixels of the first row through the fourth row in the original data block area A, B, C are respectively (P2 2+P3 2+P4 2)÷3、P2 2、P3 2、P4 2;
Or linearly expanding the values of the pixel rows or pixel columns to be expanded according to the pixel values in the region, namely: the method comprises the steps that when an original data block area which is not completely refreshed is in an expanded pixel row, the value of each pixel in the pixel row to be expanded is alpha multiplied by P, wherein alpha is the ratio of any two refreshed adjacent pixels which are in the same column with the pixel to be expanded in the original data block area, alpha is a fixed value, and P is the value of the refreshed adjacent pixels which are in the same column with the pixel to be expanded in the original data block area; when the original data block area with incomplete refreshing is in an expanded pixel column, the value of each pixel in the pixel column to be expanded is alpha multiplied by P, wherein alpha is the ratio of any two refreshed adjacent pixels in the same row of the pixels to be expanded to the inside of the original data block area, alpha is a fixed value, and P is the value of the refreshed adjacent pixels in the same row of the pixels to be expanded to the original data block area. If P 2 2/p3 2≈p3 2/p2 4 is approximately equal to alpha, the value of the pixel in the expanded pixel row or pixel column is alpha×p 2 2、P2 2、P3 2、P4 2.
In this embodiment, for the original data block area that needs to be expanded in pixel rows and pixel columns, the sequence of row expansion and column expansion may be set according to the display requirement or dynamically calculated according to the pixel value content, for example, the pixel rows are selected to be expanded first, then the pixel columns are expanded, or the pixel columns are selected to be expanded first, then the pixel rows are expanded, so that the incompletely refreshed original data block area becomes a completely refreshed original data block area.
As shown in fig. 6, in adjusting the local refresh zone range, the reduced local refresh range and the expanded local refresh range may be used in combination, or may be used alone, that is: the discarding process may be performed on all the pixel rows or pixel columns refreshed in the partial refresh area, or the expanding refresh process may be performed on the pixel rows or pixel columns not refreshed in the partial refresh area, or a combination of both, for example: one row of pixels not refreshed on the upper side in the incompletely refreshed original data block region A, B, C is refreshed, two columns of pixels not refreshed on the left side in the incompletely refreshed original data block region A, D, E, F are refreshed, and one row of pixels located on the upper side in the original data block F, G, H region is discarded. The partial refresh area after adjustment is made to include only the fully refreshed original data block areas A, B, C, D, 1,2, E, 3,4 by discarding and expanding the partially refreshed original data block areas as shown in fig. 7. Or a row of pixels not refreshed at the upper side in the original data block area B, C that is not completely refreshed is refreshed, while two columns of pixel data that are refreshed at the right side in the original data block area A, D, E, F are discarded, and a row of pixels that are refreshed at the upper side in the original data block area F, G, H are discarded. The partial refresh area after adjustment is made to include only the fully refreshed original data block areas B, C, 1,2,3,4 by discarding and expanding the incompletely refreshed original data block areas as shown in fig. 8.
Further, when adjusting the range of the local refresh area, the partial refresh original data block area where the boundary of the local refresh area is located may be directly set as the extended refresh processing, or the partial refresh original data block area where the boundary of the local refresh area is located may be directly set as the discard processing, so that the boundary only includes the full refresh original data block area, as shown in fig. 5, taking the original data block area A, B, C as an example, no matter how many pixel rows are refreshed, such as 1, 2, and 3, the discard processing may be directly performed on the refreshed pixel rows in the area A, B, C, so that the adjusted partial refresh area only includes the original data block areas 1 and 2 at the boundary.
Of course, the dynamic adjustment may be performed according to the proportion of the refreshed pixel rows or pixel columns to the total pixel rows or pixel columns in the original data block area, if the proportion of the refreshed pixel rows or pixel columns to the total pixel rows or pixel columns in the original data block area is smaller than or equal to the preset threshold, the refreshed pixel rows or pixel columns in the original data block area are discarded, and if the proportion of the refreshed pixel rows or pixel columns is larger than the preset threshold, the expansion refresh process is performed to the pixel rows or pixel columns in the original data block area, which may be selected according to the actual requirements. As shown in fig. 5, the preset threshold is one half, for the original data block area F, G, H, only 1 row of pixels at the lower side in each original data block area are refreshed, and the total pixel row number is 4, the refreshed pixel row is one quarter, and finally, discarding processing is selected; for the original data block regions A, B, C, three rows of pixels in each original data block region are refreshed, and the total pixel row number is 4, the refreshed pixel row ratio is three quarters, and finally the extended refresh processing is selected.
As shown in fig. 7, in the process of adjusting the refresh area range, for the original data block areas, such as the original data block areas a and F, which are not completely refreshed, where the boundary intersections of the partial refresh areas are located. If the partial refresh original data block areas where two boundaries are located select to discard, then the pixel rows or pixel columns refreshed in the partial refresh original data block areas where the boundary intersection is located are discarded, for example, the partial refresh original data block areas A, B, C where one boundary is located select to discard the pixel rows refreshed in the area, and the partial refresh original data block areas A, D, E, F where the other boundary is located select to discard the pixel columns refreshed in the area, at this time, all the refreshed pixels in the partial refresh original data block area a are discarded. If the original data block areas with incomplete refresh where two boundaries are located select the extended refresh processing, the pixel rows or pixel columns that are not refreshed in the original data block area with incomplete refresh where the intersection point of the boundaries is located perform the extended refresh processing, for example, the original data block areas A, B, C with incomplete refresh where one boundary of the local refresh area is located select the pixel rows that are not refreshed in the extended area, and the original data block areas A, D, E, F with incomplete refresh where the other boundary is located also select the pixel columns that are not refreshed in the extended area, at this time, the original data block area a with incomplete refresh performs the extended refresh processing. If the partial refresh original data block area where one boundary is located selects discarding processing and the partial refresh original data block area where the other boundary is located selects expanding refreshing processing, the partial refresh original data block area where the boundary intersection is located finally selects discarding processing, and the original data block area is not refreshed, so as to ensure that the final partial refresh area is a rectangular area.
Step S400, the compressed data of the display image stored in the frame buffer is read, and the display image is displayed in the display device after decompression.
Specifically, when displaying an image, the display driving chip reads the compressed data of the whole frame of image in the frame buffer, the compressed data of the whole frame of image is composed of the compressed data in the local refreshing region and the compressed data of the display image refreshed last time outside the local refreshing region, and the display driving chip further decompresses the compressed data of the whole frame of display image and displays the decompressed compressed data in the display panel.
If the compression, storage and decompression are completed, the display bridge chip decompresses the compressed data of the display image and then sends the decompressed display image to the following image receiving device, such as the display bridge chip or the display driving chip of the display panel, through the corresponding interface, such as MIPI, DPI, LVDS, eDP.
When the local refreshing of any area is carried out, the invention ensures that the adjusted local refreshing area does not contain the incompletely refreshed original data block area, and ensures that all data blocks in the local refreshing area can be correctly compressed, stored and decompressed, thereby enabling a system needing to compress, store, decompress and the like the display image to support the local refreshing of any display area and effectively avoiding abnormal effects such as messy codes, screen images and the like in the local refreshing display process of the image. Meanwhile, the data blocks in the local refreshing area and the data blocks outside the local refreshing area use the same compression and decompression algorithm, and new compression and decompression algorithms and processes are not needed to be additionally added, so that the compression and decompression algorithm processing processes of the system are completely unified in different display modes, the complexity of the system is reduced, the storage space of a frame buffer is saved, and the area, the cost and the power consumption of a display driving chip or a display bridging chip are saved.
While the foregoing has been disclosed in the specification and drawings, it will be apparent to those skilled in the art that various substitutions and modifications may be made without departing from the spirit of the invention, and it is intended that the scope of the invention be limited not by the specific embodiments disclosed, but by the appended claims.
Claims (8)
1. The method for supporting local refreshing of any display area is applied to a display system or a display data path for compressing, storing and decompressing an original picture, and is characterized by comprising the following steps:
s100, dividing an image to be compressed into M multiplied by N original data blocks according to the resolution of the image to be compressed, compressing the M multiplied by N original data blocks, and storing the compressed M multiplied by N original data blocks in a frame buffer, wherein M, N is an integer greater than or equal to 1;
S200, acquiring the position and the size of a local refreshing region, judging whether the local refreshing region contains an incomplete refreshing original data block region, if so, receiving image data of the local refreshing region, adjusting the range of the local refreshing region to ensure that the adjusted local refreshing region only contains the complete refreshing original data block region, further compressing and storing data blocks corresponding to the adjusted local refreshing region into a storage space corresponding to the original data block in a frame buffer, otherwise, directly receiving the image data blocks corresponding to the local refreshing region, compressing and storing the compressed image data blocks into the storage space corresponding to the original data block in the frame buffer, wherein the adjusting range of the local refreshing region comprises
For the partial refresh original data block area where the boundary intersection point of the partial refresh area is located, if the partial refresh original data block areas where the two boundaries are located select to discard or expand the refresh processing, the pixel row or the pixel column refreshed in the partial refresh original data block area where the boundary intersection point is located performs the discard or expand refresh processing,
For the incompletely refreshed original data block area where the boundary intersection point of the local refresh area is located, if the incompletely refreshed original data block area where one boundary is located selects discarding processing and the incompletely refreshed original data block area where the other boundary is located selects expanding refreshing processing, the incompletely refreshed original data block area where the boundary intersection point is located selects discarding processing and does not carry out refreshing;
S300, the compressed data of the display image stored in the frame buffer is read, decompressed and sent to the display system for display.
2. The method of claim 1, wherein in step S200, adjusting the local refresh zone range comprises narrowing the local refresh zone range, the narrowing the local refresh zone range comprising
Discarding the refreshed pixel rows or pixel columns in the incompletely refreshed original data block area.
3. The method of claim 2, wherein discarding the refreshed rows or columns of pixels in the original data block region is performed when the proportion of the refreshed rows or columns of pixels in the incompletely refreshed original data block region to the total rows or columns of pixels in the original data block region is less than or equal to a predetermined threshold.
4. The method of claim 1, wherein in step S200, adjusting the local refresh zone range comprises expanding the local refresh zone range, the expanding the local refresh zone range comprising
And carrying out expansion refreshing processing on pixel rows or pixel columns which are not refreshed in the original data block area according to the image data in the original data block area which is not completely refreshed in the partial refreshing area, so that the original data block area which is not completely refreshed is changed into an original data block area which is completely refreshed.
5. The method of claim 4, wherein the extended refresh process comprises
When the original data block area which is not completely refreshed is in an expanded pixel row, the value of each pixel in the pixel row to be expanded is copied to the value of the refreshed outermost pixel which is in the same column with the pixel in the original data block area;
When an original data block area which is not completely refreshed is used for expanding a pixel column, the value of each pixel in the pixel column to be expanded is copied to the value of the refreshed outermost pixel which is in the same row with the pixel in the original data block area;
Or alternatively
The value of each pixel in the pixel row or the pixel column to be expanded is directly set, and the value of each pixel in the pixel row or the pixel column to be expanded is set to be the same or different.
6. The method of claim 4, wherein the extended refresh process comprises
The method comprises the steps that when an original data block area which is not completely refreshed is in an expanded pixel row, the value of each pixel in the pixel row to be expanded is the average value of refreshed pixels which are in the same column with the pixel in the original data block area;
When the pixel column is expanded, the value of each pixel in the pixel column to be expanded is the average value of the refreshed pixels in the same row as the pixel in the original data block area.
7. The method of claim 4, wherein the extended refresh process comprises
The method comprises the steps that when an original data block area which is not completely refreshed is in an expanded pixel row, the value of each pixel in the pixel row to be expanded is alpha multiplied by P, wherein alpha is the ratio of any two refreshed adjacent pixels which are in the same column with the pixel to be expanded in the original data block area, alpha is a fixed value, and P is the value of the refreshed adjacent pixels which are in the same column with the pixel to be expanded in the original data block area;
when the original data block area with incomplete refreshing is in an expanded pixel column, the value of each pixel in the pixel column to be expanded is alpha multiplied by P, wherein alpha is the ratio of any two refreshed adjacent pixels in the same row of the pixels to be expanded to the inside of the original data block area, alpha is a fixed value, and P is the value of the refreshed adjacent pixels in the same row of the pixels to be expanded to the original data block area.
8. The method of claim 4, wherein the extended refresh process is performed on the pixel rows or columns not refreshed in the original data block area when the proportion of the refreshed pixel rows or pixel columns in the incompletely refreshed original data block area to the total pixel rows or pixel columns in the original data block area is greater than or equal to a preset threshold.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010923997.3A CN112073725B (en) | 2020-09-04 | 2020-09-04 | Method for supporting local refreshing of arbitrary display area |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010923997.3A CN112073725B (en) | 2020-09-04 | 2020-09-04 | Method for supporting local refreshing of arbitrary display area |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112073725A CN112073725A (en) | 2020-12-11 |
| CN112073725B true CN112073725B (en) | 2024-10-22 |
Family
ID=73665594
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010923997.3A Active CN112073725B (en) | 2020-09-04 | 2020-09-04 | Method for supporting local refreshing of arbitrary display area |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112073725B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113488001A (en) * | 2021-07-08 | 2021-10-08 | 无锡信捷电气股份有限公司 | Method for improving screen ghost on basis of software level |
| CN113781589A (en) * | 2021-08-20 | 2021-12-10 | 深圳天德钰科技股份有限公司 | Display control method, display control circuit and display device |
| CN114360468B (en) * | 2022-02-18 | 2023-04-18 | 上海铼锶信息技术有限公司 | Screen refreshing display method and system |
| CN115665396B (en) * | 2022-10-14 | 2024-05-03 | 格兰菲智能科技有限公司 | Demura compensation value decompression method and device based on code stream random access |
| CN118335020A (en) * | 2023-01-12 | 2024-07-12 | 汉朔科技股份有限公司 | Method and device for locally refreshing electronic price tag at any position |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019212907A1 (en) * | 2018-05-02 | 2019-11-07 | Apple Inc. | Electronic display partial image frame update systems and methods |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5805223A (en) * | 1994-05-25 | 1998-09-08 | Canon Kk | Image encoding apparatus having an intrapicture encoding mode and interpicture encoding mode |
| KR101373193B1 (en) * | 2012-06-29 | 2014-03-12 | 연세대학교 산학협력단 | Apparatus and method for interpolating image |
| WO2014126093A1 (en) * | 2013-02-14 | 2014-08-21 | 株式会社日立国際電気 | Image processing device |
| KR20150095051A (en) * | 2014-02-12 | 2015-08-20 | 삼성전자주식회사 | Display device and method for image update of the same |
| CN105070220B (en) * | 2015-09-11 | 2017-11-10 | 京东方科技集团股份有限公司 | A kind of display methods of display panel, display device and display device |
| CN111063309B (en) * | 2018-10-17 | 2021-08-06 | 珠海全志科技股份有限公司 | Method for refreshing irregular graph conflict, storage device and display terminal |
| CN109862366B (en) * | 2019-02-18 | 2021-07-13 | 格兰菲智能科技有限公司 | Image compression method and image processing system |
-
2020
- 2020-09-04 CN CN202010923997.3A patent/CN112073725B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019212907A1 (en) * | 2018-05-02 | 2019-11-07 | Apple Inc. | Electronic display partial image frame update systems and methods |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112073725A (en) | 2020-12-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112073725B (en) | Method for supporting local refreshing of arbitrary display area | |
| US9384524B2 (en) | Image processing apparatus and image display system | |
| US8665282B2 (en) | Image generating apparatus and image generating method and reading of image by using plural buffers to generate computer readable medium | |
| US20020190943A1 (en) | Image display apparatus | |
| US11295709B2 (en) | Method for processing image data with reduced transmission bandwidth for display | |
| JPH09281933A (en) | Data driver, liquid crystal display device and information processing device using the same | |
| US8159440B2 (en) | Controller driver and display apparatus using the same | |
| US20170345356A1 (en) | Display Driving Apparatus And Operating Method Thereof | |
| US20080303758A1 (en) | Display Device | |
| CN112004089B (en) | Method for supporting local refreshing of arbitrary display area | |
| US20120026179A1 (en) | Image processing division | |
| JP2002325253A (en) | Image information transmission apparatus, image information transmission system, and image information transmission method | |
| US20040218670A1 (en) | Method and apparatus for reducing the bandwidth required for transmitting video data for display | |
| JP2011077970A (en) | Image processor, image display system, electronic device and image processing method | |
| US20030160748A1 (en) | Display control circuit, semiconductor device, and portable device | |
| US20070109234A1 (en) | Liquid crystal display and method for driving same | |
| JP3253778B2 (en) | Display system, display control method, and electronic device | |
| KR101169994B1 (en) | Graphic image processing apparatus and method using alpha plane | |
| JP2002182639A (en) | Image processing device | |
| KR100510674B1 (en) | Memory access method for image pivot | |
| JP2024169890A (en) | Display controller and display system | |
| KR20220080314A (en) | Video display device including a frame buffer structure for outputting video of a display panel and control method thereof | |
| JP2007193159A (en) | Image display control apparatus and image display control method | |
| JP2004037632A (en) | Image display control device, display device, and electronic apparatus | |
| JPH09218820A (en) | Image processor and mapping method for image memory |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |