[go: up one dir, main page]

CN117221565A - VGTP-based image display method and device under high delay, medium and electronic equipment - Google Patents

VGTP-based image display method and device under high delay, medium and electronic equipment Download PDF

Info

Publication number
CN117221565A
CN117221565A CN202311229680.XA CN202311229680A CN117221565A CN 117221565 A CN117221565 A CN 117221565A CN 202311229680 A CN202311229680 A CN 202311229680A CN 117221565 A CN117221565 A CN 117221565A
Authority
CN
China
Prior art keywords
frames
actual
frame
vgtp
preset time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311229680.XA
Other languages
Chinese (zh)
Inventor
李魁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xian Wanxiang Electronics Technology Co Ltd
Original Assignee
Xian Wanxiang Electronics Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xian Wanxiang Electronics Technology Co Ltd filed Critical Xian Wanxiang Electronics Technology Co Ltd
Priority to CN202311229680.XA priority Critical patent/CN117221565A/en
Publication of CN117221565A publication Critical patent/CN117221565A/en
Pending legal-status Critical Current

Links

Landscapes

  • Television Systems (AREA)

Abstract

The disclosure relates to an image display method, device, medium and electronic equipment based on VGTP (video graphics transport protocol) under high delay. The method comprises the following steps: if the actual frames received by the zero terminal according to the VGTP protocol are continuous and the number of the actual frames received in the first preset time is less than the number of the target frames, the actual frames are subjected to inter-frame buffer storage in the second preset time so that the number of the buffered actual frames reaches the number of the target frames, and the buffered actual frames are decoded in the first preset time to display the corresponding pictures; if the actual frames received by the zero terminal according to the VGTP protocol are discontinuous, inserting the frames into the received actual frames in a first preset time, so that the number of the actual frames is complemented to be consistent with the number of the target frames, and decoding the complemented actual frames to display the corresponding pictures. The method and the device solve the problems of blocking, blurring, faults and the like in the image display of the VGTP protocol, and realize the normal display of the image picture under high delay.

Description

基于VGTP高延迟下的图像显示方法、装置、介质及电子设备Image display method, device, media and electronic equipment based on VGTP high delay

技术领域Technical field

本公开涉及数据传输技术领域,尤其涉及一种基于VGTP高延迟下的图像显示方法、装置、介质及电子设备。The present disclosure relates to the field of data transmission technology, and in particular to an image display method, device, medium and electronic equipment based on VGTP under high delay.

背景技术Background technique

在网络条件非常差的时候,基于人机接口的计算机图像实时压缩传输协议(VANXVM Graphic Transport Protocol,VGTP)的图像显示会遇到困难,如会出现卡顿、模糊、断层等一些问题,从而影响用户体验。When the network conditions are very poor, the computer image real-time compression transmission protocol (VANXVM Graphic Transport Protocol, VGTP) based on the human-machine interface will encounter difficulties in image display, such as freezing, blurring, faults and other problems, which will affect the user experience.

因此,有必要提供一种新的技术方案改善上述方案中存在的一个或者多个问题。Therefore, it is necessary to provide a new technical solution to improve one or more problems existing in the above solution.

需要说明的是,在上述背景技术部分公开的信息仅用于加强对本公开的背景的理解,因此可以包括不构成对本领域普通技术人员已知的现有技术的信息。It should be noted that the information disclosed in the above background section is only used to enhance understanding of the background of the present disclosure, and therefore may include information that does not constitute prior art known to those of ordinary skill in the art.

发明内容Contents of the invention

本公开的目的在于提供一种基于VGTP高延迟下的图像显示方法、装置、介质及电子设备,进而至少在一定程度上克服由于相关技术的限制和缺陷而导致的一个或者多个问题。The purpose of this disclosure is to provide an image display method, device, medium and electronic equipment based on VGTP high delay, thereby overcoming one or more problems caused by limitations and defects of related technologies, at least to a certain extent.

根据本公开实施例的第一方面,提供一种基于VGTP高延迟下的图像显示方法,该方法包括:According to a first aspect of an embodiment of the present disclosure, an image display method under high latency based on VGTP is provided. The method includes:

若零终端按照VGTP协议接收到的实际帧为连续的,且在第一预设时间内接收到的所述实际帧的数量少于目标帧的数量,则将所述实际帧在第二预设时间内进行帧间缓存,以使缓存后的所述实际帧的数量达到所述目标帧的数量,并在所述第一预设时间内对缓存后的所述实际帧进行解码,以显示其对应的画面;If the actual frames received by the zero terminal according to the VGTP protocol are continuous, and the number of actual frames received within the first preset time is less than the number of target frames, the actual frames will be sent in the second preset time. Inter-frame caching is performed within the first preset time so that the number of actual frames after buffering reaches the number of target frames, and the actual frames after buffering are decoded within the first preset time to display them. corresponding screen;

若所述零终端按照VGTP协议接收到的所述实际帧为不连续的,则在所述第一预设时间内对接收到的所述实际帧进行插帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面。If the actual frame received by the zero terminal according to the VGTP protocol is discontinuous, the actual frame received is interpolated within the first preset time, so that the actual frame is The number is completed to be consistent with the number of the target frames, and the completed actual frames are decoded to display their corresponding pictures.

本公开的实施例中,所述若所述零终端按照VGTP协议接收到的所述实际帧为不连续的,则在所述第一预设时间内对接收到的所述实际帧内进行插帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面,包括:In the embodiment of the present disclosure, if the actual frames received by the zero terminal according to the VGTP protocol are discontinuous, the actual frames received are interpolated within the first preset time. frames, so that the number of actual frames is completed to be consistent with the number of target frames, and the completed actual frames are decoded to display their corresponding pictures, including:

若所述第一预设时间内的所述实际帧只有I帧,无P帧,则在所述实际帧内插入所述P帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面。If the actual frames within the first preset time period have only I frames and no P frames, insert the P frames into the actual frames so that the number of actual frames is completed to the same number as the actual frames. The number of target frames is consistent, and the completed actual frames are decoded to display their corresponding pictures.

本公开的实施例中,所述若零终端按照VGTP协议接收到的所述实际帧为不连续的,则在所述第一预设时间内对接收到的所述实际帧内进行插帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面,包括:In the embodiment of the present disclosure, if the actual frames received by the zero terminal according to the VGTP protocol are discontinuous, frames are inserted into the actual frames received within the first preset time, In order to complete the number of actual frames to be consistent with the number of target frames, and decode the completed actual frames to display their corresponding pictures, including:

若所述零终端在所述第一预设时间内接收到的所述实际帧只有所述P帧,无所述I帧,则在所述实际帧内插入所述I帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面。If the actual frame received by the zero terminal within the first preset time is only the P frame and no I frame, then the I frame is inserted into the actual frame so that all The number of actual frames is completed until it is consistent with the number of target frames, and the completed actual frames are decoded to display corresponding pictures.

本公开的实施例中,所述若零终端按照VGTP协议接收到的所述实际帧为不连续的,则在所述第一预设时间内对接收到的所述实际帧内进行插帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面,包括:In the embodiment of the present disclosure, if the actual frames received by the zero terminal according to the VGTP protocol are discontinuous, frames are inserted into the actual frames received within the first preset time, In order to complete the number of actual frames to be consistent with the number of target frames, and decode the completed actual frames to display their corresponding pictures, including:

若所述零终端在所述第一预设时间内接收到的所述实际帧只有所述P帧,无所述I帧,则在所述实际帧内插入所述I帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面。If the actual frame received by the zero terminal within the first preset time is only the P frame and no I frame, then the I frame is inserted into the actual frame so that all The number of actual frames is completed until it is consistent with the number of target frames, and the completed actual frames are decoded to display corresponding pictures.

根据本公开实施例的第二方面,提供一种基于VGTP高延迟下的图像显示装置,该装置包括:According to a second aspect of the embodiment of the present disclosure, an image display device based on VGTP under high latency is provided. The device includes:

缓存模块,用于若零终端按照VGTP协议接收到的实际帧为连续的,且在第一预设时间内接收到的所述实际帧的数量少于目标帧,则将所述实际帧在第二预设时间内进行帧间缓存,以使缓存后的所述实际帧的数量达到所述目标帧的数量,并在所述第一预设时间内对缓存后的所述实际帧进行解码,以显示其对应的画面;A cache module configured to cache the actual frames in the first preset time if the actual frames received by the zero terminal according to the VGTP protocol are continuous and the number of actual frames received within the first preset time is less than the target frame. Perform inter-frame caching within a second preset time so that the number of cached actual frames reaches the number of target frames, and decode the cached actual frames within the first preset time, to display its corresponding screen;

插帧模块,用于若所述零终端按照VGTP协议接收到的所述实际帧为不连续的,则在所述第一预设时间内对接收到的所述实际帧进行插帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面。A frame insertion module, configured to interpolate frames within the first preset time if the actual frames received by the zero terminal according to the VGTP protocol are discontinuous, so that The number of actual frames is completed to be consistent with the number of target frames, and the completed actual frames are decoded to display corresponding pictures.

本公开的实施例中,所述插帧模块包括:In this embodiment of the present disclosure, the frame insertion module includes:

第一插帧子模块,用于若所述零终端在所述第一预设时间内接收到的所述实际帧只有I帧,无P帧,则在所述实际帧内插入所述P帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面。The first frame insertion submodule is used to insert the P frame into the actual frame if the actual frame received by the zero terminal within the first preset time is only an I frame and no P frame. , so that the number of actual frames is completed to be consistent with the number of target frames, and the completed actual frames are decoded to display their corresponding pictures.

本公开的实施例中,所述插帧模块包括:In this embodiment of the present disclosure, the frame insertion module includes:

第二插帧子模块,用于若所述零终端在所述第一预设时间内接收到的所述实际帧只有所述P帧,无所述I帧,并再插入所述P帧,则在所述实际帧内插入所述I帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面。The second frame insertion submodule is used to insert the P frame again if the actual frame received by the zero terminal within the first preset time is only the P frame and no I frame, Then insert the I frame into the actual frame so that the number of the actual frames is completed to be consistent with the number of the target frames, and the completed actual frames are decoded to display them. corresponding screen.

根据本公开实施例的第三方面,提供一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现上述任意一个实施例中所述VGTP高延迟下的图像显示方法的步骤。According to a third aspect of the embodiment of the present disclosure, there is provided a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the image display method under VGTP high delay described in any of the above embodiments is implemented. A step of.

根据本公开实施例的第四方面,提供一种电子设备,包括:According to a fourth aspect of an embodiment of the present disclosure, an electronic device is provided, including:

处理器;以及processor; and

存储器,用于存储所述处理器的可执行指令;Memory for storing executable instructions for the processor;

其中,所述处理器配置为经由执行所述可执行指令来执行上述任意一个实施例中所述VGTP高延迟下的图像显示方法的步骤。Wherein, the processor is configured to execute the steps of the image display method under VGTP high delay in any of the above embodiments by executing the executable instructions.

本公开的实施例提供的技术方案可以包括以下有益效果:The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

本公开的一种实施例中,通过上述方法,当传输到零终端的实际帧是连续的,且在第一预设时间内接收的实际帧小于目标帧,则对实际帧进行帧间缓存,使得缓存后的实际帧的数量达到目标帧的数量,并显示器对应的画面;当传输到零终端的实际帧是不连续的,则对实际帧进行插帧,使实际帧的数量补全到与目标帧的数量一致,并显示对应的画面。本公开解决了VGTP协议的图像显示时出现的卡顿、模糊及断层等问题,实现了高延迟下的图像画面正常显示。In an embodiment of the present disclosure, through the above method, when the actual frames transmitted to the zero terminal are continuous, and the actual frames received within the first preset time are less than the target frame, the actual frames are inter-frame buffered, Make the number of actual frames after buffering reach the number of target frames, and display the corresponding picture; when the actual frames transmitted to the zero terminal are discontinuous, the actual frames are interpolated so that the number of actual frames is completed to be equal to The number of target frames is consistent and the corresponding screen is displayed. This disclosure solves problems such as stuck, blur, and faults that occur when displaying images of the VGTP protocol, and achieves normal display of images under high latency.

应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本公开。It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only, and do not limit the present disclosure.

附图说明Description of drawings

此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本公开的实施例,并与说明书一起用于解释本公开的原理。显而易见地,下面描述中的附图仅仅是本公开的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure. Obviously, the drawings in the following description are only some embodiments of the present disclosure. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without exerting creative efforts.

图1示意性示出本公开示例性实施例中一种基于VGTP高延迟下的图像显示方法的步骤流程图;Figure 1 schematically shows a step flow chart of an image display method under high latency based on VGTP in an exemplary embodiment of the present disclosure;

图2示意性示出本公开示例性实施例中一种基于VGTP高延迟下的图像显示装置的框图;Figure 2 schematically shows a block diagram of an image display device based on VGTP under high latency in an exemplary embodiment of the present disclosure;

图3示意性示出本公开示例性实施例中一种程序产品示意图;Figure 3 schematically shows a schematic diagram of a program product in an exemplary embodiment of the present disclosure;

图4示意性示出本公开示例性实施例中一种电子设备示意图。FIG. 4 schematically shows a schematic diagram of an electronic device in an exemplary embodiment of the present disclosure.

具体实施方式Detailed ways

现在将参考附图更全面地描述示例实施方式。然而,示例实施方式能够以多种形式实施,且不应被理解为限于在此阐述的范例;相反,提供这些实施方式使得本公开将更加全面和完整,并将示例实施方式的构思全面地传达给本领域的技术人员。所描述的特征、结构或特性可以以任何合适的方式结合在一个或更多实施方式中。Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concepts of the example embodiments. To those skilled in the art. The described features, structures or characteristics may be combined in any suitable manner in one or more embodiments.

此外,附图仅为本公开的示意性图解,并非一定是按比例绘制。图中相同的附图标记表示相同或类似的部分,因而将省略对它们的重复描述。附图中所示的一些方框图是功能实体,不一定必须与物理或逻辑上独立的实体相对应。可以采用软件形式来实现这些功能实体,或在一个或多个硬件模块或集成电路中实现这些功能实体,或在不同网络和/或处理器装置和/或微控制器装置中实现这些功能实体。Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings represent the same or similar parts, and thus their repeated description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and/or processor devices and/or microcontroller devices.

本示例实施方式中首先提供了一种基于VGTP高延迟下的图像显示方法。参考图1中所示,该方法可以包括:This example implementation first provides an image display method under high latency based on VGTP. Referring to what is shown in Figure 1, the method may include:

步骤S101:若零终端按照VGTP协议接收到的实际帧为连续的,且在第一预设时间内接收到的所述实际帧的数量少于目标帧的数量,则将所述实际帧在第二预设时间内进行帧间缓存,以使缓存后的所述实际帧的数量达到所述目标帧的数量,并在所述第一预设时间内对缓存后的所述实际帧进行解码,以显示其对应的画面。Step S101: If the actual frames received by the zero terminal according to the VGTP protocol are continuous, and the number of actual frames received within the first preset time is less than the number of target frames, then the actual frames are Perform inter-frame caching within a second preset time so that the number of cached actual frames reaches the number of target frames, and decode the cached actual frames within the first preset time, to display its corresponding screen.

步骤S102:若所述零终端按照VGTP协议接收到的所述实际帧为不连续的,则在所述第一预设时间内对接收到的所述实际帧进行插帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面。Step S102: If the actual frame received by the zero terminal according to the VGTP protocol is discontinuous, insert the received actual frame within the first preset time so that the The number of actual frames is completed to be consistent with the number of target frames, and the completed actual frames are decoded to display corresponding pictures.

通过上述方法,当传输到零终端的实际帧是连续的,且在第一预设时间内接收的实际帧小于目标帧,则对实际帧进行帧间缓存,使得缓存后的实际帧的数量达到目标帧的数量,并显示器对应的画面;当传输到零终端的实际帧是不连续的,则对实际帧进行插帧,使实际帧的数量补全到与目标帧的数量一致,并显示对应的画面。本公开解决了VGTP协议的图像显示时出现的卡顿、模糊及断层等问题,实现了高延迟下的图像画面正常显示。Through the above method, when the actual frames transmitted to the zero terminal are continuous and the actual frames received within the first preset time are less than the target frame, the actual frames are inter-frame cached so that the number of cached actual frames reaches The number of target frames, and the corresponding screen is displayed; when the actual frames transmitted to the zero terminal are discontinuous, the actual frames are interpolated to make the number of actual frames consistent with the number of target frames, and the corresponding picture. This disclosure solves problems such as stuck, blur, and faults that occur when displaying images of the VGTP protocol, and achieves normal display of images under high latency.

下面,将参考图1对本示例实施方式中的上述方法的各个步骤进行更详细的说明。In the following, each step of the above method in this exemplary embodiment will be described in more detail with reference to FIG. 1 .

在步骤S101中,若零终端按照VGTP协议接收到的实际帧为连续的,且在第一预设时间内接收到的所述实际帧的数量少于目标帧的数量,则将所述实际帧在第二预设时间内进行帧间缓存,以使缓存后的所述实际帧的数量达到所述目标帧的数量,并在所述第一预设时间内对缓存后的所述实际帧进行解码,以显示其对应的画面。In step S101, if the actual frames received by the zero terminal according to the VGTP protocol are continuous, and the number of actual frames received within the first preset time is less than the number of target frames, then the actual frames will be Inter-frame caching is performed within the second preset time so that the number of cached actual frames reaches the number of target frames, and the cached actual frames are cached within the first preset time. Decode to display its corresponding picture.

需要理解的是,虚拟机一般对实际帧进行编码,然后将编码后的实际帧发送到零终端,零终端接收到编码后的实际帧后进行解码,使得解码后的实际帧的画面显示在零终端。但是虚拟机与零终端在通信延迟较大时,VGTP协议传输在零终端显示的时候可以分以下两种情况:What needs to be understood is that the virtual machine generally encodes the actual frame, and then sends the encoded actual frame to the zero terminal. The zero terminal receives the encoded actual frame and decodes it, so that the decoded actual frame is displayed on the zero terminal. terminal. However, when the communication delay between the virtual machine and the zero terminal is large, the VGTP protocol transmission can be divided into the following two situations when the zero terminal is displayed:

1)从虚拟机传输到零终端的实际帧是连续的,只是延迟较大,实际帧中没有丢帧的情况;1) The actual frames transmitted from the virtual machine to the zero terminal are continuous, but the delay is large, and there is no frame loss in the actual frames;

2)从虚拟机传输到零终端的实际帧是不连续的,存在丢帧的情况,导致在零终端解码的时候会出现画面不连续。2) The actual frames transmitted from the virtual machine to the zero terminal are discontinuous, and there are frame drops, resulting in discontinuous pictures when the zero terminal is decoded.

当虚拟机传输到零终端的实际帧是连续的,且零终端在第一预设时间内接收到的实际帧的数量少于目标帧的数量时,即零终端在第一预设时间内接收目标帧时出现了延迟,导致零终端在第一预设时间内只接收到了实际帧,因此,需要对实际帧做帧间缓存,具体是在第二预设时间内对实际帧做帧间缓存,以使帧间缓存后的实际帧的数量在第一预设时间内达到目标帧的数量,然后零终端在第一预设时间内对帧间缓存后的实际帧进行解码,并显示解码后的帧间缓存后的实际帧对应的画面。其中,第一预设时间、第二预设时间的设定,根据实际情况进行设定,本公开对此不做限制。目标帧为零终端在第一预设时间内设定的接收到的帧。实际帧的帧数、目标帧的帧数,可根据实际情况设定,本公开对此不做限制。When the actual frames transmitted by the virtual machine to the zero terminal are continuous and the number of actual frames received by the zero terminal within the first preset time is less than the number of target frames, that is, the zero terminal receives within the first preset time There is a delay in the target frame, causing the zero terminal to only receive the actual frame within the first preset time. Therefore, inter-frame buffering of the actual frame is required, specifically, inter-frame buffering of the actual frame within the second preset time. , so that the number of actual frames after inter-frame buffering reaches the number of target frames within the first preset time, and then the zero terminal decodes the actual frames after inter-frame buffering within the first preset time and displays the decoded The picture corresponding to the actual frame after inter-frame buffering. The first preset time and the second preset time are set according to the actual situation, and the present disclosure does not limit this. The target frame is a received frame set by the zero terminal within the first preset time. The number of actual frames and the number of target frames can be set according to actual conditions, and this disclosure does not limit this.

在一个示例性中,当第一预设时间为1S时,目标帧为60帧,实际帧为30帧,此时设置1.5s的帧间缓存,延迟0.5s来显示上一秒的画面,此时可以很好解决画面帧率不够、卡顿的问题。In an example, when the first preset time is 1S, the target frame is 60 frames and the actual frame is 30 frames. At this time, an inter-frame buffer is set for 1.5s and the picture of the previous second is displayed with a delay of 0.5s. This It can effectively solve the problem of insufficient picture frame rate and lagging.

在步骤S102中,若所述零终端按照VGTP协议接收到的所述实际帧为不连续的,则在所述第一预设时间内对接收到的所述实际帧进行插帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面。In step S102, if the actual frame received by the zero terminal according to the VGTP protocol is discontinuous, the actual frame received is interpolated within the first preset time, so that the actual frame will be The number of actual frames is completed to be consistent with the number of target frames, and the completed actual frames are decoded to display corresponding pictures.

需要理解的是,当虚拟机传输到零终端的实际帧是不连续的时候,需要对实际帧进行插帧,使实际帧的数量补全到与目标帧的数量一致,然后在零终端对补全后的实际帧进行解码,并显示补全后的实际帧对应的画面。What needs to be understood is that when the actual frames transmitted by the virtual machine to the zero terminal are discontinuous, the actual frames need to be interpolated to make the number of actual frames consistent with the number of target frames, and then supplemented on the zero terminal. The completed actual frame is decoded and the picture corresponding to the completed actual frame is displayed.

还需要理解的是,对实际帧进行插帧,使得实际帧的数量补全到与目标帧的数量一致时,分为两种情况,一种是零终端在第一预设时间内接收到的实际帧只有I帧,没有P帧,另一种是零终端在第一预设时间内的实际帧只有P帧,没有I帧。需要根据情况对实际帧进行插帧补全。对实际帧进行插帧补全的具体方式在下述实施例中阐述,此处不做赘述。It also needs to be understood that when the actual frames are interpolated so that the number of actual frames is consistent with the number of target frames, there are two situations. One is that the zero terminal receives it within the first preset time. The actual frames are only I frames and no P frames. The other is that the actual frames of the zero terminal within the first preset time are only P frames and no I frames. Actual frames need to be interpolated and completed according to the situation. The specific method of interpolating frame completion for actual frames is explained in the following embodiments, and will not be described again here.

在一个实施例中,所述若所述零终端按照VGTP协议接收到的所述实际帧为不连续的,则在所述第一预设时间内对接收到的所述实际帧内进行插帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面,包括:In one embodiment, if the actual frames received by the zero terminal according to the VGTP protocol are discontinuous, frames are inserted into the actual frames received within the first preset time. , so that the number of actual frames is completed to be consistent with the number of target frames, and the completed actual frames are decoded to display their corresponding pictures, including:

若所述零终端在所述第一预设时间内接收到的所述实际帧只有I帧,无P帧,则在所述实际帧内插入所述P帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面。If the actual frame received by the zero terminal within the first preset time is only an I frame and no P frame, the P frame is inserted into the actual frame so that the actual frame is The number is completed to be consistent with the number of the target frames, and the completed actual frames are decoded to display their corresponding pictures.

需要理解的是,当零终端在第一预设时间内接收到的实际帧中只存在I帧,不存在P帧时,在此种情况下,对实际帧进行插帧时,只需要在实际帧内插入P帧即可,实现对实际帧插帧后,将实际帧的数量补全到与目标帧的数量一致,然后在零终端对补全后的实际帧进行解码,以显示解码补全后的实际帧对应的画面。It should be understood that when there are only I frames and no P frames among the actual frames received by the zero terminal within the first preset time, in this case, when interpolating the actual frames, only the actual frames need to be inserted. Just insert P frames into the frame. After inserting the actual frame, complete the number of actual frames to be consistent with the number of target frames, and then decode the completed actual frames on the zero terminal to display the decoding completion. The picture corresponding to the actual frame after.

在一个示例性中,第一预设时间为1s,目标帧为60帧时,传输1s的实际帧只有I帧,没有P帧,此时可以采用插帧的方式,补全60帧画面,再在零终端(也即显示器)显示。In an example, when the first preset time is 1s and the target frame is 60 frames, the actual frames transmitted for 1s are only I frames and no P frames. At this time, frame interpolation can be used to complete the 60 frames, and then Displayed on the zero terminal (that is, the monitor).

在一个实施例中,所述若零终端按照VGTP协议接收到的所述实际帧为不连续的,则在所述第一预设时间内对接收到的所述实际帧内进行插帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面,包括:In one embodiment, if the actual frames received by the zero terminal according to the VGTP protocol are discontinuous, frames are inserted into the actual frames received within the first preset time, so as to Completing the number of actual frames to be consistent with the number of target frames, and decoding the completed actual frames to display their corresponding pictures, including:

若所述零终端在所述第一预设时间内接收到的所述实际帧只有所述P帧,无所述I帧,则在所述实际帧内插入所述I帧,并再插入所述P帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面。If the actual frame received by the zero terminal within the first preset time is only the P frame and no I frame, then insert the I frame into the actual frame, and then insert all the frames. The P frame is configured so that the number of actual frames is completed to be consistent with the number of target frames, and the completed actual frames are decoded to display their corresponding pictures.

需要理解的是,当零终端在第一预设时间内接收到的实际帧中只存在P帧,不存在I帧时,此时画面会不清晰,在此种情况下,需要立即向虚拟机请求I帧,以使虚拟机将I帧发送到零终端,即对实际帧进行插帧。也就是说只需要在实际帧内插入I帧,补全这个画面,随后在插入P帧,补全到目标帧,实现对实际帧进行插帧,使实际帧的数量补全到与目标帧的数量一致,然后在零终端对补全后的实际帧进行解码,以显示解码补全后的实际帧对应的画面。What needs to be understood is that when there are only P frames and no I frames among the actual frames received by the zero terminal within the first preset time, the picture will not be clear at this time. In this case, you need to immediately report to the virtual machine Request an I frame so that the virtual machine sends the I frame to the zero terminal, i.e. interpolates the actual frame. That is to say, you only need to insert an I frame into the actual frame to complete the picture, and then insert a P frame to complete it to the target frame, so as to interpolate the actual frame so that the number of actual frames is completed to the same as the target frame. The numbers are consistent, and then the completed actual frame is decoded on the zero terminal to display the picture corresponding to the decoded and completed actual frame.

在一个示例性中,第一预设时间为为1s,目标帧为60帧时,传输1s内只有P帧,没有I帧,此时画面会不清晰,此时需要立即向虚拟机请求传输I帧,来补全这个画面,随后在插入P帧,补全60帧,再在零终端(也即显示器)显示。In an example, when the first preset time is 1s and the target frame is 60 frames, only P frames and no I frames are transmitted within 1 second. At this time, the picture will not be clear. At this time, you need to immediately request the virtual machine to transmit I frames. frames to complete the picture, and then insert P frames to complete 60 frames, and then display them on the zero terminal (that is, the monitor).

需要说明的是,尽管在附图中以特定顺序描述了本公开中方法的各个步骤,但是,这并非要求或者暗示必须按照该特定顺序来执行这些步骤,或是必须执行全部所示的步骤才能实现期望的结果。附加的或备选的,可以省略某些步骤,将多个步骤合并为一个步骤执行,以及/或者将一个步骤分解为多个步骤执行等。另外,也易于理解的是,这些步骤可以是例如在多个模块/进程/线程中同步或异步执行。It should be noted that although the various steps of the method in the present disclosure are described in a specific order in the drawings, this does not require or imply that these steps must be performed in this specific order, or that all of the steps shown must be performed. Achieve desired results. Additionally or alternatively, certain steps may be omitted, multiple steps may be combined into one step for execution, and/or one step may be decomposed into multiple steps for execution, etc. Additionally, it is also readily understood that these steps may be performed synchronously or asynchronously, for example, in multiple modules/processes/threads.

进一步的,本示例实施方式中,还提供了一种基于VGTP高延迟下的图像显示装置。参考图2中所示,装置200可以包括缓存模块201和插帧模块202。Furthermore, in this exemplary embodiment, an image display device based on VGTP under high latency is also provided. Referring to what is shown in FIG. 2 , the device 200 may include a cache module 201 and a frame insertion module 202 .

其中,缓存模块201,用于若零终端按照VGTP协议接收到的实际帧为连续的,且在第一预设时间内接收到的所述实际帧的数量少于目标帧的数量,则将所述实际帧在第二预设时间内进行帧间缓存,以使缓存后的所述实际帧的数量达到所述目标帧的数量,并在所述第一预设时间内对缓存后的所述实际帧进行解码,以显示其对应的画面。Among them, the cache module 201 is used to cache all the actual frames received by the zero terminal according to the VGTP protocol if they are continuous and the number of actual frames received within the first preset time is less than the number of target frames. The actual frames are inter-frame cached within the second preset time, so that the number of cached actual frames reaches the number of the target frames, and the cached said frames are cached within the first preset time. The actual frame is decoded to display its corresponding picture.

插帧模块202,用于若所述零终端按照VGTP协议接收到的所述实际帧为不连续的,则在所述第一预设时间内对接收到的所述实际帧进行插帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面。The frame insertion module 202 is configured to interpolate frames within the first preset time if the actual frames received by the zero terminal according to the VGTP protocol are discontinuous, so as to The number of actual frames is completed to be consistent with the number of target frames, and the completed actual frames are decoded to display corresponding pictures.

在一个实施例中,所述插帧模块202包括:In one embodiment, the frame insertion module 202 includes:

第一插帧子模块,用于若所述零终端在所述第一预设时间内接收到的所述实际帧只有I帧,无P帧,则在所述实际帧内插入所述P帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面。The first frame insertion submodule is used to insert the P frame into the actual frame if the actual frame received by the zero terminal within the first preset time is only an I frame and no P frame. , so that the number of actual frames is completed to be consistent with the number of target frames, and the completed actual frames are decoded to display their corresponding pictures.

在一个实施例中,所述插帧模块202包括:In one embodiment, the frame insertion module 202 includes:

第二插帧子模块,用于若所述零终端在所述第一预设时间内接收到的所述实际帧只有所述P帧,无所述I帧,则在所述实际帧内插入所述I帧,并再插入所述P帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面。The second frame insertion submodule is used to insert the actual frame into the actual frame if the zero terminal receives only the P frame and no I frame within the first preset time. The I frame, and then insert the P frame, so that the number of the actual frames is completed to be consistent with the number of the target frames, and the completed actual frames are decoded to display them. corresponding screen.

关于上述实施例中的装置,其中各个模块执行操作的具体方式已经在有关该方法的实施例中进行了详细描述,此处将不做详细阐述说明。Regarding the devices in the above embodiments, the specific manner in which each module performs operations has been described in detail in the embodiments related to the method, and will not be described in detail here.

应当注意,尽管在上文详细描述中提及了用于动作执行的设备的若干模块或者单元,但是这种划分并非强制性的。实际上,根据本公开的实施方式,上文描述的两个或更多模块或者单元的特征和功能可以在一个模块或者单元中具体化。反之,上文描述的一个模块或者单元的特征和功能可以进一步划分为由多个模块或者单元来具体化。作为模块或单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本公开方案的目的。本领域普通技术人员在不付出创造性劳动的情况下,即可以理解并实施。It should be noted that although several modules or units of equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to embodiments of the present disclosure, the features and functions of two or more modules or units described above may be embodied in one module or unit. Conversely, the features and functions of one module or unit described above may be further divided into being embodied by multiple modules or units. Components shown as modules or units may or may not be physical units, that is, they may be located in one place, or they may be distributed over multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the disclosed solution. Persons of ordinary skill in the art can understand and implement the method without any creative effort.

在本公开的示例性实施例中,还提供了一种计算机可读存储介质,其上存储有计算机程序,该程序被列入处理器执行时可以实现上述任意一个实施例中所述基于VGTP高延迟下的图像显示方法的步骤。在一些可能的实施方式中,本发明的各个方面还可以实现为一种程序产品的形式,其包括程序代码,当所述程序产品在终端设备上运行时,所述程序代码用于使所述终端设备执行本说明书上述基于VGTP高延迟下的图像显示方法部分中描述的根据本发明各种示例性实施方式的步骤。In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided, on which a computer program is stored. When the program is included in the execution of the processor, it can realize the VGTP-based high-speed operation described in any of the above embodiments. Image display method steps under delay. In some possible implementations, various aspects of the present invention can also be implemented in the form of a program product, which includes program code. When the program product is run on a terminal device, the program code is used to cause the The terminal device performs the steps according to various exemplary embodiments of the present invention described in the above-mentioned VGTP-based image display method under high delay section of this specification.

参考图3所示,描述了根据本发明的实施方式的用于实现上述方法的程序产品300,其可以采用便携式紧凑盘只读存储器(CD-ROM)并包括程序代码,并可以在终端设备,例如个人电脑上运行。然而,本发明的程序产品不限于此,在本文件中,可读存储介质可以是任何包含或存储程序的有形介质,该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。Referring to Figure 3, a program product 300 for implementing the above method according to an embodiment of the present invention is described, which can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be used on a terminal device, For example, run on a personal computer. However, the program product of the present invention is not limited thereto. In this document, a readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, apparatus or device.

所述程序产品可以采用一个或多个可读介质的任意组合。可读介质可以是可读信号介质或者可读存储介质。可读存储介质例如可以为但不限于电、磁、光、电磁、红外线或半导体的系统、装置或器件,或者任意以上的组合。可读存储介质的更具体的例子(非穷举的列表)包括:具有一个或多个导线的电连接、便携式盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑盘只读存储器(CD-ROM)、光存储器件、磁存储器件或者上述的任意合适的组合。The program product may take the form of any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared or semiconductor system, device or device, or any combination thereof. More specific examples (non-exhaustive list) of readable storage media include: electrical connection with one or more conductors, portable disk, hard disk, random access memory (RAM), read only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.

所述计算机可读存储介质可以包括在基带中或者作为载波一部分传播的数据信号,其中承载了可读程序代码。这种传播的数据信号可以采用多种形式,包括但不限于电磁信号、光信号或上述的任意合适的组合。可读存储介质还可以是可读存储介质以外的任何可读介质,该可读介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。可读存储介质上包含的程序代码可以用任何适当的介质传输,包括但不限于无线、有线、光缆、RF等等,或者上述的任意合适的组合。The computer-readable storage medium may include a data signal propagated in baseband or as part of a carrier wave carrying readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A readable storage medium may also be any readable medium other than a readable storage medium that can transmit, propagate, or transport the program for use by or in connection with an instruction execution system, apparatus, or device. Program code contained on a readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the above.

可以以一种或多种程序设计语言的任意组合来编写用于执行本发明操作的程序代码,所述程序设计语言包括面向对象的程序设计语言—诸如Java、C++等,还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算设备上执行、部分地在用户设备上执行、作为一个独立的软件包执行、部分在用户计算设备上部分在远程计算设备上执行或者完全在远程计算设备或服务器上执行。在涉及远程计算设备的情形中,远程计算设备可以通过任意种类的网络,包括局域网(LAN)或广域网(WAN),连接到用户计算设备,或者,可以连接到外部计算设备(例如利用因特网服务提供商来通过因特网连接)。Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., as well as conventional procedural Programming language—such as "C" or a similar programming language. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device or entirely on the remote computing device or server implement. In situations involving remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device, such as provided by an Internet service. (business comes via Internet connection).

在本公开的示例性实施例中,还提供一种电子设备,该电子设备可以包括处理器,以及用于存储所述处理器的可执行指令的存储器。其中,所述处理器配置为经由执行所述可执行指令来执行上述任意一个实施例中所述基于VGTP高延迟下的图像显示方法的步骤。In an exemplary embodiment of the present disclosure, an electronic device is also provided, and the electronic device may include a processor, and a memory for storing executable instructions of the processor. Wherein, the processor is configured to execute the steps of the image display method based on VGTP high delay in any of the above embodiments by executing the executable instructions.

所属技术领域的技术人员能够理解,本发明的各个方面可以实现为系统、方法或程序产品。因此,本发明的各个方面可以具体实现为以下形式,即:完全的硬件实施方式、完全的软件实施方式(包括固件、微代码等),或硬件和软件方面结合的实施方式,这里可以统称为“电路”、“模块”或“系统”。Those skilled in the art will understand that various aspects of the present invention may be implemented as systems, methods or program products. Therefore, various aspects of the present invention can be implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software implementations, which may be collectively referred to herein as "Circuit", "Module" or "System".

下面参照图4来描述根据本发明的这种实施方式的电子设备600。图4显示的电子设备600仅仅是一个示例,不应对本发明实施例的功能和使用范围带来任何限制。An electronic device 600 according to this embodiment of the invention is described below with reference to FIG. 4 . The electronic device 600 shown in FIG. 4 is only an example and should not bring any limitations to the functions and scope of use of the embodiments of the present invention.

如图4所示,电子设备600以通用计算设备的形式表现。电子设备600的组件可以包括但不限于:至少一个处理单元610、至少一个存储单元620、连接不同系统组件(包括存储单元620和处理单元610)的总线630、显示单元640等。As shown in Figure 4, electronic device 600 is embodied in the form of a general computing device. The components of the electronic device 600 may include, but are not limited to: at least one processing unit 610, at least one storage unit 620, a bus 630 connecting different system components (including the storage unit 620 and the processing unit 610), a display unit 640, and the like.

其中,所述存储单元存储有程序代码,所述程序代码可以被所述处理单元610执行,使得所述处理单元610执行本说明书上述基于VGTP高延迟下的图像显示方法部分中描述的根据本发明各种示例性实施方式的步骤。例如,所述处理单元610可以执行如图1中所示的步骤。Wherein, the storage unit stores program code, and the program code can be executed by the processing unit 610, so that the processing unit 610 executes the image display method according to the present invention based on VGTP under high delay in this specification. Steps of Various Exemplary Embodiments. For example, the processing unit 610 may perform steps as shown in FIG. 1 .

所述存储单元620可以包括易失性存储单元形式的可读介质,例如随机存取存储单元(RAM)6201和/或高速缓存存储单元6202,还可以进一步包括只读存储单元(ROM)6203。The storage unit 620 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 6201 and/or a cache storage unit 6202, and may further include a read-only storage unit (ROM) 6203.

所述存储单元620还可以包括具有一组(至少一个)程序模块6205的程序/实用工具6204,这样的程序模块6205包括但不限于:操作系统、一个或者多个应用程序、其它程序模块以及程序数据,这些示例中的每一个或某种组合中可能包括网络环境的实现。The storage unit 620 may also include a program/utility 6204 having a set of (at least one) program modules 6205 including, but not limited to: an operating system, one or more applications, other program modules, and programs. Data, each of these examples or some combination may include an implementation of a network environment.

总线630可以为表示几类总线结构中的一种或多种,包括存储单元总线或者存储单元控制器、外围总线、图形加速端口、处理单元或者使用多种总线结构中的任意总线结构的局域总线。Bus 630 may be a local area representing one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, a graphics acceleration port, a processing unit, or using any of a variety of bus structures. bus.

电子设备600也可以与一个或多个外部设备700(例如键盘、指向设备、蓝牙设备等)通信,还可与一个或者多个使得用户能与该电子设备600交互的设备通信,和/或与使得该电子设备600能与一个或多个其它计算设备进行通信的任何设备(例如路由器、调制解调器等等)通信。这种通信可以通过输入/输出(I/O)接口650进行。并且,电子设备600还可以通过网络适配器660与一个或者多个网络(例如局域网(LAN),广域网(WAN)和/或公共网络,例如因特网)通信。网络适配器660可以通过总线630与电子设备600的其它模块通信。应当明白,尽管图中未示出,可以结合电子设备600使用其它硬件和/或软件模块,包括但不限于:微代码、设备驱动器、冗余处理单元、外部磁盘驱动阵列、RAID系统、磁带驱动器以及数据备份存储系统等。Electronic device 600 may also communicate with one or more external devices 700 (e.g., keyboard, pointing device, Bluetooth device, etc.), may also communicate with one or more devices that enable a user to interact with electronic device 600, and/or with Any device (eg, router, modem, etc.) that enables the electronic device 600 to communicate with one or more other computing devices. This communication may occur through input/output (I/O) interface 650. Furthermore, the electronic device 600 may also communicate with one or more networks (eg, a local area network (LAN), a wide area network (WAN), and/or a public network, such as the Internet) through the network adapter 660. Network adapter 660 may communicate with other modules of electronic device 600 via bus 630. It should be understood that, although not shown in the figures, other hardware and/or software modules may be used in conjunction with electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives And data backup storage system, etc.

通过以上的实施方式的描述,本领域的技术人员易于理解,这里描述的示例实施方式可以通过软件实现,也可以通过软件结合必要的硬件的方式来实现。因此,根据本公开实施方式的技术方案可以以软件产品的形式体现出来,该软件产品可以存储在一个非易失性存储介质(可以是CD-ROM,U盘,移动硬盘等)中或网络上,包括若干指令以使得一台计算设备(可以是个人计算机、服务器或者网络设备等)执行根据本公开实施方式的上述基于VGTP高延迟下的图像显示方法。Through the above description of the embodiments, those skilled in the art can easily understand that the example embodiments described here can be implemented by software, or can be implemented by software combined with necessary hardware. Therefore, the technical solution according to the embodiment of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, U disk, mobile hard disk, etc.) or on the network , including several instructions to cause a computing device (which may be a personal computer, a server or a network device, etc.) to execute the above-described VGTP-based image display method under high latency according to an embodiment of the present disclosure.

本领域技术人员在考虑说明书及实践这里公开的发明后,将容易想到本公开的其它实施方案。本申请旨在涵盖本公开的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本公开的真正范围和精神由所附的权利要求指出。Other embodiments of the disclosure will be readily apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure that follow the general principles of the disclosure and include common common sense or customary technical means in the technical field that are not disclosed in the disclosure. . It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

Claims (8)

1.一种基于VGTP高延迟下的图像显示方法,其特征在于,该方法包括:1. An image display method based on VGTP under high latency, characterized in that the method includes: 若零终端按照VGTP协议接收到的实际帧为连续的,且在第一预设时间内接收到的所述实际帧的数量少于目标帧的数量,则将所述实际帧在第二预设时间内进行帧间缓存,以使缓存后的所述实际帧的数量达到所述目标帧的数量,并在所述第一预设时间内对缓存后的所述实际帧进行解码,以显示其对应的画面;If the actual frames received by the zero terminal according to the VGTP protocol are continuous, and the number of actual frames received within the first preset time is less than the number of target frames, the actual frames will be sent in the second preset time. Inter-frame caching is performed within the first preset time so that the number of cached actual frames reaches the number of target frames, and the cached actual frames are decoded within the first preset time to display them. corresponding screen; 若所述零终端按照VGTP协议接收到的所述实际帧为不连续的,则在所述第一预设时间内对接收到的所述实际帧进行插帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面。If the actual frame received by the zero terminal according to the VGTP protocol is discontinuous, the actual frame received is interpolated within the first preset time, so that the actual frame is The number is completed to be consistent with the number of the target frames, and the completed actual frames are decoded to display their corresponding pictures. 2.根据权利要求1所述的基于VGTP高延迟下的图像显示方法,其特征在于,所述若所述零终端按照VGTP协议接收到的所述实际帧为不连续的,则在所述第一预设时间内对接收到的所述实际帧内进行插帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面,包括:2. The image display method based on VGTP high delay according to claim 1, characterized in that if the actual frame received by the zero terminal according to the VGTP protocol is discontinuous, then in the first Interpolate frames within the received actual frames within a preset time so as to complete the number of actual frames to be consistent with the number of target frames, and perform an interpolation on the completed actual frames. Decode to display its corresponding picture, including: 若所述零终端在所述第一预设时间内接收到的所述实际帧只有I帧,无P帧,则在所述实际帧内插入所述P帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面。If the actual frame received by the zero terminal within the first preset time is only an I frame and no P frame, the P frame is inserted into the actual frame so that the actual frame is The number is completed to be consistent with the number of the target frames, and the completed actual frames are decoded to display their corresponding pictures. 3.根据权利要求1所述的基于VGTP高延迟下的图像显示方法,其特征在于,所述若零终端按照VGTP协议接收到的所述实际帧为不连续的,则在所述第一预设时间内对接收到的所述实际帧内进行插帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面,包括:3. The image display method based on VGTP high delay according to claim 1, characterized in that if the actual frame received by the zero terminal according to the VGTP protocol is discontinuous, then in the first preset Assume that frames are interpolated within the received actual frames within a time period so that the number of actual frames is completed to be consistent with the number of target frames, and the completed actual frames are decoded, to display its corresponding screen, including: 若所述零终端在所述第一预设时间内接收到的所述实际帧只有所述P帧,无所述I帧,则在所述实际帧内插入所述I帧,并再插入所述P帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面。If the actual frame received by the zero terminal within the first preset time is only the P frame and no I frame, then insert the I frame into the actual frame, and then insert all the frames. The P frame is configured so that the number of the actual frames is completed to be consistent with the number of the target frames, and the completed actual frames are decoded to display the corresponding picture. 4.一种基于VGTP高延迟下的图像显示装置,其特征在于,该装置包括:4. An image display device based on VGTP under high latency, characterized in that the device includes: 缓存模块,用于若零终端按照VGTP协议接收到的实际帧为连续的,且在第一预设时间内接收到的所述实际帧的数量少于目标帧的数量,则将所述实际帧在第二预设时间内进行帧间缓存,以使缓存后的所述实际帧的数量达到所述目标帧的数量,并在所述第一预设时间内对缓存后的所述实际帧进行解码,以显示其对应的画面;A cache module, configured to cache the actual frames if the actual frames received by the zero terminal according to the VGTP protocol are continuous and the number of actual frames received within the first preset time is less than the number of target frames. Inter-frame caching is performed within the second preset time so that the number of cached actual frames reaches the number of target frames, and the cached actual frames are cached within the first preset time. Decode to display its corresponding picture; 插帧模块,用于若所述零终端按照VGTP协议接收到的所述实际帧为不连续的,则在所述第一预设时间内对接收到的所述实际帧进行插帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面。A frame insertion module, configured to interpolate frames within the first preset time if the actual frames received by the zero terminal according to the VGTP protocol are discontinuous, so that The number of actual frames is completed to be consistent with the number of target frames, and the completed actual frames are decoded to display corresponding pictures. 5.根据权利要求4所述的基于VGTP高延迟下的图像显示装置,其特征在于,所述插帧模块包括:5. The image display device based on VGTP high delay according to claim 4, characterized in that the frame insertion module includes: 第一插帧子模块,用于若所述零终端在所述第一预设时间内接收到的所述实际帧只有I帧,无P帧,则在所述实际帧内插入所述P帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面。The first frame insertion submodule is used to insert the P frame into the actual frame if the actual frame received by the zero terminal within the first preset time is only an I frame and no P frame. , so that the number of actual frames is completed to be consistent with the number of target frames, and the completed actual frames are decoded to display their corresponding pictures. 6.根据权利要求4所述的基于VGTP高延迟下的图像显示装置,其特征在于,所述插帧模块包括:6. The image display device based on VGTP high delay according to claim 4, characterized in that the frame insertion module includes: 第二插帧子模块,用于若所述零终端在所述第一预设时间内接收到的所述实际帧只有所述P帧,无所述I帧,则在所述实际帧内插入所述I帧,并再插入所述P帧,以使将所述实际帧的数量补全到与所述目标帧的数量一致,并对补全后的所述实际帧进行解码,以显示其对应的画面。The second frame insertion submodule is used to insert the actual frame into the actual frame if the zero terminal receives only the P frame and no I frame within the first preset time. The I frame, and then insert the P frame, so that the number of the actual frames is completed to be consistent with the number of the target frames, and the completed actual frames are decoded to display them. corresponding screen. 7.一种计算机可读存储介质,其上存储有计算机程序,其特征在于,该程序被处理器执行时实现权利要求1~3任一项所述VGTP高延迟下的图像显示方法的步骤。7. A computer-readable storage medium with a computer program stored thereon, characterized in that when the program is executed by a processor, the steps of the image display method under VGTP high delay described in any one of claims 1 to 3 are implemented. 8.一种电子设备,其特征在于,包括:8. An electronic device, characterized in that it includes: 处理器;以及processor; and 存储器,用于存储所述处理器的可执行指令;Memory for storing executable instructions for the processor; 其中,所述处理器配置为经由执行所述可执行指令来执行权利要求1~3任一项所述VGTP高延迟下的图像显示方法的步骤。Wherein, the processor is configured to execute the steps of the image display method under VGTP high delay according to any one of claims 1 to 3 by executing the executable instructions.
CN202311229680.XA 2023-09-22 2023-09-22 VGTP-based image display method and device under high delay, medium and electronic equipment Pending CN117221565A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311229680.XA CN117221565A (en) 2023-09-22 2023-09-22 VGTP-based image display method and device under high delay, medium and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311229680.XA CN117221565A (en) 2023-09-22 2023-09-22 VGTP-based image display method and device under high delay, medium and electronic equipment

Publications (1)

Publication Number Publication Date
CN117221565A true CN117221565A (en) 2023-12-12

Family

ID=89042240

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311229680.XA Pending CN117221565A (en) 2023-09-22 2023-09-22 VGTP-based image display method and device under high delay, medium and electronic equipment

Country Status (1)

Country Link
CN (1) CN117221565A (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101060633A (en) * 2006-04-17 2007-10-24 株式会社日立制作所 Image display apparatus
CN105472404A (en) * 2014-09-11 2016-04-06 成都鼎桥通信技术有限公司 Data processing method in video service

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101060633A (en) * 2006-04-17 2007-10-24 株式会社日立制作所 Image display apparatus
CN105472404A (en) * 2014-09-11 2016-04-06 成都鼎桥通信技术有限公司 Data processing method in video service

Similar Documents

Publication Publication Date Title
US9645784B2 (en) Screen splicing system and video data stream processing method
CN111221491A (en) Interaction control method and device, electronic equipment and storage medium
US12106008B2 (en) Screen sharing display method and apparatus, device, and storage medium
CN102801941B (en) A kind of embedded radio projection access device
CN113655975B (en) Image display method, image display device, electronic apparatus, and medium
CN111291244B (en) Housing information display method, device, terminal and storage medium
CN110855645B (en) Streaming media data playing method and device
CN110290398B (en) Video issuing method and device, storage medium and electronic equipment
CN115348454B (en) Video transmission processing method and terminal equipment
JP6389279B2 (en) Display interface bandwidth modulation
CN112866784A (en) Large-screen local playback control method, control system, equipment and storage medium
CN114071190B (en) Cloud application video stream processing method, related device and computer program product
CN115767149A (en) Video data transmission method and device
WO2023240835A1 (en) Video compression method, electronic device and readable storage medium
CN108391170A (en) Switch method, apparatus, television set and the storage medium of EDID files
CN117221565A (en) VGTP-based image display method and device under high delay, medium and electronic equipment
EP4510595A1 (en) Video synchronous display method and apparatus, device and medium
US12177463B2 (en) Wireless display sharing with dynamic resolution switching
CN109104581B (en) Wireless screen transmission method, system and receiving terminal
WO2024078172A1 (en) Screen display method and apparatus, device, and readable storage medium
CN114339415B (en) Client video playing method and device, electronic equipment and readable medium
CN115826898A (en) Cross-screen display method, system, device, equipment and storage medium
CN112040149A (en) Input source switching method and device of screen projector, screen projector and storage medium
CN117354558A (en) Image processing methods, devices, electronic equipment and storage media
CN118535114A (en) Picture sharing method and device for glasses, storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination