[go: up one dir, main page]

TWI504245B - A video transmission control method - Google Patents

A video transmission control method Download PDF

Info

Publication number
TWI504245B
TWI504245B TW101109361A TW101109361A TWI504245B TW I504245 B TWI504245 B TW I504245B TW 101109361 A TW101109361 A TW 101109361A TW 101109361 A TW101109361 A TW 101109361A TW I504245 B TWI504245 B TW I504245B
Authority
TW
Taiwan
Prior art keywords
packet
gateway
frame
packets
determination
Prior art date
Application number
TW101109361A
Other languages
Chinese (zh)
Other versions
TW201340688A (en
Inventor
Sheau Ru Tong
Chih Ming Chen
Huan Wen Chen
Original Assignee
Univ Nat Pingtung Sci & Tech
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Univ Nat Pingtung Sci & Tech filed Critical Univ Nat Pingtung Sci & Tech
Priority to TW101109361A priority Critical patent/TWI504245B/en
Publication of TW201340688A publication Critical patent/TW201340688A/en
Application granted granted Critical
Publication of TWI504245B publication Critical patent/TWI504245B/en

Links

Landscapes

  • Data Exchanges In Wide-Area Networks (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Description

視訊傳輸控制方法Video transmission control method

本發明係關於一種視訊傳輸控制方法,尤其是一種藉由可調式視訊壓縮標準(H.264/SVC)之資料層的優先權及視訊封包的有效性決定傳輸內容之視訊傳輸控制方法。The present invention relates to a video transmission control method, and more particularly to a video transmission control method for determining transmission content by the priority of a data layer of an adjustable video compression standard (H.264/SVC) and the validity of a video packet.

按,隨著無線通訊技術(例如:行動通訊及車載資通訊等)及家庭網路設備逐漸發展成熟,家庭網路設備與各種無線通訊網路之間可以配合網際網路(Internet)進行無縫(Seamless)連接,大幅擴展網路服務(例如:影音串流服務等)所能涵蓋的範疇。According to the development of wireless communication technologies (such as mobile communication and telematics) and home network devices, home network devices and various wireless communication networks can be seamlessly connected with the Internet ( Seamless) connectivity that greatly expands the range of network services (eg, video streaming services, etc.).

以影音串流服務為例,透過一客戶端裝置(Terminal Client)、一移動閘道器(Mobile Gateway)、一媒體伺服器(Media Server)及連接其間的異質網路(Heterogeneous Network),使用者可以擷取該伺服器的影音串流資料,例如:採用可調式視訊壓縮標準(H.264/SVC)壓縮而成的視訊資料等。其中,由於該客戶端與閘道器之間的傳輸訊號易受干擾,對網路頻寬與穩定性需求極高的影音串流資料而言,如何暢通且無縫地傳送到該客戶端裝置,仍是相關研發人員努力的目標。Take the video streaming service as an example, through a client device (Terminal Client), a mobile gateway (Mobile Gateway), a media server (Media Server), and a heterogeneous network (Heterogeneous Network) connected therebetween. The video stream data of the server can be retrieved, for example, video data compressed by an adjustable video compression standard (H.264/SVC). Among them, because the transmission signal between the client and the gateway is susceptible to interference, how to smoothly and seamlessly transmit to the client device for the video stream data with extremely high network bandwidth and stability requirements It is still the goal of the relevant R&D personnel.

以H.264/SVC視訊壓縮技術為例,其調適方式包含空間可調(Spatial Scalability,D)、時間可調(Temporal Scalability,T)及品質可調(Quality Scalability,Q)三種(如第1圖所示),各種調適方式可分為一基本層(Base Layer,例如:D0、T0或Q0)及至少一增益層(Enhancement Layer,例如:D1、T1或Q1等),該基本層僅提供基本畫面品質的資料,該增益層則提供使該基本層畫面品質提高的資料,其中,各基本層或增益層可分為數個時期(epoch),各時期可分為數個圖群(Group of Picture,GOP),各圖群可分為數個訊框(Frame),各訊框可分為數個封包(Packet)。藉此,可使得視訊資料的編解碼調適更具彈性,以符合影音串流傳輸需求。Taking H.264/SVC video compression technology as an example, the adaptation method includes three types: spatial Scalability (D), Temporal Scalability (T), and Quality Scalability (Q). As shown in the figure, various adaptation modes can be divided into a base layer (for example, D0, T0 or Q0) and at least one enhancement layer (for example, D1, T1 or Q1, etc.), and the basic layer is only provided. The basic picture quality data, the gain layer provides data for improving the quality of the base layer picture, wherein each base layer or gain layer can be divided into several periods (epoch), and each period can be divided into several groups (Group of Picture) , GOP), each group can be divided into several frames, each frame can be divided into several packets (Packet). Thereby, the encoding and decoding adaptation of the video data can be made more flexible to meet the needs of video streaming.

然而,由於三種調適方式的影像相互參考,例如:第2a、2b及2c圖所示之空間、時間及品質可調的編/解碼參考關係,使得視訊資料之間存在更複雜的相依性,在傳輸過程中,倘若發生網路壅塞(Network Congestion)情形,而導致視訊資料(例如:封包,Packet)錯誤(Fault)或遺失(Loss),將會影響到其它視訊資料的解碼結果,進而提高視訊解碼的難度。However, due to the inter-reference of the images of the three adaptation modes, for example, the space, time and quality adjustable coding/decoding reference relationship shown in Figures 2a, 2b and 2c, the video data has more complicated dependencies. During the transmission process, if a network congestion occurs, the video data (eg, Packet) is faulty or lost, which will affect the decoding result of other video data, thereby improving the video. The difficulty of decoding.

為解決上述視訊解碼問題,遂發展出視訊優先權控制(Video Priority Control)技術,其中,又可略分為速率控制(Rate-based Video Priority Control)及捨棄控制(Drop-based Video Priority Control)兩種方式,分別如下所述:In order to solve the above video decoding problem, the video priority control (Video Priority Control) technology has been developed, which can be further divided into Rate-based Video Priority Control and Drop-based Video Priority Control. The methods are as follows:

上述速率控制方式係依據接收端實際的網路壅塞狀況,在H.264/SVC傳輸層採用頻寬估計(Bandwidth Estimation)及壅塞控制(Congestion Control)等技術,即時調整欲進行傳輸的視訊資料,以進行傳輸速率控制(Rate Control)。惟,此方式在調整傳輸速率的過程中,並未考量封包遺失(Packet Loss)對後續視訊資料解碼的影響,造成無法解碼的資料佔用儲存的空間及有限的網路頻寬,不僅無法確保視訊資料傳輸的有效性,而且,可能會導致緩衝溢出(Buffer Overflow)及網路壅塞等情形。The above rate control method uses the bandwidth estimation (Bandwidth Estimation) and the congestion control (Congestion Control) technology in the H.264/SVC transmission layer to adjust the video data to be transmitted in real time according to the actual network congestion condition at the receiving end. For Rate Control. However, in the process of adjusting the transmission rate, this method does not consider the impact of packet loss (Secret Lost) on the decoding of subsequent video data, resulting in unresolvable data occupying storage space and limited network bandwidth, which cannot ensure videoconferencing. The validity of data transmission, and may cause buffer overflow (Buffer Overflow) and network congestion.

上述捨棄控制方式係依據H.264/SVC調適層資訊,採用流量分離(Traffic Splitting)技術及基於訊框優先權(Frame-priority)的捨棄(dropping)技術,依照視訊編碼的特性捨棄較不重要的資料,以便控制網路的流量,避免網路壅塞。惟,此方式僅針對時間可調相依性進行資料捨棄,並未完整考量三種可調維度(即空間、時間及品質)所造成的影響,導致具有空間及品質可調相依性的視訊解碼困難;而且,在設定調適資料的門檻值(Threshold)過於粗略,可能會造成資料過度刪減的情況。因此,導致視訊品質嚴重下降。The above discard control method is based on H.264/SVC adaptation layer information, using traffic splitting (Traffic Splitting) technology and frame-priority-based dropping technology, discarding less important according to the characteristics of video coding. Information to control network traffic and avoid network congestion. However, this method only discards data for time-adjustable dependencies, and does not fully consider the effects of three adjustable dimensions (ie, space, time, and quality), resulting in video decoding with spatial and quality-adjustable dependencies; Moreover, the threshold value (Threshold) in setting the adjustment data is too rough, which may result in excessive data deletion. As a result, the quality of video is seriously degraded.

綜上所述,習知視訊傳輸控制方法在網路壅塞時,除了會導致視訊品質下降及傳輸有效性低落,而且,在傳輸過程會有「緩衝溢出」及「資料壅塞」的疑慮,在實際使用時更衍生不同限制與缺點,確有不便之處,亟需進一步改良,提升其實用性。In summary, the conventional video transmission control method will cause video quality degradation and low transmission efficiency when the network is blocked. In addition, there will be "buffer overflow" and "data congestion" in the transmission process. When used, it has different limitations and shortcomings. It is inconvenient and needs further improvement to improve its practicability.

本發明的目的乃改良上述之缺點,以提供一種視訊傳輸控制方法,藉由H.264/SVC三種可調維度的相依性,先行過濾無法解碼的視訊資料,以提高資料傳輸的有效性。The object of the present invention is to improve the above-mentioned shortcomings, and to provide a video transmission control method, which can filter the unrepeatable video data by using the three adjustable dimensions of H.264/SVC to improve the validity of data transmission.

本發明之次一目的係提供一種視訊傳輸控制方法,基於考量H.264/SVC三種可調相依性的情形下,捨棄較不重要的視訊資料,以避免視訊品質嚴重下降。A second object of the present invention is to provide a video transmission control method that discards less important video data based on consideration of three adjustable dependencies of H.264/SVC to avoid severe degradation of video quality.

本發明全文所述之「耦接」(coupling),係指二裝置之間藉由有線實體、無線媒介或其組合(例如:異質網路)等方式,而使該二裝置之資料可以相互傳遞,係本發明所屬技術領域中具有通常知識者可以理解。The term "coupling" as used throughout the present invention means that the data of the two devices can be transmitted to each other by means of a wired entity, a wireless medium or a combination thereof (for example, a heterogeneous network). It is understood by those of ordinary skill in the art to which the present invention pertains.

本發明全文所述之「編碼相依性」(Coding Dependency),係指經過編碼的視訊串流(Video Streaming)資料,其訊框(Frame)間依據時間(T)、空間(D)或品質(Q)可調特性,而形成相互參考的性質,如第3a圖所示,訊框間依據時間(Tn ,n=0~3)、空間(Dm ,m=0~1)或品質(Qk ,k=0~1)可調特性而相互參考,惟不以此為限。舉例而言,如第3b圖所示,其中,1個圖群包含8個訊框,倘若訊框之識別碼、空間可調、時間可調及品質可調參數分別以(i,d,t,q)表示,i為訊框編號(frame number),d為空間可調參數值,t為時間可調參數值,q為空間可調參數值。則該伺服器1進行視訊編碼時,訊框(0,0,0,0)係供(0,0,0,1)、(0,1,0,0)及(1,0,1,0)作為編碼參考,其中,訊框(1,0,1,0)再供(1,0,1,1)作為編碼參考,且訊框(0,1,0,0)再供(0,1,0,1)及(1,1,1,0)作為編碼參考,其中,訊框(1,1,1,0)再供(1,1,1,1)作為編碼參考,其餘訊框係可依此類推。換言之,當各訊框解碼時,需參考供其作為編碼參考的訊框,例如:訊框(0,0,0,1)需參考(0,0,0,0)等,才能順利解碼,係本發明所屬技術領域中具有通常知識者可以理解。"Coding Dependency" as used throughout the present invention refers to encoded Video Streaming data, depending on time (T), space (D) or quality (frame). Q) Adjustable characteristics, and form a mutual reference property, as shown in Figure 3a, depending on time (T n , n = 0 to 3), space (D m , m = 0 to 1) or quality (between frames) Q k , k = 0 ~ 1) adjustable characteristics and mutual reference, but not limited to this. For example, as shown in Figure 3b, one of the groups contains 8 frames, if the frame's identification code, spatially adjustable, time-adjustable, and quality-adjustable parameters are (i, d, t, respectively). , q) means that i is the frame number, d is the spatially adjustable parameter value, t is the time adjustable parameter value, and q is the spatially adjustable parameter value. Then, when the server 1 performs video encoding, the frame (0, 0, 0, 0) is provided with (0, 0, 0, 1), (0, 1, 0, 0) and (1, 0, 1, 0) As a coding reference, the frame (1,0,1,0) is further supplied with (1,0,1,1) as the coding reference, and the frame (0,1,0,0) is re-supplied (0). , 1,0,1) and (1,1,1,0) as coding references, wherein the frame (1,1,1,0) is further provided with (1,1,1,1) as the coding reference, and the rest Frames can be deduced by analogy. In other words, when decoding each frame, refer to the frame for which it is used as a coding reference. For example, the frame (0, 0, 0, 1) needs to refer to (0, 0, 0, 0), etc., in order to decode smoothly. It will be understood by those of ordinary skill in the art to which the present invention pertains.

一種視訊傳輸控制方法,係包含:一設定程序,係由一伺服器將一串流資料之不同群組的訊框分為數個封包,待將各封包依所屬群組設定優先權後,再傳送該封包至一閘道器,由該閘道器暫存來自該伺服器的封包;及一調節程序,係由該閘道器先依據該封包之暫存容量多寡而決定是否捨棄優先權較低的封包,再判斷各封包是否皆屬於同一群組,若判斷為是,則依據該訊框間的編碼相依性將各封包視為有效或無效,若判斷為否,則傳送被視為有效之封包至一客戶端;其中,該調節程序包含:一捨棄步驟,係由該閘道器判斷該封包之暫存容量是否高於一閘道上限值,若判斷為是,則捨棄已暫存之封包中優先權最低者,若判斷為否,則繼續接收來自該伺服器的封包;一判斷步驟,係由該閘道器判斷已暫存之封包是否屬於同一群組,若判斷為是,則進行一封包過濾作業,若判斷為否,則進行一封包傳送作業;一過濾步驟,係由該閘道器進行該封包過濾作業,依據該訊框間的編碼相依性,判斷各訊框本身及其參考訊框的封包是否均已收齊,若判斷為是,則將該訊框本身之封包皆視為有效,若判斷為否,則將該訊框本身之封包皆視為無效;及一傳送步驟,係由該閘道器進行該封包傳送作業,將被視為無效的封包捨棄,再將被視為有效的封包傳送至該客戶端。A video transmission control method includes: a setting program, wherein a server divides a frame of a different stream of data into a plurality of packets, and then sets each packet according to a group priority, and then transmits The packet is sent to a gateway, and the gateway temporarily stores the packet from the server; and an adjustment procedure is determined by the gateway according to the temporary storage capacity of the packet to determine whether to discard the lower priority. The packet is further determined whether each packet belongs to the same group. If the determination is yes, the packets are regarded as valid or invalid according to the coding dependency between the frames. If the determination is no, the transmission is regarded as valid. The packet is packaged to a client; wherein the adjustment procedure includes: a discarding step, wherein the gateway determines whether the temporary storage capacity of the packet is higher than a threshold upper limit, and if the determination is yes, discarding the temporary storage If the priority of the packet is the lowest, if the judgment is no, the packet from the server is continuously received; in a determining step, it is determined by the gateway whether the temporarily stored packets belong to the same group, and if the determination is yes, Carry out one Packet filtering operation, if the determination is no, a packet transmission operation is performed; in a filtering step, the packet filtering operation is performed by the gateway, and each frame itself and its reference are judged according to the coding dependency between the frames. Whether the packet of the frame has been collected. If the judgment is yes, the packet of the frame itself is regarded as valid. If the determination is no, the packet of the frame itself is regarded as invalid; and a transmission step The packet transmission operation is performed by the gateway, and the packet deemed to be invalid is discarded, and the packet deemed to be valid is transmitted to the client.

其中,另包含一重組程序,係由該客戶端將有效封包組成該訊框,並依據該訊框間的編碼相依性修剪無法解碼之訊框。The method further includes a recombination program, wherein the client forms a valid packet into the frame, and trims the frame that cannot be decoded according to the coding dependency between the frames.

其中,該捨棄步驟,再由該閘道器判斷該暫存容量是 否高於一閘道下限值,若判斷為是,則維持目前之暫存容量,若判斷為否,則繼續接收來自該伺服器的封包,其中,該閘道下限值低於該閘道上限值。Wherein, the discarding step, and then the gateway determines that the temporary storage capacity is No higher than the lower threshold of a gateway. If the judgment is yes, the current temporary storage capacity is maintained. If the determination is negative, the packet from the server is continuously received, wherein the lower threshold of the gateway is lower than the gateway. Limit.

其中,該伺服器係先後依據該串流資料之一時間、一空間及一品質可調參數由小至大,而設定該封包之優先權由高至低。The server sequentially sets the priority of the packet from high to low according to one of the time, a space and a quality adjustable parameter of the stream data.

為讓本發明之上述及其他目的、特徵及優點能更明顯易懂,下文特舉本發明之較佳實施例,並配合所附圖式,作詳細說明如下:The above and other objects, features and advantages of the present invention will become more <RTIgt;

請參閱第4圖所示,其係本發明視訊傳輸控制方法較佳實施例之系統架構圖,其中,一閘道器(Mobile Gateway)2分別耦接一客戶端(Terminal Client)3及一伺服器(Media Server)1。該伺服器1可選為具有資料儲存功能之媒體伺服器(Media Server)等,用以解析串流(Streaming)資料之格式(例如:視訊訊框,Video Frame)、封裝(packeting)串流資料為數個封包(例如:視訊串流封包,Video Streaming Packet)、設定各封包之優先權及傳送該封包至該閘道器2。該閘道器2可選為具有資料儲存功能之移動閘道器(Mobile Gateway)等,用以暫存該伺服器1所傳送的封包及傳送有效的封包至該客戶端3,其中,該閘道器2可以依據該封包之暫存容量是否超過暫存上限,而適時地捨棄(dropping)優先權較低的封包,而且,該閘道器2會依據該封包間的編碼相依性(Coding Dependency)過濾(filtering)無法解碼的封包(即被視為〝無效〞之封包),以避免發生緩衝溢出(Buffer Overflow)或無效封包佔用網路頻寬等情形。該客戶端3可選為具有資料儲存功能之可攜式裝置(Portable Apparatus)等,用以將可以解碼的封包(即被視為〝有效〞之封包)重組成訊框資料,及依據上述編碼相依性修剪(trimming)無法解碼之訊框資料,以便進行訊框解碼(decoding)作業。藉此,使用者可以透過該客戶端3及閘道器2,而擷取該伺服器1的串流資料。在此實施例中,該串流資料係以可調式視訊壓縮標準(H.264/SVC)作為實施態樣,亦可選為其他兼具時間、空間及品質可調特性之視訊資料,在此並不設限。Referring to FIG. 4, it is a system architecture diagram of a preferred embodiment of the video transmission control method of the present invention, wherein a gateway (Mobile Gateway) 2 is coupled to a client (Terminal Client) 3 and a servo. (Media Server) 1. The server 1 can be selected as a media server (Media Server) with data storage function, etc., for parsing streaming (Streaming) data formats (eg, video frames), and packing streaming data. It is a number of packets (for example, Video Streaming Packet), sets the priority of each packet, and transmits the packet to the gateway 2. The gateway 2 can be selected as a mobile gateway with a data storage function, etc., for temporarily storing the packet transmitted by the server 1 and transmitting a valid packet to the client 3, wherein the gate 3 The tracker 2 can drop the lower priority packet in time according to whether the temporary storage capacity of the packet exceeds the temporary storage limit, and the gateway 2 according to the coding dependency between the packets (Coding) Dependency) Filters packets that cannot be decoded (that is, packets that are considered invalid) to avoid buffer overflow (Buffer Overflow) or invalid packets occupying network bandwidth. The client 3 can be selected as a portable device with a data storage function, etc., for reassembling the decodable packet (ie, the packet deemed to be valid) into the frame data, and according to the above coding. Dependency Trimming cannot decode the frame data for frame decoding. Thereby, the user can retrieve the streaming data of the server 1 through the client 3 and the gateway 2. In this embodiment, the streaming data is implemented in an adjustable video compression standard (H.264/SVC), and other video data having both time, space, and quality characteristics can be selected. There are no limits.

請參閱第5圖所示,其係本發明視訊傳輸控制方法較佳實施例之運作流程圖,其中,該視訊傳輸控制方法包含一設定程序S1及一調節程序S2。Referring to FIG. 5, it is an operational flowchart of a preferred embodiment of the video transmission control method of the present invention, wherein the video transmission control method includes a setting program S1 and an adjustment program S2.

該設定程序S1,係由該伺服器1將一串流資料之不同群組的訊框分為數個封包,待將各封包依所屬群組設定優先權後,再傳送該封包至該閘道器2,由該閘道器2暫存來自該伺服器1的封包。詳言之,當使用者欲藉由該客戶端3觀看多媒體串流時,可由該客戶端3透過該閘道器2傳送一請求訊息至該伺服器1,例如:請求某一串流資料的訊息,待該伺服器1收到該請求訊息後,會將該客戶端3所請求之串流資料,依不同H.264/SVC視訊資料層(Layer)分為不同群組(例如:epoch1、2、3、...、n),再將各群組的訊框分別封裝為數個封包,例如:視訊資訊(Video Information)、視訊資料(Video Data)及控制訊息(Control Massage)等封包,並暫存於該伺服器1,為方便進行後續程序,可先將各封包視為〝無效封包〞。其中,該伺服器1會依據各封包所屬群組的時間(T)、空間(D)及品質(Q)可調參數,而設定各封包的優先權,倘若遇到需要捨棄封包的時候,可以先捨棄優先權低的資料(即被參考次數較少的封包),而保留較重要的資料(即被參考次數較多的封包)。在本實施例中,該伺服器1係先後依據該串流資料之一時間(T)、一空間(D)及一品質(Q)可調參數由小(代表基本層)至大(代表增益層),而設定優先權由高至低。舉例而言,如下列表1所示,當該時間、空間及品質可調參數分別為0~3、0~1及0~1時,可將具有不同可調參數的視訊資料封包之優先權設為第1至16優先。In the setting program S1, the server 1 divides the frames of different groups of a stream of data into several packets, and after each packet is set according to the priority of the group, the packet is transmitted to the gateway. 2. The packet from the server 1 is temporarily stored by the gateway 2. In detail, when the user wants to watch the multimedia stream by the client 3, the client 3 can transmit a request message to the server 1 through the gateway 2, for example, requesting a certain stream of data. The message, after the server 1 receives the request message, divides the stream data requested by the client 3 into different groups according to different H.264/SVC video data layers (for example: epoch1) 2, 3, ..., n), and then package the frames of each group into several packets, for example: video information (Video Packets such as Information), Video Data, and Control Massage are temporarily stored in the server 1. To facilitate subsequent procedures, each packet can be regarded as an invalid packet. The server 1 sets the priority of each packet according to the time (T), space (D) and quality (Q) adjustable parameters of each group to which the packet belongs, if the packet needs to be discarded, First discard the data with low priority (that is, the packet with less reference time), and retain the more important data (that is, the packet with more reference times). In this embodiment, the server 1 is based on one of the stream data (T), a space (D), and a quality (Q) adjustable parameter from small (representing the base layer) to large (representing the gain). Layer), and set the priority from high to low. For example, as shown in the following list 1, when the time, space, and quality adjustable parameters are 0~3, 0~1, and 0~1, the priority of the video data packet with different adjustable parameters can be set. Priority is given to 1st to 16th.

其中,若該視訊資料封包的時間(T)、空間(D)及品質(Q)可調參數分別為0、0及0,則具有最高優先權(即第1優先);若該視訊資料封包的時間(T)、空間(D)及品質(Q)可調參數值為3、1及1,則具有最低優先權(即第16優先),其餘時間、空間及品質可調參數所代表的優先權係可依此類推。Wherein, if the time (T), space (D), and quality (Q) adjustable parameters of the video data packet are 0, 0, and 0, respectively, the highest priority (ie, the first priority); if the video data packet is included The time (T), space (D), and quality (Q) tunable values of 3, 1, and 1, have the lowest priority (ie, the 16th priority), and the remaining time, space, and quality tunable parameters represent Priority can be deduced by analogy.

接著,當該封包暫存的數量累積超過一伺服上限值(例如:300)後,該伺服器1將會開始傳送該封包至該閘道器2,而該閘道器2收到該封包後,則會暫存該封包,並依據該視訊資訊封包設定每秒傳輸的封包量等視訊資訊,接著,該閘道器2會將收到的封包狀態預設為〝無效封包〞,同時,紀錄各封包所屬群組(例如:epoch),以便進行後續判斷封包有效性之過程。Then, when the number of temporarily stored packets exceeds a servo upper limit (for example, 300), the server 1 will start transmitting the packet to the gateway 2, and the gateway 2 receives the packet. After that, the packet is temporarily stored, and video information such as the amount of packets transmitted per second is set according to the video information packet, and then the gateway device 2 presets the received packet status as an invalid packet, and Record the group to which each packet belongs (for example: epoch) for subsequent evaluation of the validity of the packet.

該調節程序S2,係由該閘道器2先依據該封包之暫存容量多寡而決定是否捨棄優先權較低的封包,再判斷各封包是否皆屬於同一群組,若判斷為「是」,則依據該訊框間 的編碼相依性將各封包視為〝有效〞或〝無效〞;若判斷為「否」,則僅傳送被視為〝有效〞之封包至該客戶端3。接著,再進行該設定步驟S1。其中,該調節程序S2包含一捨棄步驟S21、一判斷步驟S22、一過濾步驟S23及一傳送步驟S24,分別如後所述:In the adjustment program S2, the gateway device 2 determines whether to discard the packets with lower priority according to the temporary storage capacity of the packet, and then determines whether the packets belong to the same group. If the determination is yes, According to the frame The encoding dependency treats each packet as valid or invalid; if the determination is "No", only the packet deemed to be valid is transmitted to the client 3. Then, the setting step S1 is performed again. The adjustment procedure S2 includes a discarding step S21, a judging step S22, a filtering step S23, and a transmitting step S24, respectively, as follows:

該捨棄步驟S21,係由該閘道器2判斷該封包之暫存容量是否高於一閘道上限值,若判斷為「是」,則捨棄已暫存之封包中優先權最低者;若判斷為「否」,則繼續接收來自該伺服器1的封包。詳言之,當該閘道器2暫存來自該伺服器1之封包時,若該封包之暫存容量高於該閘道上限值(例如:最大暫存量之80%),則必須捨棄一部分已暫存的封包,較佳先捨棄較低優先權之視訊資料層的封包,使該暫存容量低於該閘道上限值,避免發生緩衝溢出(Buffer Overflow)的情形,其中,由於捨棄的封包屬於較低優先權之視訊資料層(即較不重要的解碼參考資料),可以避免視訊品質嚴重下降。In the step S21, the gateway 2 determines whether the temporary storage capacity of the packet is higher than a threshold of the gateway. If the determination is YES, the lowest priority among the temporarily stored packets is discarded; If no, the packet from the server 1 continues to be received. In detail, when the gateway 2 temporarily stores the packet from the server 1, if the temporary storage capacity of the packet is higher than the upper threshold of the gateway (for example, 80% of the maximum temporary storage amount), a part of the packet must be discarded. The temporarily stored packet is preferably discarded after the packet of the lower priority video data layer, so that the temporary storage capacity is lower than the upper threshold of the gateway to avoid buffer overflow (Buffer Overflow), wherein Packets are part of the lower priority video data layer (ie, less important decoding reference material) to avoid severe degradation in video quality.

此外,該閘道器2還可以進一步判斷該暫存容量是否高於一閘道下限值(例如:最大暫存量之20%),該閘道下限值低於該閘道上限值,若判斷為「是」(即介於該閘道上限值及閘道下限值之間),則可以維持目前之暫存容量;若判斷為「否」,則可以繼續接收來自該伺服器1的封包,例如:另一視訊資料層的封包。In addition, the gateway device 2 can further determine whether the temporary storage capacity is higher than a lower threshold value (for example, 20% of the maximum temporary storage amount), and the lower threshold value of the gateway is lower than the upper limit value of the gateway. If it is "Yes" (that is, between the upper threshold of the gateway and the lower limit of the gateway), the current temporary storage capacity can be maintained; if the determination is "No", the packet from the server 1 can continue to be received. For example, a packet of another video data layer.

該判斷步驟S22,係由該閘道器2判斷已暫存之封包是否屬於同一群組,若判斷為「是」,則進行該過濾步驟S23,以進行一封包過濾作業;若判斷為「否」,則進行該 傳送步驟S24,以進行一封包傳送作業。詳言之,由於該伺服器1會將不同群組的訊框依序封裝為數個封包,再傳送至該閘道器2,為防止該閘道器2暫存的封包過多,由該訊框間的編碼相依性判斷該封包是否有效時,可僅由同一群組(例如:epoch1、2、3等)的封包為依據,當該閘道器2暫存目前群組(例如:epoch1)時,若收到屬於下一群組(例如:epoch2)之封包時,即可捨棄目前群組(例如:epoch1)的無效封包,並將目前群組被視為〝有效〞之封包傳送至該客戶端3,以避免發生緩衝溢出的情形。In the determining step S22, the gateway 2 determines whether the temporarily stored packets belong to the same group. If the determination is YES, the filtering step S23 is performed to perform a packet filtering operation; if the determination is "No" Then, do this Step S24 is transmitted to perform a packet transfer operation. In detail, since the server 1 sequentially packs the frames of different groups into a plurality of packets and transmits them to the gateway 2, the frame is prevented from being excessively stored in the gateway 2 When the coding dependency determines whether the packet is valid, it may be based only on the packet of the same group (for example, epoch 1, 2, 3, etc.), when the gateway 2 temporarily stores the current group (for example: epoch1) If a packet belonging to the next group (for example: epoch2) is received, the invalid packet of the current group (for example: epoch1) can be discarded, and the packet that the current group is regarded as valid is transmitted to the client. End 3 to avoid a buffer overflow situation.

該過濾步驟S23,係由該閘道器2進行該封包過濾作業,依據該訊框間的編碼相依性,判斷各訊框本身及其參考訊框的封包是否均已收齊,若判斷為「是」,則將該訊框本身之封包皆視為〝有效〞,若判斷為「否」,則將該訊框本身之封包皆視為〝無效〞。詳言之,當該伺服器1(即編碼端)將各訊框分割為數個封包進行傳輸時,由於各訊框的封包的大小、數量及到達時間不一等因素,該客戶端3(即解碼端)依據該訊框間的編碼相依性解碼影像時,需等該訊框本身及其參考的封包收齊之後才能進行,此時,若正在進行解碼之訊框本身或其參考訊框的封包未收齊(例如:遺失等),則無法正常解碼此訊框。因此,當該閘道器2收到的訊框本身及其參考的封包皆已收齊時,才將該訊框本身之封包由〝無效〞改視為〝有效〞,若僅傳送被視為〝有效〞之封包至該客戶端3,則可避免無效資料佔用有限的網路資源。舉例說明如下所述:In the filtering step S23, the packet filtering operation is performed by the gateway device 2, and according to the coding dependencies between the frames, it is determined whether the frames of the frame itself and the reference frame of the frame are all collected, and if the judgment is “ Yes, the packet of the frame itself is considered to be valid. If the judgment is "No", the packet of the frame itself is regarded as invalid. In detail, when the server 1 (ie, the encoding end) divides the frames into a plurality of packets for transmission, the client 3 (ie, due to factors such as the size, number, and arrival time of the packets of each frame) When the decoding end decodes the image according to the coding dependency between the frames, the frame itself and the reference packet of the frame itself are collected, and then the frame itself or its reference frame is being decoded. If the packet is not collected (for example, lost, etc.), the frame cannot be decoded normally. Therefore, when the frame received by the gateway 2 and the reference packet thereof have been collected, the packet of the frame itself is regarded as invalid by the invalid tampering, and only the transmission is regarded as 〝 Valid packets to the client 3 can prevent invalid data from occupying limited network resources. An example is as follows:

請參閱第6a圖所示,其係本發明之閘道器的封包傳輸控制示意圖(一),其中,當該閘道器2收到該伺服器1所傳送的封包後,會判斷各訊框所屬的封包是否收齊,若該訊框本身及其參考訊框的封包皆已收齊,則該閘道器2會將該訊框之封包視為〝有效〞(如圖所示之〝有效封包〞V),例如:訊框(0,0,0,0)、(0,0,0,1)、(1,0,1,0)及(1,0,1,1)之封包;否則,仍視該訊框的封包為〝無效〞(如圖所示之〝無效封包〞I),例如:訊框(0,1,0,0)、(0,1,0,1)、(1,1,1,0)及(1,1,1,1)之封包,其中,訊框(0,1,0,0)及(1,1,1,1)乃本身的封包未收齊之態樣,訊框(0,1,0,1)及(1,1,1,0)則為其參考訊框的封包未收齊之態樣。其中,當該閘道器2判斷各訊框所屬的封包是否收齊的同時,仍繼續接收封包,因此,該閘道器2過濾出〝有效〞之封包後,可以再次檢查被視為〝無效〞的封包(即〝無效封包〞I)是否已能改視為〝有效〞(即〝有效封包〞V)。Please refer to FIG. 6a, which is a schematic diagram (1) of packet transmission control of the gateway device of the present invention, wherein when the gateway device 2 receives the packet transmitted by the server 1, it will judge each frame. Whether the associated packet is collected or not, if the frame itself and the reference frame of the frame are collected, the gateway 2 will treat the packet of the frame as valid (as shown in the figure) Packet 〞V), for example: packet (0,0,0,0), (0,0,0,1), (1,0,1,0) and (1,0,1,1) Otherwise, the packet of the frame is still invalid (as shown in the figure, invalid packet 〞I), for example: frame (0,1,0,0), (0,1,0,1) , (1,1,1,0) and (1,1,1,1) packets, where the frame (0,1,0,0) and (1,1,1,1) are their own packets In the case of uncollected, the frames (0, 1, 0, 1) and (1, 1, 1, 0) are the unpacked packets of their reference frame. Wherein, when the gateway device 2 determines whether the packet to which each frame belongs is collected, the packet is still received. Therefore, after the gateway device 2 filters out the valid packet, it can be checked again and is invalid. Whether the 封 packet (ie 〝 invalid packet 〞 I) can be changed to be valid (ie, valid packet 〞V).

請參閱第6b圖所示,其係本發明之閘道器的封包傳輸控制示意圖(二),其中,由於該訊框(0,1,0,0)本身及其參考訊框(0,0,0,0)的封包均已收齊,而且,該訊框(0,1,0,1)及(1,1,1,0)本身及其參考訊框(0,1,0,0)的封包均已收齊,故皆改視為〝有效〞(即〝有效封包〞V)。Please refer to FIG. 6b, which is a schematic diagram of packet transmission control of the gateway device of the present invention (2), wherein the frame (0, 1, 0, 0) itself and its reference frame (0, 0) The packets of 0,0) have been collected, and the frame (0,1,0,1) and (1,1,1,0) themselves and their reference frames (0,1,0,0) The packets have been collected, so they are all considered to be valid (ie, valid packets 〞V).

該傳送步驟S24,係由該閘道器2進行該封包傳送作業,將被視為〝無效〞的封包捨棄,再將被視為〝有效〞的封包傳送至該客戶端3。詳言之,當該閘道器2接收到下一群組(例如:epoch2)的封包時,必須將目前群組(例如:epoch1)的封包過濾及檢視作業告一段落,此時, 若有屬於目前群組之訊框的封包仍未收齊(即該訊框之封包被視為〝無效〞),例如:第6b圖所示之訊框(1,1,1,1),則該閘道器2會認為未收齊之封包已遺失,而將整個訊框的封包捨棄(即由封包暫存空間中清空),例如:第6c圖所示之訊框(1,1,1,1)。接著,該閘道器2會將目前群組中被視為〝有效〞的封包(即〝有效封包〞V)依序傳送至該客戶端3。因此,藉由該閘道器2事先將無法正常解碼的視訊串流資料(即〝無效封包〞)濾除,可以降低無效資料的傳輸量,進而提高傳輸有效性。之後,再進行該設定步驟S1,由該閘道器2持續接收來自該伺服器的其他封包,並判斷其為〝有效〞或〝無效〞。In the transmitting step S24, the packet transfer operation is performed by the gateway device 2, and the packet regarded as invalid is discarded, and the packet regarded as valid is transmitted to the client 3. In detail, when the gateway 2 receives the packet of the next group (for example, epoch2), the packet filtering and viewing operation of the current group (for example, epoch1) must be ended. If there is a packet belonging to the frame of the current group, the packet is still not collected (that is, the packet of the frame is considered invalid), for example, the frame (1, 1, 1, 1) shown in Figure 6b, Then, the gateway 2 considers that the unpacked packet has been lost, and discards the entire frame (ie, is emptied from the temporary storage space), for example, the frame shown in Figure 6c (1, 1, 1,1). Next, the gateway 2 transmits the packets (ie, the valid packets 〞V) that are considered to be valid in the current group to the client 3. Therefore, by the gateway device 2 filtering the video stream data that cannot be normally decoded (ie, the invalid packet), the transmission amount of the invalid data can be reduced, thereby improving the transmission efficiency. Thereafter, the setting step S1 is performed again, and the gateway 2 continuously receives other packets from the server and determines whether it is valid or invalid.

此外,本發明視訊傳輸控制方法還可以包含一重組程序S3,係由該客戶端3將〝有效封包〞組成該訊框,並依據該訊框間的編碼相依性修剪無法解碼之訊框。詳言之,由於該伺服器1與該閘道器2之間傳輸的無效資料(即〝無效封包〞),已由該閘道器2該訊框間的編碼相依性濾除,因此,該客戶端3收到來自該閘道器2的封包並暫存後,可以依據該訊框間的編碼相依性修剪無法解碼之訊框,即依據該訊框間的編碼相依性將無法解碼之訊框捨棄,並將可解碼之訊框轉換成影像,較佳複製可解碼之訊框以填補無法解碼之訊框,以提高使用者觀看視訊串流時的順暢度。In addition, the video transmission control method of the present invention may further comprise a reassembly procedure S3, wherein the client 3 constructs the frame by the valid packet, and trims the frame that cannot be decoded according to the coding dependency between the frames. In detail, since the invalid data (ie, the invalid packet 传输) transmitted between the server 1 and the gateway 2 has been filtered by the code dependency between the frames of the gateway 2, the After receiving the packet from the gateway 2 and temporarily storing it, the client 3 may trim the frame that cannot be decoded according to the coding dependency between the frames, that is, according to the coding dependency between the frames, the decoding cannot be decoded. The frame is discarded, and the decodable frame is converted into an image, and the frame that can be decoded is preferably copied to fill the frame that cannot be decoded, so as to improve the smoothness of the user when watching the video stream.

綜上所述,倘若採用哈利波特預告片(取自http://minarlab.mis.npust.edu.tw/AMVS)做為測試影片,並採用JSVM 9.15參考軟體編碼成H.264/SVC格式。影片 編碼參數詳細的配置資訊如下列表2所示。In summary, if the Harry Potter trailer (taken from http://minarlab.mis.npust.edu.tw/AMVS) is used as the test film, and the JSVM 9.15 reference software is used to encode H.264/SVC. format. film Detailed configuration information for the encoding parameters is shown in Table 2 below.

請參閱第7圖所示,其係本發明視訊傳輸控制方法較佳實施例之測試結果示意圖,其中,在不同位元率(Bit Rate)情況下,都可以維持高峰值雜訊比(PSNR)值,因此,在有限的網路傳輸頻寬下,不僅可以有效地傳輸影像,還可以維持一定的影像品質。Please refer to FIG. 7, which is a schematic diagram of test results of a preferred embodiment of the video transmission control method of the present invention, wherein a high peak noise ratio (PSNR) can be maintained at different bit rates. Value, therefore, under limited network transmission bandwidth, not only can the image be transmitted efficiently, but also a certain image quality can be maintained.

藉由前揭之技術手段,本發明所揭示之視訊傳輸控制方法的主要特點列舉如下:該閘道器2可以判斷該封包之暫存容量是否高於該閘道上限值,若判斷為「是」,則捨棄已暫存之封包中優先權最低者,若判斷為「否」,則繼續接收來自該伺服器1的封包;再由該閘道器2判斷已暫存之封包是否屬於同一群組,若判斷為「是」,則進行該封包過 濾作業,若判斷為「否」,則進行該封包傳送作業,該封包過濾作業係由該閘道器2依據該訊框間的編碼相依性,由未捨棄的無效封包中過濾出有效封包,並檢視所有已暫存的封包中是否仍存在有效封包;該封包傳送作業係由該閘道器2將該群組的無效封包捨棄,再傳送該群組的有效封包至該客戶端3。因此,本發明視訊傳輸控制方法係藉由H.264/SVC三種可調維度的相依性,先行過濾無法解碼的視訊資料,可以提高資料傳輸的有效性,提高使用者觀賞影片的順暢度,為本發明之功效。The main features of the video transmission control method disclosed by the present invention are as follows: The gateway device 2 can determine whether the temporary storage capacity of the packet is higher than the upper limit of the gateway, and if it is determined to be "Yes" Then, the lowest priority among the temporarily stored packets is discarded. If the determination is No, the packet from the server 1 is continuously received; and the gateway 2 determines whether the temporarily stored packets belong to the same group. Group, if the judgment is "Yes", the packet is made If the filtering operation is negative, the packet transmission operation is performed. The packet filtering operation is performed by the gateway device 2, and the valid packet is filtered by the invalid packet that is not discarded according to the coding dependency between the frames. And checking whether there is still a valid packet in all the temporarily stored packets; the packet transmission operation is discarded by the gateway 2 to invalidate the group, and then the valid packet of the group is transmitted to the client 3. Therefore, the video transmission control method of the present invention firstly filters the video data that cannot be decoded by the dependency of three adjustable dimensions of H.264/SVC, thereby improving the effectiveness of data transmission and improving the smoothness of the user watching the video. The efficacy of the invention.

再者,該伺服器1係先後依據該串流資料之時間、空間及品質可調參數由小至大(即先依據時間可調參數由小至大,再依據空間可調參數由小至大,再依據品質可調參數由小至大),而設定該封包之優先權由高至低,若該閘道器2判斷該封包之暫存容量高於一閘道上限值,可以捨棄已暫存之封包中優先權最低者,使該暫存容量低於該閘道上限值,避免發生緩衝溢出的情形,由於捨棄的封包屬於較低優先權之視訊資料層(即較不重要的解碼參考資料),可以避免視訊品質嚴重下降。因此,本發明視訊傳輸控制方法係基於考量H.264/SVC三種可調相依性的情形下,捨棄較不重要的視訊資料,可以避免視訊品質嚴重下降,提高使用者觀賞影片的清晰度,乃本發明之功效。Furthermore, the server 1 is based on the time, space and quality adjustable parameters of the stream data from small to large (that is, according to the time adjustable parameter from small to large, and then according to the spatially adjustable parameters from small to large , according to the quality adjustable parameter from small to large), and set the priority of the packet from high to low, if the gateway 2 determines that the temporary storage capacity of the packet is higher than the upper limit of a gateway, you can abandon the temporary The lowest priority among the stored packets is such that the temporary storage capacity is lower than the upper threshold of the gateway to avoid buffer overflow, since the discarded packet belongs to the lower priority video data layer (ie, the less important decoding reference) Data), can avoid serious degradation of video quality. Therefore, the video transmission control method of the present invention is based on the consideration of three adjustable dependencies of H.264/SVC, and discarding less important video data can avoid serious degradation of video quality and improve the clarity of the user watching the video. The efficacy of the invention.

雖然本發明已利用上述較佳實施例揭示,然其並非用以限定本發明,任何熟習此技藝者在不脫離本發明之精神和範圍之內,相對上述實施例進行各種更動與修改仍屬本發明所保護之技術範疇,因此本發明之保護範圍當視後附 之申請專利範圍所界定者為準。While the invention has been described in connection with the preferred embodiments described above, it is not intended to limit the scope of the invention. The technical scope of the invention is protected, and therefore the scope of protection of the present invention is attached The scope of the patent application is subject to change.

〔本發明〕〔this invention〕

1‧‧‧伺服器1‧‧‧Server

2‧‧‧閘道器2‧‧‧ gateway

3‧‧‧客戶端3‧‧‧Client

I‧‧‧無效封包I‧‧‧ Invalid packet

V‧‧‧有效封包V‧‧‧Valid packet

S1‧‧‧設定程序S1‧‧‧Setting procedure

S2‧‧‧調節程序S2‧‧‧ adjustment procedure

S21‧‧‧捨棄步驟S21‧‧‧Abandonment steps

S22‧‧‧判斷步驟S22‧‧‧ judgment steps

S23‧‧‧過濾步驟S23‧‧‧Filter step

S24‧‧‧傳送步驟S24‧‧‧Transfer steps

S3‧‧‧重組程序S3‧‧‧ Reorganization procedure

第1圖:H.264/SVC視訊壓縮技術之三種可調方式示意圖。Figure 1: Schematic diagram of three adjustable modes of H.264/SVC video compression technology.

第2a圖:H.264/SVC視訊壓縮技術之空間可調的編/解碼參考關係示意圖。Figure 2a: Schematic diagram of spatially tunable coding/decoding reference relationship for H.264/SVC video compression technology.

第2b圖:H.264/SVC視訊壓縮技術之空間可調的編/解碼參考關係示意圖。Figure 2b: Schematic diagram of spatially tunable coding/decoding reference relationship for H.264/SVC video compression technology.

第2c圖:H.264/SVC視訊壓縮技術之品質可調的編/解碼參考關係示意圖。Figure 2c: Schematic diagram of the quality-adjustable encoding/decoding reference relationship of H.264/SVC video compression technology.

第3a圖:本發明視訊傳輸控制方法較佳實施例之編碼相依性示意圖(一)。Figure 3a is a schematic diagram of coding dependencies (1) of a preferred embodiment of the video transmission control method of the present invention.

第3b圖:本發明視訊傳輸控制方法較佳實施例之編碼相依性示意圖(二)。Figure 3b is a schematic diagram of coding dependencies (2) of the preferred embodiment of the video transmission control method of the present invention.

第4圖:本發明視訊傳輸控制方法較佳實施例之系統架構圖。Figure 4 is a system architecture diagram of a preferred embodiment of the video transmission control method of the present invention.

第5圖:本發明視訊傳輸控制方法較佳實施例之運作流程圖。Figure 5 is a flow chart showing the operation of the preferred embodiment of the video transmission control method of the present invention.

第6a圖:本發明之閘道器的封包傳輸控制示意圖(一)。Figure 6a: Schematic diagram of packet transmission control of the gateway of the present invention (1).

第6b圖:本發明之閘道器的封包傳輸控制示意圖(二)。Figure 6b: Schematic diagram of packet transmission control of the gateway of the present invention (2).

第6c圖:本發明之閘道器的封包傳輸控制示意圖(三 )。Figure 6c: Schematic diagram of packet transmission control of the gateway device of the present invention (3) ).

第7圖:本發明視訊傳輸控制方法較佳實施例之測試結果示意圖。Figure 7 is a diagram showing the test results of a preferred embodiment of the video transmission control method of the present invention.

S1...設定程序S1. . . Setting procedure

S2...調節程序S2. . . Adjustment procedure

S21...捨棄步驟S21. . . Discard step

S22...判斷步驟S22. . . Judgment step

S23...過濾步驟S23. . . Filtering step

S24...傳送步驟S24. . . Transfer step

S3...重組程序S3. . . Reorganization procedure

Claims (4)

一種視訊傳輸控制方法,係包含:一設定程序,係由一伺服器將一串流資料之不同群組的訊框分為數個封包,待將各封包依所屬群組設定優先權後,再傳送該封包至一閘道器,由該閘道器暫存來自該伺服器的封包;及一調節程序,係由該閘道器先依據該封包之暫存容量多寡而決定是否捨棄優先權較低的封包,再判斷各封包是否皆屬於同一群組,若判斷為是,則依據該訊框間的編碼相依性將各封包視為有效或無效,若判斷為否,則傳送被視為有效之封包至一客戶端;其中該調節程序包含:一捨棄步驟,係由該閘道器判斷該封包之暫存容量是否高於一閘道上限值,若判斷為是,則捨棄已暫存之封包中優先權最低者,若判斷為否,則繼續接收來自該伺服器的封包;一判斷步驟,係由該閘道器判斷已暫存之封包是否屬於同一群組,若判斷為是,則進行一封包過濾作業,若判斷為否,則進行一封包傳送作業;一過濾步驟,係由該閘道器進行該封包過濾作業,依據該訊框間的編碼相依性,判斷各訊框本身及其參考訊框的封包是否均已收齊,若判斷為是,則將該訊框本身之封包皆視為有效,若判斷為否,則將該訊框本身之封包皆視為無效;及 一傳送步驟,係由該閘道器進行該封包傳送作業,將被視為無效的封包捨棄,再將被視為有效的封包傳送至該客戶端。 A video transmission control method includes: a setting program, wherein a server divides a frame of a different stream of data into a plurality of packets, and then sets each packet according to a group priority, and then transmits The packet is sent to a gateway, and the gateway temporarily stores the packet from the server; and an adjustment procedure is determined by the gateway according to the temporary storage capacity of the packet to determine whether to discard the lower priority. The packet is further determined whether each packet belongs to the same group. If the determination is yes, the packets are regarded as valid or invalid according to the coding dependency between the frames. If the determination is no, the transmission is regarded as valid. The packet is encapsulated to a client; wherein the adjustment procedure includes: a discarding step, wherein the gateway determines whether the temporary storage capacity of the packet is higher than a threshold upper limit, and if the determination is yes, discarding the temporarily stored packet If the judgment is negative, the packet from the server is continuously received; in the determining step, it is determined by the gateway whether the temporarily stored packets belong to the same group, and if the determination is yes, then One The filtering operation, if the determination is no, performs a packet transmission operation; in a filtering step, the packet filtering operation is performed by the gateway device, and the frame itself and the reference signal are judged according to the coding dependency between the frames. Whether the packets of the frame have been collected, and if the judgment is yes, the packets of the frame itself are regarded as valid. If the determination is no, the packets of the frame itself are regarded as invalid; In a transmitting step, the packet transmission operation is performed by the gateway, and the packet deemed to be invalid is discarded, and the packet deemed to be valid is transmitted to the client. 如申請專利範圍第1項所述之視訊傳輸控制方法,另包含一重組程序,係由該客戶端將有效封包組成該訊框,並依據該訊框間的編碼相依性修剪無法解碼之訊框。 The video transmission control method according to claim 1, further comprising a recombination program, wherein the client forms a valid packet into the frame, and trims the frame that cannot be decoded according to the coding dependency between the frames. . 如申請專利範圍第1項所述之視訊傳輸控制方法,其中該捨棄步驟,再由該閘道器判斷該暫存容量是否高於一閘道下限值,若判斷為是,則維持目前之暫存容量,若判斷為否,則繼續接收來自該伺服器的封包,其中,該閘道下限值低於該閘道上限值。 The video transmission control method of claim 1, wherein the discarding step determines whether the temporary storage capacity is higher than a lower threshold of the gateway, and if the determination is yes, maintaining the current The temporary storage capacity, if the determination is negative, continues to receive the packet from the server, wherein the lower threshold of the gateway is lower than the upper limit of the gateway. 如申請專利範圍第1或2項所述之視訊傳輸控制方法,其中該伺服器係先後依據該串流資料之一時間、一空間及一品質可調參數由小至大,而設定該封包之優先權由高至低。The video transmission control method according to claim 1 or 2, wherein the server sets the packet according to a time, a space and a quality adjustable parameter of the streaming data from small to large. Priority is from high to low.
TW101109361A 2012-03-19 2012-03-19 A video transmission control method TWI504245B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW101109361A TWI504245B (en) 2012-03-19 2012-03-19 A video transmission control method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW101109361A TWI504245B (en) 2012-03-19 2012-03-19 A video transmission control method

Publications (2)

Publication Number Publication Date
TW201340688A TW201340688A (en) 2013-10-01
TWI504245B true TWI504245B (en) 2015-10-11

Family

ID=49771119

Family Applications (1)

Application Number Title Priority Date Filing Date
TW101109361A TWI504245B (en) 2012-03-19 2012-03-19 A video transmission control method

Country Status (1)

Country Link
TW (1) TWI504245B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101427573A (en) * 2006-02-16 2009-05-06 维德约股份有限公司 System and method for thinning of scalable video coding bit-streams
TW201008293A (en) * 2008-08-06 2010-02-16 Thomson Licensing Method for predicting a lost or damaged block of an enhanced spatial layer frame and SVC-decoder adapted therefore
US20100111165A1 (en) * 2008-10-31 2010-05-06 Electronics And Telecommunications Research Institute Network flow-based scalable video coding adaptation device and method
US20100235880A1 (en) * 2006-10-17 2010-09-16 A10 Networks, Inc. System and Method to Apply Network Traffic Policy to an Application Session

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101427573A (en) * 2006-02-16 2009-05-06 维德约股份有限公司 System and method for thinning of scalable video coding bit-streams
US20100235880A1 (en) * 2006-10-17 2010-09-16 A10 Networks, Inc. System and Method to Apply Network Traffic Policy to an Application Session
TW201008293A (en) * 2008-08-06 2010-02-16 Thomson Licensing Method for predicting a lost or damaged block of an enhanced spatial layer frame and SVC-decoder adapted therefore
US20100111165A1 (en) * 2008-10-31 2010-05-06 Electronics And Telecommunications Research Institute Network flow-based scalable video coding adaptation device and method

Also Published As

Publication number Publication date
TW201340688A (en) 2013-10-01

Similar Documents

Publication Publication Date Title
EP1482681B1 (en) Medium streaming distribution system
CN104519325B (en) A kind of adaptive support method of wireless video monitoring system based on 4G network
CN104735470B (en) A kind of streaming media data transmission method and device
US10602139B2 (en) Embedded multimedia systems with adaptive rate control for power efficient video streaming
Hemy et al. MPEG system streams in best-effort networks
JP5021765B2 (en) An error filter that distinguishes video data errors on reverse and forward links
TW201415893A (en) Frame prioritization based on prediction information
JP4440651B2 (en) Data structures for data streaming systems
JP2009027720A (en) System and method executing lost packet recovery with congestion avoidance
CN101166270A (en) Multimedia video communication method and system
CN101951331A (en) Digital household network multimedia sharing system and sharing method thereof
WO2013189428A2 (en) Anti-packet-loss real-time communication method, system and related device based on hierarchical coding
KR20130138638A (en) The utilization of ber(bit error rate) for rate adaptation in mmt d3-ld
CN103795996A (en) 3D video transmission method and device
US20140040495A1 (en) System and method for low delay fast update for video streaming
EP2308215B1 (en) Thinning of packet-switched video data
Clayman et al. In-network scalable video adaption using big packet protocol
TWI504245B (en) A video transmission control method
Shih Enhancing packet-level forward error correction for streaming video in wireless networks
Park et al. Network-adaptive HD MPEG-2 video streaming with cross-layered channel monitoring in WLAN
WO2009109232A1 (en) Method and apparatus for distributing media over a communications network
CN105263067B (en) A kind of more net concurrent transmission methods of scalable coded video stream
Santos et al. On the design of robust and adaptive IEEE 802.11 multicast services for video transmissions
Zhao Design and implementation of video surveillance system based on CDMA cellular wireless networks
Xu et al. Development of a network adaptive H. 264/AVC medical video transmission system

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees