CN113890897B - Message processing method and related device - Google Patents

Abstract

The embodiment of the application discloses a message processing method and a related device, which can firstly determine necessary transmission information and unnecessary transmission information in message information to be transmitted, wherein the unnecessary transmission information is fixed value information corresponding to the information type of the message information to be transmitted, and information determined based on other information in the message information to be transmitted, and the necessary transmission information is other information. Only the necessary transmission information is required to be transmitted, and the receiver can complement unnecessary transmission information parts in the necessary transmission information according to the information type of the message information and the necessary transmission information. Therefore, the compressed message information corresponding to the message information to be transmitted can be determined according to the necessary transmission information, and then the compressed message information is transmitted to the target message node corresponding to the message information to be transmitted, so that the target message node is restored to obtain the message information to be transmitted based on the compressed message information, the information quantity required by message transmission is reduced, and the occupation of network bandwidth resources is reduced.

Description

A message processing method and related devices

Technical field

The present application relates to the field of Internet technology, and in particular to a message processing method and related devices.

Background technique

Tunnel technology is an encapsulation technology that is widely used in VPN networks. Tunneling technology uses a network transmission protocol to encapsulate data packets generated by other passenger protocols into its own packets and then transmit them across the network. Tunnel technology is widely used in the domain name system. The domain name system (Domain Name System, abbreviation: DNS) is a basic service of the Internet. DNS, as a distributed database that maps domain names and IP addresses to each other, can make it easier for users to access the Internet.

In related technologies, DNS messages need to be transmitted through tunnels in different DNS nodes in some scenarios. If traditional tunnel technology is used to transmit DNS messages, there is a problem of large forwarding data traffic and occupying a lot of network bandwidth.

Contents of the invention

In order to solve the above technical problems, this application provides a message processing method. Before transmitting the message, the message information to be transmitted can be compressed, and the compressed message information is generated based only on the necessary transmission information. The compressed message only needs to be By transmitting the message information to the target message node, the target message node can decompress the message information to be transmitted based on the necessary transmission information, thereby reducing the amount of information during message transmission.

The embodiments of this application disclose the following technical solutions:

In a first aspect, embodiments of the present application disclose a message processing method, which method includes:

Obtain message information to be transmitted;

Determine necessary transmission information and non-essential transmission information in the message information to be transmitted, where the non-essential transmission information is fixed value information corresponding to the information type of the message information to be transmitted, and based on the message to be transmitted Information determined by other information in the information, the necessary transmission information includes other information in the message information to be transmitted except the non-essential transmission information;

Determine the compressed message information corresponding to the message information to be transmitted according to the necessary transmission information;

The compressed message information is transmitted to a target message node corresponding to the message information to be transmitted, so that the target message node restores the message information to be transmitted based on the compressed message information.

In a possible implementation, the method further includes:

Determine a compression template corresponding to the information type, the compression template being used to identify whether each information part in the information of the information type must be transmitted;

Determining the necessary transmission information and non-essential transmission information in the message information to be transmitted includes:

In response to the message information to be transmitted complying with the compression template, necessary transmission information and unnecessary transmission information in the message information to be transmitted are determined according to the compression template.

In a possible implementation, determining the necessary transmission information and non-essential transmission information in the message information to be transmitted includes:

In response to the message information to be transmitted not complying with the compression template, determining the encapsulation information in the message information to be transmitted, the encapsulation information being used to send the message information to be transmitted;

The information part of the message information to be transmitted except the encapsulation information is determined as the necessary transmission information corresponding to the message information to be transmitted.

In a possible implementation, the method further includes:

Determine the computable information in the unnecessary transmission information that is determined based on other information in the message information to be transmitted;

Determining the compressed message information corresponding to the message information to be transmitted based on the necessary transmission information includes:

According to the computable information and the necessary transmission information, the compressed message information corresponding to the message information to be transmitted is determined.

In a possible implementation, determining the compressed message information corresponding to the message information to be transmitted based on the computable information and the necessary transmission information includes:

According to the compression dictionary, determine the incompressible information and the compressible information in the computable information, the compressible information is the information with corresponding compressed content in the compression dictionary, and the incompressible information is the information in the compression dictionary There is no information corresponding to the compressed content;

compress the compressible information into target compressed information according to the compression dictionary;

According to the target compression information, the incompressible information and the necessary transmission information, the compressed message information corresponding to the message information to be transmitted is determined.

In a possible implementation, the method further includes:

Determine the information content identifier corresponding to the compressed message information, the information content identifier is used to identify whether each information part in the computable information is added to the compressed message information, and is used to identify the fixed value Whether each information part in the information is added to the compressed message information;

Transmit the information content identifier to the target message node.

In a possible implementation, the message information to be transmitted is any one of multiple pieces of message information to be transmitted, and the multiple pieces of message information to be transmitted correspond to the same target message node. The method Also includes:

Determine the compressed message information corresponding to the multiple pieces of message information to be transmitted:

The compressed message information corresponding to the plurality of pieces of message information to be transmitted is spliced to obtain comprehensive message information, wherein one of the comprehensive message information corresponds to a set of target encapsulation information, and the target encapsulation information is represented by Transmitting the comprehensive message information to the target message node;

Transmitting the compressed message information to the target message node corresponding to the message information to be transmitted includes:

The comprehensive message information is transmitted to the target message node, so that the target message node restores and obtains the plurality of message information to be transmitted based on the comprehensive message information.

In a possible implementation, the compressed message information corresponding to the multiple pieces of message information to be transmitted is spliced to obtain comprehensive message information, including:

Determine the total amount of information corresponding to the spliced compressed message information, and the time taken for splicing;

In response to the total amount of information not exceeding the information amount sending threshold and the time used for splicing not exceeding the information sending time threshold, obtaining the target compressed message information to be spliced for information splicing;

After the splicing of the target compressed message information is completed, re-execute the step of determining the total amount of information corresponding to the spliced compressed message information and the time used for splicing;

In response to the total information amount exceeding the information amount sending threshold, or the splicing time exceeding the information sending time threshold, the spliced compressed message information is determined to be the comprehensive message information.

In a possible implementation manner, the message information to be transmitted is DNS message information.

In a second aspect, embodiments of the present application disclose a message processing device, which includes an acquisition unit, a first determination unit, a second determination unit and a first transmission unit:

The acquisition unit is used to acquire message information to be transmitted;

The first determining unit is used to determine necessary transmission information and non-essential transmission information in the message information to be transmitted. The non-essential transmission information is fixed value information corresponding to the information type of the message information to be transmitted. , and information determined based on other information in the message information to be transmitted, where the necessary transmission information includes other information in the message information to be transmitted except for the non-essential transmission information;

The second determination unit is configured to determine the compressed message information corresponding to the message information to be transmitted according to the necessary transmission information;

The first transmission unit is configured to transmit the compressed message information to a target message node corresponding to the message information to be transmitted, so that the target message node restores the message to be transmitted based on the compressed message information. Transmit message information.

In a possible implementation, the device further includes a third determining unit:

The third determination unit is used to determine the compression template corresponding to the information type, and the compression template is used to identify whether each information part in the information of the information type must be transmitted;

The first determination unit is specifically used for:

In response to the message information to be transmitted complying with the compression template, necessary transmission information and unnecessary transmission information in the message information to be transmitted are determined according to the compression template.

In a possible implementation, the first determination unit is specifically used to:

In response to the message information to be transmitted not complying with the compression template, determining the encapsulation information in the message information to be transmitted, the encapsulation information being used to send the message information to be transmitted;

The information part of the message information to be transmitted except the encapsulation information is determined as the necessary transmission information corresponding to the message information to be transmitted.

In a possible implementation, the device further includes a fourth determining unit:

A fourth determination unit, configured to determine the computable information in the unnecessary transmission information determined based on other information in the message information to be transmitted;

The second determination unit is specifically used for:

According to the computable information and the necessary transmission information, the compressed message information corresponding to the message information to be transmitted is determined.

In a possible implementation, the second determination unit is specifically used to:

According to the compression dictionary, determine the incompressible information and the compressible information in the computable information, the compressible information is the information with corresponding compressed content in the compression dictionary, and the incompressible information is the information in the compression dictionary There is no information corresponding to the compressed content;

compress the compressible information into target compressed information according to the compression dictionary;

According to the target compression information, the incompressible information and the necessary transmission information, the compressed message information corresponding to the message information to be transmitted is determined.

In a possible implementation, the device further includes a fifth determination unit and a second transmission unit:

The fifth determination unit is used to determine the information content identifier corresponding to the compressed message information. The information content identifier is used to identify whether each information part in the computable information is added to the compressed message information, and Used to identify whether each information part in the fixed value information is added to the compressed message information;

The second transmission unit is used to transmit the information content identifier to the target message node.

In a possible implementation, the message information to be transmitted is any one of multiple pieces of message information to be transmitted, and the multiple pieces of message information to be transmitted correspond to the same target message node, and the device Also includes a sixth determination unit and a splicing unit:

The sixth determination unit is used to determine the compressed message information corresponding to the multiple pieces of message information to be transmitted:

A splicing unit is used to splice the compressed message information corresponding to the plurality of pieces of message information to be transmitted to obtain comprehensive message information, wherein one piece of the comprehensive message information corresponds to a set of target encapsulation information, so The target encapsulation information is used to transmit the comprehensive message information to the target message node;

The first transmission unit is specifically used for:

The comprehensive message information is transmitted to the target message node, so that the target message node restores and obtains the plurality of message information to be transmitted based on the comprehensive message information.

In a possible implementation, the splicing unit is specifically used for:

Determine the total amount of information corresponding to the spliced compressed message information, and the time taken for splicing;

In response to the total amount of information not exceeding the information amount sending threshold and the time used for splicing not exceeding the information sending time threshold, obtaining the target compressed message information to be spliced for information splicing;

After the splicing of the target compressed message information is completed, re-execute the step of determining the total amount of information corresponding to the spliced compressed message information and the time used for splicing;

In response to the total information amount exceeding the information amount sending threshold, or the splicing time exceeding the information sending time threshold, the spliced compressed message information is determined to be the comprehensive message information.

In a possible implementation manner, the message information to be transmitted is DNS message information.

It can be seen from the above technical solution that after obtaining the message information to be transmitted, in order to reduce the amount of information when transmitting the message, the necessary transmission information and the unnecessary transmission information in the message information to be transmitted can be determined first. The transmission information is fixed-value information corresponding to the information type of the message information to be transmitted, and information determined based on other information in the message information to be transmitted. The necessary transmission information includes information other than the information in the message information to be transmitted. Other information than necessary transmission information. It can be seen that only the necessary transmission information needs to be transmitted, and the recipient who receives the necessary transmission information can complete the non-essential transmission information part according to the information type of the message information and the necessary transmission information. Therefore, the compressed message information corresponding to the message information to be transmitted can be determined based on the necessary transmission information, and then the compressed message information is transmitted to the target message node corresponding to the message information to be transmitted, so that the target message node can The message information is restored to obtain the message information to be transmitted, which reduces the amount of information required for message transmission and reduces the occupation of network bandwidth resources.

Description of the drawings

In order to explain the embodiments of the present application or the technical solutions in the prior art more clearly, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without exerting creative efforts.

Figure 1 is a flow chart of a message processing method provided by an embodiment of the present application;

Figure 2 is a schematic diagram of a message processing method provided by an embodiment of the present application;

Figure 3 is a schematic diagram of a message processing method provided by an embodiment of the present application;

Figure 4 is a schematic diagram of a message processing method provided by an embodiment of the present application;

Figure 5 is a schematic diagram of a message processing method provided by an embodiment of the present application;

Figure 6 is a schematic diagram of a message processing method provided by an embodiment of the present application;

Figure 7 is a schematic diagram of a message processing method provided by an embodiment of the present application;

Figure 8 is a schematic diagram of a message processing method provided by an embodiment of the present application;

Figure 9 is a schematic diagram of a message processing method provided by an embodiment of the present application;

Figure 10 is a schematic diagram of a message processing method provided by an embodiment of the present application;

Figure 11 is a schematic diagram of a message processing method provided by an embodiment of the present application;

Figure 12 is a schematic diagram of a message processing method provided by an embodiment of the present application;

Figure 13 is a flow chart of a message processing method provided by an embodiment of the present application;

Figure 14 is a flow chart of a message processing method provided by an embodiment of the present application;

Figure 15 is a schematic diagram of a message processing method provided by an embodiment of the present application;

Figure 16 is a schematic diagram of a message processing method provided by an embodiment of the present application;

Figure 17 is a schematic diagram of a message processing method provided by an embodiment of the present application;

Figure 18 is a structural block diagram of a message processing device provided by an embodiment of the present application.

Detailed ways

The embodiments of the present application are described below with reference to the accompanying drawings.

Message transmission between message nodes is a common technical scenario in network communication. For example, in the following situations of DNS messages, message forwarding between DNS nodes is required:

(1) Dynamic scheduling of DNS resources: When DNS node A has insufficient service capabilities, it forwards DNS packets through the tunnel to DNS node B with stronger service capabilities, and uses the service resources of node B to share response services.

(2) DNS attack mitigation: When DNS node A is attacked by large traffic, it cannot handle this part of the attack traffic. At this time, DNS node A forwards part or all of the attack traffic through the tunnel to DNS node B, which is more resistant to attacks. Node B handles the attack traffic, thereby alleviating the pressure on node A to resist attacks.

However, in traditional tunnel technology, all the contents of the message are transmitted when transmitting the message, which increases the amount of transmitted data and occupies a large amount of network bandwidth.

In order to solve the above technical problems, this application provides a message processing method. Before transmitting the message, the message information to be transmitted can be compressed, and the compressed message information is generated based only on the necessary transmission information. The compressed message only needs to be By transmitting the message information to the target message node, the target message node can decompress the message information to be transmitted based on the necessary transmission information, thereby reducing the amount of information during message transmission.

It can be understood that this method can be applied to a processing device, which is a processing device capable of packet processing, such as a terminal device or a server with a packet processing function. This method can be executed independently by the terminal device or the server, or can be applied to a network scenario in which the terminal device and the server communicate, and can be executed by the terminal device and the server in cooperation. Among them, the terminal device can be a computer, a mobile phone and other devices. The server can be understood as an application server or a Web server. In actual deployment, the server can be an independent server or a cluster server.

Next, a message processing method provided by the embodiment of the present application will be introduced with reference to the accompanying drawings.

Referring to Figure 1, Figure 1 is a flow chart of a message processing method provided by an embodiment of the present application. The method includes:

S101: Obtain message information to be transmitted.

The message information to be transmitted is the message information that needs to be transmitted to other message nodes. The message node corresponding to the message information to be transmitted is the target message node, that is, the message information to be transmitted needs to be sent to the target message node. node.

S102: Determine the necessary transmission information and non-essential transmission information in the message information to be transmitted.

Among them, the non-essential transmission information is fixed value information corresponding to the information type of the message information to be transmitted, and information determined based on other information in the message information to be transmitted, and the necessary transmission information includes the message information to be transmitted. Among other information except necessary transmission information, the fixed value information refers to the fixed value that all message information under this information type has.

Therefore, even if the message node as the receiver does not receive the unnecessary transmission information, the unnecessary transmission information can be restored according to the information type of the message information and the received necessary transmission information. It can be seen that when transmitting messages, in order to reduce the amount of transmitted message information without affecting the message transmission effect, the transmission of unnecessary transmission information can be reduced.

S103: Determine the compressed message information corresponding to the message information to be transmitted based on the necessary transmission information.

The processing device can generate compressed message information corresponding to the message information to be transmitted based on the necessary transmission information, so that the compressed message information only includes the necessary transmission information, and the amount of message information of the compressed message information is reduced.

S104: Transmit the compressed message information to the target message node corresponding to the message information to be transmitted, so that the target message node restores the message information to be transmitted based on the compressed message information.

After receiving the compressed message information, the target message node can determine the fixed value corresponding to the compressed message information based on the information type of the message information; and can calculate the missing value based on the compressed message information. information part, so that the information of the message to be transmitted can be restored.

It can be seen from the above technical solution that after obtaining the message information to be transmitted, in order to reduce the amount of information when transmitting the message, the necessary transmission information and the unnecessary transmission information in the message information to be transmitted can be determined first. The transmission information is fixed-value information corresponding to the information type of the message information to be transmitted, and information determined based on other information in the message information to be transmitted. The necessary transmission information includes information other than the information in the message information to be transmitted. Other information than necessary transmission information. It can be seen that only the necessary transmission information needs to be transmitted, and the recipient who receives the necessary transmission information can complete the non-essential transmission information part according to the information type of the message information and the necessary transmission information. Therefore, the compressed message information corresponding to the message information to be transmitted can be determined based on the necessary transmission information, and then the compressed message information is transmitted to the target message node corresponding to the message information to be transmitted, so that the target message node can The message information is restored to obtain the message information to be transmitted, which reduces the amount of information required for message transmission and reduces the occupation of network bandwidth resources.

It can be understood that message information of the same information type usually has relatively fixed information parts. Therefore, in order to improve the efficiency and accuracy of compressing message information, in one possible implementation, in determining the message information When the necessary transmission part and the non-essential transmission part are determined, the processing device can first determine the compression template corresponding to the information type. The compression template is used to identify whether each information part in the information of this information type must be transmitted.

The processing device can determine whether the message to be transmitted conforms to the compression template, that is, the information distribution format in the message to be transmitted is consistent with the compression template, so that it can determine whether each information part must be transmitted based on the compression template. In response to the message to be transmitted conforming to the compression template, the processing device can determine the necessary transmission information and the non-essential transmission information in the message to be transmitted according to the compression template, so that the message information to be transmitted can be processed by simply referring to the template. Perform fast compression to improve the efficiency and accuracy of message compression.

For example, in one possible implementation, the message information to be transmitted may be DNS message information, and the compression template corresponding to this information type may be as shown in Figure 2.

Among them, the 4h, 5h, 0h, 11h, and 1h information parts are fixed value information corresponding to the information type, and the TBC part represents the information part corresponding to the information type that can be calculated through other information. These information parts are non-essential transmission parts. ;The IP_ID, TTL, SIP, SPORT, and DNSID information are necessary transmission information. The DIP, DPORT, FLAG, QNAME, T/C, and ADD_RR fields are diverse and are fixed values in some DNS message information. It can also be used as a non-fixed value in text information. It can be regarded as a non-essential transmission part when it is a fixed value, and it can be regarded as a necessary transmission part when it is a non-fixed value. Referring to Figure 3, Figure 3 shows the necessary transmission information FP obtained through the compression template.

In addition, in a possible implementation, in response to the message information to be transmitted not conforming to the compression template, in order to prevent the necessary transmission information from being lost during the compression process without accurate discrimination, The processing device can first determine the encapsulation information in the message information to be transmitted. The encapsulation information is used to send the message information to be transmitted. That is, the encapsulation information is the information that must be added when sending the message information to be transmitted to the processing device. , through this encapsulation information, the message information to be transmitted can be transmitted in the tunnel. It can be understood that the encapsulation information can be regarded as fixed value information corresponding to the information type. Therefore, the processing device can determine the information part of the message information to be transmitted except the encapsulation information as the message information to be transmitted. Corresponding necessary transmission information, thus possibly avoiding the omission of necessary transmission information to the greatest extent. As shown in Figure 4, nc is the message information to be transmitted with the encapsulation information removed. The processing device can add header information T and L to the nc information to generate compressed message information.

As mentioned above, the message information to be transmitted includes part of the information that can be determined based on other information. This part of the information can be called computable information, that is, the recipient of the information can calculate the computable information based on the necessary transmission information. information. It is understandable that the receiver needs to spend a certain amount of calculation time when calculating the computable information. Therefore, in a possible implementation, in order to enable the message information to be processed more efficiently, a balance between sending messages and processing The resources and time required for the message. The processing device can first determine the computable information in the unnecessary transmission information based on other information in the message information to be transmitted, and then determine the computable information and the necessary transmission information based on the computable information and the necessary transmission information. Compressed message information corresponding to the message information to be transmitted, so that this part of the computable information can also be sent to the target message node, so that the target message node does not need to recalculate the information in it, saving the time required for message processing ;At the same time, since the fixed value information is relatively easy to obtain and does not require calculation and other steps, without sending the fixed value information, the message transmission requirements can be reduced with less impact on the message information processing efficiency. network bandwidth.

In addition, in order to further reduce the amount of information transmitted by the message, the processing device can recommend a compression dictionary for common information content in the message information. The compression dictionary records the information content before compression and the corresponding compressed content after compression. The compression dictionary The information content of the content is much smaller than the information content before compression. In a possible implementation, the processing device can determine the incompressible information and the compressible information in the computable information according to the compression dictionary, where the compressible information is the information with corresponding compressed content in the compression dictionary, and the incompressible information It is information that does not have corresponding compressed content in the compression dictionary. The processing device can compress the compressible information into target compressed information according to the compression dictionary, and determine the compressed message information corresponding to the message information to be transmitted based on the target compressed information, incompressible information and necessary transmission information. It can be understood that in some cases, some necessary transmission information can also be compressed. In the embodiment of the present application, in order to ensure the accuracy of the transmission of necessary transmission information and avoid information errors during the decompression process, the processing device can only Compress computable information.

It is understandable that since the processing device does not send all the message information to the target message node, the target message node needs to find the missing information part and restore it. In a possible implementation, in order for the target message node to clearly learn the sent part and the unsent part of the message information to be transmitted, the processing device can determine the information content identifier corresponding to the compressed message information, and the The information content identifier is used to identify whether each information part in the computable information is added to the compressed message information, and may be used to identify whether each information part in the fixed value information is added to the compressed message information. The processing device can transmit the information content identifier to the target message node, so that when generating compressed message information based on the computable information and necessary transmission information, the target message node can learn the content of the compressed message information based on the information content identifier. The existing and missing information parts in the message information to be transmitted can achieve targeted information restoration.

For example, as shown in Figure 5, Figure 5 is a schematic diagram of compressed packet information, in which the compressed packet information (Packetblock, PB for short) includes header information T and L, necessary transmission information FP and part of the necessary transmission information VP ( Variablepart) and information content identification BM (Bitmap), where the information included in T and L is as follows:

T: 1B type marks the PB type, such as compressed packets according to the compression template corresponding to the DNS request (T=0), uncompressed packets (T=1), etc.

L: 1~2B length field, the highest bit is the field end flag, and the lower 7 bits mark the byte length of the entire PB, as shown in Figure 7. L includes all data starting from T and ending with the last non-essential transmission information variable part (VP). When PB is short (1~2^7), L is 1B: the highest bit is 1, and the lower 7 bits mark the byte length of the entire PB. When PB is long (2^7+1~2^14) L is 2B: the highest bit of the first byte is 0, and the lower 7 bits mark the byte length of the entire PB [13:7]. The highest bit of the second byte is 1, and the lower 7 bits mark the byte length of the entire PB [6:0]. The structure of the L field is shown in Figure 12.

After determining the necessary transmission information and non-essential transmission information through the compression template shown in Figure 2, the processing device can generate the FP part based on the regular information in the necessary transmission information. The regular information refers to the FP part in each DNS message. Have the necessary transmission information. At the same time, the processing device can select the computable information and the non-conventional information in the necessary transmission information to generate the VP part. The non-conventional information refers to the necessary transmission information that is not included in every DNS message. For example, when there is the above When there is diversity of information, if the information is a non-fixed value, it can be regarded as non-conventional information in the necessary transmission information to generate the corresponding VP field. This BM part is shown in Figure 6. Among them, BM information can identify the value corresponding to each VP part. If BM[X]=1 in the VP part, it means that the compressed message information contains unnecessary transmission information corresponding to this part of VP; if BM[X]=0 , it means that the compressed message information does not contain the unnecessary transmission information corresponding to this part of VP. In the BM information shown in Figure 6, the fixed value information in the unnecessary transmission information, such as the default value in the DNS message, etc., corresponds to BM[X]=0, and other computable information corresponds to BM[X]= 1.

The structure of the VP part is shown in Figure 7. A VP includes a pointer TK (token) and the data DATA corresponding to the pointer. Among them, an unnecessary transmission information part can correspond to a VP, or it can be split when the information content is large. into multiple VPs for transmission. Among them, the structure of the TK part can be shown in Figure 8. The MT (MORE token) field is used to identify whether the VP field to which the current token belongs has ended, that is, whether the VP field is part of the same non-essential transmission information; the C field is It is used to identify whether the DATA field is a dictionary pointer, that is, whether the DATA is compressed information; the LEN field is used to identify the byte length of the DATA, 1 to 64 bits. When the unnecessary transmission information is not compressed based on the compression dictionary, the DATA field contains the original text information of the unnecessary transmission information; when compression is performed, the DATA field contains the compression information corresponding to the unnecessary transmission information.

In the VP field, some unnecessary transmission information is compressed, and the same unnecessary transmission information is split into multiple VP fields, as shown in Figure 9, where VP0 is the compressed unnecessary transmission information and VP1 is the original text. The non-essential transmission information transmitted, VP0 and VP1 are two parts of the same non-essential transmission information "baidu.com". As shown in the figure, the MT field can be used to identify that the VP0 field has not ended, and the DATA in VP0 is a dictionary pointer. Dictionary pointers can be used to decompress this DATA field.

In addition to being able to compress a single piece of message information to be transmitted, for scenarios where multiple pieces of message information are to be transmitted, the processing device can also further reduce the bandwidth required for message information transmission through the combination of multiple pieces of message information. resource. It can be understood that in order to transmit in a tunnel, encapsulation information usually needs to be added to the message information. For example, in order to send the message information to be transmitted to the processing device, corresponding encapsulation information needs to be added to the message information to be transmitted. .

Among them, each piece of message information needs to add corresponding encapsulation information when it is sent. Therefore, in order to reduce the bandwidth resources occupied when transmitting multiple message information, the processing device can combine the information that needs to be transmitted among the multiple pieces of message information to be transmitted. The content is merged into one message information, so that the encapsulation information only needs to be added once.

In a possible implementation, the message information to be transmitted can be any one of multiple pieces of message information to be transmitted. The multiple pieces of message information to be transmitted correspond to the same target message node, and the processing device can determine Compressed message information corresponding to multiple pieces of message information to be transmitted, and then splicing the compressed message information corresponding to multiple pieces of message information to be transmitted to obtain comprehensive message information, where one piece of comprehensive message information corresponds to A set of target encapsulation information used to transmit the comprehensive message information to the target message node.

The processing device can transmit the comprehensive message information to the target message node, so that the target message node can restore and obtain the multiple pieces of message information to be transmitted based on the comprehensive message information. For example, as shown in Figure 10, the processing device can determine the PB information corresponding to multiple original messages, then combine these PB information, and then add the target encapsulation information FH (frameheader, corresponding to Figure 10) corresponding to the DNS tunnel transmission. FRAM HD), IP HD and ETHHD in . Among them, the Protocol field in IP HD is 131, which means a private IP encapsulation protocol is used. Of course, in addition to the non-essential transmission information that can be compressed, the necessary transmission information in the PB part can also be compressed based on compression dictionary and other methods, and there is no restriction here. The compressed tunnel encapsulation FH is 8B in total, divided into 4 parts, as shown in Figure 11.

It is understandable that message information usually has a certain timeliness. If the message information is not sent to the corresponding recipient in time after receiving the message information, it may cause problems such as invalidation of the message information. In addition, when transmitting message information in a tunnel, the tunnel usually has a certain upper limit for the amount of information transmitted. If the amount of information in a message exceeds the upper limit, it will be difficult to transmit it in the tunnel. Based on this, in a possible implementation, the processing device can first determine the information sending time threshold and the information amount sending threshold, and then determine the total information amount corresponding to the spliced compressed message information, and the splicing time.

In response to the fact that the total amount of information does not exceed the information amount sending threshold, and the time used for splicing does not exceed the information sending time threshold, it means that the splicing of compressed message information takes a short time and the amount of information is small, and the compressed message information can be continued to be spliced. At this time, the processing device can obtain the target compressed message information to be spliced for information splicing. At the same time, after the splicing of the target compressed message information is completed, the processing device can re-execute the steps of determining the total amount of information corresponding to the spliced compressed message information and the time taken for splicing.

In response to the total amount of information exceeding the information amount sending threshold, or the time taken for splicing exceeding the information sending time threshold, the processing device may directly determine the spliced compressed message information as the comprehensive message information. Based on the above technical solution, the processing equipment can monitor the amount of information and the splicing time of the spliced compressed message information in real time when splicing messages to ensure the stable transmission of the comprehensive message information.

In order to facilitate understanding of the technical solution provided by this application, next, a message processing method provided by the embodiment of this application will be introduced based on a practical application scenario.

Referring to Figure 13, Figure 13 is a flow chart of a message processing method in an actual application scenario provided by an embodiment of the present application. After starting the processing, the processing device can first receive the message information to be transmitted, and then determine whether the message information to be transmitted is a DNS message. If not, discard the message and re-receive the next message information; if so, remove the message. Layer 2 header (encapsulated information), and determine whether the remaining information part conforms to the compression template. If not, construct the remaining part as the NC field, add T and L fields, and determine whether the message processing has timed out. If not, determine Whether the message length reaches the MTU, if not, continue processing the next message information. If it times out or the message length reaches the MTU, add encapsulation information to generate compressed message information; if so, construct the necessary transmission information FP field according to the compression template, and then Determine whether the remaining non-essential transmission information is fixed value information. If so, discard it. If not, determine whether the information can be compressed. If it is compressible, the compressed information will be determined as the VP field. If it is not compressible, the VP field will be constructed directly based on the original information. . The processing device can determine whether the non-fixed value field has ended. If it has not ended, it will continue to determine whether compression can be performed. If it has ended, it will determine whether the message has ended. If so, it will add the T and L fields, and then determine the total time to assemble the compressed message information. Whether it exceeds the time threshold, if so, add encapsulation information, end the message processing and send; if not, determine whether the length of the message with assembled compressed information reaches the information volume threshold MTU, if so, add encapsulation information to end the processing, if If not, the next hop message information to be transmitted can be obtained for processing.

After receiving the compressed message information processed above, the target message node can restore the information as shown in Figure 14. After receiving the information, you can first determine whether it is a DNS tunnel forwarding message. If so, remove the encapsulation information, and then determine whether it is compressed information. If not, directly read the original text and end the message processing; if it is compressed information, process The device can recover this information. Referring to Figure 14, the processing device can first remove the T and L fields, and then determine whether the compression is based on the compression template. If not, restore the original text of the message, then add a layer 2 header and determine whether the message ends; if the compression is based on the compression template, Then restore the fixed value information first, then restore the necessary transmission information FP, and then determine whether it is an optional compression field. If so, perform corresponding restoration based on different DATA types. If not, perform corresponding restoration based on the BM identifier. details as follows:

If the corresponding BM bit = 0, restore it to the default value.

If the corresponding BM bit = 1, use VP to restore.

If data in token+data is the original text, use data to restore the message;

If data in token+data is a dictionary pointer, use data to retrieve the dictionary, and use the dictionary return value to restore the message;

If it contains multiple VPs, concatenate each VP recovery message.

Example of partially compressing the VP field: QNAME=baidu.com is split into 2 VP decompression processes:

a. First use the dictionary pointer VP0 data to retrieve the dictionary, and use the dictionary return value baidu to restore the first part of QNAME;

b. Then use the original VP1 data to restore the second part of QNAME: .com;

c. Splice baidu and .com together and restore QNAME=baidu.com.

For the computable information in the information, the processing device can calculate and add according to the protocol definition.

a.The total length in the IP header is the byte length of the recovery template.

b. Add header checksum to the IP header: perform binary complement summation of the entire IP header.

c.The total length in the UDP header is the length in bytes of the UDP header plus the DNS part in the recovery template.

d. Add checksum to the UDP header: perform a binary complement sum of the three parts of the UDP pseudo-header, UDP header and UDP data.

e. Number of additional resource records added to the DNS part: Calculate how many resource records ADD_RR contains in the recovery template.

After compressing the template PB to recover the UDP format DNS message information, add a Layer 2 header and restore the original DNS request message template, as shown in Figure 16. Lenth\type=0800h in the Layer 2 header indicates an Ipv4 message.

For non-template compressed packets, the processing device can add a Layer 2 header before nc to restore the original DNS request packet, as shown in Figure 17. The lenth\type in the second-layer header should be filled according to the first 4 bits of nc (1st_4bits). If it is an Ipv4 message, 1st_4bits=4, lenth\type=0800h; if it is an Ipv6 message, 1st_4bits=6, lenth\type=86ddh.

Regarding the message processing method provided by the above embodiment, the embodiment of the present application also provides a message processing device. See Figure 18. Figure 18 is a structural block diagram of a message processing device 1800 provided by the embodiment of the present application. , the device 1800 includes an acquisition unit 1801, a first determination unit 1802, a second determination unit 1803 and a first transmission unit 1804:

Obtaining unit 1801, used to obtain message information to be transmitted;

The first determining unit 1802 is used to determine necessary transmission information and non-essential transmission information in the message information to be transmitted, where the non-essential transmission information is fixed value information corresponding to the information type of the message information to be transmitted, and information determined based on other information in the message information to be transmitted, where the necessary transmission information includes other information in the message information to be transmitted except for the non-essential transmission information;

The second determining unit 1803 is configured to determine the compressed message information corresponding to the message information to be transmitted according to the necessary transmission information;

The first transmission unit 1804 is used to transmit the compressed message information to the target message node corresponding to the message information to be transmitted, so that the target message node restores the message to be transmitted based on the compressed message information. Message information.

In a possible implementation, the device further includes a third determining unit:

The third determination unit is used to determine the compression template corresponding to the information type, and the compression template is used to identify whether each information part in the information of the information type must be transmitted;

The first determining unit 1802 is specifically used for:

In response to the message information to be transmitted complying with the compression template, necessary transmission information and unnecessary transmission information in the message information to be transmitted are determined according to the compression template.

In a possible implementation, the first determining unit 1802 is specifically used to:

In response to the message information to be transmitted not complying with the compression template, determining the encapsulation information in the message information to be transmitted, the encapsulation information being used to send the message information to be transmitted;

The information part of the message information to be transmitted except the encapsulation information is determined as the necessary transmission information corresponding to the message information to be transmitted.

In a possible implementation, the device further includes a fourth determining unit:

A fourth determination unit, configured to determine the computable information in the unnecessary transmission information determined based on other information in the message information to be transmitted;

The second determination unit 1803 is specifically used to:

According to the computable information and the necessary transmission information, the compressed message information corresponding to the message information to be transmitted is determined.

In a possible implementation, the second determining unit 1803 is specifically used to:

According to the compression dictionary, determine the incompressible information and the compressible information in the computable information, the compressible information is the information with corresponding compressed content in the compression dictionary, and the incompressible information is the information in the compression dictionary There is no information corresponding to the compressed content;

compress the compressible information into target compressed information according to the compression dictionary;

According to the target compression information, the incompressible information and the necessary transmission information, the compressed message information corresponding to the message information to be transmitted is determined.

In a possible implementation, the device further includes a fifth determination unit and a second transmission unit:

The fifth determination unit is used to determine the information content identifier corresponding to the compressed message information. The information content identifier is used to identify whether each information part in the computable information is added to the compressed message information, and Used to identify whether each information part in the fixed value information is added to the compressed message information;

The second transmission unit is used to transmit the information content identifier to the target message node.

In a possible implementation, the message information to be transmitted is any one of multiple pieces of message information to be transmitted, and the multiple pieces of message information to be transmitted correspond to the same target message node, and the device Also includes a sixth determination unit and a splicing unit:

The sixth determination unit is used to determine the compressed message information corresponding to the multiple pieces of message information to be transmitted:

A splicing unit is used to splice the compressed message information corresponding to the plurality of pieces of message information to be transmitted to obtain comprehensive message information, wherein one piece of the comprehensive message information corresponds to a set of target encapsulation information, so The target encapsulation information is used to transmit the comprehensive message information to the target message node;

The first transmission unit 1804 is specifically used for:

The comprehensive message information is transmitted to the target message node, so that the target message node restores and obtains the plurality of message information to be transmitted based on the comprehensive message information.

In a possible implementation, the splicing unit is specifically used for:

Determine the total amount of information corresponding to the spliced compressed message information, and the time taken for splicing;

In response to the total amount of information not exceeding the information amount sending threshold and the time used for splicing not exceeding the information sending time threshold, obtaining the target compressed message information to be spliced for information splicing;

After the splicing of the target compressed message information is completed, re-execute the step of determining the total amount of information corresponding to the spliced compressed message information and the time used for splicing;

In response to the total information amount exceeding the information amount sending threshold, or the splicing time exceeding the information sending time threshold, the spliced compressed message information is determined to be the comprehensive message information.

In a possible implementation manner, the message information to be transmitted is DNS message information.

Those of ordinary skill in the art can understand that all or part of the steps to implement the above method embodiments can be completed through hardware related to program instructions. The foregoing program can be stored in a computer-readable storage medium. When the program is executed, the execution includes: The steps of the above method embodiment; and the aforementioned storage medium can be at least one of the following media: read-only memory (English: read-only memory, abbreviation: ROM), RAM, magnetic disk or optical disk, etc., which can store The medium for program code.

It should be noted that each embodiment in this specification is described in a progressive manner, and the same and similar parts between the various embodiments can be referred to each other. Each embodiment focuses on the differences from other embodiments. at. In particular, the device and system embodiments are described simply because they are basically similar to the method embodiments. For relevant details, please refer to the partial description of the method embodiments. The device and system embodiments described above are only illustrative. The units described as separate components may or may not be physically separated. The components shown as units may or may not be physical units, that is, they may be located in One location, or it can be distributed across multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. Persons of ordinary skill in the art can understand and implement the method without any creative effort.

The above is only a specific implementation mode of the present application, but the protection scope of the present application is not limited thereto. Any person familiar with the technical field can easily think of changes or modifications within the technical scope disclosed in the present application. Replacements shall be covered by the protection scope of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims (9)

1. A method for processing a message, the method comprising:

acquiring message information to be transmitted;

determining a compression template corresponding to an information type, wherein the compression template is used for identifying whether each information part in the information of the information type must be transmitted or not;

responding to the message information to be transmitted to conform to the compression template, determining necessary transmission information and unnecessary transmission information in the message information to be transmitted according to the compression template, wherein the unnecessary transmission information is fixed value information corresponding to the information type of the message information to be transmitted and information determined based on other information in the message information to be transmitted, and the necessary transmission information comprises other information except the unnecessary transmission information in the message information to be transmitted;

determining compressed message information corresponding to the message information to be transmitted according to the necessary transmission information;

transmitting the compressed message information to the target message node corresponding to the message information to be transmitted, and enabling the target message node to restore the message information to be transmitted based on the compressed message information.

2. The method according to claim 1, wherein the method further comprises:

Determining encapsulation information in the message information to be transmitted in response to the message information to be transmitted not conforming to the compression template, wherein the encapsulation information is used for sending the message information to be transmitted;

and determining the information parts except the encapsulation information in the message information to be transmitted as necessary transmission information corresponding to the message information to be transmitted.

3. The method according to claim 1, wherein the method further comprises:

determining the calculable information which is determined based on other information in the message information to be transmitted in the unnecessary transmission information;

the determining compressed message information corresponding to the message information to be transmitted according to the necessary transmission information includes:

and determining compressed message information corresponding to the message information to be transmitted according to the computable information and the necessary transmission information.

4. The method according to claim 3, wherein determining compressed message information corresponding to the message information to be transmitted according to the calculable information and the necessary transmission information includes:

according to a compression dictionary, determining incompressible information and compressible information in the computable information, wherein the compressible information is information with corresponding compression content in the compression dictionary, and the incompressible information is information without corresponding compression content in the compression dictionary;

Compressing the compressible information into target compressed information according to the compression dictionary;

and determining compressed message information corresponding to the message information to be transmitted according to the target compressed information, the incompressible information and the necessary transmission information.

5. A method according to claim 3, characterized in that the method further comprises:

determining an information content identifier corresponding to the compressed message information, wherein the information content identifier is used for identifying whether each information part in the calculable information is added to the compressed message information or not and identifying whether each information part in the fixed value information is added to the compressed message information or not;

and transmitting the information content identification to the target message node.

6. The method of claim 1, wherein the message information to be transmitted is any one of a plurality of pieces of message information to be transmitted, the plurality of pieces of message information to be transmitted corresponding to the same target message node, the method further comprising:

determining compressed message information corresponding to the message information to be transmitted respectively:

splicing the compressed message information respectively corresponding to the message information to be transmitted to obtain comprehensive message information, wherein one piece of the comprehensive message information corresponds to a set of target encapsulation information, and the target encapsulation information is used for transmitting the comprehensive message information to the target message node;

The transmitting the compressed message information to the target message node corresponding to the message information to be transmitted comprises the following steps:

and transmitting the comprehensive message information to the target message node, and enabling the target message node to restore the plurality of pieces of message information to be transmitted based on the comprehensive message information.

7. The method of claim 6, wherein the splicing the compressed message information corresponding to each of the plurality of pieces of message information to be transmitted to obtain the integrated message information includes:

determining the total information quantity corresponding to the spliced compressed message information and the time used for splicing;

responding to the total information quantity not exceeding the information quantity sending threshold value and the time used for splicing not exceeding the information sending time threshold value, acquiring target compressed message information to be spliced and carrying out information splicing;

after the target compressed message information is spliced, re-executing the step of determining the total information quantity corresponding to the spliced compressed message information and the time for splicing;

and determining the spliced compressed message information as the comprehensive message information in response to the total information amount exceeding the information amount sending threshold or the time used for splicing exceeding the information sending time threshold.

8. The method of claim 1, wherein the message information to be transmitted is DNS message information.

9. The device for processing the message is characterized by comprising an acquisition unit, a third determination unit, a first determination unit, a second determination unit and a first transmission unit:

the acquisition unit is used for acquiring the message information to be transmitted;

a third determining unit, configured to determine a compression template corresponding to an information type, where the compression template is used to identify whether each information part in information of the information type must be transmitted;

the first determining unit is configured to determine, according to the compression template, necessary transmission information and unnecessary transmission information in the to-be-transmitted message information in response to the to-be-transmitted message information conforming to the compression template, where the unnecessary transmission information is fixed value information corresponding to an information type of the to-be-transmitted message information, and information determined based on other information in the to-be-transmitted message information, and the necessary transmission information includes other information except the unnecessary transmission information in the to-be-transmitted message information;

the second determining unit is configured to determine compressed message information corresponding to the message information to be transmitted according to the necessary transmission information;

The first transmission unit is configured to transmit the compressed message information to a target message node corresponding to the message information to be transmitted, so that the target message node restores the compressed message information to obtain the message information to be transmitted.