CN119154999A

CN119154999A - Data transmission method and device and electronic equipment

Info

Publication number: CN119154999A
Application number: CN202310727701.4A
Authority: CN
Inventors: 梁俊斌
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2023-06-16
Filing date: 2023-06-16
Publication date: 2024-12-17

Abstract

The present application relates to the field of computer technology, and in particular to a data transmission method, device and electronic device for effectively reducing the packet loss rate of a network. The embodiment of the present application transmits multimedia data to a receiving end; based on the feedback information of the receiving end, when it is determined that the transmission quality of the multimedia data does not meet the set standard, triggers repeated transmission of each data packet to be transmitted; wherein, after triggering repeated transmission, for each data packet to be transmitted, the following operations are performed: obtaining at least one target retransmission parameter corresponding to a data packet; determining a corresponding quantization strategy according to at least one target retransmission parameter, and quantizing a data packet using at least one quantization strategy obtained, to obtain at least one retransmission data packet after quantization; based on the data size of at least one retransmission data packet, using corresponding bandwidth occupancy, sending a data packet and at least one retransmission data packet to the receiving end.

Description

Data transmission method and device and electronic equipment

Technical Field

The present application relates to the field of computer technologies, and in particular, to a data transmission method, a data transmission device, and an electronic device.

Background

In the data transmission process, the instability of the transmission network easily causes the packet loss phenomenon in the transmission process, so that the receiving end cannot normally receive the data. For example, in audio-video call and network live broadcast services, the voice quality is mainly affected by network packet loss, and the instability of the transmission network causes the blocking and incoherence of the sound of the receiving end. The network packet loss causes are numerous, for example, network data congestion triggers the network device to actively discard packets to a certain extent, data packets are lost due to network device or transmission line faults, the wireless network is interfered to cause data abnormality, and the packets cannot be discarded through verification, etc. Network packet loss has high randomness and burstiness, so that the network packet loss brings great challenges to the data transmission process.

In the related art, a repeated multiple transmission strategy is generally used to solve the problem of network packet loss, where the repeated multiple transmission strategy refers to that an original data packet is copied multiple times and then transmitted to a receiving end at different time intervals. However, the repeated multiple strategy can solve the problem that the receiving end cannot receive the corresponding data packet due to network packet loss, but the repeated multiple strategy requires additional consumption of bandwidth, and the higher the repeated multiple is, the stronger the packet loss resistance can be brought, but the more serious the bandwidth consumption is brought. For the bandwidth-limited network, the increase of repeated transmission times causes network congestion to be aggravated, and further triggers more packet loss, so that a receiving end cannot normally receive transmission data, and the data transmission process between the transmitting end and the receiving end is seriously affected.

On the other hand, in the related art, the repeated multiple strategy is usually preset, the regulation and control rule is limited, and in the changeable network state, the repeated multiple strategy cannot be timely adjusted to the network state. Therefore, when the network environment changes, a fixed repeated multi-sending strategy is still used, and the problem of packet loss is aggravated.

Therefore, the repeated multiple-sending method cannot effectively solve the network packet loss problem.

Disclosure of Invention

The application aims to provide a data transmission method, a data transmission device and electronic equipment, which are used for effectively reducing the packet loss rate of a network.

In a first aspect, the present application provides a data transmission method, applied to a transmitting end, where the method includes:

transmitting multimedia data to a receiving end;

Triggering to repeatedly transmit each data packet to be transmitted when determining that the transmission quality of the multimedia data does not meet a set standard based on the feedback information of the receiving end;

After triggering the repeated transmission, the following operations are executed for each data packet to be transmitted:

Acquiring at least one target retransmission parameter corresponding to a data packet;

Respectively determining corresponding quantization strategies according to the at least one target retransmission parameter, and respectively carrying out quantization processing on the data packet by adopting the obtained at least one quantization strategy to obtain at least one retransmission data packet after quantization processing, wherein the data sizes of the retransmission data packets obtained by adopting different quantization strategies are different, and the data sizes of the retransmission data packets are positively correlated with the bandwidth occupation amount;

And based on the data size of the at least one retransmission data packet, respectively adopting corresponding bandwidth occupation amount to send the data packet and the at least one retransmission data packet to the receiving end.

In a second aspect, the present application provides a data transmission method, applied to a receiving end, where the method includes:

determining feedback information for representing the transmission quality of the multimedia data according to the multimedia data transmitted by a transmitting end;

the feedback information is sent to the sending end, so that the sending end triggers repeated transmission of each data packet to be transmitted when the transmission quality of the multimedia data is determined to not meet the set standard based on the feedback information;

And receiving each data packet and at least one retransmission data packet corresponding to each data packet sent by the sending end, wherein the at least one retransmission data packet corresponding to one data packet is obtained by respectively carrying out quantization processing on the one data packet by adopting a quantization strategy corresponding to at least one target retransmission parameter after the sending end acquires at least one target retransmission parameter corresponding to the one data packet, wherein the data sizes of the retransmission data packets obtained by adopting different quantization strategies are different, and the data sizes of the retransmission data packets are positively correlated with the bandwidth occupation amount.

In a third aspect, the present application provides a data transmission apparatus comprising:

The transmission module is used for transmitting the multimedia data to the receiving end;

The triggering module is used for triggering repeated transmission of each data packet to be transmitted when the transmission quality of the multimedia data is determined to not meet the set standard based on the feedback information of the receiving end;

The acquisition module is used for acquiring at least one target retransmission parameter corresponding to one data packet;

The processing module is used for respectively determining corresponding quantization strategies according to the at least one target retransmission parameter, and respectively carrying out quantization processing on the data packet by adopting the obtained at least one quantization strategy to obtain at least one retransmission data packet after quantization processing, wherein the data sizes of the retransmission data packets obtained by adopting different quantization strategies are different, and the data sizes of the retransmission data packets are positively correlated with the bandwidth occupation amount;

And the first sending module is used for respectively adopting corresponding bandwidth occupation amount based on the data size of the at least one retransmission data packet and sending the data packet and the at least one retransmission data packet to the receiving end.

In a possible embodiment, the obtaining module is specifically configured to:

Based on the latest received feedback information of the receiving end, a current first network transmission state is obtained;

Selecting a candidate retransmission parameter set corresponding to the first network transmission state from all initial retransmission parameters according to the mapping relation between the network transmission state and all initial retransmission parameters;

and obtaining the at least one target retransmission parameter corresponding to the data packet based on the obtained candidate retransmission parameter set.

In one possible embodiment, the number of candidate retransmission parameters included in the candidate retransmission parameter set is the same as the number of times of repeated transmission of the data packet, and the obtaining module is specifically configured to:

If the feedback information includes at least one reference retransmission parameter detected by the receiving end, respectively smoothing the at least one reference retransmission parameter detected by the receiving end according to each candidate retransmission parameter in the candidate retransmission parameter set to obtain the at least one target retransmission parameter corresponding to the data packet;

And if the feedback information does not comprise at least one reference retransmission parameter detected by the receiving end, taking each candidate retransmission parameter in the candidate retransmission parameter set as the at least one target retransmission parameter corresponding to the data packet.

In a possible embodiment, the obtaining module is specifically configured to:

receiving at least one target retransmission parameter corresponding to the data packet sent by target equipment, wherein the target equipment is the receiving end or third party equipment except the sending end and the receiving end;

the target retransmission parameters used by the data packet in each repeated transmission are determined by the target device according to the feedback information of the receiving end which is received most recently.

In a possible embodiment, the processing module is specifically configured to:

for at least one repeated transmission of the one data packet, performing the following operations:

Determining a target quantization strategy corresponding to a target retransmission parameter of one repeated transmission according to a corresponding relation between the retransmission parameter and the quantization strategy, wherein quantization precision corresponding to different quantization strategies is different, and the size of coding bits of retransmission data packets obtained based on different quantization precision is different;

And encoding the data packet according to the target quantization precision of the target quantization strategy to obtain the retransmission data packet corresponding to the one-time repeated transmission.

In a fourth aspect, the present application provides a data transmission apparatus comprising:

The determining module is used for determining feedback information used for representing the transmission quality of the multimedia data according to the multimedia data transmitted by the transmitting end;

the second sending module is used for sending the feedback information to the sending end, so that the sending end triggers repeated transmission of each data packet to be transmitted when the transmission quality of the multimedia data is determined to not meet the set standard based on the feedback information;

The device comprises a transmitting end, a receiving module and a quantization module, wherein the transmitting end is used for transmitting data packets and at least one retransmission data packet corresponding to each data packet, the receiving module is used for receiving each data packet transmitted by the transmitting end and at least one retransmission data packet corresponding to each data packet, the transmitting end is used for acquiring at least one target retransmission parameter corresponding to one data packet and then respectively adopting a quantization strategy corresponding to the at least one target retransmission parameter to quantize the one data packet to obtain the data packet, and the data sizes of the retransmission data packets obtained by adopting different quantization strategies are different and are positively correlated with the bandwidth occupation amount.

In a possible embodiment, the determining module is further configured to:

Acquiring a current first network transmission state according to the newly determined feedback information;

And based on the obtained candidate retransmission parameter set, obtaining the at least one target retransmission parameter corresponding to each data packet to be transmitted by the sending end, and sending the obtained at least one target retransmission parameter corresponding to each data packet to the sending end.

In one possible embodiment, the number of candidate retransmission parameters included in the candidate retransmission parameter set is the same as the number of times of repeated transmission of the data packet, and the determining module is specifically configured to:

if the feedback information includes at least one reference retransmission parameter detected by the receiving end, respectively performing smoothing processing on the at least one reference retransmission parameter detected by the receiving end according to each candidate retransmission parameter in the candidate retransmission parameter set to obtain the at least one target retransmission parameter corresponding to each data packet to be transmitted by the sending end;

And if the feedback information does not comprise at least one reference retransmission parameter detected by the receiving end, taking each candidate retransmission parameter in the candidate retransmission parameter set as the at least one target retransmission parameter corresponding to each data packet to be transmitted by the sending end.

In a possible embodiment, the determining module is further configured to:

and sending feedback information comprising at least one reference retransmission parameter detected by the receiving end to third party equipment, so that the third party equipment determines the at least one target retransmission parameter corresponding to each data packet to be transmitted by the sending end according to the at least one reference retransmission parameter detected by the receiving end in the latest received feedback information, and sends the at least one target retransmission parameter corresponding to each data packet to be transmitted to the sending end.

In a fifth aspect, an embodiment of the present application provides an electronic device, including a processor and a memory, where the memory stores program code that, when executed by the processor, causes the processor to perform the steps of any of the methods of the first aspect, or the steps of any of the methods of the second aspect.

In a sixth aspect, embodiments of the present application provide a computer storage medium storing computer instructions that, when run on a computer, cause the computer to perform the steps of any of the methods of the first aspect, or the steps of any of the methods of the second aspect.

In a seventh aspect, embodiments of the present application provide a computer program product comprising a computer program stored in a computer readable storage medium, which when read from the computer readable storage medium by a processor of an electronic device, causes the electronic device to perform the steps of the method of any one of the first aspect or the steps of the method of any one of the second aspect.

The embodiment of the application adopts the technical scheme and has at least the following technical effects:

According to the embodiment of the application, based on feedback information of a receiving end, when the transmission quality of multimedia data is determined to not meet a set standard, a sending end is triggered to repeatedly transmit each data packet to be transmitted, wherein at least one target retransmission parameter corresponding to one data packet is acquired for each data packet, corresponding quantization strategies are respectively determined, the acquired at least one quantization strategy is adopted to carry out quantization processing on the data packet to obtain at least one retransmission data packet after the quantization processing, namely, the sending end respectively determines the corresponding quantization strategy according to the acquired at least one target retransmission parameter, and carries out quantization processing on the data packet to be transmitted according to the quantization strategy corresponding to each retransmission parameter, so that at least one retransmission data packet corresponding to the data packet after the quantization processing can be obtained. The data size of the retransmission data packet obtained by adopting different quantization strategies is different, and the data size of the retransmission data packet is positively correlated with the bandwidth occupation amount, so that the bandwidth occupation amount of the transmitted retransmission data packet can be adjusted by using different quantization strategies, thereby reducing the occupation of network transmission resources and avoiding network congestion.

Drawings

The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute a limitation on the application. In the drawings:

FIG. 1 is a schematic diagram of a multimedia data repeating system in the prior art;

Fig. 2 is a schematic diagram of an application architecture of a data transmission method according to an embodiment of the present application;

FIG. 3 is a flow chart of a data transmission method according to an embodiment of the present application;

Fig. 4 is a schematic diagram illustrating a transmission of multimedia data to a receiving end according to an embodiment of the present application;

fig. 5 is a schematic diagram of a sending end triggering retransmission according to an embodiment of the present application;

Fig. 6 is a flowchart of determining a target retransmission parameter by a transmitting end according to an embodiment of the present application;

fig. 7 is a flowchart of determining a target retransmission parameter by a receiving end according to an embodiment of the present application;

Fig. 8 is a flowchart of determining a target retransmission parameter by a third party device according to an embodiment of the present application;

FIG. 9 is a flow chart of at least one retransmission of a packet according to an embodiment of the present application;

FIG. 10 is a schematic diagram of an encoder frame according to an embodiment of the present application;

Fig. 11 is a schematic diagram of repeated transmission according to an embodiment of the present application;

fig. 12 is an overall flowchart of a multimedia data transmission according to an embodiment of the present application;

fig. 13 is a schematic structural diagram of a data transmission device according to an embodiment of the present application;

fig. 14 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

Fig. 15 is a schematic structural diagram of a data transmission device according to an embodiment of the present application;

Fig. 16 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the technical solutions of the present application, but not all embodiments. All other embodiments, based on the embodiments described in the present document, which can be obtained by a person skilled in the art without any creative effort, are within the scope of protection of the technical solutions of the present application.

In order to facilitate a better understanding of the technical solutions of the present application, the following description of some terms related to the present application will be presented to those skilled in the art:

The packet loss rate is the ratio of the number of lost data packets to the number of transmitted data packets, the packet loss rate is related to the length of the data packets and the frequency of packet transmission, and repeated multiple transmission can effectively avoid the problem that the corresponding data packets cannot be received by a receiving end due to network packet loss, but the repeated multiple transmission requires extra consumption of bandwidth.

Repeating multiple-meaning that the data packet is duplicated and transmitted to the receiving end at different time intervals.

In practical application, when multimedia data is transmitted, the packet loss phenomenon is easily caused in the transmission process due to the instability of the transmission network, so that the receiving end cannot normally receive the data, and the problem of network packet loss is usually solved by using a repeated multi-sending strategy. However, the repeated multiple transmission strategy requires additional bandwidth consumption, and the network congestion is aggravated due to the increase of repeated transmission times, more packet losses are further triggered, so that the receiving end cannot normally receive the transmission data, and the data transmission process between the transmitting end and the receiving end is seriously affected.

For ease of understanding, the following description will briefly be given of a repeated multiple strategy scheme in the related art.

Referring to fig. 1, a schematic diagram of a repeating multi-sending strategy in the related art is shown. The repeated multiple strategy is to copy the data packet multiple times and send the data packet to the receiving end at different time intervals. Taking a data packet obtained after the transmitted data packet is used as an example of the data packet obtained after the audio data encoding processing, the transmitting end configures repeated multiple times according to the real-time packet loss state counted by the receiving end, determines the number of the multiple data packets which are multiple to the receiving end according to the repeated multiple times, and transmits the data packet and a certain number of multiple data packets corresponding to the data packet to the receiving end.

The number of the multiple configured with the higher the counted packet loss rate is, for example, 100% when the packet loss rate reaches 20% -30%, and 200% when the packet loss rate reaches 30% -50%. And the increase of multiple times can ensure that the receiving end receives the multimedia data, so that in theory, the problem of network packet loss can be solved by increasing the multiple times.

However, the repeated multiple requires additional bandwidth consumption, the higher the repeated multiple is, the higher the bandwidth occupation is, that is, the network congestion is aggravated due to the increase of the repeated multiple, more packet loss is further triggered, and in the related art, the repeated multiple strategy is usually preset and limited in regulation rule, and in the network state with varied changes, the repeated multiple strategy cannot be timely adjusted for the network state. Therefore, the network packet loss problem cannot be effectively solved by using the repeated multiple strategy.

Therefore, in order to solve the above-mentioned problems, a data transmission method is provided in an embodiment of the present application, mainly for how to determine corresponding quantization strategies according to at least one target retransmission parameter corresponding to the obtained transmission when the data packet is repeatedly transmitted in a network packet loss scenario, and quantize the data packet by using the obtained at least one quantization strategy, so as to obtain at least one quantized retransmission data packet, wherein the data sizes of the retransmission data packets obtained by using different quantization strategies are different, and the data sizes of the retransmission data packets are positively correlated with the bandwidth occupation amount, so that the bandwidth occupation amount of each retransmission data packet can be effectively controlled, and the data packet and the at least one retransmission data packet are sent to a receiving end by using the corresponding bandwidth occupation amount based on the data size of the at least one retransmission data packet, that is, by controlling the bandwidth occupation amount of each retransmission data packet, the problem of congestion caused by excessive bandwidth occupation amount can be effectively avoided, and the packet loss rate of the network can be effectively reduced.

The system architecture of the data transmission method in the embodiment of the application can comprise at least one transmitting end and at least one receiving end. The transmitting end is used for transmitting the multimedia data to the receiving end.

Referring to fig. 2, taking a system architecture including a plurality of terminals 20 and a server 21 as an example, the number of terminals and servers included in the system architecture is not limited in the embodiment of the present application. Communication may be performed between terminals in the system architecture or between a terminal and a server based on a communication network. Each terminal in the system architecture can be used as a transmitting end of multimedia data or a receiving end of the multimedia data, and a server in the system architecture can be used as a transmitting end of the multimedia data or a receiving end of the multimedia data.

The terminal 20 may be any smart device such as a smart phone, a tablet computer, a portable personal computer, etc., and various applications may be installed on the terminal 20, and the object transmits multimedia data to other terminals 20 or the server 21 through an application client on the terminal 20. Or the server 21 receives a request sent by an application on the terminal 20, and the server sends multimedia data to the terminal 20.

Here, the server 21 is taken as a transmitting end, and the terminal 20 is taken as a receiving end. The server 21 can provide various network services for the terminal 20, and for different application programs, the server 21 can be regarded as a corresponding background server, and the background server can transmit multimedia data corresponding to the request to a corresponding receiving end according to the request sent by the terminal.

The method comprises the steps of transmitting multimedia data to a terminal 20 by a server 21, triggering each data packet to be transmitted to repeatedly transmit based on feedback information of the terminal 20 when determining that the transmission quality of the multimedia data does not meet a set standard, wherein the server 21 acquires at least one target retransmission parameter corresponding to one data packet for each data packet, respectively determining corresponding quantization strategies according to the at least one target retransmission parameter, respectively carrying out quantization processing on one data packet by adopting the acquired at least one quantization strategy, acquiring at least one retransmission data packet after quantization processing, respectively adopting corresponding bandwidth occupation amount based on the data size of the at least one retransmission data packet, and transmitting the one data packet and the at least one retransmission data packet to the terminal 20.

The server 21 may be a server, a server cluster formed by a plurality of servers, or a cloud computing center.

The terminal 20 and the server 21 may be connected through a communication network to realize communication therebetween. Alternatively, the communication networks described above use standard communication techniques, protocols, or a combination of both. The communication network is typically the internet, but may be any network including, but not limited to, a local area network (Local Area Network, LAN), metropolitan area network (Metropolitan Area Network, MAN), wide area network (Wide Area Network, WAN), a mobile, wired or wireless network, a private network, or any combination of virtual private networks. In some embodiments, data exchanged over the network is represented using techniques and/or formats including HyperText Mark-up Language (HTML), extensible markup Language (Extensible Markup Language, XML), and the like. All or some of the links may also be encrypted using conventional encryption techniques such as secure sockets layer (Secure Socket Layer, SSL), transport layer security (Transport Layer Security, TLS), virtual private network (Virtual Private Network, VPN), internet protocol security (Internet Protocol Security, IPsec), etc. In other embodiments, custom and/or dedicated data communication techniques may also be used in place of or in addition to the data communication techniques described above.

It should be noted that, the application architecture diagram in the embodiment of the present application is to more clearly illustrate the technical solution in the embodiment of the present application, and does not constitute a limitation on the technical solution provided by the embodiment of the present application, and for other application architectures and service applications, the technical solution provided by the embodiment of the present application is also applicable to similar problems, and in each embodiment of the present application, a data transmission method is applied to the application architecture shown in fig. 2 for schematic illustration.

Based on the above embodiments, referring to fig. 3, a flowchart of a data transmission method in an embodiment of the present application is shown, and the method is applied to a transmitting end, and specifically includes:

step S301, the transmitting end transmits the multimedia data to the receiving end.

Optionally, embodiments of the present application may include, but are not limited to, audio data, video data, text data, and picture data.

Illustratively, as shown in fig. 4, the object may input audio by triggering a control as shown in the left diagram of fig. 4, and send the input audio data to the receiving end.

In the embodiment of the application, the transmitting end inputs the multimedia data to be transmitted into the encoder to obtain the data packet corresponding to the multimedia data, and transmits the corresponding data packet to the receiving end.

The multimedia data to be transmitted may be multiple frames, and one data packet may include data of a part of frames in the multiple frames.

For example, taking multimedia data as audio data, where the audio data includes multiple frames, each frame of data may be input to an audio encoder to obtain a data packet corresponding to each frame. Wherein each data packet corresponds to audio data of a certain frame of the multi-frame audio data.

Step S302, the receiving end determines feedback information for representing the transmission quality of the multimedia data according to the multimedia data transmitted by the sending end.

In the embodiment of the application, the receiving end periodically detects the number of the data packets of the received multimedia data, determines feedback information and sends the feedback information detected periodically to the sending end.

The feedback information comprises a packet loss rate and the maximum continuous packet loss number.

In the embodiment of the application, the packet loss rate can be that the receiving end carries out packet loss statistics on the data packets in a statistics period, whether the received adjacent data packets meet the normal interval between the time stamps or not is judged based on the time stamp information (time) recorded in each data packet, if not, the data packet loss phenomenon is indicated, the number of the lost data packets in a statistics period is counted, and then the packet loss rate is determined according to the number of the lost data packets.

Wherein normally adjacent time stamps should be linearly increasing.

It should be noted that, the time interval of each data packet sent by the sending end is preset, and the receiving end can know the number of the data packets sent by the sending end in the statistical period, so that the receiving end can determine the packet loss rate corresponding to one statistical period according to the number of the lost data packets in the statistical period and the number of the data packets sent by the sending end.

The maximum continuous packet loss number may be the maximum number of data packets continuously lost in a statistics period according to the time stamp by the receiving end.

Step S303, the receiving end sends feedback information to the sending end.

Step S304, the transmitting end triggers repeated transmission of each data packet to be transmitted when determining that the transmission quality of the multimedia data does not meet the set standard based on the feedback information of the receiving end.

Exemplary, as shown in fig. 5, a schematic diagram of a transmitting end triggering retransmission according to an embodiment of the present application. As shown in fig. 5, the sending end transmits multimedia data to the receiving end, receives feedback information determined by the receiving end according to the transmitted multimedia data, and when the sending end determines that the set standard is not met according to the received feedback information, the sending end triggers repeated transmission, and the sending end starts to repeatedly transmit each data packet to be transmitted to the receiving end.

In an optional implementation manner, when the transmitting end determines that the transmission quality of the multimedia data does not meet the set standard based on the feedback information of the receiving end, the transmitting end may determine that at least one of the packet loss rate and the maximum number of continuous packets lost exceeds a threshold according to the packet loss rate and the maximum number of continuous packets lost included in the feedback information, so as to determine that the transmission quality of the multimedia data does not meet the set standard.

For example, taking the case of judging the packet loss rate as an example, if the threshold value corresponding to the packet loss rate is 40%, and if the received packet loss rate is 50%, it is determined that the transmission quality of the multimedia data does not meet the set standard.

Based on the above process, when the transmission quality of the multimedia data is determined not to meet the set standard, triggering to carry out repeated transmission on each data packet to be transmitted.

In step S305, the transmitting end determines each data packet to be transmitted and at least one retransmission data packet corresponding to each data packet.

After the transmitting end triggers retransmission, the receiving end periodically detects the received data packet to determine feedback information and transmits the feedback information detected periodically to the transmitting end.

The feedback information includes a reference retransmission parameter, a packet loss rate and a maximum continuous packet loss number.

The following description describes a data packet to be transmitted:

Optionally, in the embodiment of the present application, a transmitting end obtains at least one target retransmission parameter corresponding to a data packet, determines a corresponding quantization strategy according to the target retransmission parameter, and performs quantization processing on each data packet by using the determined quantization strategy to obtain at least one retransmission data packet after quantization processing of each data packet;

in implementation, the transmitting end may acquire at least one target retransmission parameter corresponding to one data packet according to a plurality of different manners.

The method comprises the steps that a transmitting end determines at least one target retransmission parameter corresponding to a data packet;

optionally, referring to fig. 6, a flowchart of determining a target retransmission parameter by a transmitting end according to an embodiment of the present application includes the following specific steps:

Step S601, a sending end obtains a current first network transmission state based on feedback information of a receiving end which is received latest;

Optionally, the embodiment of the present application determines the current first network transmission state according to the packet loss rate and the maximum continuous packet loss number in the latest received feedback information.

The following embodiments of the present application are directed to a process of determining a current first network transmission state according to a packet loss rate and a maximum continuous packet loss number in newly received feedback information:

In embodiment 1, the current first network transmission state is determined according to the latest received feedback information and the mapping relationship between the feedback information and the network transmission state.

In the embodiment of the application, when the network transmission state is determined according to the packet loss rate and the maximum continuous packet loss number, the packet loss rate can be divided into different ranges.

For example, the range of packet loss rate may be:

lossrate<3%;3%≤lossrate<5%;5%≤lossrate<10%;10%≤lossrate<15%;

15-lossrate%, lossrate-25%, lossrate-30%, lossrate-50% and lossrate-50%. Wherein lossrate denotes a packet loss rate.

In addition, when determining the network transmission state according to the packet loss rate and the maximum continuous packet loss number, the embodiment of the application can divide the maximum continuous packet loss number into different ranges.

Illustratively, the range dividing the maximum consecutive packet loss number may be:

contlost<2;2≤contlost<3;3≤contlost<4;4≤contlost<5;5≤contlost<6;

Contlost <8 > 6 <8 >, contlost <10 >8 < contlost <15 >, contlost <20 > 15, contlost <20 >. Wherein contlost denotes the maximum continuous packet loss number.

Based on the above ranges for dividing the packet loss rate, 9 ranges corresponding to the packet loss rate can be determined, and 10 ranges corresponding to the maximum continuous packet loss rate can be determined by dividing the range for the maximum continuous packet loss rate, and based on the 9 ranges corresponding to the determined packet loss rate and the 10 ranges corresponding to the determined maximum continuous packet loss rate, the embodiment of the application can determine the corresponding 90 network transmission states.

The mapping relationship between the feedback information and the network transmission state is exemplified by table 1.

In the embodiment of the present application, a case that contlost <2,2 is less than or equal to contlost <3 included in the maximum continuous packet loss number case is taken as an example in table 1, and a mapping relationship between feedback information and a network transmission state is exemplified.

It should be noted that the specific values in table 1 are only examples, and do not limit the present application.

TABLE 1

Note that lossrate in table 1 in the embodiment of the present application indicates a determined packet loss rate, and contlost indicates a determined maximum continuous packet loss number.

If the latest received packet loss rate is less than 3% and the maximum continuous packet loss number is less than 2, determining that the current network transmission state is 0.

Embodiment 2 determines, according to the latest received feedback information, a packet loss rate level corresponding to a packet loss rate in the feedback information, and determines a maximum continuous packet loss number level corresponding to a maximum continuous packet loss number in the feedback information, and determines a current first network transmission state according to the packet loss rate level and the maximum continuous packet loss number level.

In implementation, the embodiment of the application can determine the corresponding packet loss rate grade according to the packet loss rate in the latest received feedback information and the corresponding relation between the preset packet loss rate and the packet loss rate grade, and can determine the corresponding maximum continuous packet loss rate grade according to the maximum continuous packet loss number in the latest received feedback information and the corresponding relation between the preset maximum continuous packet loss number and the maximum continuous packet loss number grade.

The embodiment of the application can preset the packet loss rate grades corresponding to different packet loss rates.

Optionally, the corresponding relationship between the preset packet loss rate and the packet loss rate grade and the corresponding relationship between the maximum continuous packet loss number and the maximum continuous packet loss number grade in the embodiment of the application can be displayed through a table.

Exemplary, the corresponding relationship between the preset different packet loss rates and the packet loss rate grades is shown in table 2:

TABLE 2

Note that lossrate in table 2 in the embodiment of the present application indicates a determined packet loss rate, and state_ lossrate indicates a packet loss rate level.

For example, if the packet loss rate is less than 3%, it is determined that the packet loss rate class corresponding to the packet loss rate is 0.

Optionally, in the embodiment of the present application, a maximum continuous packet loss level corresponding to different maximum continuous packet loss numbers may be preset.

Exemplary, the corresponding relationship between the preset different maximum continuous packet loss numbers and the maximum continuous packet loss number grades is shown in table 3:

TABLE 3 Table 3

Note that contlost in table 3 in the embodiment of the present application indicates the determined maximum continuous packet loss, and state_ contlost indicates the maximum continuous packet loss level.

For example, if the maximum continuous packet loss is less than 2, the maximum continuous packet loss level corresponding to the maximum continuous packet loss is determined to be 0.

Based on table 3 of the above example, the maximum continuous packet loss level corresponding to the maximum continuous packet loss may be determined according to the maximum continuous packet loss determined in one statistical period.

Based on the above table 2 and table 3, the embodiment of the present application can determine that the current packet loss rate level includes 9 levels, and the maximum continuous packet loss number level includes 10 levels.

Optionally, different network transmission states may be preset based on different packet loss rate levels and different maximum consecutive packet loss number levels.

Based on the 9 packet loss rate levels, the 10 maximum continuous packet loss number levels can be preset to 90 network transmission states.

Exemplary, the partially preset network transmission status is shown by table 4. Table 4 is merely an example, and does not limit the present application.

TABLE 4 Table 4

Optionally, based on the determined packet loss rate level and the maximum continuous packet loss number level, in the embodiment of the present application, the corresponding network transmission state may be determined according to the packet loss rate level and the maximum continuous packet loss number level. The different packet loss rates and the different maximum continuous packet loss number grades are combined, so that the corresponding network transmission state can be determined.

For example, when the packet loss rate level is 0 and the maximum continuous packet loss number level is 0, the corresponding network transmission state 0 is the case where the packet loss rate level is 0 and the maximum continuous packet loss number level is 0, and the current first network transmission state is the case where the packet loss rate level is 0 and the maximum continuous packet loss number level is 0.

Step S602, a sending end selects a candidate retransmission parameter set corresponding to a first network transmission state from all initial retransmission parameters according to the mapping relation between the network transmission state and all initial retransmission parameters;

the number of candidate retransmission parameters included in the candidate retransmission parameter set is the same as the number of times of repeating transmission of the data packet.

For example, in the embodiment of the present application, table 5 shows a mapping relationship between a network transmission state and each initial retransmission parameter, and the number of initial retransmission parameters is taken as 3 as an example.

TABLE 5

For example, if the current first network transmission state is 0, according to the mapping relationship between the network transmission state and each initial retransmission parameter, the corresponding candidate retransmission parameter set is determined to be a1, a2, a3.

In the embodiment of the application, the candidate retransmission parameters in the candidate retransmission parameter set comprise candidate retransmission parameter sets corresponding to different sequence numbers. For example, the sequence numbers of the candidate retransmission parameters a1, a2, a3 in the candidate retransmission parameter set are 1,2,3.

It should be noted that, the initial retransmission parameter may be a specific value, for example, a1 may be 70%.

Optionally, the embodiment of the present application may provide several retransmission strategies, and based on a mapping relationship between a preset retransmission strategy and each initial retransmission parameter, a corresponding candidate retransmission parameter set may be determined according to the determined retransmission strategy after determining a preset network transmission state.

In the embodiment of the application, the quantity of the retransmission data packets can be adjusted by adjusting different retransmission strategies, the time interval between each retransmission data packet in the sending process is adjusted, and the like.

It should be noted that only one retransmission strategy can be used at each transmission.

For example, if the embodiment of the present application provides five retransmission strategies, each network transmission state corresponds to at least one initial retransmission parameter for the five retransmission strategies. After determining the network transmission status, determining at least one candidate retransmission parameter corresponding to the determined retransmission policy.

For example, if the determined network transmission status is 0 and the retransmission policy used is determined to be retransmission packets repeatedly transmitted 3, and each retransmission packet is transmitted at intervals of 20ms, the transmitting end transmits the retransmission packets respectively determined according to a1, a2, a3 at intervals of 20 ms.

Optionally, based on a process of determining at least one candidate retransmission parameter according to a network transmission state and a retransmission policy, the embodiments of the present application provide the following ways:

mode 1, determining at least one corresponding candidate retransmission parameter based on a preset retransmission policy.

In the embodiment of the application, after determining the network transmission state, based on a preset retransmission policy, at least one corresponding candidate retransmission parameter can be determined.

Mode 2, determining that a retransmission policy needs to be used based on a preset retransmission policy rule, and determining at least one corresponding candidate retransmission parameter based on the determined retransmission policy and the determined network transmission state.

In the embodiment of the application, the retransmission strategy can be determined to be needed according to the current network state and the preset retransmission strategy rule.

In an exemplary embodiment, when the network state is determined to be in a peak period, the retransmission policy to be used is determined according to a preset retransmission policy rule. The application is not limited in this regard.

Step S603, the transmitting end obtains at least one target retransmission parameter corresponding to a data packet based on the obtained candidate retransmission parameter set.

Optionally, in the embodiment of the present application, the process of obtaining at least one target retransmission parameter corresponding to one data packet may be divided into the following cases:

If the feedback information includes at least one reference retransmission parameter detected by the receiving end, respectively smoothing the at least one reference retransmission parameter detected by the receiving end according to each candidate retransmission parameter in the candidate retransmission parameter set to obtain at least one target retransmission parameter corresponding to one data packet;

It should be noted that, in the embodiment of the present application, the candidate retransmission parameters and the corresponding feedback information are determined by the receiving end in the same statistical period.

Based on the determined candidate retransmission parameters, the embodiment of the application can respectively determine at least one target retransmission parameter by respectively performing smoothing processing on at least one reference retransmission parameter detected by the receiving end and each candidate retransmission parameter.

Optionally, in the embodiment of the present application, the reference retransmission parameter detected by the receiving end includes at least one reference retransmission parameter, and the candidate retransmission parameter set includes at least one candidate retransmission parameter. The at least one reference retransmission parameter detected by the receiving end is a reference retransmission parameter corresponding to different sequence numbers, and the candidate retransmission parameter set also comprises candidate retransmission parameters corresponding to the same sequence number type.

Optionally, the embodiment of the present application performs smoothing processing on a candidate retransmission parameter corresponding to the sequence number in at least one candidate retransmission parameter set and a reference retransmission parameter corresponding to the sequence number based on the sequence number, and determines a target retransmission parameter corresponding to the sequence number.

Optionally, for one sequence number of the at least one sequence number, in the embodiment of the present application, the received candidate retransmission parameter of the sequence number and the reference retransmission parameter of the sequence number may be smoothed according to a formula. Success_rate (i, k) =a. Success_rate (i-1, k) + (1-a). Success_rate_cur (k)

Formula one

Wherein, the success_rate (i, k) represents a target retransmission parameter, the success_rate (i-1, k) represents a candidate retransmission parameter, the success_rate_cur (k) represents a reference retransmission parameter detected by a receiving end, and a represents a weight.

Based on the formula I, after at least one reference retransmission parameter is detected, the target retransmission parameter corresponding to the sequence number can be determined based on the reference retransmission parameter corresponding to any sequence number and the candidate retransmission parameter corresponding to the corresponding sequence number.

For the reference retransmission parameters corresponding to other sequence numbers, the smoothing process can be performed according to a formula I, and the target retransmission parameters corresponding to the sequence numbers can be determined.

Optionally, the embodiment of the present application may update the stored candidate retransmission parameters with the determined target retransmission parameters as candidate retransmission parameters.

And replacing the candidate retransmission parameters corresponding to the sequence numbers according to the sequence numbers corresponding to each target retransmission parameter in at least one target retransmission parameter to obtain updated candidate retransmission parameters.

For example, taking the reference retransmission parameter as an example, the receiving end detects the success rate of receiving the retransmission packet. And (3) carrying out an example on the candidate retransmission parameters corresponding to one sequence number in each candidate retransmission parameter set, if the candidate retransmission parameters corresponding to the sequence number are 70%, the detected reference retransmission parameters corresponding to the sequence number are 80%, and if the target retransmission parameters obtained after smoothing processing according to the candidate retransmission parameters and the reference retransmission parameters are 75%, modifying the mapping relation between the network transmission state and the initial retransmission parameters corresponding to the sequence number, and modifying the network transmission state into the mapping relation between the network transmission state and the initial retransmission parameters of 75%. Then the next time the candidate retransmission parameter corresponding to the sequence number is determined according to the network transmission state, the determined candidate retransmission parameter is 75%.

And 2, if the feedback information does not include at least one reference retransmission parameter detected by the receiving end, taking each candidate retransmission parameter in the candidate retransmission parameter set as at least one target retransmission parameter corresponding to one data packet.

After the sending end triggers retransmission, the receiving end does not determine feedback information of the first period detection after triggering retransmission. The reference retransmission parameter in the feedback information is periodically detected by the receiving end after the transmitting end triggers retransmission, so that at least one reference retransmission parameter detected by the receiving end is not included in the feedback information of the transmitting end at this time.

And in the second mode, the transmitting end receives at least one target retransmission parameter corresponding to one data packet transmitted by the receiving end.

In this way, the receiving end determines at least one target retransmission parameter corresponding to each data packet, and sends the determined at least one target retransmission parameter corresponding to each data packet to the sending end.

Optionally, referring to fig. 7, a flowchart of determining a target retransmission parameter by a receiving end according to an embodiment of the present application includes the following specific steps:

Step S701, a receiving end obtains a current first network transmission state according to the feedback information which is determined most recently;

Step S702, a receiving end selects a candidate retransmission parameter set corresponding to a first network transmission state from all initial retransmission parameters according to the mapping relation between the network transmission state and all initial retransmission parameters;

The number of the candidate retransmission parameters included in the candidate retransmission parameter set is the same as the number of times of repeated transmission of the data packet.

Step S703, the receiving end obtains at least one target retransmission parameter corresponding to each data packet to be transmitted by the transmitting end based on the obtained candidate retransmission parameter set.

It should be noted that, in the embodiment of the present application, the process from step S701 to step S703 may refer to the process from step S601 to step S603, and the present application is not described herein.

Step S704, the receiving end sends at least one target retransmission parameter corresponding to each obtained data packet to the sending end.

Optionally, the embodiment of the present application determines the target retransmission parameters in the following ways:

In the mode 1, if the feedback information includes at least one reference retransmission parameter detected by the receiving end, smoothing the at least one reference retransmission parameter detected by the receiving end according to each candidate retransmission parameter in the candidate retransmission parameter set, so as to obtain the at least one target retransmission parameter corresponding to each data packet to be transmitted by the transmitting end;

it should be noted that, the process that the receiving end obtains the at least one target retransmission parameter corresponding to each data packet to be transmitted by the sending end according to the feedback information including at least one reference retransmission parameter detected by the receiving end may refer to the process that the sending end obtains the at least one target retransmission parameter corresponding to each data packet to be transmitted by the sending end according to the feedback information including at least one reference retransmission parameter detected by the receiving end. The present application is not described in detail herein.

And 2, if the feedback information does not include at least one reference retransmission parameter detected by the receiving end, taking each candidate retransmission parameter in the candidate retransmission parameter set as at least one target retransmission parameter corresponding to each data packet to be transmitted by the sending end.

After the sending end triggers retransmission, the receiving end does not determine feedback information of the first period detection after triggering retransmission. The reference retransmission parameters in the feedback information are periodically detected by the receiving end after the transmitting end triggers retransmission, so that at least one reference retransmission parameter detected by the receiving end is not included in the feedback information of the receiving end at the moment.

In the third mode, the transmitting end receives at least one target retransmission parameter corresponding to one data packet sent by the third party device.

In this way, the third party device determines at least one target retransmission parameter corresponding to each data packet, and sends the determined at least one target retransmission parameter corresponding to each data packet to the sending end.

Optionally, referring to fig. 8, a flowchart of determining a target retransmission parameter by a third party device according to an embodiment of the present application includes the following specific steps:

step S801, the receiving end sends feedback information including at least one reference retransmission parameter detected by the receiving end to the third party device.

Step S802, the third party device determines at least one target retransmission parameter corresponding to each data packet to be transmitted by the sending end according to at least one reference retransmission parameter detected by the receiving end in the latest received feedback information.

It should be noted that, in the embodiment of the present application, the process of determining, by the third party device, at least one target retransmission parameter corresponding to each data packet to be transmitted may refer to a process of acquiring, by the transmitting end, at least one target retransmission parameter corresponding to each data packet to be transmitted, which is not described herein in detail.

Step 803, the third party device sends at least one target retransmission parameter corresponding to each data packet to be transmitted to the sending end.

After determining at least one target retransmission parameter corresponding to a data packet, the transmitting end of the embodiment of the application can quantize the data packet according to the target retransmission parameter to obtain at least one retransmission data packet after quantization.

The following describes in detail the process of performing quantization processing on a data packet to obtain at least one retransmission data packet after the quantization processing:

In the embodiment of the application, corresponding quantization strategies are respectively determined according to at least one target retransmission parameter, and quantization processing is carried out on one data packet by adopting the obtained at least one quantization strategy respectively, so as to obtain at least one retransmission data packet after the quantization processing;

the data sizes of the retransmission data packets obtained by adopting different quantization strategies are different, and the data sizes of the retransmission data packets are positively correlated with the bandwidth occupation amount.

Optionally, in the embodiment of the present application, for at least one retransmission of a data packet, a flowchart of at least one retransmission of a data packet as shown in fig. 9 is provided, and specific steps are as follows:

Step S901, determining a target quantization strategy corresponding to a target retransmission parameter of one-time repeated transmission according to a correspondence between the retransmission parameter and the quantization strategy;

the quantization precision corresponding to different quantization strategies is different, and the size of the coding bit of the retransmission data packet obtained based on the different quantization precision is different;

Step S902, according to the target quantization precision of the target quantization strategy, encoding a data packet to obtain a retransmission data packet corresponding to one repeated transmission.

It should be noted that, in the embodiment of the present application, a correspondence between retransmission parameters and quantization policies may be preset, and a corresponding target quantization policy may be determined according to a target retransmission parameter.

Optionally, the correspondence between the retransmission parameters and the quantization policies preset in the embodiment of the present application is shown in table 6:

TABLE 6

In the embodiment of the present application, the success_rate (i, k) represents a determined target retransmission parameter.

For example, for a retransmission packet with a quantization policy of "no quantization processing", the retransmission packet is sent to the receiving end with a corresponding bandwidth occupation amount based on the size of the original packet.

In the embodiment of the application, based on different quantization strategies, the encoder respectively quantizes and encodes the data packet and stores the data packet in a transmission buffer.

Optionally, taking multimedia data as audio data as an example, the embodiment of the present application may process the data packet in several ways:

Mode 1a conventional audio encoder based on an acoustic excitation model processes data packets.

Wherein the conventional encoder may be opus encoder.

In the embodiment of the application, the encoder can control the quantization precision by adjusting the prediction gain of the prediction filter, and when the prediction gain value is reduced, the entropy value of the quantization index is increased, so that the encoded bit number is increased, namely the quantization precision is improved. Conversely, if the prediction gain of the prediction filter increases, the entropy value of the quantization index is lowered, thereby reducing the number of encoded bits, i.e., the quantization accuracy decreases.

Mode 2, processing a data packet based on a deep learning audio encoder.

Wherein the main stream of the deep learning audio encoder is implemented based on an encoder-rvq-decoder framework, wherein rvq (residual vector quantizers) represents a quantization accuracy control unit. The specific frame is shown in fig. 10, and as shown in the left graph in fig. 10, is a training process of a deep learning audio encoder, wherein audio data is input into an encoder-rvq-decoder frame, the audio data is converted into an encoded signal by an encoder in the frame, the encoded signal is subjected to denoising processing, the encoded signal is compressed by a quantization precision control unit, and finally the encoded signal is converted into audio by a decoder. Wherein the converted audio is made as close as possible to the original audio by the discriminator by inputting the converted audio and the original audio into the discriminator.

As shown in the right diagram of fig. 10, in the inferred deployment of the deep learning audio encoder, the encoder and quantization accuracy control unit transmit the compressed bit stream to the receiving end at the transmitting end, and the decoder applies decoding to the audio signal to form high quality audio at the receiving end.

As shown in fig. 10, the audio data is input into an encoder-rvq-decoder framework to obtain a corresponding quantized retransmission packet.

Step S306, the transmitting end respectively adopts corresponding bandwidth occupation amount based on the data size of at least one retransmission data packet to transmit one data packet and at least one retransmission data packet to the receiving end.

Exemplary, as shown in fig. 11, a schematic diagram of repeated transmission according to an embodiment of the present application is shown. When a sending end repeatedly transmits each data packet to be transmitted, the embodiment of the application respectively sends each data packet and at least one retransmission data packet corresponding to each data packet to a receiving end based on the bandwidth occupation amount.

As shown in fig. 12, an overall flow chart of multimedia data transmission according to an embodiment of the present application is shown. When triggering each data packet to be transmitted to repeatedly transmit, processing the data packet to be transmitted according to different quantization strategies to obtain a corresponding retransmission data packet obtained through different quantization processes, storing the processed retransmission data packet in a sending buffer area, performing multiple operations to a receiving end according to the retransmission data packet, and after the receiving end receives the data packet and the retransmission data packet, respectively performing decoding processing on the received data packet and the retransmission data packet to obtain corresponding multimedia data. And when the receiving end receives the data packet, the receiving end detects the packet loss rate and the maximum continuous packet loss number of the received data packet in a counting period, and when the receiving end receives the retransmission data packet, the receiving end counts the receiving success rate of the retransmission data packet with each serial number in the received retransmission data packet in the counting period. In the multi-packet quantization control module, the retransmission data packets which are stored in the sending buffer area of the sending end and processed by different quantization strategies are selected according to the determined packet loss rate, the maximum continuous packet loss number and the receiving success rate, and the retransmission data packets which are required to be sent and processed by the quantization strategies are selected, so that the sending end sends the selected retransmission data packets to the receiving end.

For example, taking a retransmission policy of 400% as an example, four retransmission packets are transmitted based on one packet. If the counting period is two seconds, the receiving end respectively counts the receiving success rate of the retransmission data packet with the sequence number of 1-4 within two seconds after triggering the repeated transmission, and determines the receiving success rates corresponding to different sequence numbers. For example, if the number of retransmission packets with sequence numbers 1 to 4 received by the receiving end in two seconds is 10, 70, 85, 5, respectively, and the number of retransmission packets with sequence numbers 1 to 4 transmitted by the transmitting end in the two seconds is 100, 20, respectively, then the success rate of receiving retransmission packets with sequence numbers 1 to 4 is 10/100=10%, 70/100=70%, 85/100=85%, 5/20=25%, respectively.

In the embodiment of the present application, the third party device may perform the task of selecting the retransmission data packet to be transmitted in the multiple packet quantization control module, or the transmitting end may perform the task of selecting the retransmission data packet to be transmitted in the multiple packet quantization control module. The application is not limited in this regard.

Step S307, the receiving end receives each data packet sent by the sending end and at least one retransmission data packet corresponding to each data packet.

Based on the above process, the data transmission method of the embodiment of the present application can be applied to a voice transmission scene in a voip (voice over IP) call, a transmission scene of a picture and a voice during a game, a transmission scene of a picture and a voice during live broadcasting, and a transmission scene of a voice during audio broadcasting.

In the embodiment of the application, aiming at the transmission of the picture and the sound, the sound and the picture can be respectively transmitted.

For convenience of description, the above parts are respectively described as functionally divided into modules. Of course, the functions of each module may be implemented in the same piece or pieces of software or hardware when implementing the present application.

Those skilled in the art will appreciate that the various aspects of the application may be implemented as a system, method, or program product. Accordingly, aspects of the present application may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, micro-code, etc.) or an embodiment combining hardware and software aspects that may be referred to herein collectively as a "circuit," module "or" system.

The specific implementation manner of each module in the apparatus in the above embodiment has been described in detail in the embodiment related to the method, and will not be described in detail herein.

Based on the same inventive concept, the embodiments of the present application provide a data transmission device, which solves the problem on the similar principle as the method of the above embodiments, so that the implementation of the device can refer to the implementation of the above method, and the repetition is omitted.

As shown in fig. 13, a data transmission device 1300 provided in an embodiment of the present application includes a transmission module 1301, a triggering module 1302, an obtaining module 1303, a processing module 1304, and a first sending module 1305.

A transmission module 1301, configured to transmit multimedia data to a receiving end;

a triggering module 1302, configured to trigger, based on feedback information of the receiving end, repeated transmission of each data packet to be transmitted when it is determined that the transmission quality of the multimedia data does not meet a set standard;

An obtaining module 1303, configured to obtain at least one target retransmission parameter corresponding to a data packet;

a processing module 1304, configured to determine corresponding quantization policies according to the at least one target retransmission parameter, and perform quantization processing on the one data packet by using the obtained at least one quantization policy, so as to obtain at least one quantized retransmission data packet, where data sizes of the retransmission data packets obtained by using different quantization policies are different, and the data sizes of the retransmission data packets and the bandwidth occupation amounts are in positive correlation;

And the first sending module 1305 is configured to send the one data packet and the at least one retransmission data packet to the receiving end by adopting corresponding bandwidth occupation amounts based on the data size of the at least one retransmission data packet.

In one possible embodiment, the obtaining module 1303 is specifically configured to:

In one possible embodiment, the number of candidate retransmission parameters included in the candidate retransmission parameter set is the same as the number of times of repeated transmission of the data packet, and the obtaining module 1303 is specifically configured to:

In one possible embodiment, the processing module 1304 is specifically configured to:

The principle of solving the problem of the electronic device is similar to that of the method of the above embodiment, so that the implementation of the electronic device can refer to the implementation of the method, and the repetition is omitted.

Referring to fig. 14, the electronic device 140 may include at least a processor 141, and a memory 142. Wherein the memory 142 stores program code which, when executed by the processor 141, causes the processor 141 to perform the steps performed by the client in the data transmission method in the above-described embodiment of the present application.

As shown in fig. 15, a data transmission apparatus 1500 provided in an embodiment of the present application includes a determining module 1501, a second sending module 1502, and a receiving module 1503.

A determining module 1501, configured to determine feedback information representing transmission quality of multimedia data transmitted by a transmitting end according to the multimedia data;

A second sending module 1502, configured to send the feedback information to the sending end, so that the sending end triggers repeated transmission of each data packet to be transmitted when determining, based on the feedback information, that the transmission quality of the multimedia data does not meet a set standard;

The receiving module 1503 is configured to receive each data packet sent by the sending end and at least one retransmission data packet corresponding to each data packet, where the at least one retransmission data packet corresponding to one data packet is obtained by respectively performing quantization processing on the one data packet by using a quantization policy corresponding to the at least one target retransmission parameter after the sending end obtains at least one target retransmission parameter corresponding to the one data packet, and the data sizes of the retransmission data packets obtained by using different quantization policies are different, and the data sizes of the retransmission data packets are positively correlated with the bandwidth occupation amount.

In a possible embodiment, the determining module 1501 is further configured to:

In one possible embodiment, the number of candidate retransmission parameters included in the candidate retransmission parameter set is the same as the number of times of repeated transmission of the data packet, and the determining module 1501 is specifically configured to:

In a possible embodiment, the determining module 1501 is further configured to:

An electronic device 160 according to such an embodiment of the application is described below with reference to fig. 16. The electronic device 160 of fig. 16 is merely an example and should not be construed as limiting the functionality and scope of use of embodiments of the present application.

As shown in fig. 16, the electronic device 160 is embodied in the form of a general-purpose electronic device. The components of electronic device 160 may include, but are not limited to, at least one processing unit 161, at least one memory unit 162 as described above, and a bus 163 that connects the various system components, including memory unit 162 and processing unit 161.

Bus 163 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a processor, or a local bus using any of a variety of bus architectures.

The storage unit 162 may include readable media in the form of volatile memory, such as Random Access Memory (RAM) 1621 and/or cache memory 1622, and may further include Read Only Memory (ROM) 1623.

Storage unit 162 may also include a program/utility 1616 having a set (at least one) of program modules 1624, such program modules 1624 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment.

Electronic device 160 may also communicate with one or more external devices 164 (e.g., keyboard, pointing device, etc.), one or more devices that enable objects to interact with electronic device 160, and/or any device (e.g., router, modem, etc.) that enables electronic device 160 to communicate with one or more other electronic devices. Such communication may occur through an input/output (I/O) interface 165. Also, electronic device 160 may communicate with one or more networks, such as a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network, such as the Internet, via network adapter 166. As shown, network adapter 166 communicates with other modules for electronic device 160 through bus 163. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with electronic device 160, including, but not limited to, microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.

Based on the same inventive concept as the above-described method embodiments, aspects of the interface presenting method provided by the present application may also be implemented in the form of a program product, which comprises program code for causing an electronic device to perform the steps performed by a server in the interface presenting method according to the various exemplary embodiments of the present application described in the present specification, when the program product is run on the electronic device.

The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of a readable storage medium include an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

While preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiments and all such alterations and modifications as fall within the scope of the application.

It will be apparent to those skilled in the art that various modifications and variations can be made to the present application without departing from the spirit or scope of the application. Thus, it is intended that the present application also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.

Claims

1. A data transmission method, characterized in that it is applied to a sending end, and the method comprises:

Transmit multimedia data to a receiving end;

Based on the feedback information of the receiving end, when it is determined that the transmission quality of the multimedia data does not meet the set standard, triggering repeated transmission of each data packet to be transmitted;

After the repeated transmission is triggered, the following operations are performed for each data packet to be transmitted:

Obtaining at least one target retransmission parameter corresponding to a data packet;

Determine the corresponding quantization strategies according to the at least one target retransmission parameter, and respectively use the obtained at least one quantization strategy to quantize the one data packet to obtain at least one retransmission data packet after quantization, wherein the data sizes of the retransmission data packets obtained by using different quantization strategies are different, and the data size of the retransmission data packet is positively correlated with the bandwidth occupancy;

Based on the data size of the at least one retransmission data packet, the one data packet and the at least one retransmission data packet are sent to the receiving end using corresponding bandwidth occupancy amounts.

2. The method according to claim 1, wherein obtaining at least one target retransmission parameter corresponding to a data packet comprises:

Obtaining a current first network transmission state based on the most recently received feedback information from the receiving end;

Selecting, from the initial retransmission parameters, a candidate retransmission parameter set corresponding to the first network transmission state according to a mapping relationship between the network transmission state and the initial retransmission parameters;

Based on the obtained candidate retransmission parameter set, the at least one target retransmission parameter corresponding to the one data packet is obtained.

3. The method according to claim 2, wherein the number of candidate retransmission parameters included in the candidate retransmission parameter set is the same as the number of times the data packet is repeatedly transmitted;

The obtaining, based on the obtained candidate retransmission parameter set, the at least one target retransmission parameter corresponding to the one data packet comprises:

If the feedback information includes at least one reference retransmission parameter detected by the receiving end, smoothing the at least one reference retransmission parameter detected by the receiving end according to each candidate retransmission parameter in the candidate retransmission parameter set to obtain the at least one target retransmission parameter corresponding to the one data packet;

If the feedback information does not include the at least one reference retransmission parameter detected by the receiving end, each candidate retransmission parameter in the candidate retransmission parameter set is used as the at least one target retransmission parameter corresponding to the one data packet.

4. The method according to claim 1, wherein obtaining at least one target retransmission parameter corresponding to a data packet comprises:

Receiving at least one target retransmission parameter corresponding to the data packet sent by a target device; wherein the target device is the receiving end, or a third-party device other than the sending end and the receiving end;

The target retransmission parameter used for each repeated transmission of a data packet is determined by the target device according to the most recently received feedback information from the receiving end.

5. The method according to any one of claims 1 to 4, characterized in that the step of determining corresponding quantization strategies according to the at least one target retransmission parameter, and using the at least one obtained quantization strategy to quantize the one data packet to obtain at least one retransmission data packet after quantization, comprises:

For at least one repeated transmission of the one data packet, perform the following operations:

Determine a target quantization strategy corresponding to a target retransmission parameter of a repeated transmission according to a correspondence between the retransmission parameter and the quantization strategy; wherein different quantization strategies correspond to different quantization accuracies, and the coded bit sizes of the retransmission data packets obtained based on the different quantization accuracies are different;

According to the target quantization accuracy of the target quantization strategy, the one data packet is encoded to obtain a retransmission data packet corresponding to the one repeated transmission.

6. A data transmission method, characterized in that it is applied to a receiving end, and the method comprises:

Determining, according to the multimedia data transmitted by the sending end, feedback information used to indicate the transmission quality of the multimedia data;

Sending the feedback information to the sending end, so that when the sending end determines based on the feedback information that the transmission quality of the multimedia data does not meet the set standard, triggering repeated transmission of each data packet to be transmitted;

Receive each data packet sent by the sending end and at least one retransmission data packet corresponding to each data packet; wherein, the at least one retransmission data packet corresponding to the one data packet is obtained by the sending end after obtaining at least one target retransmission parameter corresponding to the one data packet, and then using the quantization strategy corresponding to the at least one target retransmission parameter to quantize the one data packet; wherein, the data sizes of the retransmission data packets obtained by using different quantization strategies are different, and the data size of the retransmission data packets is positively correlated with the bandwidth occupancy.

7. The method according to claim 6, characterized in that the method further comprises:

Obtaining a current first network transmission state according to the latest determined feedback information;

Based on the obtained candidate retransmission parameter set, the at least one target retransmission parameter corresponding to each data packet to be transmitted by the transmitting end is obtained, and the at least one target retransmission parameter corresponding to each data packet obtained is sent to the transmitting end.

8. The method according to claim 7, wherein the number of candidate retransmission parameters included in the candidate retransmission parameter set is the same as the number of times the data packet is repeatedly transmitted;

The obtaining, based on the obtained candidate retransmission parameter set, the at least one target retransmission parameter corresponding to each data packet to be transmitted by the transmitting end comprises:

If the feedback information includes at least one reference retransmission parameter detected by the receiving end, then, according to each candidate retransmission parameter in the candidate retransmission parameter set, respectively smoothing the at least one reference retransmission parameter detected by the receiving end, to obtain the at least one target retransmission parameter corresponding to each data packet to be transmitted by the sending end;

If the feedback information does not include at least one reference retransmission parameter detected by the receiving end, each candidate retransmission parameter in the candidate retransmission parameter set is used as the at least one target retransmission parameter corresponding to each data packet to be transmitted by the sending end.

9. The method according to claim 6, characterized in that after determining the feedback information for indicating the transmission quality of the multimedia data according to the multimedia data transmitted by the transmitting end, the method further comprises:

Feedback information including at least one reference retransmission parameter detected by the receiving end is sent to a third-party device, so that the third-party device determines the at least one target retransmission parameter corresponding to each data packet to be transmitted by the transmitting end according to the at least one reference retransmission parameter detected by the receiving end in the most recently received feedback information, and sends the at least one target retransmission parameter corresponding to each data packet to be transmitted to the transmitting end.

10. A data transmission device, comprising:

A transmission module, used for transmitting multimedia data to a receiving end;

A trigger module, configured to trigger repeated transmission of each data packet to be transmitted when it is determined that the transmission quality of the multimedia data does not meet a set standard based on the feedback information of the receiving end;

An acquisition module, used for acquiring at least one target retransmission parameter corresponding to a data packet;

A processing module, configured to determine corresponding quantization strategies according to the at least one target retransmission parameter, and respectively use the obtained at least one quantization strategy to perform quantization processing on the one data packet to obtain at least one retransmission data packet after quantization processing, wherein the data sizes of the retransmission data packets obtained by using different quantization strategies are different, and the data size of the retransmission data packet is positively correlated with the bandwidth occupancy;

The first sending module is used to send the one data packet and the at least one retransmission data packet to the receiving end by using corresponding bandwidth occupancy amounts based on the data size of the at least one retransmission data packet.

11. A data transmission device, comprising:

A determination module, used to determine feedback information indicating the transmission quality of the multimedia data according to the multimedia data transmitted by the sending end;

A second sending module, configured to send the feedback information to the sending end, so that when the sending end determines based on the feedback information that the transmission quality of the multimedia data does not meet the set standard, the sending end triggers repeated transmission of each data packet to be transmitted;

A receiving module is used to receive each data packet sent by the sending end and at least one retransmission data packet corresponding to each data packet; wherein, the at least one retransmission data packet corresponding to the one data packet is obtained by the sending end after obtaining at least one target retransmission parameter corresponding to the one data packet, and then using the quantization strategy corresponding to the at least one target retransmission parameter to quantize the one data packet; wherein the data size of the retransmission data packet obtained by using different quantization strategies is different, and the data size of the retransmission data packet is positively correlated with the bandwidth occupancy.

12. An electronic device, characterized in that it comprises a processor and a memory, wherein the memory stores a program code, and when the program code is executed by the processor, the processor performs the steps of any method in claims 1 to 5, or the steps of any method in claims 6 to 9.

13. A computer-readable storage medium, characterized in that it includes a computer program, and when the computer program is run on an electronic device, the computer program is used to enable the electronic device to execute the steps of any method in claims 1 to 5, or the steps of any method in claims 6 to 9.

14. A computer program product, characterized in that it comprises a computer program, wherein the computer program is stored in a computer-readable storage medium, and a processor of an electronic device reads and executes the computer program from the computer-readable storage medium, so that the electronic device performs the steps of any method in claims 1 to 5, or the steps of any method in claims 6 to 9.