CN106302372A - Network media stream packet receiving method, Apparatus and system - Google Patents

Abstract

The present invention provides a network media stream packet receiving method, device and system, wherein the method receives an instruction for fetching data packets from the user side, wherein the instruction includes a preset number of packets to be received, and is obtained from the kernel receiving buffer of the kernel space After the preset number of data packets received, send the preset number of data packets to the user receiving buffer on the user side, which solves the problem that the system frequently calls network data packets and seriously reduces the performance of the streaming media server, and improves the performance of the streaming media server. The external service capability of the streaming media server is improved.

Description

Network media stream packet receiving method, device and system

technical field

The present invention relates to the communication field, in particular, to a method, device and system for receiving network media stream packets.

Background technique

In operating systems such as Unix/Linux, network packets are generally received through network sockets using system calls. In the process of receiving data packets, it is necessary to fall into the kernel state through relevant system calls, and copy the data packets received by the network card from the kernel receiving buffer to the user buffer. For the User Data Protocol (UDP) code stream, the system call recvfrom for receiving packets can only return one packet at a time.

In related technologies, an Internet Protocol Television (IPTV for short) streaming server may need to receive live code streams of more than two hundred channels from an encoder. Calculated on the basis of 200 channels with a code rate of 8Mbps for each channel, the traffic to be received will reach 1.6Gbps; if it is a 4K resolution ultra-high-definition channel, calculated at an average of 20Mbps, the traffic will reach 4Gbps. Assuming that the size of each UDP packet sent by the encoder is 1500 bytes, in the case of 4K resolution, the system calls per second will reach more than 330,000 times. The overhead of system calls seriously affects the performance of the streaming media server and its external service capabilities.

Aiming at the problem in the related technology that the system frequently invokes network data packets and seriously reduces the performance of the streaming media server, no effective solution has been proposed yet.

Contents of the invention

The present invention provides a network media stream packet receiving method, device and system to at least solve the problem in the related art that the system frequently invokes network data packets.

According to one aspect of the present invention, a method for receiving network media stream packets is provided, including:

receiving an instruction from the user side to fetch data packets, wherein the instruction includes a preset number of received packets;

After acquiring the preset received data packets from the kernel receiving buffer in the kernel space, sending the preset received data packets to the user receiving buffer on the user side.

Further, said obtaining a preset number of received packets from the kernel receiving buffer of the kernel space includes:

A detection function is registered in the kernel space, and the detection function obtains the preset number of received packets from the kernel receiving buffer of the kernel space.

Further, the instruction includes an identification parameter, and the acquisition of a preset number of received packets from the kernel receive buffer in the kernel space includes:

A detection function corresponding to the identification parameter is identified in the kernel space, and the detection function obtains the preset number of received packets from a kernel receiving buffer in the kernel space.

Further, after receiving the instruction for fetching data packets from the user side, it includes:

In the case that the number of data packets in the kernel receiving buffer of the kernel space is less than the preset number of received packets, the current data packets in the kernel receiving buffer of the kernel space are sent to the user on the user side Receive buffer.

Further, while sending the data packets of the preset number of received packets to the user receiving buffer of the user side, the auxiliary information of the data packets is also sent to the user receiving buffer of the user side, Wherein, the auxiliary information includes at least one of the following: data packet length, receiving time, source IP address, and port number.

According to another aspect of the present invention, a method for receiving network media stream packets is also provided, including:

The user side sends an instruction to fetch data packets, wherein the instruction includes a preset number of received packets;

The user receiving buffer on the user side receives the preset number of data packets sent from the kernel space, and the preset number of data packets are obtained from the kernel receiving buffer of the kernel space.

Further, the calculation factor of the preset number of received packets includes at least one of the following:

Code rate, packet receiving interval.

According to another aspect of the present invention, a network media stream packet receiving device is also provided, including:

The first receiving module is configured to receive an instruction for fetching data packets from the user side, wherein the instruction includes a preset number of received packets;

The acquisition module is configured to acquire the preset received data packets from the kernel receiving buffer in the kernel space, and then send the preset received data packets to the user receiving buffer on the user side.

Further, the acquisition module includes:

The first obtaining unit is configured to register a detection function in the kernel space, and the detection function obtains the preset number of received packets from the kernel receiving buffer of the kernel space.

Further, the instruction includes an identification parameter, and the acquisition module includes:

The second obtaining unit is configured to identify a detection function corresponding to the identification parameter in the kernel space, and the detection function obtains the preset number of received packets from the kernel receiving buffer of the kernel space.

Further, the acquisition module includes:

The third acquisition unit is used to send the data packets currently in the kernel receiving buffer of the kernel space when the number of data packets in the kernel receiving buffer of the kernel space is less than the preset number of received packets Give the user receive buffer on the user side.

Further, the device also includes:

The first sending module is configured to send the auxiliary information of the data packet to the user receiving buffer of the user side, wherein the auxiliary information includes at least one of the following: data packet length, receiving time, source IP address, The port number.

According to another aspect of the present invention, a network media stream packet receiving device is also provided, including:

The second sending module is used for the user side to send an instruction for fetching data packets, wherein the instruction includes a preset number of received packets;

The second receiving module is used for the user receiving buffer on the user side to receive the preset number of data packets sent from the kernel space, the preset number of data packets received from the kernel space Acquired by the kernel receive buffer.

Further, the calculation factor of the preset number of received packets includes at least one of the following:

Code rate, packet receiving interval.

According to another aspect of the present invention, there is also provided a network media stream packet receiving system, which is characterized in that it includes: a user side device, a kernel device;

The kernel device receives an instruction from the user-side device to fetch data packets, wherein the instruction includes a preset number of received packets;

After acquiring the preset received data packets from the kernel receiving buffer of the kernel device, sending the preset received data packets to the user receiving buffer of the user-side device.

According to the present invention, an instruction for receiving data packets from the user side is adopted, wherein the instruction includes a preset number of received packets, and after obtaining the preset number of data packets from the kernel receiving buffer in the kernel space, the preset received packets A number of data packets are sent to the user receiving buffer on the user side, which solves the problem that the system frequently calls network data packets and seriously reduces the performance of the streaming media server, and improves the external service capability of the streaming media server.

Description of drawings

The accompanying drawings described here are used to provide a further understanding of the present invention and constitute a part of the application. The schematic embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations to the present invention. In the attached picture:

Fig. 1 is a flow chart one of a method for receiving packets of a network media stream according to an embodiment of the present invention;

Fig. 2 is a flow chart two of a method for receiving packets of a network media stream according to an embodiment of the present invention;

Fig. 3 is a structural block diagram 1 of a network media stream packet receiving device according to an embodiment of the present invention;

Fig. 4 is a structural block diagram 2 of a network media stream packet receiving device according to an embodiment of the present invention;

Fig. 5 is a schematic diagram of a network packet receiving system according to a preferred embodiment of the present invention.

detailed description

Hereinafter, the present invention will be described in detail with reference to the drawings and examples. It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.

It should be noted that the terms "first" and "second" in the description and claims of the present invention and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence.

A method for receiving packets of network media streams is provided in the present embodiment. FIG. 1 is a flowchart one of a method for receiving packets of network media streams according to an embodiment of the present invention. As shown in FIG. 1 , the process includes the following steps:

Step S102, receiving an instruction from the user side to fetch data packets, wherein the instruction includes a preset number of received packets;

Step S104, after obtaining the preset number of received data packets from the kernel receiving buffer in the kernel space, sending the preset received number of data packets to the user receiving buffer on the user side.

Through the above steps, the command to fetch data packets from the user side is received, and after obtaining the preset number of packets received from the kernel receiving buffer in the kernel space, the preset number of packets received is sent to the user on the user side for reception. Buffer, which realizes that a certain number of data packets can be fetched according to the instructions of the user side, instead of only fetching one data packet each time, which solves the problem that the system frequently calls network data packets and seriously reduces the performance of the streaming media server, and improves the performance of the streaming media. Server external service capability.

In this embodiment, a detection function may be registered in the kernel space, and the detection function obtains the preset received number of data packets from the kernel receiving buffer of the kernel space. In the case that the instruction includes an identification parameter, a detection function corresponding to the identification parameter may be identified in the kernel space, and the detection function obtains the preset number of received packets from the kernel receiving buffer in the kernel space.

In this embodiment, when the number of data packets in the kernel receiving buffer of the kernel space is less than the preset number of received packets, the current data packets in the kernel receiving buffer of the kernel space are sent to the user side The user receive buffer.

In this embodiment, while sending the data packets of the preset number of received packets to the user receiving buffer of the user side, the auxiliary information of the data packets is also sent to the user receiving buffer of the user side, wherein , the auxiliary information includes at least one of the following: packet length, receiving time, source IP address, port number.

A method for receiving packets of network media streams is provided in this embodiment. FIG. 2 is a flow chart 2 of a method for receiving packets of network media streams according to an embodiment of the present invention. As shown in FIG. 2 , the process includes the following steps:

Step S202, the user side sends an instruction to fetch data packets, wherein the instruction includes a preset number of received packets;

Step S204, the user receiving buffer on the user side receives the preset number of data packets sent from the kernel space, and the preset number of data packets are obtained from the kernel receiving buffer of the kernel space.

Through the above steps, the user side sends an instruction to fetch data packets, wherein the instruction includes a preset number of received packets, and the user receiving buffer on the user side receives the data packets of the preset number of received packets sent from the kernel space, and the preset number of packets received Set the number of received packets and the data packets are obtained from the kernel receiving buffer of the kernel space, which realizes that a certain number of data packets can be fetched according to the instructions of the user side, instead of only fetching one data packet at a time, which solves the problem of frequent system calls Network data packets seriously reduce the performance of the streaming media server and improve the external service capability of the streaming media server.

In this embodiment, the calculation factor of the preset number of received packets may include at least one of the following: a code rate, and an interval for receiving packets.

In this embodiment, a device for receiving packets of network media streams is also provided, which is used to implement the above embodiments and preferred implementation modes, and what has already been described will not be repeated. As used below, the term "module" may be a combination of software and/or hardware that realizes a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementations in hardware, or a combination of software and hardware are also possible and contemplated.

Fig. 3 is a structural block diagram 1 of a network media stream packet receiving device according to an embodiment of the present invention. As shown in Fig. 3, the device includes

The first receiving module 32 is configured to receive an instruction for fetching data packets from the user side, wherein the instruction includes a preset number of received packets;

The obtaining module 34 is configured to obtain the preset received data packets from the kernel receiving buffer in the kernel space, and then send the preset received data packets to the user receiving buffer on the user side.

Through the above-mentioned device, an instruction to fetch data packets from the user side is received, and after obtaining a preset number of data packets from the kernel receiving buffer in the kernel space, the preset number of data packets to be received is sent to the user on the user side for receiving Buffer, which realizes that a certain number of data packets can be fetched according to the instructions of the user side, instead of only fetching one data packet each time, which solves the problem that the system frequently calls network data packets and seriously reduces the performance of the streaming media server, and improves the performance of the streaming media. Server external service capability.

In this embodiment, the acquisition module 34 includes:

The first obtaining unit is configured to register a detection function in the kernel space, and the detection function obtains the preset number of received packets from the kernel receiving buffer of the kernel space.

In the case that the instruction includes an identification parameter, the obtaining module 34 includes:

The second obtaining unit is used to identify a detection function corresponding to the identification parameter in the kernel space, and the detection function obtains the preset number of data packets received from the kernel receiving buffer of the kernel space.

The third acquisition unit is used to send the current data packets in the kernel receiving buffer of the kernel space to the user when the number of data packets in the kernel receiving buffer of the kernel space is less than the preset number of receiving packets side of the user receive buffer.

In this embodiment, the device also includes:

The first sending module is configured to send the auxiliary information of the data packet to the user receiving buffer of the user side, wherein the auxiliary information includes at least one of the following: data packet length, receiving time, source IP address, port number.

Fig. 4 is a structural block diagram II of a network media stream packet receiving device according to an embodiment of the present invention. As shown in Fig. 4, the device includes

The second sending module 42 is used for the user side to send an instruction for fetching data packets, wherein the instruction includes a preset number of received packets;

The second receiving module 44 is used for the user receiving buffer on the user side to receive the preset number of data packets sent from the kernel space, and the preset number of data packets are received from the kernel space of the kernel space obtained from the area.

Through the above device, the user side sends an instruction to fetch data packets, wherein the instruction includes a preset number of received packets, and the user receiving buffer on the user side receives the preset number of data packets sent from the kernel space, and the preset number of packets received Set the number of received packets and the data packets are obtained from the kernel receiving buffer of the kernel space, which realizes that a certain number of data packets can be fetched according to the instructions of the user side, instead of only fetching one data packet at a time, which solves the problem of frequent system calls Network data packets seriously reduce the performance of the streaming media server and improve the external service capability of the streaming media server.

In another embodiment, a system for receiving packets of network media streams is also provided, including: a user side device and a kernel device;

The kernel device receives an instruction from the user-side device to fetch data packets, wherein the instruction includes a preset number of received packets;

After acquiring the preset received data packets from the kernel receiving buffer of the kernel device, the preset received data packets are sent to the user receiving buffer of the user-side device.

The present invention will be described in detail below in combination with preferred embodiments and implementation modes.

This preferred embodiment provides a network packet receiving method, device and system, which reduces the overhead of system calls and solves the performance bottleneck problem of the streaming media server, thereby improving its external service capability.

The device/system of this preferred embodiment includes the following modules:

The user packet receiving module calls the system call to collect network packets for processing.

The kernel packet receiving module runs in the kernel space and returns the number of packets specified by the user at a time.

The method of this preferred embodiment comprises the following steps:

Step 1. Use the jprobe (Jumper probe) debugging tool of the kernel to register a detection function, which realizes the function of receiving packets in batches. Compile it into a kernel module (named receivepacketdriver.ko).

Step 2. Use the insmod command to install the kernel packet receiving module to the Kernel of an operating system such as Linux.

Step 3. The user packet receiving module calculates how many packets to receive at a time according to the code rate and packet receiving interval, etc., and receives packets through the system interface recvmsg, and at the same time specifies the number of packets to receive and carries special marking parameters.

Step 4. The system call recvmsg with special flag parameters will execute the function in the kernel packet receiving module receivepacketdriver.ko. This function will take the user-specified number of packets from the kernel receiving buffer and return them to the user, and return the auxiliary information of each packet (such as the length of the packet, receiving time, source IP address and port, etc.). If the number of packets in the kernel's receive buffer is less than the number specified by the user, only the existing number is returned.

Step 5. The user packet receiving module performs subsequent processing after obtaining multiple packets.

Fig. 5 is a schematic diagram of a network packet receiving system according to a preferred embodiment of the present invention. As shown in Fig. 5, a detection function is registered to the kernel function udp_recvmsg by using the interface register_jprobe of the kernel, and the detection function realizes a batch packet collection function. Compile this kernel packet receiving module into receivepacketdriver.ko, and install it into the kernel to run through the insmod command.

The user packet receiving module calls the system interface recvmsg(int sockfd, struct msghdr*msg, int flags) to receive packets, and the flags are special values such as MSG_BATCH. The number of received packets is specified by the msg_iovlen of the structure msg, and the msg_control is used to return the auxiliary information of each packet.

recvmsg will call udp_recvmsg to execute the previously registered detection function. If flags is MSG_BATCH, the detection function will take msg_iovlen packets from the kernel receive queue and return them to the user. If the number of packets in the kernel receive queue is less than msg_iovlen, all existing packets in the queue are returned. The receiving process is over.

The user packet receiving module periodically calls recvmsg to receive the code stream for subsequent processing.

The embodiment of the invention also provides a storage medium. Optionally, in this embodiment, the foregoing storage medium may be configured to store program codes for executing the method steps of the foregoing embodiments:

Optionally, in this embodiment, the above-mentioned storage medium may include but not limited to: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk Various media that can store program codes such as discs or optical discs.

Optionally, in this embodiment, the processor executes the methods in the foregoing embodiments according to the program code stored in the storage medium.

Obviously, those skilled in the art should understand that each module or each step of the above-mentioned present invention can be realized by a general-purpose computing device, and they can be concentrated on a single computing device, or distributed in a network formed by multiple computing devices Alternatively, they may be implemented in program code executable by a computing device so that they may be stored in a storage device to be executed by a computing device, and in some cases, in an order different from that shown here The steps shown or described are carried out, or they are separately fabricated into individual integrated circuit modules, or multiple modules or steps among them are fabricated into a single integrated circuit module for implementation. As such, the present invention is not limited to any specific combination of hardware and software.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.

Claims (15)

1. a network media stream packet receiving method, it is characterised in that including:

Receiving the instruction of user's side draw packet, wherein, described instruction includes presetting packet receiving quantity；

After the kernel of kernel spacing receives the default packet receiving number of data bag of relief area acquisition, by described default packet receiving Number of data bag is sent to the user of described user side and receives relief area.

Method the most according to claim 1, it is characterised in that the described kernel reception relief area from kernel spacing obtains Preset packet receiving number of data bag to include:

Registering probe function in kernel spacing, described probe function receives relief area from the kernel of kernel spacing and obtains Described default packet receiving number of data bag.

Method the most according to claim 2, it is characterised in that described instruction includes identification parameter, described empty from kernel Between kernel receive relief area obtain preset packet receiving number of data bag include:

Identifying the probe function corresponding with described identification parameter in kernel spacing, described probe function is from kernel spacing Kernel receive relief area obtain described default packet receiving number of data bag.

Method the most according to claim 1, it is characterised in that wrap after the instruction of described reception user's side draw packet Include:

Kernel at described kernel spacing receives the data packet number in relief area less than described default packet receiving quantity In the case of, the kernel of presently described kernel spacing is received the packet in relief area and is sent to the use of described user side Reception relief area, family.

Method the most according to claim 1, it is characterised in that described method includes:

While the user that described default packet receiving number of data bag is sent to described user side is received relief area, The user that the auxiliary information of described packet is also sent to described user side receives relief area, wherein, and described auxiliary Information includes at least one of: data packet length, receive time, source IP address, port numbers.

6. a network media stream packet receiving method, it is characterised in that including:

User side sends the instruction of the bag that fetches data, and wherein, described instruction includes presetting packet receiving quantity；

The user of described user side receives relief area and receives the described default packet receiving quantity number sent from kernel spacing According to bag, described default packet receiving number of data bag is to receive relief area from the kernel of described kernel spacing to obtain.

Method the most according to claim 6, it is characterised in that the calculating factor of described default packet receiving quantity includes following At least one:

Code check, packet receiving is spaced.

8. a network media stream packet receiving device, it is characterised in that including:

First receiver module, for receiving the instruction of user's side draw packet, wherein, described instruction includes presetting receipts Bag quantity；

Acquisition module, after receiving the default packet receiving number of data bag of relief area acquisition from the kernel of kernel spacing, The user that described default packet receiving number of data bag is sent to described user side is received relief area.

Device the most according to claim 8, it is characterised in that described acquisition module includes:

First acquiring unit, for registering probe function in kernel spacing, described probe function is from kernel spacing Kernel receives relief area and obtains described default packet receiving number of data bag.

Device the most according to claim 9, it is characterised in that described instruction includes identification parameter, described acquisition module Including:

Second acquisition unit, for identifying the probe function corresponding with described identification parameter in kernel spacing, described Probe function receives relief area from the kernel of kernel spacing and obtains described default packet receiving number of data bag.

11. devices according to claim 8, it is characterised in that described acquisition module includes:

3rd acquiring unit, for receiving the data packet number in relief area less than institute at the kernel of described kernel spacing In the case of stating default packet receiving quantity, the kernel of presently described kernel spacing is received the packet in relief area and sends Relief area is received to the user of described user side.

12. devices according to claim 8, it is characterised in that described device also includes:

First sending module, receives slow for the auxiliary information of described packet is sent to the user of described user side Rushing district, wherein, described auxiliary information includes at least one of: data packet length, receive time, source IP ground Location, port numbers.

13. 1 kinds of network media stream packet receiving devices, it is characterised in that including:

Second sending module, sends the instruction of the bag that fetches data for user side, and wherein, described instruction includes presetting receipts Bag quantity；

Second receiver module, the user for described user side receives relief area and receives from described in kernel spacing transmission Presetting packet receiving number of data bag, described default packet receiving number of data bag is to receive from the kernel of described kernel spacing Relief area obtains.

14. devices according to claim 13, it is characterised in that the calculating factor of described default packet receiving quantity include with At least one lower:

Code check, packet receiving is spaced.

15. 1 kinds of network media stream packet receiving systems, it is characterised in that including: user side equipment, interior nuclear equipment；

Described interior nuclear equipment receive user side equipment fetch data bag instruction, wherein, described instruction include preset packet receiving Quantity；

After the kernel of described interior nuclear equipment receives the default packet receiving number of data bag of relief area acquisition, preset described Packet receiving number of data bag is sent to the user of described user side equipment and receives relief area.