CN109947581B - High concurrency data transfer method and data transfer method for switch - Google Patents
High concurrency data transfer method and data transfer method for switch Download PDFInfo
- Publication number
- CN109947581B CN109947581B CN201910249826.4A CN201910249826A CN109947581B CN 109947581 B CN109947581 B CN 109947581B CN 201910249826 A CN201910249826 A CN 201910249826A CN 109947581 B CN109947581 B CN 109947581B
- Authority
- CN
- China
- Prior art keywords
- data
- thread
- udp
- processed
- socket
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
本发明公开了一种高并发的数据传送方法及用于交换机的数据传送方法,属于基于Linux内核的数据传送,要解决的技术问题为如何实现高并发数据的接收、处理和传送;该方法基于IO多路复用技术接收来自发送端的UDP数据,根据采集端的采集需求对UDP数据进行多线程处理,得到处理后数据,基于IO多路复用技术将处理后数据传送至采集端TCP端口。用于交换机的数据传送方法,包括通过高并发的数据传送方法,接收来自交换机的UDP数据,并对UDP数据进行多线程处理后,将处理后数据发送至采集端。
The invention discloses a high-concurrency data transmission method and a data transmission method for a switch, which belong to data transmission based on Linux kernel, and the technical problem to be solved is how to realize the reception, processing and transmission of high-concurrency data; the method is based on The IO multiplexing technology receives the UDP data from the sender, performs multi-thread processing on the UDP data according to the collection requirements of the collection end, and obtains the processed data. Based on the IO multiplexing technology, the processed data is transmitted to the collection end TCP port. The data transmission method used for the switch includes receiving UDP data from the switch through a highly concurrent data transmission method, and after multi-threaded processing of the UDP data, the processed data is sent to the acquisition terminal.
Description
Claims (6)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910249826.4A CN109947581B (en) | 2019-03-29 | 2019-03-29 | High concurrency data transfer method and data transfer method for switch |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910249826.4A CN109947581B (en) | 2019-03-29 | 2019-03-29 | High concurrency data transfer method and data transfer method for switch |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109947581A CN109947581A (en) | 2019-06-28 |
| CN109947581B true CN109947581B (en) | 2021-08-27 |
Family
ID=67012972
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910249826.4A Active CN109947581B (en) | 2019-03-29 | 2019-03-29 | High concurrency data transfer method and data transfer method for switch |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109947581B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112631788B (en) * | 2021-01-06 | 2023-11-28 | 上海哔哩哔哩科技有限公司 | Data transmission method and data transmission server |
| CN112954373A (en) * | 2021-01-26 | 2021-06-11 | 四川天翼网络服务有限公司 | High-concurrency multi-protocol-supported audio and video on demand system and method |
| CN113468081B (en) * | 2021-07-01 | 2024-05-28 | 福建信息职业技术学院 | Device and method for converting serial port into udp based on ebi bus |
| CN113342554B (en) * | 2021-08-02 | 2022-01-04 | 阿里云计算有限公司 | IO multiplexing method, medium, device and operating system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103164256A (en) * | 2011-12-08 | 2013-06-19 | 深圳市快播科技有限公司 | Processing method and system capable of achieving one machine supporting high concurrency |
| CN103780517A (en) * | 2014-01-20 | 2014-05-07 | 江苏省未来网络创新研究院 | Driving system and driving method for cooperative work of controller and exchanger under different versions of OpenFlow |
| CN106411777A (en) * | 2016-09-27 | 2017-02-15 | 福建中金在线信息科技有限公司 | Method and system for processing high concurrent data |
| CN108459915A (en) * | 2018-01-31 | 2018-08-28 | 中电福富信息科技有限公司 | A kind of TCP channel suitable for high concurrent scene manages system and method |
| CN109298943A (en) * | 2018-10-11 | 2019-02-01 | 四川长虹电器股份有限公司 | Concurrent processing method for UDP server |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9384071B2 (en) * | 2011-03-31 | 2016-07-05 | Solarflare Communications, Inc. | Epoll optimisations |
| CN102316116B (en) * | 2011-09-29 | 2014-05-21 | 高新兴科技集团股份有限公司 | System for supporting multiple platform network communication processing and method thereof |
| CN105049162A (en) * | 2015-05-21 | 2015-11-11 | 北京科东电力控制系统有限责任公司 | Public network information high-efficiency transmission method based on Epoll model |
| CN107484227B (en) * | 2017-09-01 | 2021-01-01 | 天津赞普科技股份有限公司 | Wifi networking multi-hot-spot control communication method |
-
2019
- 2019-03-29 CN CN201910249826.4A patent/CN109947581B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103164256A (en) * | 2011-12-08 | 2013-06-19 | 深圳市快播科技有限公司 | Processing method and system capable of achieving one machine supporting high concurrency |
| CN103780517A (en) * | 2014-01-20 | 2014-05-07 | 江苏省未来网络创新研究院 | Driving system and driving method for cooperative work of controller and exchanger under different versions of OpenFlow |
| CN106411777A (en) * | 2016-09-27 | 2017-02-15 | 福建中金在线信息科技有限公司 | Method and system for processing high concurrent data |
| CN108459915A (en) * | 2018-01-31 | 2018-08-28 | 中电福富信息科技有限公司 | A kind of TCP channel suitable for high concurrent scene manages system and method |
| CN109298943A (en) * | 2018-10-11 | 2019-02-01 | 四川长虹电器股份有限公司 | Concurrent processing method for UDP server |
Non-Patent Citations (2)
| Title |
|---|
| 基于TCP、UDP的多路多数据流融合网络系统设计;龙玉军;《电子设计工程》;20111105;第19卷(第21期);第69-72页 * |
| 采用epoll模型设计多路udp接收程序;dong_beijing;《https://blog.csdn.net/dong_beijing/article/details/60876591》;20170308;第1-5页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109947581A (en) | 2019-06-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109947581B (en) | High concurrency data transfer method and data transfer method for switch | |
| US9143467B2 (en) | Network interface controller with circular receive buffer | |
| Buonadonna et al. | An implementation and analysis of the virtual interface architecture | |
| US6594701B1 (en) | Credit-based methods and systems for controlling data flow between a sender and a receiver with reduced copying of data | |
| US9112894B2 (en) | Real time distributed network monitoring and security monitoring platform (RTD-NMS) | |
| García-Dorado et al. | High-performance network traffic processing systems using commodity hardware | |
| CN105141603B (en) | Communication data transmission method and system | |
| Welsh et al. | Atm and fast ethernet network interfaces for user-level communication | |
| US11444890B2 (en) | Method and device for improving bandwidth utilization in a communication network | |
| WO2014082562A1 (en) | Method, device, and system for information processing based on distributed buses | |
| CN111522663B (en) | Data transmission method, device and system based on distributed storage system | |
| CN113067810B (en) | Network packet capturing method, device, equipment and medium | |
| CN106789099B (en) | PCIE-based high-speed network isolation method and terminal | |
| CN107479966B (en) | Signaling acquisition method based on multi-core CPU | |
| CN109800035B (en) | Algorithm integrated service framework system | |
| US20070288646A1 (en) | Communication interface device and communication method | |
| GB2458952A (en) | A device queues packets and stores a state parameter for each packet, indicating a state of an entity associated with the packet, e.g. reset state of a server | |
| MacArthur et al. | An efficient method for stream semantics over rdma | |
| CN111131081A (en) | Method and device for supporting multi-process high-performance unidirectional transmission | |
| CN117421122A (en) | Data transmission method, network card and CPU | |
| CN116610530A (en) | Processing method and device of network data, computer equipment and storage medium | |
| CN1306772C (en) | Access method of short packet data | |
| Baker et al. | Via communication performance on a gigabit ethernet cluster | |
| US20250139023A1 (en) | ALLOWING NON-VOLATILE MEMORY EXPRESS (NVMe) OVER FABRIC (NVMe-oF) TRAFFIC OVER INTERFACES USING A SCALABLE END POINT (SEP) ADDRESSING MECHANISM | |
| KR100534618B1 (en) | apparatus method of exchange packet in socket communication processor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information | ||
| CB03 | Change of inventor or designer information |
Inventor after: Zhu Naiguo Inventor after: Li Chao Inventor after: Yu Hao Inventor before: Li Chao Inventor before: Yu Hao |
|
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 250100 No. 1036 Tidal Road, Jinan High-tech Zone, Shandong Province, S01 Building, Tidal Science Park Applicant after: Inspur cloud Information Technology Co.,Ltd. Address before: 250100 No. 1036 Tidal Road, Jinan High-tech Zone, Shandong Province, S01 Building, Tidal Science Park Applicant before: Tidal Cloud Information Technology Co.,Ltd. Address after: 250100 No. 1036 Tidal Road, Jinan High-tech Zone, Shandong Province, S01 Building, Tidal Science Park Applicant after: Tidal Cloud Information Technology Co.,Ltd. Address before: 250100 S06 tower, 1036, Chao Lu Road, hi tech Zone, Ji'nan, Shandong. Applicant before: SHANDONG INSPUR CLOUD INFORMATION TECHNOLOGY Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |
