[go: up one dir, main page]

CN113961367B - A method and device for realizing remote data collection - Google Patents

A method and device for realizing remote data collection Download PDF

Info

Publication number
CN113961367B
CN113961367B CN202111148641.8A CN202111148641A CN113961367B CN 113961367 B CN113961367 B CN 113961367B CN 202111148641 A CN202111148641 A CN 202111148641A CN 113961367 B CN113961367 B CN 113961367B
Authority
CN
China
Prior art keywords
board
port
subscription table
table item
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111148641.8A
Other languages
Chinese (zh)
Other versions
CN113961367A (en
Inventor
何刚
陈勇
齐达
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
New H3C Security Technologies Co Ltd
Original Assignee
New H3C Security Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by New H3C Security Technologies Co Ltd filed Critical New H3C Security Technologies Co Ltd
Priority to CN202111148641.8A priority Critical patent/CN113961367B/en
Publication of CN113961367A publication Critical patent/CN113961367A/en
Application granted granted Critical
Publication of CN113961367B publication Critical patent/CN113961367B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/547Remote procedure calls [RPC]; Web services
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/546Message passing systems or structures, e.g. queues
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/54Indexing scheme relating to G06F9/54
    • G06F2209/544Remote
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/54Indexing scheme relating to G06F9/54
    • G06F2209/548Queue

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

本申请提供了一种实现远程数据采集的方法及设备。应用该方法的业务通过执行远程过程调用任务,在本板数据获取周期到达时,调用本板订阅表项对应的数据获取函数获取需写入的数据;在数据获取函数获取到数据时,将数据获取函数获取到的数据写入本板订阅表项并设置已写入标识;在远程采集周期到达时,调用本板订阅表项对应的数据上报函数校验本板订阅表项已被写入,将本板标识、本板订阅表项的每条表项记录的已写入数据及每条表项记录的已写入数据的指示索引封装在远程过程调用协议报文,发送远程过程调用协议报文到采集器。

The present application provides a method and device for realizing remote data collection. The business applying the method executes a remote procedure call task, and when the data acquisition cycle of the board arrives, calls the data acquisition function corresponding to the subscription table item of the board to obtain the data to be written; when the data acquisition function obtains the data, writes the data obtained by the data acquisition function into the subscription table item of the board and sets the written flag; when the remote collection cycle arrives, calls the data reporting function corresponding to the subscription table item of the board to verify that the subscription table item of the board has been written, encapsulates the board flag, the written data of each table item record of the subscription table item of the board, and the indication index of the written data of each table item record in the remote procedure call protocol message, and sends the remote procedure call protocol message to the collector.

Description

Method and equipment for realizing remote data acquisition
Technical Field
The present application relates to communication technologies, and in particular, to a method and apparatus for implementing remote data acquisition.
Background
TELEMETRY (telemetry) is a remote data acquisition technology for monitoring equipment performance and faults, and adopts a push mode to timely acquire rich monitoring data, so that the rapid positioning of network faults can be realized, and the network operation and maintenance problems are solved. Depending on the manner in which the data is reported, TELEMETRY may be implemented in a variety of ways. By adopting the TELEMETRY technology of RPC (Remote Procedure Call ), the device can automatically read statistical information and push the statistical information to the collector through an RPC protocol, thereby realizing a more real-time and efficient data collection function.
In the frame type communication equipment, the main control board informs each service board that data needs to be collected, when the sampling period arrives, the main control board obtains the collected data from each service board, and after summarization, the collected data are sent to the collector through the RPC protocol message. For example, when packet loss data and overrun data of frame equipment need to be collected, the main control board informs each service board to start RPC collection, each service board traverses each service port of the main board, and after calling a data statistics interface function to obtain the packet loss number and overrun times of each port and the queue of the main board, the obtained packet loss number and overrun times of each port and the queue of the main board are sent to other service boards through IPC (Inter-Process Communication ), each service board carries out superposition calculation of all single board data and then sends the superimposed data to the main control board, and the main control board sends the superimposed data to the collector through RPC protocol messages. The method has the defects that the larger the number of service boards in the frame type equipment is, the larger the IPC forming pressure in the frame type equipment is, the superposition calculation time is long, the important information such as packet loss and overrun is not timely updated in real time, and the real situation cannot be reflected in real time. The packet loss and overrun data obtained by the user from the collector after superposition calculation cannot be distinguished, and the packet loss and overrun data of each service board cannot be counted and analyzed based on the client requirements. The existing centralized RPC statistical data collection time of the frame type communication equipment is long, the collector cannot distinguish collected data, and statistical calculation cannot be flexibly carried out according to requirements.
Disclosure of Invention
The application aims to provide a method and equipment for realizing remote data acquisition, wherein a service board directly pushes acquired data to an acquisition device, so that the real-time performance of data acquisition is improved.
The method comprises the steps of creating a remote procedure call task for a service board of frame type communication equipment, calling a data acquisition function corresponding to a board subscription table item to acquire data to be written when a data acquisition period of the board arrives, writing the data acquired by the data acquisition function into the board subscription table item and setting a written identifier when the data acquisition function acquires the data, calling a data reporting function corresponding to the board subscription table item and checking that the board subscription table item is written by the data reporting function based on the written identifier of the board subscription table item when the remote procedure call task arrives, and packaging the board identifier, written data recorded by each table item of the board subscription table item and an indication index of the written data recorded by each table item into a remote procedure call protocol message by the data reporting function, and sending the remote procedure call protocol message to an acquirer.
The application further provides equipment for realizing remote data acquisition, the equipment is a service board of frame type communication equipment, the service board comprises a plurality of ports, an exchange unit, a processor and a memory, a bottom layer driving data acquisition module of the exchange unit is used for executing the following operation, a remote procedure call task is newly established, when the data acquisition period of the board arrives, the remote procedure call task calls a data acquisition function corresponding to a subscription table item of the board to acquire data to be written in, when the data acquisition function acquires the data, the remote procedure call task writes the data acquired by the data acquisition function into the subscription table item of the board and sets written identification, when the remote procedure call task arrives in the remote acquisition period, the remote procedure call task calls a data reporting function corresponding to the subscription table item of the board and verifies that the subscription table item of the board has been written in based on the written identification of the subscription table item of the board, and the data reporting function encapsulates the local identification, written data recorded by each table item of the subscription table item and an indication index of the written data recorded by each table item into a remote procedure call message, and sends the remote procedure call message to a remote procedure call protocol.
The application has the beneficial effects that the service board directly pushes the collected data to the collector, improves the real-time performance of data collection, realizes distributed collection in frame type communication equipment manufacturers, and reduces the collection time. And the user can send multiple groups of data at one time through the remote procedure call protocol message, and the user can freely process the acquired data according to the service board identification and the indication index of the remote procedure call protocol message, so that the processing flexibility of the user on the acquired data of the frame type communication device is improved.
Drawings
FIG. 1 is a flow chart of an embodiment of a method for remotely collecting data according to the present application;
fig. 2 is a flowchart of an embodiment of collecting port packet loss data by a service board according to the present application;
fig. 3 is a schematic diagram of an embodiment of a device for implementing remote data collection according to the present application.
Detailed Description
A plurality of examples shown in the drawings will be described in detail. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the application. Well-known methods, procedures, components and circuits have not been described in detail so as not to obscure the examples.
The terms "comprising" and "including" are used in the sense of including but not limited to, including the numbers "above", "within" and "below" and not including the numbers. The term "based on" means based at least in part on a portion thereof.
Fig. 1 is an embodiment of a method for implementing remote data collection, which is applied to a service board of a frame communication device and includes the following steps:
Step 101, creating a remote procedure call task of a service board;
102, when a remote procedure call task arrives at a data acquisition period of a local board, calling a data acquisition function corresponding to a subscription table item of the local board to acquire data to be written;
Step 103, when the data acquisition function acquires data, the remote procedure call task writes the data acquired by the data acquisition function into the subscription table entry of the local board and sets the written identification;
step 104, when the remote process calling task arrives at the remote acquisition period, calling a data reporting function corresponding to the subscription table item of the board;
step 105, the remote procedure call task data call reporting function verifies that the board subscription table entry has been written based on the writing identification of the board subscription table entry;
Step 106, the remote procedure call task data call data reporting function encapsulates the local board identification, the written data of each table entry record of the local board subscription table entry and the indication index of the written data of each table entry record in the remote procedure call protocol message;
step 107, send a remote procedure call protocol message to the collector.
The application has the beneficial effects that the service board directly pushes the collected data to the collector, improves the real-time performance of data collection, realizes distributed collection in frame type communication equipment manufacturers, and reduces the collection time. And the user can identify the collected data according to the service board identification and the indication index of the remote procedure call protocol message, and can freely process the collected data, thereby improving the processing flexibility of the user on the collected data of the frame type communication device.
In the embodiment of fig. 1, the remote procedure call task of the service board may call the device state information (such as CPU and memory states) of the service board, call the physical port state information (such as optical module state and bandwidth utilization of the port), the packet/queue statistics data (such as interface packet loss and packet error statistics, queue packet loss statistics, and queue buffer resource occupation state) of the port, and the table entry/resource data (such as usage conditions of forwarding table entry resources, ACL flow table resources, and virtual interface resources) of the exchange chip. The method comprises the steps of configuring a collector, configuring a collection period, configuring subscription table items, calling corresponding data collection parameters by a bottom layer driving data acquisition module of the service board through executing a remote procedure call task, writing the data into the corresponding subscription table items, and then sending the written subscription table items to the collector through a remote procedure call protocol message when the collection period arrives.
The data collected by each service board of the frame type equipment is independently sent to the collector, the data is sent to the collector through a distributed data sending mechanism, the collected data is not required to be concentrated in the frame type communication equipment through IPC communication, the CPU burden of each service board is lightened, the data collection efficiency is improved, a client can also count the data of a certain service board or a plurality of service boards or the whole frame according to the collected data sent by each service board independently, and the statistic mode is more flexible.
Fig. 2 is a flowchart of an embodiment of collecting port packet loss data by a service board according to the present application;
Step 201, traversing each service module of the board;
The service board receives a remote acquisition period configured by the main control board, an indication index, an operation action of adding a subscription table item, a configured port packet loss number subscription table item, a port overrun subscription table item, a port queue packet loss number subscription table item and a port queue overrun subscription table item, and triggers a remote procedure call process.
The bottom layer driving data acquisition module of the service board starts a remote procedure call task, a timer is set according to a remote acquisition period, when the timer arrives, the remote procedure call task of the service board calls a data reporting function of the written subscription table item, a remote procedure call protocol message is sent to the acquisition device, and acquired data is pushed to the acquisition device.
Therefore, before the timer arrives, the data to be collected needs to be written into the four subscription table entries. Thus, the plate data acquisition period is a time interval different from the remote acquisition period, and the remote procedure call task starts traversing each business Module (MOD) of the plate when the plate data acquisition period arrives.
Step 202, traversing each port of the board;
the remote procedure call task traverses the physical ports on each switch chip on the board.
Step 203, obtaining a virtual output queue identifier corresponding to the service module identifier and the port identifier;
in the frame communication device, an identification MOD ID of each service module and an identification Port ID of one physical Port on the service board correspond to a VOQ (Virtual Output Queue ) index. By traversing each service module and each physical Port, the VOQ index on the service board can be obtained according to the identifier MOD ID and the physical Port ID of the service module obtained by traversing.
Step 204, polling whether the corresponding multiple queues of the virtual output queue identification have packet loss numbers and overrun numbers, if not, executing step 205, if so, executing step 206;
the multiple virtual queues (e.g., 8 virtual queues) of each physical port to which each VOQ index points are polled to obtain whether each virtual queue has a packet loss number or an overrun number (number of times virtual queue bandwidth is exceeded).
Step 205, not setting the subscription table item;
When the multiple virtual queues pointed by the VOQ index of the remote procedure call task poll have no packet loss number or overrun number, the data of the four subscription table items do not need to be written, and the four subscription table items are not set.
In the application, when the data needing to be collected is not written into each subscription table entry, the writing state of each subscription table entry keeps the initial value, so that the remote procedure call task can confirm whether the subscription table entry writes the data needing to be collected or not by checking whether the writing state of each subscription table entry is set or not.
If the remote procedure call task determines that any subscription table item is not written in through verification, the data uploading parameters of the subscription table item do not need to be called, the transmission of empty acquisition data to the acquisition device is avoided, and the bandwidth occupied by useless remote procedure call protocol messages and the processing resources of the acquisition device are avoided.
Step 206, writing the data into the corresponding subscription table item;
When one or more virtual queues pointed by the task polling VOQ index have packet loss numbers or overrun numbers, the remote procedure call task is used for writing the port identification, the queue identification and the packet loss numbers into the port queue packet loss number subscription table entry and setting the port identification, the queue identification and the overrun numbers into the port queue overrun subscription table entry and setting the port identification, the queue identification and the overrun numbers.
And counting the packet loss number of a plurality of virtual queues pointed by the VOQ index by the remote procedure call task, calculating the packet loss number of the port of the local board corresponding to the VOQ index, writing the port identification and the packet loss number into a port packet loss number subscription table entry, and setting.
And counting packet loss numbers of a plurality of virtual queues pointed by the VOQ index by the remote procedure call task, calculating the packet loss number of the port of the local plate corresponding to the VOQ index, writing the port identification and the overrun number into the port overrun subscription table entry, and setting.
Based on the embodiment shown in fig. 2, the remote procedure call task has completed writing the collected data into the port packet loss number subscription table entry, the port overrun subscription table entry, the port queue packet loss number subscription table entry, and the port queue overrun subscription table entry.
When the timer of the remote acquisition period arrives, the remote procedure call task verifies that the port packet loss number subscription table entry is set, calls a data reporting function corresponding to the port packet loss number subscription table entry, and encapsulates the local plate identifier of the service plate, the port identifier and the packet loss number recorded by each table entry of the port packet loss number subscription table entry and the indication index thereof in the remote procedure call protocol message. For example, the three entries of the port packet loss number subscription table entry record the packet loss numbers of the three ports respectively, and the local board identifier of the service board, the port identifier and the packet loss number recorded in the table entry 1 and the indication index 1, the port identifier and the packet loss number recorded in the table entry 2 and the indication index 2, and the port identifier and the packet loss number recorded in the table entry 3 and the indication index 3 are encapsulated in the remote procedure call protocol message. Therefore, the method not only can support one-time uploading of multiple groups of data, but also can enable a user to select the number of packet loss of the port to be counted according to the counting requirement, so that the following data counting is more flexible.
The remote procedure call task verifies that the port overrun subscription table entry is set, and calls a data reporting function of the port overrun subscription table entry to encapsulate the service board identifier, the port identifier and the overrun number of each table entry record of the port overrun subscription table entry and the indication index of the port overrun subscription table entry in the remote procedure call protocol message. For example, 2 entries of the port overrun subscription entries record overrun numbers of 2 ports respectively, the local board identifier of the service board, the port identifier and overrun number recorded in the entry 1 and the indication index 1 are packaged in a remote procedure call protocol message, and the port identifier and overrun number recorded in the entry 2 and the indication index 2 are packaged in the remote procedure call protocol message.
The remote procedure call task verifies that the queue packet loss number subscription table entry is set, and calls a data reporting function corresponding to the queue packet loss number subscription table entry to package the service board identifier, the port identifier, the queue identifier and the packet loss number of each table entry record and the indication index thereof in a remote procedure call protocol message. For example, 2 entries of the port overrun subscription entries record packet loss numbers of virtual queues queue1 and queue8 of port1 respectively, a local board identifier of a service board, a port1 identifier recorded by the entry 1, a virtual queue identifier queue1 and a packet loss number indication index 1 are packaged in a remote procedure call protocol message, and a port1 identifier, a virtual queue identifier queue8 and a packet loss number indication index 2 recorded by the entry 2 are packaged in the remote procedure call protocol message.
And the remote procedure call task verifies that the queue overrun subscription table entry is set, calls a data reporting function corresponding to the queue overrun subscription table entry, and encapsulates the service board identifier, the port identifier, the queue identifier and the overrun number of each table entry record and the indication index of the service board identifier, the queue identifier and the overrun number in the remote procedure call protocol message. For example, 2 entries of the port overrun subscription table entry record overrun numbers of virtual queues queue1 and queue8 of port1 respectively, a service board identifier, a port1 identifier recorded by the table entry 1, a virtual queue identifier queue1 and a packet loss number indication index 1, and a port1 identifier recorded by the table entry 2, a virtual queue identifier queue8 and a packet loss number indication index 2 are packaged in a remote procedure call protocol message.
The application adopts a service board distributed reporting mode to upload the acquired data to the collector, and each service board is independently processed, so that the CPU occupancy rate of the process on the main control board is not influenced, the performance bottleneck is reduced, a user can flexibly select the statistical object and the statistical direction from the acquired data reported by each service board, and the flexibility of data statistics is improved for the user.
Fig. 3 is a schematic diagram of an embodiment of the present remote data acquisition device provided by the present application. The 30 equipment is applied as a service board of frame type communication equipment, and the service board comprises a plurality of ports, a switching unit, a processor and a memory, wherein the bottom layer driving data acquisition module of the switching unit which can be used as a switching chip is used for executing the following operations;
Newly-built remote procedure call tasks; when the remote procedure call task arrives at the remote acquisition period, the data reporting function corresponding to the plate subscription table item is called, the data reporting function verifies that the plate subscription table item is written based on the writing identification of the plate subscription table item, and encapsulates the plate identification, the written data recorded by each table item of the plate subscription table item and the indication index of the written data recorded by each table item in a remote procedure call protocol message based on the collector network address.
When the remote procedure call task executed by the bottom driving data acquisition module arrives in the remote acquisition period, the data reporting function corresponding to the plate subscription table item is called, and the data reporting function verifies that the plate subscription table item is not written based on the unwritten identification of the plate subscription table item, and waits for the next remote acquisition period.
The processor executes processor executable instructions in the memory for performing operations including receiving a remote acquisition period configured by the main control board, receiving an indication index configured by the main control board, receiving an operation action to add a subscription table configured by the main control board, receiving a local board subscription table configured by the main control board, synchronously creating a remote procedure call task remote acquisition period, an indication index, an operation action to add a subscription table, and a local board subscription table to the bottom drive data.
The plate subscription table item is a port packet loss number subscription table item, a port overrun subscription table item, a port queue packet loss number subscription table item and a port queue overrun subscription table item.
The method comprises the steps of traversing each local board service module and each local board port, identifying a virtual output queue index based on an identification of each local board service module and an ID of each local board port, polling whether a plurality of queues pointed by each virtual output queue index have packet loss and overrun, if yes, counting the packet loss and overrun of the corresponding local board ports of each virtual output queue index based on the packet loss and overrun of the corresponding local board ports of each virtual output queue index, writing the port identification and the packet loss of the corresponding local board ports of each virtual output queue index into the port packet loss subscription table entry, writing the port identification and the overrun of the corresponding local board ports of each virtual output queue index into the port packet loss subscription table entry, and writing the port identification and the overrun of the corresponding virtual output queue index into the port packet loss subscription table entry, and writing the port identification and the port identification of the overrun of the corresponding virtual output queue of each virtual output queue index.
The method comprises the steps of enabling a remote procedure call task to call a data reporting function corresponding to a port packet loss number subscription table item, enabling a local board identifier of a service board, a port identifier and a packet loss number of each table item record of the port packet loss number subscription table item and an indication index of the port packet loss number subscription table item to be packaged in a remote procedure call protocol message, enabling the remote procedure call task to call the data reporting function corresponding to the port overrun subscription table item, enabling the local board identifier of the service board, the port identifier and the overrun number of each table item record of the port overrun subscription table item and the indication index of the port overrun subscription table item to be packaged in the remote procedure call protocol message, enabling the local board identifier of the service board, the port identifier and the port identifier of each table item record of the port packet loss number subscription table item and the indication index of the port packet loss number subscription table item to be packaged in the remote procedure call protocol message, and enabling the remote procedure call task to call the data reporting function corresponding to call the port identifier of the port overrun subscription table item, and the port identifier and the overrun number of each table item record of the port overrun subscription table item and the indication index of the port overrun subscription table item to be packaged in the remote procedure call protocol message.
The foregoing description of the preferred embodiments of the application is not intended to be limiting, but rather to enable any modification, equivalent replacement, improvement or the like to be made within the spirit and principles of the application.

Claims (12)

1.一种实现远程数据采集的方法,其特征在于,所述方法包括:1. A method for realizing remote data collection, characterized in that the method comprises: 为框式通信设备的业务板新建远程过程调用任务;Create a new remote procedure call task for the business board of the frame communication device; 所述远程过程调用任务在本板数据获取周期到达时,调用本板订阅表项对应的数据获取函数获取需写入的数据;When the data acquisition cycle of the board arrives, the remote procedure call task calls the data acquisition function corresponding to the subscription table item of the board to obtain the data to be written; 所述远程过程调用任务在所述数据获取函数获取到数据时,将所述数据获取函数获取到的数据写入所述本板订阅表项并设置已写入标识;When the data acquisition function acquires data, the remote procedure call task writes the data acquired by the data acquisition function into the subscription table item of the local board and sets a written flag; 所述远程过程调用任务在远程采集周期到达时,调用所述本板订阅表项对应的数据上报函数且所述数据上报函数基于所述本板订阅表项的写入标识校验所述本板订阅表项已被写入,所述数据上报函数将本板标识、所述本板订阅表项的每条表项记录的已写入数据及每条表项记录的已写入数据的指示索引封装在远程过程调用协议报文,发送所述远程过程调用协议报文到采集器。When the remote collection cycle arrives, the remote procedure call task calls the data reporting function corresponding to the subscription table item of the board, and the data reporting function verifies that the subscription table item of the board has been written based on the write identifier of the subscription table item of the board. The data reporting function encapsulates the board identifier, the written data of each item record of the subscription table item of the board, and the indication index of the written data of each item record in the remote procedure call protocol message, and sends the remote procedure call protocol message to the collector. 2.根据权利要求1所述的方法,其特征在于,所述方法还包括:2. The method according to claim 1, characterized in that the method further comprises: 所述远程过程调用任务在所述数据获取函数未获取到数据时,不修改所述本板订阅表项的未写入标识;When the data acquisition function fails to acquire data, the remote procedure call task does not modify the unwritten flag of the subscription table item of the current board; 所述远程过程调用任务在远程采集周期到达时,调用所述本板订阅表项对应的数据上报函数且所述数据上报函数基于所述本板订阅表项的未写入标识校验所述本板订阅表项未被写入,则等待下一次远程采集周期。When the remote collection cycle arrives, the remote procedure call task calls the data reporting function corresponding to the subscription table item of the local board, and the data reporting function verifies that the subscription table item of the local board has not been written based on the unwritten flag of the subscription table item of the local board, and then waits for the next remote collection cycle. 3.根据权利要求2所述的方法,其特征在于,为业务板新建远程过程调用任务包括;3. The method according to claim 2, wherein creating a new remote procedure call task for the service board comprises: 接收由主控板配置的所述的远程采集周期;Receiving the remote acquisition cycle configured by the main control board; 接收由所述主控板配置的所述指示索引;Receiving the indication index configured by the main control board; 接收由所述主控板配置的增加订阅表项的操作动作;receiving an operation action of adding a subscription table item configured by the main control board; 接收由所述主控板配置的所述本板订阅表项。Receive the subscription table item of the local board configured by the main control board. 4.根据权利要求3所述的方法,其特征在于,所述本板订阅表项是端口丢包数订阅表项,端口超限订阅表项,端口队列丢包数订阅表项,端口队列超限订阅表项。4. The method according to claim 3 is characterized in that the subscription table items of this board are port packet loss number subscription table items, port overlimit subscription table items, port queue packet loss number subscription table items, and port queue overlimit subscription table items. 5.根据权利要求4所述的方法,其特征在于,所述端口丢包数订阅表项、端口超限订阅表项、所述端口队列丢包数订阅表项以及端口队列超限订阅表项对应于丢包数据获取参数;5. The method according to claim 4, characterized in that the port packet loss number subscription table item, the port over-limit subscription table item, the port queue packet loss number subscription table item and the port queue over-limit subscription table item correspond to packet loss data acquisition parameters; 所述远程过程调用任务调用所述丢包数据获取参数获取需写入的数据包括:The remote procedure call task calls the packet loss data acquisition parameter to acquire the data to be written, including: 遍历每个本板业务模块和每个本板端口;Traverse each service module and each port of this board; 基于每个本板业务模块的标识和每个本板端口的ID识别一个虚拟输出队列索引;A virtual output queue index is identified based on the ID of each local board service module and the ID of each local board port; 轮询识别的每个虚拟输出队列索引指向的多个队列是否有丢包数和超限数;Poll multiple queues pointed to by each identified virtual output queue index to see whether there are packet loss and limit exceeding numbers; 若是,基于识别的每个虚拟输出队列索引指向的多个队列的丢包数和超限数,统计识别的每个虚拟输出队列索引对应的本板端口的丢包数和超限数;If yes, based on the number of packet losses and the number of over-limits of the multiple queues pointed to by each identified virtual output queue index, the number of packet losses and the number of over-limits of the port on the board corresponding to each identified virtual output queue index are counted; 将识别的每个虚拟输出队列索引对应的本板端口的端口标识及丢包数写入所述端口丢包数订阅表项;Write the port identifier and packet loss count of the port on the board corresponding to each identified virtual output queue index into the port packet loss count subscription table item; 将识别的每个虚拟输出队列索引对应的本板端口的端口标识及超限数写入所述端口超限订阅表项;Write the port identifier and the over-limit number of the port on the board corresponding to each identified virtual output queue index into the port over-limit subscription table item; 将识别的每个虚拟输出队列索引指向的多个队列的端口标识、队列标识及丢包数写入所述端口队列丢包数订阅表项;Write the port identifiers, queue identifiers and packet loss counts of the multiple queues pointed to by each identified virtual output queue index into the port queue packet loss count subscription table item; 将识别的每个虚拟输出队列索引指向的多个队列的端口标识、队列标识及超限数写入所述端口队列超限订阅表项。The port identifiers, queue identifiers and over-limit numbers of the multiple queues pointed to by each identified virtual output queue index are written into the port queue over-limit subscription table entry. 6.根据权利要求5所述的方法,其特征在于,所述数据上报函数将本板标识、所述本板订阅表项的每条表项记录的已写入数据及每条表项记录的已写入数据的指示索引封装在远程过程调用协议报文包括:6. The method according to claim 5, characterized in that the data reporting function encapsulates the board identifier, the written data of each table item record of the board subscription table item, and the indication index of the written data of each table item record in the remote procedure call protocol message, including: 所述端口丢包数订阅表项对应的数据上报函数将所述业务板的本板标识、所述端口丢包数订阅表项的每条表项记录的端口标识和丢包数及其指示索引封装在所述远程过程调用协议报文;The data reporting function corresponding to the port packet loss subscription table item encapsulates the board identifier of the service board, the port identifier and the packet loss count and the indication index of each item record of the port packet loss subscription table item in the remote procedure call protocol message; 所述端口超限订阅表项对应的数据上报函数将所述业务板的本板标识、所述端口超限订阅表项的每条表项记录的端口标识和超限数及其指示索引封装在所述远程过程调用协议报文;The data reporting function corresponding to the port overlimit subscription table item encapsulates the board identifier of the service board, the port identifier and the overlimit number and its indication index of each item record of the port overlimit subscription table item in the remote procedure call protocol message; 所述队列丢包数订阅表项对应的数据上报函数将所述业务板的本板标识、所述端口丢包数订阅表项的每条表项记录的端口标识、队列标识和丢包数及其指示索引封装在所述远程过程调用协议报文;The data reporting function corresponding to the queue packet loss number subscription table item encapsulates the board identifier of the service board, the port identifier of each table item record of the port packet loss number subscription table item, the queue identifier and the packet loss number and its indication index in the remote procedure call protocol message; 所述队列超限订阅表项对应的数据上报函数将所述业务板的本板标识、所述端口超限订阅表项的每条表项记录的端口标识、队列标识和超限数及其指示索引封装在所述远程过程调用协议报文。The data reporting function corresponding to the queue overlimit subscription table item encapsulates the board identifier of the service board, the port identifier of each item record of the port overlimit subscription table item, the queue identifier and the overlimit number and its indication index in the remote procedure call protocol message. 7.一种实现远程数据采集的设备,其特征在于,所述设备应用为框式通信设备的业务板,所述业务板包括多个端口、交换单元、处理器和存储器;所述交换单元的底层驱动数据获取模块用于执行以下操作;7. A device for implementing remote data collection, characterized in that the device is applied as a service board of a frame-type communication device, the service board includes multiple ports, a switching unit, a processor and a memory; the bottom-layer driver data acquisition module of the switching unit is used to perform the following operations; 新建远程过程调用任务;Create a new remote procedure call task; 所述远程过程调用任务在本板数据获取周期到达时,调用本板订阅表项对应的数据获取函数获取需写入的数据;When the data acquisition cycle of the board arrives, the remote procedure call task calls the data acquisition function corresponding to the subscription table item of the board to obtain the data to be written; 所述远程过程调用任务在所述数据获取函数获取到数据时,将所述数据获取函数获取到的数据写入所述本板订阅表项并设置已写入标识;When the data acquisition function acquires data, the remote procedure call task writes the data acquired by the data acquisition function into the subscription table item of the local board and sets a written flag; 所述远程过程调用任务在远程采集周期到达时,调用所述本板订阅表项对应的数据上报函数且所述数据上报函数基于所述本板订阅表项的写入标识校验所述本板订阅表项已被写入,所述数据上报函数将本板标识、所述本板订阅表项的每条表项记录的已写入数据及每条表项记录的已写入数据的指示索引封装在远程过程调用协议报文,发送所述远程过程调用协议报文到采集器。When the remote collection cycle arrives, the remote procedure call task calls the data reporting function corresponding to the subscription table item of the board, and the data reporting function verifies that the subscription table item of the board has been written based on the write identifier of the subscription table item of the board. The data reporting function encapsulates the board identifier, the written data of each item record of the subscription table item of the board, and the indication index of the written data of each item record in the remote procedure call protocol message, and sends the remote procedure call protocol message to the collector. 8.根据权利要求7所述的设备,其特征在于,所述底层驱动数据获取模块执行的所述远程过程调用任务在所述数据获取函数未获取到数据时,不修改所述本板订阅表项的未写入标识;8. The device according to claim 7, characterized in that the remote procedure call task executed by the bottom-level driver data acquisition module does not modify the unwritten flag of the subscription table item of the current board when the data acquisition function fails to acquire data; 所述底层驱动数据获取模块执行的所述远程过程调用任务在远程采集周期到达时,调用所述本板订阅表项对应的数据上报函数且所述数据上报函数基于所述本板订阅表项的未写入标识校验所述本板订阅表项未被写入,则等待下一次远程采集周期。When the remote collection cycle arrives, the remote procedure call task executed by the underlying driver data acquisition module calls the data reporting function corresponding to the subscription table item of the local board, and the data reporting function verifies that the subscription table item of the local board has not been written based on the unwritten flag of the subscription table item of the local board, and then waits for the next remote collection cycle. 9.根据权利要求8所述的设备,其特征在于,所述处理器执行所述存储器中的处理器可执行指令用于执行以下操作;9. The device according to claim 8, wherein the processor executes the processor executable instructions in the memory to perform the following operations; 接收由主控板配置的所述的远程采集周期;Receiving the remote acquisition cycle configured by the main control board; 接收由所述主控板配置的所述指示索引;Receiving the indication index configured by the main control board; 接收由所述主控板配置的增加订阅表项的操作动作;receiving an operation action of adding a subscription table item configured by the main control board; 接收由所述主控板配置的所述本板订阅表项;Receiving the subscription table item of the local board configured by the main control board; 向所述底层驱动数据同步新建所述远程过程调用任务的所述远程采集周期、所述指示索引、接收由所述主控板配置的增加订阅表项的操作动作、所述本板订阅表项。The remote acquisition cycle of the remote procedure call task, the indication index, the operation action of adding a subscription table item configured by the main control board, and the subscription table item of the current board are synchronously created to the underlying driver data. 10.根据权利要求9所述的设备,其特征在于,所述本板订阅表项是端口丢包数订阅表项,端口超限订阅表项,端口队列丢包数订阅表项,端口队列超限订阅表项。10. The device according to claim 9 is characterized in that the subscription table items of this board are port packet loss number subscription table items, port limit-exceeding subscription table items, port queue packet loss number subscription table items, and port queue limit-exceeding subscription table items. 11.根据权利要求10所述的设备,其特征在于,所述端口丢包数订阅表项、端口超限订阅表项、所述端口队列丢包数订阅表项以及端口队列超限订阅表项对应于丢包数据获取参数;11. The device according to claim 10, characterized in that the port packet loss number subscription table item, the port limit-exceeding subscription table item, the port queue packet loss number subscription table item and the port queue limit-exceeding subscription table item correspond to packet loss data acquisition parameters; 所述远程过程调用任务调用所述丢包数据获取参数获取需写入的数据包括以执行以下操作:The remote procedure call task calls the packet loss data acquisition parameter to acquire the data to be written, including performing the following operations: 遍历每个本板业务模块和每个本板端口;Traverse each service module and each port of this board; 基于每个本板业务模块的标识和每个本板端口的ID识别一个虚拟输出队列索引;A virtual output queue index is identified based on the ID of each local board service module and the ID of each local board port; 轮询识别的每个虚拟输出队列索引指向的多个队列是否有丢包数和超限数;Poll multiple queues pointed to by each identified virtual output queue index to see whether there are packet loss and limit exceeding numbers; 若是,基于识别的每个虚拟输出队列索引指向的多个队列的丢包数和超限数,统计识别的每个虚拟输出队列索引对应的本板端口的丢包数和超限数;If yes, based on the number of packet losses and the number of over-limits of the multiple queues pointed to by each identified virtual output queue index, the number of packet losses and the number of over-limits of the port on the board corresponding to each identified virtual output queue index are counted; 将识别的每个虚拟输出队列索引对应的本板端口的端口标识及丢包数写入所述端口丢包数订阅表项;Write the port identifier and packet loss count of the port on the board corresponding to each identified virtual output queue index into the port packet loss count subscription table item; 将识别的每个虚拟输出队列索引对应的本板端口的端口标识及超限数写入所述端口超限订阅表项;Write the port identifier and the over-limit number of the port on the board corresponding to each identified virtual output queue index into the port over-limit subscription table item; 将识别的每个虚拟输出队列索引指向的多个队列的端口标识、队列标识及丢包数写入所述端口队列丢包数订阅表项;Write the port identifiers, queue identifiers and packet loss counts of the multiple queues pointed to by each identified virtual output queue index into the port queue packet loss count subscription table item; 将识别的每个虚拟输出队列索引指向的多个队列的端口标识、队列标识及超限数写入所述端口队列超限订阅表项。The port identifiers, queue identifiers and over-limit numbers of the multiple queues pointed to by each identified virtual output queue index are written into the port queue over-limit subscription table entry. 12.根据权利要求11所述的设备,其特征在于,所述处理器执行所述存储器中的处理器可执行指令执行所述数据上报函数将本板标识、所述本板订阅表项的每条表项记录的已写入数据及每条表项记录的已写入数据的指示索引封装在远程过程调用协议报文的操作包括:12. The device according to claim 11, characterized in that the processor executes the processor executable instructions in the memory to execute the data reporting function to encapsulate the board identifier, the written data of each table item record of the board subscription table item, and the indication index of the written data of each table item record in the remote procedure call protocol message, including: 所述远程过程调用任务调用所述端口丢包数订阅表项对应的数据上报函数,将所述业务板的本板标识、所述端口丢包数订阅表项的每条表项记录的端口标识和丢包数及其指示索引封装在所述远程过程调用协议报文;The remote procedure call task calls the data reporting function corresponding to the port packet loss subscription table item, and encapsulates the board identifier of the service board, the port identifier and the packet loss count of each item recorded in the port packet loss subscription table item, and its indication index in the remote procedure call protocol message; 所述远程过程调用任务调用所述端口超限订阅表项对应的数据上报函数,将所述业务板的本板标识、所述端口超限订阅表项的每条表项记录的端口标识和超限数及其指示索引封装在所述远程过程调用协议报文;The remote procedure call task calls the data reporting function corresponding to the port overlimit subscription table item, and encapsulates the board identifier of the service board, the port identifier and the overlimit number and its indication index of each item record of the port overlimit subscription table item in the remote procedure call protocol message; 所述远程过程调用任务调用所述队列丢包数订阅表项对应的数据上报函数,将所述业务板的本板标识、所述端口丢包数订阅表项的每条表项记录的端口标识、队列标识和丢包数及其指示索引封装在所述远程过程调用协议报文;The remote procedure call task calls the data reporting function corresponding to the queue packet loss subscription table item, and encapsulates the board identifier of the service board, the port identifier of each item recorded in the port packet loss subscription table item, the queue identifier and the packet loss number and its indication index in the remote procedure call protocol message; 所述远程过程调用任务调用所述队列超限订阅表项对应的数据上报函数,将所述业务板的本板标识、所述端口超限订阅表项的每条表项记录的端口标识、队列标识和超限数及其指示索引封装在所述远程过程调用协议报文。The remote procedure call task calls the data reporting function corresponding to the queue overlimit subscription table item, and encapsulates the board identifier of the business board, the port identifier of each item recorded in the port overlimit subscription table item, the queue identifier and the overlimit number and its indication index in the remote procedure call protocol message.
CN202111148641.8A 2021-09-29 2021-09-29 A method and device for realizing remote data collection Active CN113961367B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111148641.8A CN113961367B (en) 2021-09-29 2021-09-29 A method and device for realizing remote data collection

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111148641.8A CN113961367B (en) 2021-09-29 2021-09-29 A method and device for realizing remote data collection

Publications (2)

Publication Number Publication Date
CN113961367A CN113961367A (en) 2022-01-21
CN113961367B true CN113961367B (en) 2025-07-04

Family

ID=79463068

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111148641.8A Active CN113961367B (en) 2021-09-29 2021-09-29 A method and device for realizing remote data collection

Country Status (1)

Country Link
CN (1) CN113961367B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119376884B (en) * 2024-10-18 2026-01-09 深圳市国电科技通信有限公司 Task scheduling methods, devices, electronic equipment and storage media

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111049698A (en) * 2018-10-15 2020-04-21 华为技术有限公司 A method and device for collecting telemetry data
CN111522772A (en) * 2020-04-27 2020-08-11 杭州迪普科技股份有限公司 Method and device for configuring service board

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106559236B (en) * 2015-09-28 2020-11-20 中兴通讯股份有限公司 Device resource management method, device, main control board and frame-type device for service board
CN112818195B (en) * 2019-11-15 2023-12-26 腾讯科技(深圳)有限公司 Data acquisition method, device and system and computer storage medium
CN111597061B (en) * 2020-05-25 2023-11-17 瑞斯康达科技发展股份有限公司 Method and device for remote procedure call by client or server
CN113419881B (en) * 2021-08-23 2021-11-19 中电烽友信息技术(武汉)有限公司 Local shared memory operation method and system based on universal blackboard

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111049698A (en) * 2018-10-15 2020-04-21 华为技术有限公司 A method and device for collecting telemetry data
CN111522772A (en) * 2020-04-27 2020-08-11 杭州迪普科技股份有限公司 Method and device for configuring service board

Also Published As

Publication number Publication date
CN113961367A (en) 2022-01-21

Similar Documents

Publication Publication Date Title
US11258719B1 (en) Methods, systems and computer readable media for network congestion control tuning
CN102882705B (en) Method for reporting log through terminal equipment and log reporting system
CN107317802A (en) A kind of generating date dissemination system based on SOA and DDS
CN113961367B (en) A method and device for realizing remote data collection
CN116016295A (en) Ethernet performance monitoring method, system, industrial control equipment and storage medium
CN114979058A (en) CAN multi-mailbox multiplexing processing method and system
CN103297350B (en) Implementing method and switching equipment of cell switching system
CN118055039A (en) Network equipment management method and system based on telemetry data
US20050261796A1 (en) System and method for improving equipment communication in semiconductor manufacturing equipment
CN116488985A (en) Processing method of multi-source heterogeneous IoT data
CN119847967B (en) Host expansion method, device, equipment and storage medium based on RS485 bus
CN110032508B (en) Function driver testing method, device, terminal device and storage medium
CN114666285B (en) Method, system, storage medium and computing device for scheduling Ethernet transmission queue
CN118714008A (en) Network optimization method, device, electronic device and storage medium
CN118503025A (en) Interrupt loss detection method, device, host and detection system
CN118784586A (en) Data transmission method based on DPU, DPU, electronic device and computer storage medium
CN118295954A (en) Data transmission method and communication system of processing card based on PCIe protocol
CN114124856B (en) Flow control method, device and storage medium
CN112217689B (en) Network message tracking method and system based on OpenStack
CN118819689A (en) Data collection method, device, electronic device and storage medium
CN113626161A (en) Distributed multi-user data scheduling method and system
CN107168264A (en) The serial ports shared system and method for environmental monitoring
CN119030905B (en) Protocol Analyzer Systems for FC and Ethernet
CN110300019B (en) Event management subsystem and method for multi-protocol exchange system
CN103428110B (en) The receiving handling method and device of Realtime Transport Protocol data bag

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant