[go: up one dir, main page]

CN112732528B - Index collection method, system, equipment and storage medium based on IT operation and maintenance monitoring - Google Patents

Index collection method, system, equipment and storage medium based on IT operation and maintenance monitoring Download PDF

Info

Publication number
CN112732528B
CN112732528B CN202110024768.2A CN202110024768A CN112732528B CN 112732528 B CN112732528 B CN 112732528B CN 202110024768 A CN202110024768 A CN 202110024768A CN 112732528 B CN112732528 B CN 112732528B
Authority
CN
China
Prior art keywords
index
collection
index collection
service process
service
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110024768.2A
Other languages
Chinese (zh)
Other versions
CN112732528A (en
Inventor
王磊
滕滨
肖爱元
李智
郭志刚
张燕平
王静
朱相虎
朱林
贾鸿丰
辛永超
靳龙飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Aspire Technologies Shenzhen Ltd
China Mobile Internet Co Ltd
China Mobile Information Technology Co Ltd
Original Assignee
Aspire Technologies Shenzhen Ltd
China Mobile Internet Co Ltd
China Mobile Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Aspire Technologies Shenzhen Ltd, China Mobile Internet Co Ltd, China Mobile Information Technology Co Ltd filed Critical Aspire Technologies Shenzhen Ltd
Priority to CN202110024768.2A priority Critical patent/CN112732528B/en
Publication of CN112732528A publication Critical patent/CN112732528A/en
Application granted granted Critical
Publication of CN112732528B publication Critical patent/CN112732528B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3003Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/3024Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a central processing unit [CPU]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3051Monitoring arrangements for monitoring the configuration of the computing system or of the computing system component, e.g. monitoring the presence of processing resources, peripherals, I/O links, software programs

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computing Systems (AREA)
  • Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • General Factory Administration (AREA)
  • Testing And Monitoring For Control Systems (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention discloses an index acquisition method, a system, equipment and a storage medium based on IT operation and maintenance monitoring, wherein the index acquisition method based on the IT operation and maintenance monitoring comprises the following steps: configuring an index acquisition object and an index acquisition parameter corresponding to an acquisition index; determining the number of service processes according to the performance parameters of the acquisition host, and sequentially distributing the index acquisition objects to the corresponding service processes; the service process determines the index acquisition object and the index acquisition parameter according to the query condition; and the service process acquires the acquisition index of the index acquisition object according to the index acquisition object and the index acquisition parameter. According to the method and the system, the service process is determined according to the performance parameters of the acquisition host, and the index acquisition object is distributed to the service process, so that the index acquisition object can be distributed to each service process in a balanced manner, the service process can acquire indexes according to the index acquisition object and the index acquisition parameters, and the index acquisition efficiency is improved.

Description

基于IT运维监控的指标采集方法、系统、设备及存储介质Index collection method, system, equipment and storage medium based on IT operation and maintenance monitoring

技术领域technical field

本发明涉及IT运维的技术领域,尤其是涉及一种基于IT运维监控的指标采集方法、设备、系统及存储介质。The present invention relates to the technical field of IT operation and maintenance, in particular to an index collection method, equipment, system and storage medium based on IT operation and maintenance monitoring.

背景技术Background technique

对于IT运维平台监控指标采集系统而言,其基础功能就是实现采集指标的配置、指标配置查询及指标采集。传统的指标采集装置一般为2层结构,分别为采集指标配置层和指标采集层。采集指标配置层是实现在监控指标执行采集工作前的配置准备工作,先将对应资源池、对应主机、需要采集的指标、指标的采集周期等内容进行配置,并且持久化存储到关系型数据库中;指标采集层主要工作是实现指标配置查询及指标采集,指标配置查询通过采集指标配置层服务获取需要采集的指标配置,指标采集根据上步获取的配置执行具体指标的采集工作。For the monitoring index collection system of the IT operation and maintenance platform, its basic function is to realize the configuration of collection indexes, index configuration query and index collection. Traditional index collection devices generally have a two-layer structure, which are the collection index configuration layer and the index collection layer. The collection index configuration layer is to realize the configuration preparation work before the monitoring index is collected. It first configures the corresponding resource pool, the corresponding host, the index to be collected, the collection cycle of the index, etc., and persists them in the relational database. The main job of the index collection layer is to realize index configuration query and index collection. The index configuration query obtains the index configuration to be collected through the collection index configuration layer service, and the index collection executes the collection of specific indicators according to the configuration obtained in the previous step.

指标采集层一般是单点运行,当要采集的指标数较大,指标进行数据采集性能差,若通过分布式采集则需要在每个采集层服务进行大量的人工配置,为不同的采集层服务分配不同的采集对象(主机)来分担采集压因此,采用人工配置浪费人力,且指标采集性能差。The indicator collection layer generally operates at a single point. When the number of indicators to be collected is large, the data collection performance of the indicators is poor. If the collection is distributed, a large amount of manual configuration needs to be performed on each collection layer service to serve different collection layers. Allocate different acquisition objects (hosts) to share the acquisition pressure. Therefore, manual configuration is a waste of manpower, and the index acquisition performance is poor.

发明内容Contents of the invention

本发明旨在至少解决现有技术中存在的技术问题之一。为此,本发明提出一种基于IT运维监控的指标采集方法,能够提高指标采集的效率、节省人力,且提高指标采集性能。The present invention aims to solve at least one of the technical problems existing in the prior art. For this reason, the present invention proposes an index collection method based on IT operation and maintenance monitoring, which can improve index collection efficiency, save manpower, and improve index collection performance.

本发明还提出一种基于IT运维监控的指标采集系统。The invention also proposes an index collection system based on IT operation and maintenance monitoring.

本发明还提出一种电子控制设备。The invention also proposes an electronic control device.

本发明还提出一种计算机可读存储介质。The invention also proposes a computer-readable storage medium.

第一方面,本发明的一个实施例提供了基于IT运维监控的指标采集方法,包括:In the first aspect, an embodiment of the present invention provides an index collection method based on IT operation and maintenance monitoring, including:

配置采集指标对应的指标采集对象和指标采集参数;Configure the index collection object and index collection parameters corresponding to the collection index;

根据采集主机的性能参数确定服务进程的数量,并将所述指标采集对象按顺序分配至对应的所述服务进程;determining the number of service processes according to the performance parameters of the collection host, and assigning the index collection objects to the corresponding service processes in sequence;

所述服务进程根据查询条件确定所述指标采集对象和所述指标采集参数;The service process determines the index collection object and the index collection parameters according to the query condition;

所述服务进程根据所述指标采集对象和所述指标采集参数采集所述指标采集对象的所述采集指标。The service process collects the collection index of the index collection object according to the index collection object and the index collection parameters.

本发明实施例的基于IT运维监控的指标采集方法至少具有如下有益效果:通过根据采集主机的性能参数确定服务进程,并将指标采集对象分配到服务进程,则可以均衡分配指标采集对象给每个服务进程,实现服务进程根据指标采集对象和指标采集参数进行指标采集,以提高指标采集的效率。The index collection method based on IT operation and maintenance monitoring in the embodiment of the present invention has at least the following beneficial effects: by determining the service process according to the performance parameters of the collection host, and assigning the index collection objects to the service processes, the index collection objects can be evenly distributed to each A service process is used to implement the service process to collect indicators according to the indicator collection objects and index collection parameters, so as to improve the efficiency of index collection.

根据本发明的另一些实施例的基于IT运维监控的指标采集方法,所述指标采集参数包括:指标类型、采集周期、协议类型、采集方式和指标查询接口。According to the index collection method based on IT operation and maintenance monitoring according to other embodiments of the present invention, the index collection parameters include: index type, collection cycle, protocol type, collection mode, and index query interface.

根据本发明的另一些实施例的基于IT运维监控的指标采集方法,所述性能参数包括:CPU核数和CPU使用百分比,所述根据采集主机的性能参数确定服务进程的数量,并将所述指标采集对象按顺序分配至对应的所述服务进程:According to the index collection method based on IT operation and maintenance monitoring according to other embodiments of the present invention, the performance parameters include: the number of CPU cores and the percentage of CPU usage, the number of service processes is determined according to the performance parameters of the collection host, and the obtained The above-mentioned indicator collection objects are assigned to the corresponding service processes in sequence:

根据所述采集主机的所述CPU核数和所述CPU使用百分比确定服务进程的数量;determining the number of service processes according to the number of CPU cores and the CPU usage percentage of the collection host;

按所述服务进程的编号顺序将所述指标采集对象分配给对应的所述服务进程。Allocating the indicator collection objects to the corresponding service processes according to the sequence of numbers of the service processes.

根据本发明的另一些实施例的基于IT运维监控的指标采集方法,所述查询条件包括:服务进程的服务编号和服务进程的总数,所述服务进程根据查询条件确定所述指标采集对象和所述指标采集参数,包括:According to the index collection method based on IT operation and maintenance monitoring according to other embodiments of the present invention, the query conditions include: the service number of the service process and the total number of service processes, and the service process determines the index collection object and The index collection parameters include:

服务进程根据所述服务进程的服务编号和所述服务进程的总数确定所述指标采集对象和所述指标采集参数。The service process determines the index collection object and the index collection parameters according to the service number of the service process and the total number of the service processes.

根据本发明的另一些实施例的基于IT运维监控的指标采集方法,所述服务进程根据所述指标采集对象和所述指标采集参数采集所述指标采集对象的指标,包括:According to the index collection method based on IT operation and maintenance monitoring according to other embodiments of the present invention, the service process collects the index of the index collection object according to the index collection object and the index collection parameters, including:

所述服务进程根据所述指标采集参数和所述指标采集对象确定指标采集检索式;The service process determines an index collection retrieval formula according to the index collection parameters and the index collection object;

所述服务进程根据所述指标采集检索采集所述指标采集对象的指标。The service process retrieves and collects the indicators of the indicator collection object according to the indicator collection.

根据本发明的另一些实施例的基于IT运维监控的指标采集方法,还包括:The index collection method based on IT operation and maintenance monitoring according to other embodiments of the present invention further includes:

监测所述服务进程的运行状态;monitoring the running status of the service process;

若所述运行状态为无更新时间,则将所述服务进程剔除。If the running state is no update time, the service process is eliminated.

根据本发明的另一些实施例的基于IT运维监控的指标采集方法,还包括:The index collection method based on IT operation and maintenance monitoring according to other embodiments of the present invention further includes:

间隔预设时间获取所有采集指标的所述指标采集对象的数量以得到采集对象总数;Obtaining the number of the index collection objects of all the collection indexes at preset time intervals to obtain the total number of collection objects;

根据所述采集对象总数在所述预设时间更新所述服务进程的数量;updating the number of the service process at the preset time according to the total number of collected objects;

根据所述服务进程的数量定期更新所述服务进程所分配的所述指标采集对象。The indicator collection objects allocated by the service process are periodically updated according to the number of the service process.

第二方面,本发明的一个实施例提供了基于IT运维监控的指标采集系统,包括:In the second aspect, an embodiment of the present invention provides an indicator collection system based on IT operation and maintenance monitoring, including:

指标配置模块,用于配置采集指标对应的指标采集对象和指标采集参数;The index configuration module is used to configure the index collection object and index collection parameters corresponding to the collection index;

服务进程,用于根据所述服务进程的编号确定所述指标采集对象和所述指标采集参数,并根据所述指标采集对象和所述指标采集参数采集所述指标采集对象的指标;A service process, configured to determine the index collection object and the index collection parameters according to the number of the service process, and collect the index of the index collection object according to the index collection object and the index collection parameters;

分配模块,用于根据采集主机的性能参数确定所述服务进程的数量,并将所述指标采集对象按顺序分配至对应的所述服务进程。The allocation module is configured to determine the number of the service processes according to the performance parameters of the collection host, and allocate the index collection objects to the corresponding service processes in sequence.

本发明实施例的基于IT运维监控的指标采集系统至少具有如下有益效果:通过根据采集主机的性能参数确定服务进程,并将指标采集对象分配到服务进程,则可以均衡分配指标采集对象给每个服务进程,实现服务进程根据指标采集对象和指标采集参数进行指标采集,以提高指标采集的效率。The index collection system based on IT operation and maintenance monitoring in the embodiment of the present invention has at least the following beneficial effects: by determining the service process according to the performance parameters of the collection host, and assigning the index collection objects to the service processes, the index collection objects can be evenly distributed to each A service process is used to implement the service process to collect indicators according to the indicator collection objects and index collection parameters, so as to improve the efficiency of index collection.

第三方面,本发明的一个实施例提供了电子控制设备,包括:存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时实现:In a third aspect, an embodiment of the present invention provides an electronic control device, including: a memory, a processor, and a computer program stored on the memory and operable on the processor. When the processor executes the program, it realizes:

如第一方面的基于IT运维监控的指标采集系统方法。Such as the index collection system method based on IT operation and maintenance monitoring in the first aspect.

第四方面,本发明的一个实施例提供了计算机可读存储介质,所述计算机可读存储介质存储有计算机可执行指令,所述计算机可执行指令用于使计算机执行如第一方面所述的基于IT运维监控的指标采集系统方法。In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to cause a computer to execute the method described in the first aspect. A system method for index collection based on IT operation and maintenance monitoring.

本申请的其它特征和优点将在随后的说明书中阐述,并且,部分地从说明书中变得显而易见,或者通过实施本申请而了解。本申请的目的和其他优点可通过在说明书、权利要求书以及附图中所特别指出的结构来实现和获得。Additional features and advantages of the application will be set forth in the description which follows, and, in part, will be obvious from the description, or may be learned by practice of the application. The objectives and other advantages of the application will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

附图说明Description of drawings

图1是本发明实施例中基于IT运维监控的指标采集方法的一具体实施例流程示意图;Fig. 1 is a schematic flow diagram of a specific embodiment of an index collection method based on IT operation and maintenance monitoring in an embodiment of the present invention;

图2是本发明实施例中基于IT运维监控的指标采集方法的另一具体实施例流程示意图;Fig. 2 is a schematic flow diagram of another specific embodiment of the index collection method based on IT operation and maintenance monitoring in the embodiment of the present invention;

图3是本发明实施例中基于IT运维监控的指标采集方法的另一具体实施例流程示意图;FIG. 3 is a schematic flow diagram of another specific embodiment of the index collection method based on IT operation and maintenance monitoring in the embodiment of the present invention;

图4是本发明实施例中基于IT运维监控的指标采集方法的另一具体实施例流程示意图;Fig. 4 is a schematic flow diagram of another specific embodiment of the index collection method based on IT operation and maintenance monitoring in the embodiment of the present invention;

图5是本发明实施例中基于IT运维监控的指标采集方法的另一具体实施例流程示意图;FIG. 5 is a schematic flow diagram of another specific embodiment of an index collection method based on IT operation and maintenance monitoring in an embodiment of the present invention;

图6是本发明实施例中基于IT运维监控的指标采集方法的另一具体实施例流程示意图;FIG. 6 is a schematic flowchart of another specific embodiment of an index collection method based on IT operation and maintenance monitoring in an embodiment of the present invention;

图7是本发明实施例中基于IT运维监控的指标采集系统的一具体实施例模块框图;Fig. 7 is a module block diagram of a specific embodiment of an index acquisition system based on IT operation and maintenance monitoring in an embodiment of the present invention;

图8是本发明实施例中电子控制设备的一具体实施例模块框图。Fig. 8 is a module block diagram of a specific embodiment of the electronic control device in the embodiment of the present invention.

附图标记:100、指标配置模块;200、服务进程;300、分配模块;400、存储器;500、处理器。Reference numerals: 100, index configuration module; 200, service process; 300, distribution module; 400, memory; 500, processor.

具体实施方式Detailed ways

以下将结合实施例对本发明的构思及产生的技术效果进行清楚、完整地描述,以充分地理解本发明的目的、特征和效果。显然,所描述的实施例只是本发明的一部分实施例,而不是全部实施例,基于本发明的实施例,本领域的技术人员在不付出创造性劳动的前提下所获得的其他实施例,均属于本发明保护的范围。The conception and technical effects of the present invention will be clearly and completely described below in conjunction with the embodiments, so as to fully understand the purpose, features and effects of the present invention. Apparently, the described embodiments are only some of the embodiments of the present invention, rather than all of them. Based on the embodiments of the present invention, other embodiments obtained by those skilled in the art without creative efforts belong to The protection scope of the present invention.

在本发明实施例的描述中,如果涉及到“若干”,其含义是一个以上,如果涉及到“多个”,其含义是两个以上,如果涉及到“大于”、“小于”、“超过”,均应理解为不包括本数,如果涉及到“以上”、“以下”、“以内”,均应理解为包括本数。如果涉及到“第一”、“第二”,应当理解为用于区分技术特征,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量或者隐含指明所指示的技术特征的先后关系。In the description of the embodiments of the present invention, if it involves "several", it means more than one, if it involves "multiple", it means more than two, if it involves "greater than", "less than", "more than ", should be understood as not including the original number, if it involves "above", "below", and "within", it should be understood as including the original number. If "first" and "second" are involved, it should be understood as used to distinguish technical features, and should not be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features or implicitly indicating the indicated The sequence of technical features.

传统的指标采集系统主要由采集指标配置层和指标采集层组成,采集指标配置层是实现在监控指标执行采集工作前的配置准备工作,先将对应资源池、对应主机、需要采集的指标、指标的采集周期等内容进行配置,并且持久性化存储到关系型数据库中;指标采集层主要工作是实现指标配置查询及指标采集,指标配置查询通过采集指标配置层服务获取需要采集的指标配置,指标采集根据上部获取的配置指标具体的指标的采集工作。The traditional index collection system is mainly composed of the collection index configuration layer and the index collection layer. The collection index configuration layer is to realize the configuration preparation work before the monitoring index is collected. First, the corresponding resource pool, corresponding host, index and index to be collected The collection cycle and other content are configured, and persistently stored in the relational database; the main work of the index collection layer is to realize the index configuration query and index collection. The index configuration query obtains the index configuration to be collected through the service of the index configuration layer. Acquisition is the collection of specific indicators based on the configuration indicators obtained from the upper part.

由于指标采集层一般是单点运行,当需要采集的指标数量较大时,比如每分钟需要对10W以上指标进行数据采集时性能会非常差;即使有一些厂家实现了分布式采集,也需要在每个采集层服务进行大量的人工配置,为不同的采集层服务分配不同的采集对象来分担采集压力。而且当服务出现故障时,整个指标采集工作面临瘫痪;及时通过外部高可用工作实现其服务的高可用,由于服务本身是有状态的,也只能实现冷备切换,不仅工作量大,而且冷备对于设备资源的开销是成倍的增加,效用性比较差。由于指标采集层服务在执行采集任务前的指标配置同步方式都是采用接口,而且接口存在网络延迟及数据库查询开销,影响了最终的指标采集的性能。Since the indicator collection layer generally operates at a single point, when the number of indicators to be collected is large, for example, when data collection of indicators above 10W per minute is required, the performance will be very poor; even if some manufacturers implement distributed collection, they still need to Each collection layer service requires a lot of manual configuration, and different collection objects are assigned to different collection layer services to share the collection pressure. Moreover, when the service fails, the entire index collection work will be paralyzed; the high availability of its services can be realized through external high availability work in time, because the service itself is stateful, and only cold standby switching can be realized, not only the workload is heavy, but also cold The overhead of equipment resources is doubled, and the utility is relatively poor. Because the index configuration synchronization method of the index collection layer service before executing the collection task is to use the interface, and the interface has network delay and database query overhead, which affects the performance of the final index collection.

基于此,本申请公开了基于IT运维监控的指标采集方法、系统、设备及存储介质,能够提高指标采集的性能、扩展性和可用性。Based on this, the present application discloses an index collection method, system, device, and storage medium based on IT operation and maintenance monitoring, which can improve the performance, scalability, and usability of index collection.

第一方面,参照图1,本发明实施例公开了基于IT运维监控的指标采集方法,包括:In the first aspect, referring to FIG. 1, the embodiment of the present invention discloses an index collection method based on IT operation and maintenance monitoring, including:

S100、配置采集指标对应的指标采集对象和指标采集参数;S100. Configure the index collection object and index collection parameters corresponding to the collection index;

S200、根据采集主机的性能参数确定服务进程的数量,并将指标采集对象按顺序分配至对应的服务进程;S200. Determine the number of service processes according to the performance parameters of the collection host, and assign the index collection objects to corresponding service processes in sequence;

S300、服务进程根据查询条件确定指标采集对象和指标采集参数;S300. The service process determines the index collection object and index collection parameters according to the query condition;

S400、服务进程根据指标采集对象和指标采集参数采集指标采集对象的指标。S400. The service process collects the index of the index collection object according to the index collection object and the index collection parameter.

由于传统的指标采集都是单点运行,因此针对采集指标数量多时,需要耗费大量的时间,如果通过人工采用分布式采集则需要大量的人工配置。因此,通过对采集指标进行配置对应的指标采集对象和指标采集参数,根据采集主机的性能参数确定服务进程的数量,并根据将指标采集对象按顺序分配至对应的服务进程。当需要采集指标时,服务进程根据查询条件确定指标采集对象和指标采集参数,服务进程根据指标采集对象和指标采集参数以采集对应指标采集对象的指标。通过给每个服务进程自动分配专属的指标采集对象,以便于通过服务进程分别管理对应的服务采集对象,然后获取服务进程中的指标采集对象和指标采集参数,则可以根据指标采集对象和和指标采集参数采集到对应的指标,能够均衡分配指标采集对象至各个服务进程,以通过服务进程采集指标,使整个指标采集系统的可用性提高,无需人工单独分配,以节省人力,且提高指标采集的效率。Since the traditional index collection is a single-point operation, it takes a lot of time to collect a large number of indexes. If the distributed collection is manually adopted, a large amount of manual configuration is required. Therefore, by configuring the corresponding index collection objects and index collection parameters for the collection indexes, the number of service processes is determined according to the performance parameters of the collection host, and the index collection objects are assigned to the corresponding service processes in sequence. When it is necessary to collect indicators, the service process determines the indicator collection object and index collection parameters according to the query conditions, and the service process collects the indicators corresponding to the indicator collection object according to the indicator collection objects and indicator collection parameters. By automatically assigning a dedicated index collection object to each service process, it is convenient to manage the corresponding service collection objects through the service process, and then obtain the index collection objects and index collection parameters in the service process, then you can collect objects and indexes according to the index When the collection parameters are collected and the corresponding indexes are collected, the index collection objects can be allocated to each service process in a balanced manner, so that the indexes can be collected through the service process, so that the availability of the entire index collection system can be improved, and there is no need for manual allocation, so as to save manpower and improve the efficiency of index collection .

在一些实施例中,指标采集参数包括:指标类型、采集周期、协议类型、采集方式和指标查询接口。指标采集对象为资源池设备或软件,且资源池设备包括主机、网络、存储、业务系统等设备。In some embodiments, the index collection parameters include: index type, collection period, protocol type, collection mode, and index query interface. The object of index collection is resource pool equipment or software, and resource pool equipment includes host, network, storage, business system and other equipment.

将需要采集指标进行配置,配置采集指标对应的指标类型、采集周期、协议类型和采集方式,然后选择需要进行指标采集的资源池设备或软件,将指标采集对象与指标采集参数进行绑定,最终存储到数据库,并提供指标采集对象和指标查询接口。因此,通过清楚需要采集指标的指标采集参数和指标采集对象,则可以合理分配服务进程,以便于对应的服务进程根据指标采集参数准确采集到对应的指标。Configure the indicators that need to be collected, configure the indicator type, collection period, protocol type, and collection method corresponding to the collection indicators, then select the resource pool device or software that needs to be collected, bind the indicator collection objects and indicator collection parameters, and finally It is stored in the database and provides an indicator collection object and an indicator query interface. Therefore, by clarifying the index collection parameters and the index collection objects that need to collect the index, the service process can be allocated reasonably, so that the corresponding service process can accurately collect the corresponding index according to the index collection parameter.

在一些实施例中,参照图2,性能参数包括:CPU核数和CPU使用百分比,步骤S200包括In some embodiments, referring to FIG. 2, the performance parameters include: the number of CPU cores and the percentage of CPU usage, and step S200 includes

S210、根据采集主机的CPU核数和CPU使用百分比确定服务进程的数量;S210. Determine the number of service processes according to the number of CPU cores and CPU usage percentage of the acquisition host;

S220、按服务进程的编号顺序将指标采集对象分配给对应的服务进程。S220. Allocate the index collection objects to the corresponding service processes according to the numbering sequence of the service processes.

其中,步骤S210和S220在指标采集层执行,且步骤S210和S220定时执行以更新服务进程的数量以及服务进程分配的采集对象。首先根据采集主机的CPU核数和CPU使用百分比确定服务进程的数量。也即每一个采集主机设置服务进程,且每个采集主机设置服务进程的数量通过如下公式计算得到:Wherein, steps S210 and S220 are executed at the indicator collection layer, and steps S210 and S220 are executed regularly to update the number of service processes and the collection objects assigned by the service processes. First, determine the number of service processes based on the number of CPU cores and CPU usage percentage of the acquisition host. That is, each collection host sets up a service process, and the number of each collection host's set service process is calculated by the following formula:

A=round[B/4*(1-C)] (1)A=round[B/4*(1-C)] (1)

式中,A为服务进程数量,B为采集主机的CPU核数,C为采集主机的CPU使用百分比。通过根据每一台采集主机的CPU核数和CPU使用百分比计算得到服务进程的数量,以计算资源合理的分配使得高配置且空闲的采集主机能够处理更多任务以提升处理效率。通过采集指标即可确定指标采集对象和指标采集参数,然后计算每一个采集主机的服务进程,且每个服务进程分配对应的指标采集对象,以实现采集主机设置多个服务进程分别进行不同指标采集对象的指标采集,以提高指标采集的效率。In the formula, A is the number of service processes, B is the number of CPU cores of the collection host, and C is the percentage of CPU usage of the collection host. The number of service processes is obtained by calculating the number of service processes based on the number of CPU cores and CPU usage percentage of each acquisition host, so that the reasonable allocation of computing resources enables high-configuration and idle acquisition hosts to process more tasks to improve processing efficiency. By collecting indicators, the indicator collection object and indicator collection parameters can be determined, and then the service process of each collection host is calculated, and each service process is assigned a corresponding indicator collection object, so that the collection host can set multiple service processes to collect different indicators separately Object index collection to improve the efficiency of index collection.

例如,若采集主机的CPU核数为8,且当前采集主机的CPU使用百分比为10%,则通过公式(1)计算得到round(1.8)=2,因此该采集主机设置两个服务进程。所以对于CPU核数为8,且CPU使用百分比为10%的采集主机可以设置两个服务进程,以根据不同的采集主机的性能参数设置对应的服务进程,使每个采集主机的合理分配服务进程,以提高指标采集的效率。For example, if the number of CPU cores of the acquisition host is 8, and the current CPU usage percentage of the acquisition host is 10%, then round(1.8)=2 is calculated by formula (1), so the acquisition host sets two service processes. Therefore, for an acquisition host with 8 CPU cores and a CPU usage percentage of 10%, two service processes can be set to set corresponding service processes according to the performance parameters of different acquisition hosts, so that each acquisition host can reasonably allocate service processes , to improve the efficiency of index collection.

其中,根据采集主机的性能参数生成服务进程,且生成的服务进程按照1开始到N的序号进行标注,并将每个服务进程的服务ID存入到数据库,且数据库为多个主机共用的一个数据库,以便于实现服务ID的统一调度及状态维护,且将每个服务进程的运行状态存入到数据库中。当服务进程按照顺序编号后,指标采集对象按照顺序分配到服务进程中,且每个服务进程管理多个指标采集对象和存储指标采集对象对应的指标采集参数,以实现指标采集对象的均衡分配。Among them, the service process is generated according to the performance parameters of the acquisition host, and the generated service process is marked according to the sequence number from 1 to N, and the service ID of each service process is stored in the database, and the database is a shared by multiple hosts. Database, in order to realize unified scheduling and state maintenance of service ID, and store the running state of each service process in the database. After the service processes are numbered in sequence, the index collection objects are assigned to the service processes in sequence, and each service process manages multiple index collection objects and stores the index collection parameters corresponding to the index collection objects to achieve a balanced allocation of index collection objects.

参照图3,在一些实施例中,基于IT运维监控的指标采集方法,还包括:Referring to FIG. 3, in some embodiments, the method for collecting indicators based on IT operation and maintenance monitoring further includes:

S500、监测服务进程的运行状态;S500. Monitoring the running state of the service process;

S600、若运行状态为无更新时间,则将服务进程剔除。S600. If the running status is no update time, delete the service process.

若服务进程不再工作,则不可以通过该服务进程采集指标采集对象的指标,从而影响指标采集的完整性。因此需要时刻监测服务进程的运行状态,若监测服务进程的运行状态为无更新时间则证明服务进程无法工作,由于服务进程在工作状态时会时刻更新时间并将更新时间同步到数据库中,因此通过监测服务进程的时间是否更新能够准确地判断服务进程是否工作,若不在工作则将服务进程剔除,提取服务进程后需要根据步骤S210和步骤S220重新更新服务进程,并重新分配每一个指标采集对象到更新后的服务进程,以保证指标采集的完整性。If the service process is no longer working, the indicators of the indicator collection object cannot be collected through the service process, thereby affecting the integrity of the indicator collection. Therefore, it is necessary to monitor the running status of the service process at all times. If the running status of the monitoring service process is no update time, it proves that the service process cannot work. Since the service process will update the time and synchronize the update time to the database when it is in the working state, so through Monitoring whether the time of the service process is updated can accurately determine whether the service process is working. If the service process is not working, the service process will be removed. After the service process is extracted, the service process needs to be updated according to steps S210 and S220, and each index collection object should be reassigned to The updated service process ensures the integrity of indicator collection.

在一些实施例中,参照图4,基于IT运维监控的指标采集方法,还包括:In some embodiments, referring to FIG. 4, the method for collecting indicators based on IT operation and maintenance monitoring further includes:

S700、间隔预设时间获取所有采集指标的指标采集对象的数量以得到采集对象总数;S700. Obtain the number of index collection objects of all collection indexes at intervals of a preset time to obtain the total number of collection objects;

S800、根据采集对象总数在预设时间更新服务进程的数量;S800. Update the number of service processes at a preset time according to the total number of collected objects;

S900、根据服务进程的数量定期更新服务进程所分配的指标采集对象。S900. Periodically update the indicator collection objects allocated by the service process according to the number of the service process.

其中,采集指标是变化的,因此采集指标配置的指标采集对象也是变化的。因此需要定时更新服务进程和服务进程管理的指标采集对象,以保证每次采集的指标准确。当采集指标需要扩容或者其中一个服务进程出现故障,也需要更新服务进程,再自动分配每个服务进程对应的指标采集对象即可,使得指标采集系统具有高扩展性和高可用性。Wherein, the collection index changes, so the index collection object of the collection index configuration also changes. Therefore, it is necessary to regularly update the service process and the indicator collection objects managed by the service process to ensure that the indicators collected each time are accurate. When the collection index needs to be expanded or one of the service processes fails, it is also necessary to update the service process, and then automatically allocate the index collection objects corresponding to each service process, so that the index collection system has high scalability and high availability.

在一些实施例中,参照图5,查询条件包括:服务进程的服务编号和服务进程内的总数,步骤S300包括:In some embodiments, referring to FIG. 5, the query condition includes: the service number of the service process and the total number in the service process, step S300 includes:

S310、服务进程根据服务进程的服务编号和服务进程的总数确定指标采集对象和指标采集参数。S310. The service process determines an index collection object and index collection parameters according to the service number of the service process and the total number of the service processes.

其中,获取当前服务进程的服务编号作为数据库查询当前服务进程需要采集的指标采集对象的查询条件,其中服务进程确定指标采集对象的公式为:Among them, the service number of the current service process is obtained as the query condition for the database to query the index collection objects that need to be collected by the current service process, and the formula for the service process to determine the index collection objects is:

MOD(D/T)=(E-1) (2)MOD(D/T)=(E-1) (2)

式中,D为指标采集对象的ID,T为服务进程的总数,E为当前服务进程的服务编号,因此通过公式(2)能够确定每一个服务进程可以采集的指标采集对象。In the formula, D is the ID of the index collection object, T is the total number of service processes, and E is the service number of the current service process, so the index collection objects that can be collected by each service process can be determined by formula (2).

例如,当服务进程的服务编号为2,且服务进程的总数为2,则服务编号为2的服务进程可以采集ID为1、3、5、……的指标采集对象。若服务进程的服务编号为2,且服务进程的总数为4,则服务编号为2的服务进程可以采集ID为1、5、9、……,因此通过查询条件能够确定每一个服务进程可以采集的指标采集对象,以便于该服务进程根据所管理的指标采集对象和指标采集参数进行指标采集。For example, when the service number of the service process is 2, and the total number of service processes is 2, the service process with the service number 2 can collect index collection objects with IDs of 1, 3, 5, . . . . If the service number of the service process is 2, and the total number of service processes is 4, then the service process with the service number 2 can collect IDs 1, 5, 9, ..., so it can be determined that each service process can collect The index collection object of the index collection object, so that the service process collects the index according to the index collection object and index collection parameters managed.

在一些实施列中,参照图6,步骤S400包括:In some implementations, referring to FIG. 6, step S400 includes:

S410、服务进程根据指标采集参数和指标采集对象确定指标采集检索式;S410. The service process determines an index collection retrieval formula according to the index collection parameters and the index collection object;

S420、服务进程根据指标采集检索采集指标采集对象的指标。S420. The service process retrieves the index of the index collection object according to the index collection.

由于指标采集参数包括:指标类型、采集周期、协议类型、采集方式和指标查询接口,因此通过服务进程根据指标采集参数和指标采集对象确定指标采集检索式,以根据指标采集检索式直接采集到对应的指标,使得指标采集快速,提升整个指标采集系统的性能。Since the index collection parameters include: index type, collection cycle, protocol type, collection method, and index query interface, the index collection search formula is determined according to the index collection parameters and index collection objects through the service process, so as to directly collect the corresponding data according to the index collection search formula. The index makes the index collection fast and improves the performance of the entire index collection system.

其中,指标采集检索式为静态的Map-Map-List组合,且数据结构为Map<IP()、采集对象>->Map<采集周期,List>->List<指标类型&协议类型&采集方式&查询接口>,通过设置指标采集检索式为Map-Map-List组合可以快速地遍历需要执行指标采集任务的指标采集对象及指标采集参数,可以更好地匹配采集周期,快速且不延迟地执行指标采集任务。不仅如此,当指标配置更新时可以通过Map的hash算法快速匹配到缓存的指标采集对象,进行指标采集参数更新,组装完成后存储到本地数据库,例如Java本地JVM数据库。因此,根据List-Map-List组合进行指标采集对象和指标采集参数进行遍历,同时根据协议类型、指标类型、采集方式对具体的指标采集对象执行采集操作,实现了针对指标采集配置的快速提取能力,提升了整个系统的处理性能。Among them, the index collection retrieval method is a static Map-Map-List combination, and the data structure is Map<IP(), collection object>->Map<collection cycle, List>->List<index type&protocol type&collection method &query interface>, by setting the index collection search type to Map-Map-List combination, you can quickly traverse the index collection objects and index collection parameters that need to execute the index collection task, which can better match the collection cycle and execute quickly and without delay Index collection task. Not only that, when the indicator configuration is updated, the hash algorithm of the Map can be used to quickly match the cached indicator collection objects, update the indicator collection parameters, and store them in the local database after assembly, such as the Java local JVM database. Therefore, the index collection objects and index collection parameters are traversed according to the List-Map-List combination, and at the same time, the collection operation is performed on the specific index collection objects according to the protocol type, index type, and collection method, realizing the rapid extraction capability for the index collection configuration , which improves the processing performance of the whole system.

下面参考图1至图6以一个具体的实施例详细描述根据本发明实施例的基于IT运维监控的指标采集方法。值得注意的是,下述描述仅是示例性说明,而不是对发明的具体限制。The method for collecting indicators based on IT operation and maintenance monitoring according to an embodiment of the present invention will be described in detail in a specific embodiment below with reference to FIGS. 1 to 6 . It should be noted that the following description is only an illustration rather than a specific limitation to the invention.

第一,先对采集指标配置指标类型、采集周期、协议类型、采集方式和指标查询接口,然后选择需要进行指标采集的资源池或主机作为指标采集对象。First, configure the index type, collection cycle, protocol type, collection method, and index query interface for the collection index first, and then select the resource pool or host that needs to collect the index as the index collection object.

第二,通过将采集主机的CPU核数和CPU使用百分比代入公式(1)计算得到服务进程的数量,且每一个服务进程按顺序编号得到服务编号,然后根据每一个服务进程的服务编号按顺序分配指标采集对象。同时定时更新指标采集对象,且监测服务进程的运行状态,若指标采集对象更新或服务进程的工作状态为不更新时间则重新计算服务进程数量且重新分配指标采集对象,以实现整个指标采集系统的高扩展性和高可用性。Second, calculate the number of service processes by substituting the CPU core number and CPU usage percentage of the acquisition host into formula (1), and each service process is numbered in order to obtain the service number, and then according to the service number of each service process in order Allocate metrics collection objects. At the same time, the index collection objects are regularly updated, and the running status of the service process is monitored. If the index collection objects are updated or the working state of the service process is not updating the time, the number of service processes is recalculated and the index collection objects are reassigned to realize the overall index collection system. High scalability and high availability.

第三,服务进程根据服务进程的服务编号和服务进程的总数确定可以采集的指标采集对象,且获取指标采集对象的指标采集参数。Thirdly, the service process determines the index collection objects that can be collected according to the service number of the service process and the total number of the service processes, and obtains the index collection parameters of the index collection objects.

第四,服务进程根据指标采集对象和指标采集参数确定Map-Map-List组合的指标采集检索式,然后根Map-Map-List组合对指标采集对象和指标采集参数进行遍历,以采集到指标采集对象的指标。通过引入指标采集检索式进行指标采集,提升了整个系统的性能。Fourth, the service process determines the index collection search formula of the Map-Map-List combination according to the index collection objects and index collection parameters, and then traverses the index collection objects and index collection parameters based on the Map-Map-List combination to collect the index collection The index of the object. The performance of the entire system is improved by introducing the index collection retrieval method for index collection.

第二方面,参照图7,本发明实施例公开了一种基于IT运维监控的指标采集系统,包括:指标配置模块100、服务进程200和分配模块300,指标配置模块100用于配置采集指标对应的指标采集对象和指标采集参数;服务进程200用于根据服务进程200的编号确定指标采集对象和指标采集参数,并根据指标采集对象和指标采集参数采集指标采集对象的采集指标;分配模块300用于根据采集主机的性能参数确定服务进程200的数量,并将指标采集对象按顺序分配至对应的服务进程200。In the second aspect, referring to FIG. 7 , the embodiment of the present invention discloses an index collection system based on IT operation and maintenance monitoring, including: an index configuration module 100, a service process 200, and an allocation module 300. The index configuration module 100 is used to configure the collection index Corresponding index collection objects and index collection parameters; the service process 200 is used to determine the index collection objects and index collection parameters according to the number of the service process 200, and collect the collection indexes of the index collection objects according to the index collection objects and index collection parameters; the allocation module 300 It is used to determine the number of service processes 200 according to the performance parameters of the collection host, and assign the index collection objects to the corresponding service processes 200 in sequence.

通过根据采集主机的性能参数确定服务进程200,并将指标采集对象分配到服务进程200,则可以均衡分配指标采集对象给每个服务进程200,实现服务进程200根据指标采集对象和指标采集参数进行指标采集,以提高指标采集的效率。By determining the service process 200 according to the performance parameters of the collection host, and assigning the index collection objects to the service process 200, the index collection objects can be distributed to each service process 200 in a balanced manner, so that the service process 200 can perform the process according to the index collection objects and index collection parameters. Index collection to improve the efficiency of index collection.

其中,一种基于IT运维监控的指标采集系统的操作过程执行参照第一方面的一种基于IT运维监控的指标采集方法,此处不再赘述。Wherein, the operation process of an index collection system based on IT operation and maintenance monitoring refers to the method for collecting indexes based on IT operation and maintenance monitoring in the first aspect, and will not be repeated here.

第三方面,参照图8,本发明实施例还公开了一种电子控制设备,包括:存储器400、处理器500及存储在存储器400上并可在处理器500上运行的计算机程序,处理器500执行所述程序时实现:如第一方面的基于IT运维监控的指标采集系统方法。In the third aspect, referring to FIG. 8 , the embodiment of the present invention also discloses an electronic control device, including: a memory 400, a processor 500, and a computer program stored on the memory 400 and operable on the processor 500, and the processor 500 When the program is executed, it is realized: the index collection system method based on IT operation and maintenance monitoring as described in the first aspect.

电子控制设备可以为移动终端设备,也可以为非移动终端设备。非移动终端设备可以为服务器、个人计算机;本发明实施方案不作具体限定。The electronic control device may be a mobile terminal device or a non-mobile terminal device. The non-mobile terminal device may be a server or a personal computer; this embodiment of the present invention does not specifically limit it.

存储器400可以为外部存储器400,也可以为内部存储器400,外部存储器400为外部存储卡。外部存储卡通过外部存储器400接口与处理器500通信,实现数据存储功能。内部存储器400可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。The memory 400 can be an external memory 400, or an internal memory 400, and the external memory 400 is an external memory card. The external memory card communicates with the processor 500 through the interface of the external memory 400 to implement a data storage function. Internal memory 400 may be used to store computer-executable program code, which includes instructions.

处理器500可以包括一个或多个处理单元,例如:处理器500可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processingunit,GPU),图像信号处理器(image signal processor,ISP),控制器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。The processor 500 may include one or more processing units, for example: the processor 500 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor ( image signal processor (ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

第四方面,本发明实施例还公开了一种计算机可读存储介质,计算机可读存储介质存储有计算机可执行指令,所述计算机可执行指令用于使计算机执行如第一方面所述的基于IT运维监控的指标采集系统方法。In the fourth aspect, the embodiment of the present invention also discloses a computer-readable storage medium. The computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to make the computer execute the method based on the first aspect. The index collection system method of IT operation and maintenance monitoring.

以上所描述的装置实施例仅仅是示意性的,其中作为分离部件说明的单元可以是或者也可以不是物理上分开的,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。The device embodiments described above are only illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

本领域普通技术人员可以理解,上文中所公开方法中的全部或某些步骤、系统可以被实施为软件、固件、硬件及其适当的组合。某些物理组件或所有物理组件可以被实施为由处理器,如中央处理器、数字信号处理器或微处理器执行的软件,或者被实施为硬件,或者被实施为集成电路,如专用集成电路。这样的软件可以分布在计算机可读介质上,计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的,术语计算机存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外,本领域普通技术人员公知的是,通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据,并且可包括任何信息递送介质。Those skilled in the art can understand that all or some of the steps and systems in the methods disclosed above can be implemented as software, firmware, hardware and an appropriate combination thereof. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit . Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). As known to those of ordinary skill in the art, the term computer storage media includes both volatile and nonvolatile media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data. permanent, removable and non-removable media. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, tape, magnetic disk storage or other magnetic storage devices, or can Any other medium used to store desired information and which can be accessed by a computer. In addition, as is well known to those of ordinary skill in the art, communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media .

上面结合附图对本发明实施例作了详细说明,但是本发明不限于上述实施例,在所属技术领域普通技术人员所具备的知识范围内,还可以在不脱离本发明宗旨的前提下作出各种变化。此外,在不冲突的情况下,本发明的实施例及实施例中的特征可以相互组合。The embodiments of the present invention have been described in detail above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned embodiments, and within the scope of knowledge of those of ordinary skill in the art, various modifications can be made without departing from the spirit of the present invention. Variety. In addition, the embodiments of the present invention and the features in the embodiments can be combined with each other if there is no conflict.

Claims (8)

1.一种基于IT运维监控的指标采集方法,其特征在于,包括:1. A method for collecting indicators based on IT operation and maintenance monitoring, characterized in that it comprises: 配置采集指标对应的指标采集对象和指标采集参数;Configure the index collection object and index collection parameters corresponding to the collection index; 根据采集主机的性能参数确定服务进程的数量,并将所述指标采集对象按顺序分配至对应的所述服务进程;其中,所述性能参数为当前的性能运行参数;Determine the number of service processes according to the performance parameters of the collection host, and assign the index collection objects to the corresponding service processes in sequence; wherein, the performance parameters are current performance operating parameters; 所述服务进程根据查询条件确定所述指标采集对象和所述指标采集参数;所述查询条件包括:服务进程的服务编号和服务进程的总数,所述服务进程根据查询条件确定所述指标采集对象和所述指标采集参数,包括:The service process determines the index collection object and the index collection parameters according to the query condition; the query condition includes: the service number of the service process and the total number of the service process, and the service process determines the index collection object according to the query condition And the index collection parameters, including: 服务进程根据所述服务进程的服务编号和所述服务进程的总数确定所述指标采集对象和所述指标采集参数;其中服务进程确定指标采集对象的公式为:The service process determines the index collection object and the index collection parameters according to the service number of the service process and the total number of the service process; wherein the formula for determining the index collection object by the service process is: MOD(D/T)=(E-1)MOD(D/T)=(E-1) 式中,D为指标采集对象的ID,T为服务进程的总数,E为当前服务进程的服务编号;所述服务进程根据所述指标采集对象和所述指标采集参数采集所述指标采集对象的指标,具体包括:In the formula, D is the ID of the index collection object, T is the total number of service processes, and E is the service number of the current service process; the service process collects the number of the index collection object according to the index collection object and the index collection parameters indicators, including: 所述服务进程根据所述指标采集参数和所述指标采集对象确定指标采集检索式;其中,指标采集检索式为静态的Map-Map-List组合,且数据结构为Map<IP( )、采集对象>->Map<采集周期,List>->List<指标类型&协议类型&采集方式&查询接口>;The service process determines the index collection retrieval formula according to the index collection parameters and the index collection object; wherein, the index collection retrieval formula is a static Map-Map-List combination, and the data structure is Map<IP( ), collection object >->Map<collection cycle, List>->List<index type&protocol type&collection method&query interface>; 所述服务进程根据所述指标采集检索式采集所述指标采集对象的指标。The service process collects the index of the index collection object according to the index collection retrieval formula. 2.根据权利要求1所述的基于IT运维监控的指标采集方法,其特征在于,所述指标采集参数包括:指标类型、采集周期、协议类型、采集方式和指标查询接口。2. The index collection method based on IT operation and maintenance monitoring according to claim 1, wherein the index collection parameters include: index type, collection cycle, protocol type, collection mode, and index query interface. 3.根据权利要求1至2任一项所述的基于IT运维监控的指标采集方法,其特征在于,所述性能参数包括:CPU核数和CPU使用百分比,所述根据采集主机的性能参数确定服务进程的数量,并将所述指标采集对象按顺序分配至对应的所述服务进程:3. The index collection method based on IT operation and maintenance monitoring according to any one of claims 1 to 2, wherein the performance parameters include: the number of CPU cores and the percentage of CPU usage, and the performance parameters according to the collection host Determine the number of service processes, and assign the indicator collection objects to the corresponding service processes in sequence: 根据所述采集主机的所述CPU核数和所述CPU使用百分比确定服务进程的数量;determining the number of service processes according to the number of CPU cores and the CPU usage percentage of the collection host; 按所述服务进程的编号顺序将所述指标采集对象分配给对应的所述服务进程。Allocating the indicator collection objects to the corresponding service processes according to the sequence of numbers of the service processes. 4.根据权利要求1至2任一项所述的基于IT运维监控的指标采集方法,还包括:4. The index collection method based on IT operation and maintenance monitoring according to any one of claims 1 to 2, further comprising: 监测所述服务进程的运行状态;monitoring the running status of the service process; 若所述运行状态为无更新时间,则将所述服务进程剔除。If the running state is no update time, the service process is eliminated. 5.根据权利要求1所述的基于IT运维监控的指标采集方法,其特征在于,还包括:5. The index collection method based on IT operation and maintenance monitoring according to claim 1, further comprising: 间隔预设时间获取所有采集指标的所述指标采集对象的数量以得到采集对象总数;Obtaining the number of the index collection objects of all the collection indexes at preset time intervals to obtain the total number of collection objects; 根据所述采集对象总数在所述预设时间更新所述服务进程的数量;updating the number of the service process at the preset time according to the total number of collected objects; 根据所述服务进程的数量定期更新所述服务进程所分配的所述指标采集对象。The indicator collection objects allocated by the service process are periodically updated according to the number of the service process. 6.一种基于IT运维监控的指标采集系统,其特征在于,包括:6. An index collection system based on IT operation and maintenance monitoring, characterized in that it comprises: 指标配置模块,用于配置采集指标对应的指标采集对象和指标采集参数;The index configuration module is used to configure the index collection object and index collection parameters corresponding to the collection index; 服务进程,用于根据所述服务进程的服务编号确定所述指标采集对象和所述指标采集参数,并根据所述指标采集对象和所述指标采集参数采集所述指标采集对象的指标;其中,服务进程确定指标采集对象的公式为:A service process, configured to determine the index collection object and the index collection parameters according to the service number of the service process, and collect the index of the index collection object according to the index collection object and the index collection parameters; wherein, The formula for the service process to determine the index collection object is: MOD(D/T)=(E-1)MOD(D/T)=(E-1) 式中,D为指标采集对象的ID,T为服务进程的总数,E为当前服务进程的服务编号;所述服务进程还用于根据所述指标采集参数和所述指标采集对象确定指标采集检索式,根据所述指标采集检索式采集所述指标采集对象的指标;其中,指标采集检索式为静态的Map-Map-List组合,且数据结构为Map<IP( )、采集对象>->Map<采集周期,List>->List<指标类型&协议类型&采集方式&查询接口>;In the formula, D is the ID of the index collection object, T is the total number of service processes, and E is the service number of the current service process; the service process is also used to determine the index collection and retrieval according to the index collection parameters and the index collection object According to the index collection retrieval formula, the index of the index collection object is collected; wherein, the index collection retrieval formula is a static Map-Map-List combination, and the data structure is Map<IP( ), collection object>->Map <collection period, List>->List<indicator type&protocol type&collection method&query interface>; 分配模块,用于根据采集主机的性能参数确定所述服务进程的数量,并将所述指标采集对象按顺序分配至对应的所述服务进程;其中,所述性能参数为当前的性能运行参数。An allocation module, configured to determine the number of the service processes according to the performance parameters of the collection host, and allocate the index collection objects to the corresponding service processes in sequence; wherein, the performance parameters are current performance operation parameters. 7.一种电子控制设备,包括:存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时实现如权利要求1至5中任一项所述的基于IT运维监控的指标采集方法。7. An electronic control device, comprising: a memory, a processor, and a computer program stored on the memory and operable on the processor, when the processor executes the program, it realizes any one of claims 1 to 5 The above-mentioned index collection method based on IT operation and maintenance monitoring. 8.一种计算机可读存储介质,其特征在于,所述计算机可读存储介质存储有计算机可执行指令,所述计算机可执行指令用于使计算机执行如权利要求1至5任一项所述的基于IT运维监控的指标采集方法。8. A computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to enable a computer to perform the operation described in any one of claims 1 to 5. The index collection method based on IT operation and maintenance monitoring.
CN202110024768.2A 2021-01-08 2021-01-08 Index collection method, system, equipment and storage medium based on IT operation and maintenance monitoring Active CN112732528B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110024768.2A CN112732528B (en) 2021-01-08 2021-01-08 Index collection method, system, equipment and storage medium based on IT operation and maintenance monitoring

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110024768.2A CN112732528B (en) 2021-01-08 2021-01-08 Index collection method, system, equipment and storage medium based on IT operation and maintenance monitoring

Publications (2)

Publication Number Publication Date
CN112732528A CN112732528A (en) 2021-04-30
CN112732528B true CN112732528B (en) 2022-11-11

Family

ID=75589917

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110024768.2A Active CN112732528B (en) 2021-01-08 2021-01-08 Index collection method, system, equipment and storage medium based on IT operation and maintenance monitoring

Country Status (1)

Country Link
CN (1) CN112732528B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116560949B (en) * 2023-07-10 2023-09-29 南瑞轨道交通技术有限公司 An implementation method, system, equipment and storage medium for data collection and reception
CN116719702B (en) * 2023-08-10 2024-03-26 深圳开源互联网安全技术有限公司 Method and device for collecting open source information, electronic equipment and storage medium

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106470219A (en) * 2015-08-17 2017-03-01 阿里巴巴集团控股有限公司 The dilatation of computer cluster and capacity reduction method and equipment
CN106789398A (en) * 2016-11-25 2017-05-31 中国传媒大学 A kind of method of media big data hadoop cluster monitoring
CN106844701A (en) * 2017-01-03 2017-06-13 宁波亿拍客网络科技有限公司 A kind of specific markers and application method that identification is perceived based on computer vision
US20190095992A1 (en) * 2017-09-24 2019-03-28 Annie Mafotsing Soh Method and system to facilitate decentralized money services software as a service
CN109522183B (en) * 2018-10-23 2022-04-12 东软集团股份有限公司 Working state monitoring method and system, collector, server and storage medium
CN110532060B (en) * 2019-08-10 2022-05-03 佳都科技集团股份有限公司 Hybrid network environment data acquisition method and system
CN110928732A (en) * 2019-11-05 2020-03-27 北京字节跳动网络技术有限公司 Server cluster performance sampling analysis method and device and electronic equipment
CN111538585B (en) * 2019-12-31 2022-03-01 明度智云(浙江)科技有限公司 Js-based server process scheduling method, system and device
CN111597065B (en) * 2020-05-12 2024-03-01 京东科技控股股份有限公司 Method and device for collecting equipment information
CN111984505B (en) * 2020-08-21 2023-06-16 豪越科技有限公司 Fortune dimension data acquisition device and acquisition method

Also Published As

Publication number Publication date
CN112732528A (en) 2021-04-30

Similar Documents

Publication Publication Date Title
CN111522636B (en) Application container adjusting method, application container adjusting system, computer readable medium and terminal device
CN105933376B (en) A data manipulation method, server and storage system
CN108829352B (en) User quota method and system for distributed storage system
CN110941481A (en) Resource scheduling method, device and system
CN105049268A (en) Distributed computing resource allocation system and task processing method
CN101799797B (en) Dynamic allocation method of user disk quota in distributed storage system
US20160378846A1 (en) Object based storage cluster with multiple selectable data handling policies
CN107967175B (en) Resource scheduling system and method based on multi-objective optimization
CN112732528B (en) Index collection method, system, equipment and storage medium based on IT operation and maintenance monitoring
CN111092930B (en) Service opening method and device
CN109085999A (en) data processing method and processing system
CN104298541A (en) Data distribution algorithm and data distribution device for cloud storage system
WO2021135263A1 (en) Cpu resource reservation method and apparatus, and related device
CN106685724A (en) Election-based node server management method, device and system
EP3217735B1 (en) M2m node deletion and registration method, m2m node and storage medium
CN111309440B (en) Method and equipment for managing and scheduling multiple types of GPUs
CN112085535A (en) Resource metering charging method, device, cluster and storage medium
CN111597270A (en) Data synchronization method, device, device and computer storage medium
CN110633053B (en) Storage capacity balancing method, object storage method and device
CN106713375A (en) Method and device for allocating cloud resources
CN114911617A (en) Resource allocation method, device, equipment and medium
CN104735103B (en) A kind of management of distributed data and method of reseptance, device
CN107943423A (en) The management method and computer-readable recording medium of storage resource in cloud system
CN110290228A (en) A method and device for allocating Internet Protocol IP addresses
CN101938516A (en) A user-oriented method for dynamically allocating storage resources

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant