CN108156225B - Micro-application monitoring system and method based on container cloud platform - Google Patents
Micro-application monitoring system and method based on container cloud platform Download PDFInfo
- Publication number
- CN108156225B CN108156225B CN201711345490.9A CN201711345490A CN108156225B CN 108156225 B CN108156225 B CN 108156225B CN 201711345490 A CN201711345490 A CN 201711345490A CN 108156225 B CN108156225 B CN 108156225B
- Authority
- CN
- China
- Prior art keywords
- monitoring
- monitoring data
- container
- micro
- application
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 197
- 238000000034 method Methods 0.000 title claims abstract description 9
- 238000013480 data collection Methods 0.000 claims abstract description 10
- 238000013500 data storage Methods 0.000 claims description 12
- 238000007726 management method Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 claims 1
- 238000011161 development Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000012806 monitoring device Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/562—Brokering proxy services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/565—Conversion or adaptation of application format or content
- H04L67/5651—Reducing the amount or size of exchanged application data
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Debugging And Monitoring (AREA)
- Information Transfer Between Computers (AREA)
Abstract
本发明公开了一种基于容器云平台的微应用监控系统和方法，包括监控数据收集装置，监控数据收集装置包括顺序连接的容器运行时后台适配器、监控数据合并器和监控收集代理装置；容器运行时后台适配器从容器运行时后台按照容器收集监控数据；监控数据合并器将属于同一微应用的多个容器的监控数据合并为一条监控数据；监控收集代理装置负责与监控汇总服务器通信，将同一主机的监控数据按照微应用分类汇报；监控配置服务器负责接收用户的配置管理请求，发送配置信息给容器运行时后台适配器、监控数据合并器、监控收集代理和监控汇总服务器。本发明可以减少监控收集代理的个数，从而提高系统利用效率。
The invention discloses a micro-application monitoring system and method based on a container cloud platform, comprising a monitoring data collection device, the monitoring data collection device comprises a container runtime background adapter, a monitoring data combiner and a monitoring and collection agent device connected in sequence; The time background adapter collects monitoring data from the container runtime background according to the container; the monitoring data combiner combines the monitoring data of multiple containers belonging to the same micro-application into one monitoring data; the monitoring collection agent device is responsible for communicating with the monitoring summary server, and the same host The monitoring data is reported according to the micro-application classification; the monitoring configuration server is responsible for receiving the user's configuration management request, and sending the configuration information to the container runtime background adapter, monitoring data consolidator, monitoring collection agent and monitoring summary server. The invention can reduce the number of monitoring and collecting agents, thereby improving the utilization efficiency of the system.
Description
Technical Field
The invention relates to the technical field of cloud computing, in particular to a micro-application monitoring system and method based on a container cloud platform.
Background
With the continuous development of computer system technology, the basic unit of computing instance has evolved from a physical server instance (physical machine) to a virtual server instance (virtual machine) and further to a container instance. In response to the development of container technology, the architecture of computer software applications has evolved from traditional monolithic applications to the architecture of current microservices and micro-applications.
Corresponding to the traditional single application, the application number of computer software under the micro-service micro-application architecture can be greatly increased; corresponding to the traditional physical machine technology and virtual machine technology, the number of instances of the application taking the container instance as the basic unit is greatly increased.
In the conventional computer monitoring technology, whether in a physical machine environment or a virtual machine environment, the collection and aggregation of monitoring data are performed by taking a computing instance as a unit. Therefore, the traditional monitoring system is not suitable for micro application in a container cloud platform environment, and mainly has two main problems that the traditional monitoring system can cause:
1. monitoring collection agent overhead issues: the number of the applied instances taking the container instance as a basic unit is greatly increased to dozens, hundreds or even thousands, the monitoring collection agent is deployed by taking the container instance as a unit, the overhead of the monitoring collection agent is very large, and the efficiency is very low;
2. ease of use issues for monitoring summary data: the granularity of the monitoring data gathered by taking the container example as a unit is too fine, and the overall operation condition of the application cannot be intuitively reflected.
Disclosure of Invention
The invention aims to overcome the defects in the prior art, provides a micro application monitoring system and method based on a container cloud platform, and solves the problems that the monitoring collection agent in the prior art is high in cost, low in efficiency and incapable of visually reflecting the overall operation condition of an application.
In order to solve the technical problems, the technical scheme adopted by the invention is as follows: the monitoring system comprises a monitoring summary server, a monitoring data collection device, a container operation background and a monitoring configuration server; the monitoring data collection device comprises a container runtime background adapter, a monitoring data merger and a monitoring collection agent device which are sequentially connected; the container runtime background adapter collects monitoring data from the container runtime background according to the container; the monitoring data merger merges the monitoring data of a plurality of containers belonging to the same micro application into one piece of monitoring data; the monitoring collection agent device is responsible for communicating with the monitoring summary server and reporting the monitoring data of the same host according to the micro application classification; and the monitoring configuration server is responsible for receiving a configuration management request of a user and sending configuration information to the background adapter, the monitoring data merger, the monitoring collection agent and the monitoring summary server when the container runs.
Further, the monitoring data collection device is deployed on a computer node of the container cloud platform.
Preferably, the computer node is a physical machine or a virtual machine.
Further, the monitoring summarizing server is also connected with a monitoring data storage database and a monitoring data display page; the monitoring summarizing server stores the combined monitoring data into a monitoring data storage database; when a user needs to check the monitoring data of the micro applications, the monitoring summarizing server reads the monitoring data from the monitoring data storage database and outputs and displays the monitoring data through a monitoring data display page.
Further, the monitoring configuration server is also connected with a monitoring configuration storage database and a monitoring configuration display page; when a user needs to check the monitoring configuration of the micro application, the monitoring configuration server reads monitoring configuration information from the monitoring configuration storage database and outputs and displays the monitoring configuration information through a monitoring configuration display page.
The invention provides a micro-application monitoring method based on a container cloud platform, which comprises the following steps:
the container runtime background adapter collects monitoring target application container instances from the container runtime background;
the monitoring data merger merges all container instance monitoring data of the same application of the same host;
all monitoring data of the same host are collected by a monitoring collection agent and reported to a monitoring summary server;
and the monitoring and summarizing server merges the monitoring data of all container instances of all hosts of the same application and stores the merged monitoring data into a monitoring data storage database.
Compared with the prior art, the invention has the following beneficial effects: the utility model provides a micro application monitoring system under container cloud platform environment, can collect the running state information of gathering micro application according to user's needs, for traditional monitored control system, can reduce the number of monitoring collection agent on the one hand to improve system utilization efficiency, on the other hand gathers monitoring information more intelligently, makes the user detect the whole state of micro application easily rather than by the data interference of too much single application container example.
Drawings
FIG. 1 is a schematic structural diagram of a micro application monitoring system based on a container cloud platform provided by the invention;
FIG. 2 is a flowchart of a micro application monitoring method based on a container cloud platform according to the present invention.
Detailed Description
The invention is further described below with reference to the accompanying drawings. The following examples are only for illustrating the technical solutions of the present invention more clearly, and the protection scope of the present invention is not limited thereby.
As shown in fig. 1, the structural schematic diagram of the micro application monitoring system based on the container cloud platform provided in the present invention includes: the monitoring and summarizing server, the monitoring data collecting device, the container operation background and the monitoring and configuring server.
The monitoring data collection device comprises a container runtime background adapter, a monitoring data merger and a monitoring collection agent device which are sequentially connected. The container runtime background adapter collects monitoring data from the container runtime background according to the container. The monitoring data merger merges the monitoring data of a plurality of containers belonging to the same micro application into one piece of monitoring data, thereby reducing the amount of network transmission data. The monitoring collection agent device is responsible for communicating with the monitoring summary server and reporting the monitoring data of the same host according to the micro application classification. The monitoring configuration server is responsible for receiving a configuration management request of a user and sending configuration information to the container operation background adapter, the monitoring data merger, the monitoring collection agent and the monitoring summary server.
The monitoring data collecting devices are deployed on the computer nodes of the container cloud platform, and only one monitoring data collecting device needs to be deployed on each computer node, so that the deployment complexity and the operation cost of the monitoring devices can be greatly reduced; the monitoring data collection device collects the running data of the application container from the container running background on the deployed computer node.
The computer node is a physical machine or a virtual machine.
The monitoring and summarizing server is responsible for collecting monitoring data of all computer nodes in the container cloud platform, and the monitoring data collected by each computer node and summarized according to the micro applications are summarized and combined according to the micro applications again to obtain overall monitoring data of the distributed micro applications.
The monitoring summarizing server is also connected with a monitoring data storage database and a monitoring data display page; the monitoring summarizing server stores the combined monitoring data into a monitoring data storage database; when a user needs to check the monitoring data of the micro applications, the monitoring summarizing server reads the monitoring data from the monitoring data storage database and outputs and displays the monitoring data through a monitoring data display page.
The monitoring configuration server is also connected with a monitoring configuration storage database and a monitoring configuration display page; when a user needs to check the monitoring configuration of the micro application, the monitoring configuration server reads monitoring configuration information from the monitoring configuration storage database and outputs and displays the monitoring configuration information through a monitoring configuration display page.
As shown in fig. 2, the method for monitoring a micro application based on a container cloud platform provided by the present invention includes the following steps:
the container runtime background adapter collects monitoring target application container instances from the container runtime background;
the monitoring data merger merges all container instance monitoring data of the same application of the same host;
all monitoring data of the same host are collected by a monitoring collection agent and reported to a monitoring summary server;
and the monitoring and summarizing server merges the monitoring data of all container instances of all hosts of the same application and stores the merged monitoring data into a monitoring data storage database.
The above description is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, several modifications and variations can be made without departing from the technical principle of the present invention, and these modifications and variations should also be regarded as the protection scope of the present invention.
Claims (6)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711345490.9A CN108156225B (en) | 2017-12-15 | 2017-12-15 | Micro-application monitoring system and method based on container cloud platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711345490.9A CN108156225B (en) | 2017-12-15 | 2017-12-15 | Micro-application monitoring system and method based on container cloud platform |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108156225A CN108156225A (en) | 2018-06-12 |
| CN108156225B true CN108156225B (en) | 2021-02-05 |
Family
ID=62467320
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711345490.9A Active CN108156225B (en) | 2017-12-15 | 2017-12-15 | Micro-application monitoring system and method based on container cloud platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108156225B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109586999B (en) * | 2018-11-12 | 2021-03-23 | 深圳先进技术研究院 | A container cloud platform state monitoring and early warning system, method and electronic device |
| US10902011B1 (en) | 2020-01-31 | 2021-01-26 | Capital One Services, Llc | Systems and methods for context development |
| US10848451B1 (en) | 2020-01-31 | 2020-11-24 | Capital One Services, Llc | Systems and methods for context development |
| US10909135B1 (en) | 2020-01-31 | 2021-02-02 | Capital One Services, Llc | Systems and methods for context development |
| CN111651237A (en) * | 2020-05-22 | 2020-09-11 | 国云科技股份有限公司 | A method and device for acquiring virtual machine monitoring data in a Docker container |
| CN112217864B (en) * | 2020-09-04 | 2025-02-18 | 微民保险代理有限公司 | Microservice monitoring method, device, system, computer equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105227374A (en) * | 2015-10-23 | 2016-01-06 | 浪潮(北京)电子信息产业有限公司 | A kind of fault moving method of cluster application and system |
| CN105763395A (en) * | 2016-04-01 | 2016-07-13 | 汉柏科技有限公司 | Method and system for monitoring and managing virtual machine and container in cloud environment |
| CN107370816A (en) * | 2017-07-26 | 2017-11-21 | 郑州云海信息技术有限公司 | A kind of dispositions method and device of Web applications |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016065080A1 (en) * | 2014-10-21 | 2016-04-28 | Twilio, Inc. | System and method for providing a miro-services communication platform |
| AU2016310529B2 (en) * | 2015-08-27 | 2020-12-17 | Johnson Controls Tyco IP Holdings LLP | Edge intelligence platform, and internet of things sensor streams system |
| CN105389243B (en) * | 2015-10-26 | 2018-06-05 | 华为技术有限公司 | A kind of container monitors method and apparatus |
| EP3423941B1 (en) * | 2016-03-04 | 2023-05-10 | Bladelogic, Inc. | Provisioning of containers for virtualized applications |
| CN106027328B (en) * | 2016-05-13 | 2020-02-07 | 深圳市中润四方信息技术有限公司 | Cluster monitoring method and system based on application container deployment |
| CN106020930B (en) * | 2016-05-13 | 2019-07-23 | 深圳市中润四方信息技术有限公司 | A kind of application management method and system based on application container |
| CN106453492B (en) * | 2016-08-30 | 2019-05-14 | 浙江大学 | Container dispatching method under Docker container cloud platform based on Fuzzy Pattern Recognition |
| CN106371974B (en) * | 2016-08-30 | 2018-11-09 | 中国民生银行股份有限公司 | The monitoring method and distribution platform of application program in Docker containers |
| CN106559488B (en) * | 2016-11-24 | 2019-09-06 | 天津市普迅电力信息技术有限公司 | A Method for Establishing Tenant-Driven Grid Geographic Information Spatial Services |
| CN106610836B (en) * | 2016-12-23 | 2019-12-31 | 国网信息通信产业集团有限公司 | A microservice operation management tool |
| CN107070860A (en) * | 2016-12-27 | 2017-08-18 | 北京粉笔蓝天科技有限公司 | A kind of collection method of monitoring data, device and system |
| CN106888254B (en) * | 2017-01-20 | 2020-08-18 | 华南理工大学 | Kubernetes-based container cloud architecture and interaction method among modules thereof |
| CN106991035B (en) * | 2017-04-06 | 2020-04-21 | 北京计算机技术及应用研究所 | Host monitoring system based on micro-service architecture |
-
2017
- 2017-12-15 CN CN201711345490.9A patent/CN108156225B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105227374A (en) * | 2015-10-23 | 2016-01-06 | 浪潮(北京)电子信息产业有限公司 | A kind of fault moving method of cluster application and system |
| CN105763395A (en) * | 2016-04-01 | 2016-07-13 | 汉柏科技有限公司 | Method and system for monitoring and managing virtual machine and container in cloud environment |
| CN107370816A (en) * | 2017-07-26 | 2017-11-21 | 郑州云海信息技术有限公司 | A kind of dispositions method and device of Web applications |
Non-Patent Citations (2)
| Title |
|---|
| 国家电网公司微应用平台架构设计与实现;冯扬，董爱强，夏元轶等;《电子测量技术》;20170715;第40卷(第7期);第52-58页 * |
| 基于大数据的电网运检管控系统架构研究;吴国巧，宋慧娟，张子沛;《上海节能》;20171031(第 10 期);第597-601页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108156225A (en) | 2018-06-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108156225B (en) | Micro-application monitoring system and method based on container cloud platform | |
| CN109586999B (en) | A container cloud platform state monitoring and early warning system, method and electronic device | |
| CN101667034B (en) | An easily expandable monitoring system that supports heterogeneous clusters | |
| CN101707632A (en) | Method for dynamically monitoring performance of server cluster and alarming real-timely | |
| CN104572401A (en) | Alarming method and alarming system | |
| CN107908521A (en) | A kind of monitoring method of container performance on the server performance and node being applied under cloud environment | |
| CN106973119A (en) | A kind of electric power enterprise storage resource management system | |
| CN106027328A (en) | Cluster monitoring method and system based on application container deployment | |
| CN110598051A (en) | Power industry monitoring system, method and device | |
| CN111625419A (en) | Log acquisition method, system, equipment and computer readable storage medium | |
| CN104104734A (en) | Log analysis method and device | |
| CN109144813A (en) | A kind of cloud computing system server node fault monitoring system and method | |
| CN107832187A (en) | A kind of power transmission and transformation equipment state monitoring system | |
| CN105516293A (en) | Cloud resource monitoring system of intelligent substation | |
| CN110111068A (en) | Production executive system and method based on micro services framework | |
| CN107094086A (en) | A kind of information acquisition method and device | |
| CN119030860A (en) | Fault node positioning method, device, electronic device and non-volatile storage medium | |
| CN111339466A (en) | Interface management method and device, electronic equipment and readable storage medium | |
| CN110568855A (en) | A UAV visual flight management system and method based on big data computing engine | |
| CN108121639A (en) | A kind of data center's total management system design method based on cloud platform | |
| CN107682222A (en) | A kind of information monitoring method, apparatus and system | |
| CN108334550A (en) | A kind of data processing system based on Human Resource Management System | |
| CN117370053A (en) | Information system service operation-oriented panoramic monitoring method and system | |
| CN1547356A (en) | A grid-oriented monitoring system and method | |
| CN113900898B (en) | Data processing system, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |