CN111581043A - Server power consumption monitoring method and device and server - Google Patents
Server power consumption monitoring method and device and server Download PDFInfo
- Publication number
- CN111581043A CN111581043A CN201910691734.1A CN201910691734A CN111581043A CN 111581043 A CN111581043 A CN 111581043A CN 201910691734 A CN201910691734 A CN 201910691734A CN 111581043 A CN111581043 A CN 111581043A
- Authority
- CN
- China
- Prior art keywords
- power consumption
- server
- total power
- bmc
- psu
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 74
- 238000012544 monitoring process Methods 0.000 title claims abstract description 37
- 230000004044 response Effects 0.000 claims abstract description 68
- 238000004891 communication Methods 0.000 claims abstract description 16
- 230000036541 health Effects 0.000 claims description 7
- 230000000737 periodic effect Effects 0.000 claims description 7
- 230000005540 biological transmission Effects 0.000 claims description 5
- 238000004458 analytical method Methods 0.000 claims description 3
- 238000012806 monitoring device Methods 0.000 abstract description 7
- 238000010586 diagram Methods 0.000 description 8
- 101150085905 DCP2 gene Proteins 0.000 description 7
- 101100031494 Schizosaccharomyces pombe (strain 972 / ATCC 24843) psu1 gene Proteins 0.000 description 7
- 101100422754 Schizosaccharomyces pombe (strain 972 / ATCC 24843) sui1 gene Proteins 0.000 description 7
- 229920002492 poly(sulfone) Polymers 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000007717 exclusion Effects 0.000 description 2
- 230000003862 health status Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000002715 modification method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3058—Monitoring arrangements for monitoring environmental properties or parameters of the computing system or of the computing system component, e.g. monitoring of power, currents, temperature, humidity, position, vibrations
- G06F11/3062—Monitoring arrangements for monitoring environmental properties or parameters of the computing system or of the computing system component, e.g. monitoring of power, currents, temperature, humidity, position, vibrations where the monitored property is the power consumption
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Power Sources (AREA)
- Debugging And Monitoring (AREA)
Abstract
The disclosure provides a monitoring method, a monitoring device and a server for server power consumption, wherein the method is applied to a Baseboard Management Controller (BMC) of the server, the BMC is in communication connection with a Management Engine (ME) through an Intelligent Platform Management Bus (IPMB), and a power sensor parameter in a configuration file of the ME is in an enabling state; the method comprises the following steps: accessing the power consumption of each power supply unit PSU of the server according to a set millisecond-level period, and calculating the total power consumption of the server according to the obtained power consumption of the PSU; and if the IPMB receives the total power consumption acquisition request message of the ME, returning a total power consumption response message to the ME through the IPMB, wherein the total power consumption response message carries the total power consumption calculated in the current period. In the disclosure, the ME acquires the total power consumption of the server through the BMC, so that the problem that the ME and the BMC access the power supply together to compete for access channels can be avoided, and the accuracy of the power supply data acquired by the BMC and the ME is improved.
Description
Technical Field
The present disclosure relates to the technical field of servers, and in particular, to a method and an apparatus for monitoring power consumption of a server, and a server.
Background
The power supply typically requires access to the server and a power cord to power the server. The Power supply includes a plurality of Power Source Units (PSU), and in the Power supply process, a BMC (baseboard Management Controller) and an ME (Management Engine) are generally required to access each Power source unit in the Power supply to monitor the health status of the whole Power supply and the total Power consumption of the server, so as to ensure the normal Power supply of the Power supply.
At present, a BMC and an ME access each power supply unit in a power supply through a routing chip, when the BMC and the ME access the power supply simultaneously, the BMC and the ME compete for an access channel, and the BMC or the ME can easily access an incorrect power supply unit due to the competition for the access channel, so that power supply data acquired by the BMC or the ME is inaccurate.
Disclosure of Invention
The purpose of the present disclosure is to provide a method and an apparatus for monitoring server power consumption, and a server, so as to prevent a BMC and an ME from competing for an access channel, and improve accuracy of power data acquired by the BMC and the ME.
In a first aspect, the disclosed embodiment provides a method for monitoring server power consumption, where the method is applied to a baseboard management controller BMC of a server, the BMC is in communication connection with a management engine ME through an intelligent platform management bus IPMB, and a power sensor parameter in a configuration file of the ME is in an enabled state; the method comprises the following steps: accessing the power consumption of each power supply unit PSU of the server according to a set millisecond-level period, and calculating the total power consumption of the server according to the obtained power consumption of the PSU; wherein, the millisecond-level period refers to the time length of the period taking millisecond as a unit; if the IPMB receives the total power consumption obtaining request message of the ME, the IPMB returns a total power consumption response message to the ME, and the total power consumption response message carries the total power consumption calculated in the current period; and sending the total power consumption acquisition request message of the ME according to the periodic value corresponding to the power sensor parameter.
In a preferred embodiment of the present disclosure, the step of accessing the power consumption of each PSU of the server according to the set millisecond-level cycle, and calculating the total power consumption of the server according to the obtained power consumption of the PSU includes: accessing the power consumption of each PSU of the server through a first designated thread according to a set millisecond-level period; and calculating the acquired power consumption of the PSU through the second designated line to obtain the total power consumption of the server.
In a preferred embodiment of the present disclosure, the step of accessing, by the first designated thread, the power consumption of each PSU of the server according to the set millisecond-level cycle includes: and accessing the routing chip through the first designated thread in a set millisecond-level period to acquire the power consumption of each PSU of the server through the routing chip.
In a preferred embodiment of the present disclosure, the method further includes: acquiring configuration information and physical information of each PSU through a third designated thread, wherein the configuration information comprises a manufacturer and a model of the PSU; the physical information includes bit information and power information of the PSU; and determining the health state of the PSU according to the acquired configuration information and the physical information.
In a second aspect, the disclosed embodiment provides a method for monitoring server power consumption, where the method is applied to a management engine ME of a server, the ME is in communication connection with a baseboard management controller BMC through an intelligent platform management bus IPMB, and power sensor parameters in a configuration file of the ME are enabled; the BMC is used for accessing the power consumption of each power supply unit PSU of the server in a set millisecond period, and calculating the total power consumption of the server according to the obtained power consumption of the PSU; the method comprises the following steps: sending a total power consumption acquisition request message to the BMC through the IPMB according to the period value corresponding to the power sensor parameter; receiving a total power consumption response message returned by the BMC through the IPMB, wherein the total power consumption response message carries the total power consumption calculated in the current period; and analyzing the total power consumption response message to obtain the total power consumption.
In a preferred embodiment of the present disclosure, the period value corresponding to the power sensor parameter is an arbitrary value between 90ms and 150 ms.
In a preferred embodiment of the present disclosure, the method further includes: performing power control on the server according to the total power consumption, wherein the power control comprises at least one of the following steps: controlling working parameters of a CPU of the server; controlling the working parameters of the memory of the server; the operating parameters of the input/output ports of the server are controlled.
In a preferred embodiment of the present disclosure, the access command parameter for each PSU in the ME configuration file is in a non-enabled state.
In a third aspect, the present disclosure provides a monitoring device for server power consumption, where the monitoring device is disposed in a BMC of a server, the BMC is in communication connection with a management engine ME through an IPMB, and a parameter of a power sensor in a configuration file of the ME is in an enable state; the device includes: the total power consumption acquisition module is used for accessing the power consumption of each power supply unit PSU of the server according to a set millisecond-level period and calculating the total power consumption of the server according to the acquired power consumption of the PSUs; wherein, the millisecond-level period refers to the time length of the period taking millisecond as a unit; the total power consumption transmission module is used for returning a total power consumption response message to the ME through the IPMB when the IPMB receives the total power consumption acquisition request message of the ME, wherein the total power consumption response message carries the total power consumption calculated in the current period; and sending the total power consumption acquisition request message of the ME according to the periodic value corresponding to the power sensor parameter.
In a fourth aspect, the present disclosure provides a monitoring apparatus for server power consumption, where the apparatus is disposed in a management engine ME of a server, the ME is in communication connection with a baseboard management controller BMC through an intelligent platform management bus IPMB, and a power sensor parameter in a configuration file of the ME is enabled; the BMC is used for accessing the power consumption of each power supply unit PSU of the server in a set millisecond period, and calculating the total power consumption of the server according to the obtained power consumption of the PSU; the device includes: the request message sending module is used for sending a total power consumption acquisition request message to the BMC according to the period value corresponding to the power sensor parameter through the IPMB; the response message receiving module is used for receiving a total power consumption response message returned by the BMC through the IPMB, wherein the total power consumption response message carries the total power consumption calculated in the current period; and the analysis module is used for analyzing the total power consumption response message to obtain the total power consumption.
In a fifth aspect, an embodiment of the present disclosure provides a server, including: the baseboard management controller BMC is in communication connection with the management engine ME through an intelligent platform management bus IPMB; power sensor parameters in the ME's configuration file are enabled; the BMC is used for accessing the power consumption of each power supply unit PSU of the server in a set millisecond period, and calculating the total power consumption of the server according to the obtained power consumption of the PSU; the ME is used for sending a total power consumption acquisition request message to the BMC through the IPMB according to the period value corresponding to the power sensor parameter; the BMC is also used for returning a total power consumption response message to the ME through the IPMB, and the total power consumption response message carries the total power consumption calculated in the current period; the ME is also used for receiving the total power consumption response message and analyzing the total power consumption response message to obtain the total power consumption.
The embodiment of the disclosure brings the following beneficial effects:
the utility model provides a monitoring method, a device and a server for server power consumption, wherein a BMC accesses the power consumption of each power supply unit PSU of the server according to a set millisecond period and calculates the total power consumption of the server according to the obtained power consumption of the PSU; and if the BMC receives the total power consumption obtaining request message of the ME through the IPMB, returning a total power consumption response message to the ME through the IPMB, wherein the total power consumption response message carries the total power consumption calculated in the current period. In the disclosure, the ME acquires the total power consumption of the server through the BMC, and the problem of channel competition caused by the fact that the ME and the BMC access the power supply together can be avoided, so that the accuracy of the power supply data acquired by the BMC and the ME is improved.
Additional features and advantages of the disclosure will be set forth in the description which follows, or in part may be learned by the practice of the above-described techniques of the disclosure, or may be learned by practice of the disclosure.
In order to make the aforementioned objects, features and advantages of the present disclosure more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a schematic structural diagram of a BMC and ME access power supply in the related art according to an embodiment of the present disclosure;
fig. 2 is a flowchart of a method for monitoring server power consumption according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of another BMC and ME access power supply in the related art according to an embodiment of the present disclosure;
fig. 4 is a flowchart of another method for monitoring server power consumption according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of power consumption of a BMC and an ME monitoring server according to an embodiment of the present disclosure;
fig. 6 is a flowchart of another method for monitoring server power consumption according to an embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of a monitoring apparatus for server power consumption according to an embodiment of the present disclosure;
fig. 8 is a schematic structural diagram of another apparatus for monitoring server power consumption according to an embodiment of the present disclosure;
fig. 9 is a schematic structural diagram of a server according to an embodiment of the present disclosure;
fig. 10 is a schematic structural diagram of a hardware link between the BMC and the ME according to an embodiment of the present disclosure.
Detailed Description
The technical solutions of the present disclosure will be described clearly and completely with reference to the following embodiments, and it should be understood that the described embodiments are only some embodiments of the present disclosure, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments disclosed herein without making any creative effort, shall fall within the protection scope of the present disclosure.
Typically, BMC and ME pass through I2C bus Structure Access Power supply, as shown in FIG. 1, I2The C bus includes two lines, one of which is connected to some of the power cells in the power supply, as exemplified in fig. 1 by connections PSU1, PSU2, PSU3, and PSU 4; another line connects another portion of the power supply units in the power supply, exemplified in FIG. 1 by connections PSU5, PSU6, PSU7, and PSU 8. Each power supply unit corresponds to a unique address. In FIG. 1, BMC and ME access I through the same routing chip2Each power supply unit on the C bus due to I2C TotalThe line is a multi-host bus, a plurality of controllers capable of controlling the bus can be connected to the bus, and when more than two controllers (equivalent to BMC and ME) send data transmission instructions simultaneously, only one controller can really control the bus; thus, when the BMC and ME access the battery cells in the power supply through the bus at the same time, it is easy to cause the BMC and ME to compete for access channels, resulting in a power data read error.
For example, if the BMC accesses the power unit PSU1 through the routing chip, while the ME accesses the power unit PSU5 through the routing chip, I at this time2The C-bus may modify the access channel from the channel accessing PSU1 to the channel accessing PSU 5. Since the addresses of the power devices corresponding to the upper and lower physical slots are the same, the BMC reads the data information of the PSU1, but actually reads the information of the power PSU5, so that the BMC reads the power information incorrectly, and the monitoring of the health state of the BMC power is inaccurate. For example, if the PSU1 and PSU5 are both in place, the PSU1 is connected to the power line, the PSU5 is not connected to the power line, the input power of the PSU1 is hundreds of watts, the input power of the PSU5 is zero watts, and the BMC may read the PSU5 with an input power of hundreds of watts, which is far from the actual value (zero watts), and the accuracy of the obtained power data is poor.
Based on this, the embodiments of the present disclosure provide a method and an apparatus for monitoring server power consumption, and a server, where the technology may be applied in a monitoring and management scenario of power supply operating conditions such as a server, a computing device, and a terminal device, especially in a monitoring and management scenario of server power consumption.
In order to facilitate understanding of the present embodiment, first, a method for monitoring power consumption of a server disclosed in the embodiments of the present disclosure is described in detail; as shown in fig. 2, the method is applied to a BMC of a server, where the BMC is communicatively connected to a management engine ME through an IPMB, and a power sensor parameter in a configuration file of the ME is in an enabled state, and the method includes the following steps:
step S202, accessing the power consumption of each power supply unit PSU of the server according to a set millisecond-level period, and calculating the total power consumption of the server according to the obtained power consumption of the PSUs; wherein, the millisecond period refers to the period duration in milliseconds.
The BMC is generally a controller that executes remote management of a server, and can perform operations such as firmware upgrade on a machine or check the running status of machine equipment when the machine is not started; wherein the machine may be a server. The PSU generally needs to be connected into a server and a power line, so that power can be supplied to the server, and normal operation of the server is guaranteed. The power consumption of the power supply unit PSU may be a real-time input/output power consumption of the power supply unit PSU, which may also be understood as a difference between a real-time input power and an output power of a device, a device (e.g., a server), or the like.
In particular implementations, the BMC may periodically access each PSU connected to the server in milliseconds (e.g., 90ms, 110ms, etc.), and obtain power consumption of each PSU, which may be obtained according to input power and output power of the PSU; specifically, the acquired power consumptions of the respective PSUs may be added or weighted to determine the total power consumption of the server. The BMC acquires the power consumption of each PSU by using millisecond-level frequency, and can ensure the real-time performance and accuracy of acquired data.
Step S204, if the IPMB receives the total power consumption obtaining request message of the ME, the IPMB returns a total power consumption response message to the ME, and the total power consumption response message carries the total power consumption calculated in the current period; and sending the total power consumption acquisition request message of the ME according to the periodic value corresponding to the power sensor parameter.
The IPMB (Intelligent Platform Management Bus) is usually two sets of redundancy I (field replaceable Unit) for communication of FRUs (field replaceable Unit) backplanes of an ATCA (Advanced telecommunications Computing Platform)2C bus is a generic term. Each management controller, which may be a BMC, is typically coupled to the IPMB bus and performs different functions. The IPMB bus may also have multiple PSUs connected to it, which may act as a sensor interface to allow system management software to read sensor data from the IPMB. In generalIn some cases, the sensor interface has configuration information including alarm thresholds, whether time triggering is allowed, etc. An ICMB (internal Management Bus) bridge may also be coupled to the IPMB to enable the IPMB to communicate with another remote Management platform via the ICMB. Meanwhile, other user boards may be externally connected to the IPMB bus for extending the functions of an IPMI (Intelligent Platform Management Interface).
The ME may send a total power consumption obtaining request message to the BMC through the IPMB, where the total power consumption obtaining request message is sent by the ME according to a period value corresponding to a power sensor parameter, and a period corresponding to the sensor parameter is usually in the order of milliseconds, for example, 90 milliseconds, 120 milliseconds, and the like. After receiving the total power consumption obtaining request message, the BMC returns a total power consumption response message to the ME through the IPMB, where the total power consumption response message generally includes the total power consumption of the server obtained by the BMC accessing the power consumption of each PSU of the server according to a millisecond-level cycle.
And when the ME receives the total power consumption response message, analyzing the total power consumption response message to obtain the total power consumption of the server. The ME may generally analyze whether the obtained total power consumption of the server exceeds a preset threshold, and if the obtained total power consumption of the server exceeds the threshold, the ME may reduce the total power consumption of the server by reducing a frequency of a Central Processing Unit (CPU), releasing a memory, limiting a high power Input/Output (IO), and the like, so that the total power consumption of the server is smaller than the threshold, and normal operation of the server is ensured.
The utility model provides a monitoring method of server power consumption, BMC accesses the power consumption of each power supply unit PSU of the server according to the set millisecond period, and calculates the total power consumption of the server according to the obtained power consumption of the PSU; and if the BMC receives the total power consumption obtaining request message of the ME through the IPMB, returning a total power consumption response message to the ME through the IPMB, wherein the total power consumption response message carries the total power consumption calculated in the current period. In the disclosure, the ME acquires the total power consumption of the server through the BMC, so that access channel competition caused by the fact that the ME and the BMC access the power supply together can be avoided, and the accuracy of the power supply data acquired by the BMC and the ME is improved.
In contrast, another method for monitoring server power consumption is provided in the related art, in order to solve the problem that the BMC and the ME access the power simultaneously, which results in a power data reading error, in the method, the BMC and the ME access the power through different routing chips, respectively, as shown in fig. 3. The BMC and the ME select the required channel through independent routing chips respectively, and then perform the operation of reading and writing the power data after the channel is selected, so that the phenomenon of competition can not be generated, but a routing chip is added in the manufacturing process, the manufacturing cost is increased, meanwhile, the complexity of the design of a bottom layer link is increased in the hardware design, and the fault tolerance rate is reduced.
The method for monitoring the power consumption of the server can be realized only by one routing chip, the hardware cost is low, and the competition of access channels caused by the fact that the ME and the BMC access the power together is avoided at low cost, so that the accuracy of the power data acquired by the BMC and the ME is improved.
The embodiment of the disclosure also provides another method for monitoring the power consumption of the server, which is implemented on the basis of the method in the embodiment; the method mainly describes the specific process that the BMC accesses the power consumption of each PSU of the server according to a millisecond-level period, and calculates the total power consumption of the server; as shown in fig. 4, the method is applied to the BMC of the server, and includes the following steps:
in step S402, the power consumption of each PSU of the server is accessed by the first designated thread according to the set millisecond-level cycle.
The first thread is usually an independent thread, and the first thread is usually used for periodically accessing the power consumption of each PSU of the server in millisecond level, so that the PSUs can be accessed at higher frequency, and the real-time performance and the accuracy of the acquired data are ensured. The BMC can access the routing chip through the first designated thread in a set millisecond-level period to acquire the power consumption of each PSU of the server through the routing chip. FIG. 5 is a schematic diagram illustrating a power consumption of a BMC and an ME monitoring server; in FIG. 5, the BMC may pass through the routing chip and I2The C-bus accesses the respective PSU to derive the power consumption of each PSU.
The routing chip can be selected from 9545 routing chips, and the 9545 routing chip is usually I2C bus extension device through which 1 way I can be connected2The C bus is expanded into 4 paths; after the internal control register is correspondingly configured, 1-path or multi-path downlink I can be simultaneously selected2C bus and uplink I2C, bus connection; the 9545 routing chip has 4 interrupt inputs and 1 interrupt output pin, increasing the real-time processing capability of the I2C bus.
Step S404, calculating the acquired power consumption of the PSU through a second designated thread to obtain the total power consumption of the server.
The second thread is usually an independent thread, and the second thread is usually used for performing superposition or weighted summation processing on the acquired power consumption of each PSU to obtain the total power consumption of the server.
Step S406, if the IPMB receives the request message for obtaining the total power consumption of the ME, the IPMB returns a response message for the total power consumption to the ME, and the response message for the total power consumption carries the total power consumption calculated in the current period.
According to the monitoring method for the power consumption of the server, the BMC firstly accesses the power consumption of each PSU of the server according to a set millisecond-level period through a first designated thread, and then calculates the obtained power consumption of the PSU through a second designated thread to obtain the total power consumption of the server; and if the BMC receives the total power consumption acquisition request message of the ME through the IPMB, returning a total power consumption response message to the ME through the IPMB, wherein the total power consumption response message carries the total power consumption calculated in the current period. According to the method, the power consumption of the PSU and the total power consumption of the calculation server are accessed through two independent thread cycles, so that the accuracy and the real-time performance of the obtained data can be guaranteed, and the availability of the data is improved.
In order to monitor the health status of each PSU in real time, this embodiment further provides another method for monitoring the power consumption of a server, where the method includes the following steps:
step 40, acquiring configuration information and physical information of each PSU through a third designated thread, wherein the configuration information comprises a manufacturer and a model of the PSU; the physical information includes bit information and power information of the PSU.
The third thread is typically a separate thread that is typically used to obtain configuration information and physical information for each power supply. The third thread can adopt a mutual exclusion lock mode to prevent the conflict of data read-write operation of the access power supply; the mutual exclusion lock can usually perform a series of operations only when the third thread takes the corresponding lock, and during the operation, other processes can only fall into a blocking waiting state because of no corresponding lock; after the operation is completed, the thread releases the corresponding lock so that other processes can operate.
And step 41, determining the health state of the PSU according to the acquired configuration information and the acquired physical information.
According to the monitoring method for the power consumption of the server, the BMC acquires the configuration information and the physical information of each PSU through the third designated thread, and determines the health state of the PSU according to the acquired configuration information and the physical information. The method can monitor the running state of each PSU in real time so as to ensure that the PSU normally supplies power to the server.
The embodiment of the disclosure also provides another method for monitoring the power consumption of the server, which is implemented on the basis of the method in the embodiment; the method is applied to a management engine ME of the server; the method mainly describes a specific process of acquiring the total power consumption of the server by the ME.
The management engine ME is in communication connection with a baseboard management controller BMC of the server through an intelligent platform management bus IPMB, and power sensor parameters in a configuration file of the ME are enabled; the BMC is used for accessing the power consumption of each power supply unit PSU of the server in a set millisecond period, and calculating the total power consumption of the server according to the obtained power consumption of the PSU; as shown in fig. 6, the method includes the steps of:
step S602, sending a total power consumption acquisition request message to the BMC through the IPMB according to the period value corresponding to the power sensor parameter.
The period value corresponding to the power sensor parameter can be any value between 90ms and 150ms, and the period value can ensure that the ME sends a total power consumption acquisition request message to the BMC through the IPMB at a high frequency, so that the real-time performance and the accuracy of acquiring the total power consumption are ensured, and the requirement of the ME for power capping operation is met. In general, the ME can only periodically send the total power consumption acquisition request message to the BMC through the IPMB, and the BMC can only receive the periodic request sent by the ME through the IPMB.
In specific implementation, the ME can acquire the total power consumption of the server through the BMC by modifying the configuration file of the ME, and the modification method is as follows: the access command parameters in the ME's configuration file for each PSU are disabled, the OEM (original equipment Manufacturer) power sensor request parameters are set to enabled, and the other request parameters in the OEM are set to disabled, as shown in table 1.
TABLE 1
| ID | Parameter(s) | Status of state |
| 0 | OEM power sensor | 100ms (Enable state) |
| 1 | OEM chassis power | Disabled state |
| 2 | OEM input | Disabled state |
| 3 | OEM export | Disabled state |
The data format of the total power consumption acquisition request message sent by the ME is shown in table 2; among them, the SDK (software development Kit) generally refers to a set of development tools when a specific software package, software framework, hardware platform, operating system, etc. build application software; a LUN (Logical Unit Number) usually represents only a Number without any physical attributes.
TABLE 2
Step S604, receiving a total power consumption response message returned by the BMC through the IPMB, where the total power consumption response message carries the total power consumption calculated in the current period.
In a specific implementation, the BMC returns the data format of the total power consumption response message, as shown in table 3:
TABLE 3
Step S606, analyzing the total power consumption response message to obtain the total power consumption.
After obtaining the total power consumption of the server, the ME may perform power control on the server according to the total power consumption, where the power control may include one or more of the following manners:
the first method is as follows: and controlling the working parameters of the CPU of the server. For example, if the total power consumption of the server exceeds a threshold, the ME may reduce the frequency of the CPU, the CPU occupancy, etc. to reduce the total power consumption of the server.
The second method comprises the following steps: and controlling the working parameters of the memory of the server. For example, the ME may control the power of the server by reducing the memory occupancy, freeing up memory space, explicitly caching data, and the like.
The third method comprises the following steps: the operating parameters of the input/output ports of the server are controlled. For example, a pin of the input/output port that is temporarily not used is tied to ground or high level to reduce quiescent current; or the transmission speed of the input/output ports is reduced to reduce the power consumption of the server.
In specific implementation, if the total power consumption obtained by the ME analysis is 1000W, and the total power consumption threshold of the server pre-stored in the ME is 800W, the obtained total power consumption exceeds the threshold, and at this time, the ME may perform power control on the server by controlling the CPU, the content of the service, or the operating parameters of the input/output ports, thereby reducing the total power consumption of the server.
In the method for monitoring the power consumption of the server, the ME firstly sends a total power consumption acquisition request message to the BMC through the IPMB according to the period value corresponding to the parameter of the power sensor, and then receives a total power consumption response message returned by the BMC through the IPMB, wherein the total power consumption response message carries the total power consumption calculated in the current period; and finally, analyzing the total power consumption response message to obtain the total power consumption. In the disclosure, the ME acquires the total power consumption of the server through the BMC, so that access channel competition caused by the fact that the ME and the BMC access the power supply together can be avoided, and the accuracy of the power supply data acquired by the BMC and the ME is improved.
Corresponding to the method embodiment shown in fig. 2, the present disclosure provides a device for monitoring power consumption of a server, where the device is disposed in a BMC of the server, the BMC is communicatively connected to a management engine ME through an IPMB, and a power sensor parameter in a configuration file of the ME is in an enabled state; as shown in fig. 7, the apparatus includes:
a total power consumption obtaining module 70, configured to access power consumption of each power supply unit PSU of the server according to a set millisecond-level period, and calculate total power consumption of the server according to the obtained power consumption of the PSU; wherein, the millisecond period refers to the period duration in milliseconds.
The total power consumption transmission module 71 is configured to return a total power consumption response message to the ME through the IPMB when receiving the total power consumption acquisition request message of the ME through the IPMB, where the total power consumption response message carries the total power consumption calculated in the current period; and sending the total power consumption acquisition request message of the ME according to the periodic value corresponding to the power sensor parameter.
According to the monitoring device for the power consumption of the server, the BMC accesses the power consumption of each power supply unit PSU of the server according to the set millisecond-level period, and calculates the total power consumption of the server according to the obtained power consumption of the PSU; and if the BMC receives the total power consumption obtaining request message of the ME through the IPMB, returning a total power consumption response message to the ME through the IPMB, wherein the total power consumption response message carries the total power consumption calculated in the current period. In the disclosure, the ME acquires the total power consumption of the server through the BMC, so that access channel competition caused by the fact that the ME and the BMC access the power supply together can be avoided, and the accuracy of the power supply data acquired by the BMC and the ME is improved.
Further, the total power consumption obtaining module 70 is further configured to access, through the first designated thread, power consumption of each PSU of the server according to a set millisecond-level cycle; and calculating the acquired power consumption of the PSU through a second designated thread to obtain the total power consumption of the server.
Further, the total power consumption obtaining module 70 is further configured to access the routing chip through the first designated thread at a set millisecond-level cycle, so as to obtain the power consumption of each PSU of the server through the routing chip.
Further, the above apparatus further comprises: the power supply information acquisition module is used for acquiring configuration information and physical information of each PSU through a third designated thread, wherein the configuration information comprises a manufacturer and a model of the PSU; the physical information includes bit information and power information of the PSU; and the health state determining module is used for determining the health state of the PSU according to the acquired configuration information and the acquired physical information.
The implementation principle and the generated technical effect of the monitoring device for server power consumption provided by the embodiment of the present disclosure are the same as those of the foregoing method embodiment, and for brief description, no mention is made in the embodiment of the device, and reference may be made to the corresponding contents in the foregoing method embodiment.
Corresponding to the method embodiment shown in fig. 6, the present disclosure provides another server power consumption monitoring apparatus, where the apparatus is disposed in a management engine ME of a server, the ME is communicatively connected to a baseboard management controller BMC through an intelligent platform management bus IPMB, and a power sensor parameter in a configuration file of the ME is enabled; the BMC is used for accessing the power consumption of each power supply unit PSU of the server in a set millisecond period, and calculating the total power consumption of the server according to the obtained power consumption of the PSU; as shown in fig. 8, the apparatus includes:
the request message sending module 80 is configured to send a total power consumption obtaining request message to the BMC according to the period value corresponding to the power sensor parameter through the IPMB.
And the response message receiving module 81 is configured to receive a total power consumption response message returned by the BMC through the IPMB, where the total power consumption response message carries the total power consumption calculated in the current period.
And the analyzing module 82 is used for analyzing the total power consumption response message to obtain the total power consumption.
In the monitoring device for the server power consumption, the ME firstly sends a total power consumption acquisition request message to the BMC through the IPMB according to the period value corresponding to the power sensor parameter, and then receives a total power consumption response message returned by the BMC through the IPMB, wherein the total power consumption response message carries the total power consumption calculated in the current period; and finally, analyzing the total power consumption response message to obtain the total power consumption. In the mode, the ME acquires the total power consumption of the server through the BMC, access channel competition caused by the fact that the ME and the BMC access the power together can be avoided, and therefore the accuracy of the power data acquired by the BMC and the ME is improved.
Further, the period value corresponding to the power sensor parameter is an arbitrary value between 90ms and 150 ms.
The device further comprises a power control module, configured to perform power control on the server according to the total power consumption, where the power control includes at least one of: controlling working parameters of a CPU of the server; controlling the working parameters of the memory of the server; the operating parameters of the input/output ports of the server are controlled.
Further, the access command parameter to each PSU in the ME configuration file is in a non-enabled state.
The implementation principle and the generated technical effect of the monitoring device for server power consumption provided by the embodiment of the present disclosure are the same as those of the foregoing method embodiment, and for brief description, no mention is made in the embodiment of the device, and reference may be made to the corresponding contents in the foregoing method embodiment.
An embodiment of the present disclosure further provides a server, as shown in fig. 9, where the server includes: the baseboard management controller BMC90 is in communication connection with a management engine ME91, and the BMC90 and the ME91 are in communication connection through an intelligent platform management bus IPMB; power sensor parameter enable in ME 91's configuration file; the BMC90 is used for accessing the power consumption of each power supply unit PSU of the server in a set millisecond-level period, and calculating the total power consumption of the server according to the obtained power consumption of the PSU; the ME91 is used for sending a total power consumption acquisition request message to the BMC according to the period value corresponding to the power sensor parameter through the IPMB; the BMC90 is further configured to return a total power consumption response message to the ME91 through the IPMB, where the total power consumption response message carries the total power consumption calculated in the current period; the ME91 is further configured to receive the total power consumption response message, and parse the total power consumption response message to obtain the total power consumption.
Since the ME sends the total power consumption obtaining request message to the BMC through the IPMB, a hardware link for mutual communication always exists between the ME and the BMC, as shown in fig. 10; the ME is connected with the BMC through the IPMB; the BMC accesses the power supply unit PSU through a MIC, which is typically a high performance computing based processing platform, and a MUX (multiplexer); the ME may control the CPU, SPI Flash (Serial Peripheral Interface Flash), and SmaRT & CLST Logic (equivalent to a fault event) to regulate the total power consumption of the server. The method and apparatus for monitoring power consumption of a server and a computer program product of the server provided by the embodiments of the present disclosure include a computer-readable storage medium storing a program code, where instructions included in the program code may be used to execute the method described in the foregoing method embodiments, and specific implementation may refer to the method embodiments, and will not be described herein again.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present disclosure may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a terminal device, or a network device) to execute all or part of the steps of the method according to the embodiments of the present disclosure. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Finally, it should be noted that: the above-mentioned embodiments are merely specific embodiments of the present disclosure, which are used for illustrating the technical solutions of the present disclosure and not for limiting the same, and the scope of the present disclosure is not limited thereto, and although the present disclosure is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive of the technical solutions described in the foregoing embodiments or equivalent technical features thereof within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present disclosure, and should be construed as being included therein. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.
Claims (11)
1. The method for monitoring the power consumption of the server is characterized in that the method is applied to a Baseboard Management Controller (BMC) of the server, the BMC is in communication connection with a Management Engine (ME) through an Intelligent Platform Management Bus (IPMB), and a power sensor parameter in a configuration file of the ME is in an enabling state; the method comprises the following steps:
accessing the power consumption of each power supply unit PSU of the server according to a set millisecond-level period, and calculating the total power consumption of the server according to the acquired power consumption of the PSU; wherein, the millisecond-level period refers to the time length of the period taking milliseconds as a unit;
if the IPMB receives the total power consumption obtaining request message of the ME, returning a total power consumption response message to the ME through the IPMB, wherein the total power consumption response message carries the total power consumption calculated in the current period; and sending the total power consumption acquisition request message of the ME according to the periodic value corresponding to the power sensor parameter.
2. The method according to claim 1, wherein the step of accessing the power consumption of each PSU of the server according to a set millisecond-level cycle and calculating the total power consumption of the server according to the obtained power consumption of the PSU comprises:
accessing the power consumption of each PSU of the server through a first designated thread according to a set millisecond-level period;
and calculating the acquired power consumption of the PSU through a second designated thread to obtain the total power consumption of the server.
3. The method of claim 2, wherein the step of accessing power consumption of each PSU of the server by the first designated thread at the set millisecond period comprises:
and accessing the routing chip through the first designated thread in a set millisecond-level period to acquire the power consumption of each PSU of the server through the routing chip.
4. The method of claim 3, further comprising:
acquiring configuration information and physical information of each PSU through a third designated thread, wherein the configuration information comprises a manufacturer and a model of the PSU; the physical information comprises in-place information and power information of the PSU;
and determining the health state of the PSU according to the acquired configuration information and the acquired physical information.
5. The method for monitoring the power consumption of the server is applied to a management engine ME of the server, the ME is in communication connection with a baseboard management controller BMC through an intelligent platform management bus IPMB, and power sensor parameters in a configuration file of the ME are enabled; the BMC is used for accessing the power consumption of each power supply unit PSU of the server in a set millisecond period, and calculating the total power consumption of the server according to the obtained power consumption of the PSU; the method comprises the following steps:
sending a total power consumption acquisition request message to the BMC according to the period value corresponding to the power sensor parameter through the IPMB;
receiving a total power consumption response message returned by the BMC through the IPMB, wherein the total power consumption response message carries the total power consumption calculated in the current period;
and analyzing the total power consumption response message to obtain the total power consumption.
6. The method of claim 5, wherein the power sensor parameter corresponds to a period value anywhere between 90ms and 150 ms.
7. The method of claim 5, further comprising:
performing power control on the server according to the total power consumption, wherein the power control comprises at least one of the following:
controlling working parameters of a CPU of the server;
controlling the working parameters of the memory of the server;
and controlling the working parameters of the input port/output port of the server.
8. The method of claim 5, wherein the access command parameter for each PSU in the ME configuration file is disabled.
9. The device for monitoring the power consumption of the server is characterized in that the device is arranged on a Baseboard Management Controller (BMC) of the server, the BMC is in communication connection with a Management Engine (ME) through an Intelligent Platform Management Bus (IPMB), and a power sensor parameter in a configuration file of the ME is in an enabling state; the device comprises:
the total power consumption acquisition module is used for accessing the power consumption of each power supply unit PSU of the server according to a set millisecond-level period and calculating the total power consumption of the server according to the acquired power consumption of the PSU; wherein, the millisecond-level period refers to the time length of the period taking milliseconds as a unit;
a total power consumption transmission module, configured to return a total power consumption response message to the ME through the IPMB when receiving a total power consumption acquisition request message of the ME through the IPMB, where the total power consumption response message carries the total power consumption calculated in the current period; and sending the total power consumption acquisition request message of the ME according to the periodic value corresponding to the power sensor parameter.
10. The device for monitoring the power consumption of the server is characterized in that the device is arranged in a management engine ME of the server, the ME is in communication connection with a baseboard management controller BMC through an intelligent platform management bus IPMB, and power sensor parameters in a configuration file of the ME are enabled; the BMC is used for accessing the power consumption of each power supply unit PSU of the server in a set millisecond period, and calculating the total power consumption of the server according to the obtained power consumption of the PSU; the device comprises:
a request message sending module, configured to send, to the BMC, a total power consumption acquisition request message according to the period value corresponding to the power sensor parameter through the IPMB;
a response message receiving module, configured to receive a total power consumption response message returned by the BMC through the IPMB, where the total power consumption response message carries the total power consumption calculated in the current period;
and the analysis module is used for analyzing the total power consumption response message to obtain the total power consumption.
11. A server, characterized in that the server comprises: the system comprises a baseboard management controller BMC and a management engine ME, wherein the BMC and the ME are in communication connection through an intelligent platform management bus IPMB;
power sensor parameters in the ME's configuration file are enabled; wherein,
the BMC is used for accessing the power consumption of each power supply unit PSU of the server in a set millisecond period, and calculating the total power consumption of the server according to the obtained power consumption of the PSU;
the ME is used for sending a total power consumption acquisition request message to the BMC according to the period value corresponding to the power sensor parameter through the IPMB;
the BMC is further configured to return a total power consumption response message to the ME through the IPMB, and the total power consumption response message carries the total power consumption calculated in the current period;
and the ME is also used for receiving the total power consumption response message and analyzing the total power consumption response message to obtain the total power consumption.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910691734.1A CN111581043A (en) | 2019-07-29 | 2019-07-29 | Server power consumption monitoring method and device and server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910691734.1A CN111581043A (en) | 2019-07-29 | 2019-07-29 | Server power consumption monitoring method and device and server |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111581043A true CN111581043A (en) | 2020-08-25 |
Family
ID=72126014
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910691734.1A Pending CN111581043A (en) | 2019-07-29 | 2019-07-29 | Server power consumption monitoring method and device and server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111581043A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112269053A (en) * | 2020-09-18 | 2021-01-26 | 苏州浪潮智能科技有限公司 | Device and method for simultaneously detecting power consumption of multiple PSUs of multiple servers |
| CN114003373A (en) * | 2021-09-30 | 2022-02-01 | 苏州浪潮智能科技有限公司 | Service testing method and device, computer equipment and storage medium |
| CN114116395A (en) * | 2021-11-26 | 2022-03-01 | 苏州浪潮智能科技有限公司 | Power overload protection method, system and device for power supply circuit of aging chamber |
| CN116303193A (en) * | 2022-09-07 | 2023-06-23 | 宁畅信息产业(北京)有限公司 | Power Monitoring Systems and Servers |
| CN117055718A (en) * | 2023-10-11 | 2023-11-14 | 苏州元脑智能科技有限公司 | System, method, device, equipment and storage medium for detecting power consumption of server |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140289570A1 (en) * | 2013-03-22 | 2014-09-25 | Insyde Software Corp. | Virtual baseboard management controller |
| CN104572402A (en) * | 2015-02-09 | 2015-04-29 | 浪潮(北京)电子信息产业有限公司 | Server and method for realizing power consumption management of server |
| CN106951027A (en) * | 2017-03-29 | 2017-07-14 | 郑州云海信息技术有限公司 | A kind of system and method for the BMC time managements of blade server |
| CN106959935A (en) * | 2017-03-13 | 2017-07-18 | 郑州云海信息技术有限公司 | A kind of method that compatible I2C communications communicate with IPMB |
-
2019
- 2019-07-29 CN CN201910691734.1A patent/CN111581043A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140289570A1 (en) * | 2013-03-22 | 2014-09-25 | Insyde Software Corp. | Virtual baseboard management controller |
| CN104572402A (en) * | 2015-02-09 | 2015-04-29 | 浪潮(北京)电子信息产业有限公司 | Server and method for realizing power consumption management of server |
| CN106959935A (en) * | 2017-03-13 | 2017-07-18 | 郑州云海信息技术有限公司 | A kind of method that compatible I2C communications communicate with IPMB |
| CN106951027A (en) * | 2017-03-29 | 2017-07-14 | 郑州云海信息技术有限公司 | A kind of system and method for the BMC time managements of blade server |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112269053A (en) * | 2020-09-18 | 2021-01-26 | 苏州浪潮智能科技有限公司 | Device and method for simultaneously detecting power consumption of multiple PSUs of multiple servers |
| CN114003373A (en) * | 2021-09-30 | 2022-02-01 | 苏州浪潮智能科技有限公司 | Service testing method and device, computer equipment and storage medium |
| CN114003373B (en) * | 2021-09-30 | 2023-11-03 | 苏州浪潮智能科技有限公司 | Service testing method, device, computer equipment and storage medium |
| CN114116395A (en) * | 2021-11-26 | 2022-03-01 | 苏州浪潮智能科技有限公司 | Power overload protection method, system and device for power supply circuit of aging chamber |
| CN116303193A (en) * | 2022-09-07 | 2023-06-23 | 宁畅信息产业(北京)有限公司 | Power Monitoring Systems and Servers |
| CN117055718A (en) * | 2023-10-11 | 2023-11-14 | 苏州元脑智能科技有限公司 | System, method, device, equipment and storage medium for detecting power consumption of server |
| CN117055718B (en) * | 2023-10-11 | 2024-02-09 | 苏州元脑智能科技有限公司 | System, method, device, equipment and storage medium for detecting power consumption of server |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111581043A (en) | Server power consumption monitoring method and device and server | |
| CN109471770B (en) | System management method and device | |
| US8656003B2 (en) | Method for controlling rack system using RMC to determine type of node based on FRU's message when status of chassis is changed | |
| KR20080016685A (en) | Point-to-point link negotiation method, device, integrated circuit and electronic system | |
| CN110109782B (en) | Method, device and system for replacing fault PCIe (peripheral component interconnect express) equipment | |
| CN111737173A (en) | I2C bus communication control method, device, system and readable storage medium | |
| CN106502814B (en) | Method and device for recording error information of PCIE (peripheral component interface express) equipment | |
| CN110795317A (en) | Method and system for realizing lighting of self-adaptive hard disk backboard by using CPLD (complex programmable logic device) | |
| CN116680101A (en) | Method and device for detecting downtime of operating system, and method and device for eliminating downtime of operating system | |
| CN109901664B (en) | Method, apparatus, system, device and readable storage medium for providing clock signal | |
| CN111506331A (en) | Server BMC refreshing method, system, terminal and storage medium | |
| CN108933687B (en) | Power consumption control method and device | |
| CN113076210B (en) | Server fault diagnosis result notification method, system, terminal and storage medium | |
| EP2618272A1 (en) | Method and apparatus for dynamic addition and dynamic removal of device | |
| CN114385319A (en) | A computer equipment and management method | |
| CN109710187A (en) | Read command accelerated method, device, computer equipment and the storage medium of NVMe SSD main control chip | |
| CN108959026A (en) | A kind of method of accurate monitoring RAID card | |
| CN116088648A (en) | Server cabinet, circuit control method and computing node | |
| CN111817892B (en) | Network management method, system, electronic equipment and storage medium | |
| CN103326897A (en) | Distributed computing environment general monitoring device and failure detection method | |
| CN103634237B (en) | Micro telecommunication computing architecture Shelf Management Controller | |
| CN101931547B (en) | Address error correction method, device and communication device for communication system | |
| CN112162887A (en) | Storage device and machine frame shared component access method, device and storage medium thereof | |
| CN117591378B (en) | Temperature control method, system, equipment and storage medium of server | |
| CN116055249B (en) | Bus communication system, control method, device and medium thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200825 |