CN111126321A

CN111126321A - Electric power safety construction protection method and device and computer equipment

Info

Publication number: CN111126321A
Application number: CN201911383183.9A
Authority: CN
Inventors: 羿应棋; 周俊煌; 黄廷城; 范纹郡; 梁志健; 夏晨; 易婷婷; 肖振
Original assignee: Guangzhou Power Electrical Technology Co ltd
Current assignee: Guangzhou Power Electrical Technology Co ltd
Priority date: 2019-12-27
Filing date: 2019-12-27
Publication date: 2020-05-08
Anticipated expiration: 2039-12-27
Also published as: CN111126321B

Abstract

The application discloses a power safety construction protection method and device and computer equipment, and relates to the technical field of image processing. The electric power safety construction protection method comprises the following steps: acquiring a construction image of an electric power construction site; when a climbing tool and an electric power constructor appear in the construction image, detecting whether the electric power constructor has climbing actions; generating an alarm message when the power constructor has a climbing action; and sending the alarm message to a terminal bound by a construction safety worker, wherein the alarm message is used for indicating the construction safety worker to carry out safety supervision on the electric power construction site corresponding to the alarm message. The method can enable a construction safety worker to perform safety supervision on a plurality of electric power construction sites without being fixedly located in one electric power construction site. Compared with the prior art, the technical scheme reduces the investment of human resources and improves the working efficiency.

Description

Electric power safety construction protection method and device and computer equipment

Technical Field

The present application relates to the field of image processing technologies, and in particular, to a method and an apparatus for protecting electric power safety construction, and a computer device.

Background

At present, a certain distance exists between the erection positions of a plurality of power lines and some power equipment and the ground, and in the process of installing and overhauling the power lines and the power equipment, an electric power construction worker needs to reach the erection positions of the power lines and the power equipment by means of a climbing tool, namely, the electric power construction worker needs to execute the installation and overhauling work in high altitude, so that the risk of safety accidents of the electric power construction worker in the working process is high.

In order to reduce the risk of safety accidents of power construction personnel, the conventional scheme is that a professional construction safety worker is arranged at each power construction site, and the construction safety worker supervises the safety performance of a climbing tool and the safety protection measures of the power construction personnel, so that the safety of the power construction personnel working in high altitude is improved.

However, arranging a construction safety worker at each power construction site requires a large amount of human resources, which is costly and results in waste of human resources.

Disclosure of Invention

In view of the above, it is necessary to provide a method and an apparatus for analyzing data of a service site, a computer device, and a storage medium, for solving the problem that the operation condition of the service site cannot be accurately reflected.

In a first aspect, an embodiment of the present application provides an electric power safety construction protection method, including:

acquiring a construction image of an electric power construction site; when a climbing tool and an electric power constructor appear in a construction image, detecting whether the electric power constructor has climbing actions; when the electric power constructor has the ascending action, generating an alarm message; and sending an alarm message to a terminal bound by a construction safety worker, wherein the alarm message is used for indicating the construction safety worker to carry out safety supervision on the electric power construction site corresponding to the alarm message.

In a second aspect, an embodiment of the present application provides an electric power safety construction protection device, including:

the construction image acquisition module is used for acquiring a construction image of an electric power construction site; the ascending action detection module is used for detecting whether the electric power constructor has ascending actions or not when ascending tools and electric power constructors appear in the construction image; the warning message generating module is used for generating warning messages when the electric power constructor has ascending actions; and the warning message sending module is used for sending a warning message to the terminal bound by the construction safety worker, and the warning message is used for indicating the construction safety worker to carry out safety supervision on the electric power construction site corresponding to the warning message.

In a third aspect, there is provided a computer device comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, performs the steps of the method of the first aspect described above.

In a fourth aspect, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, carries out the steps of the method of the first aspect described above.

The beneficial effects brought by the technical scheme provided by the embodiment of the application at least comprise:

the method comprises the steps of acquiring a construction image of an electric power construction site, detecting whether an electric power constructor has a climbing action or not when a climbing tool and the electric power constructor appear in the construction image, generating an alarm message when the electric power constructor has the climbing action, and sending the alarm message to a terminal bound by a construction safety worker, wherein the alarm message is used for indicating the construction safety worker to carry out safety supervision on the electric power construction site corresponding to the alarm message. In the embodiment of the application, when the terminal bound by the construction safety worker receives the alarm message, the construction safety worker carries out safety supervision on the electric power construction site corresponding to the alarm message, and different alarm messages can correspond to different electric power construction sites, so that the construction safety worker can carry out safety supervision on a plurality of electric power construction sites and does not need to be fixedly located in one electric power construction site. Therefore, compared with the prior art, the technical scheme reduces the investment of human resources and improves the working efficiency.

Drawings

Fig. 1 is a schematic diagram of an implementation environment of a power safety construction protection method according to an embodiment of the present application;

fig. 2 is a block diagram of a background server according to an embodiment of the present application;

fig. 3 is a flowchart of an electric power safety construction protection method according to an embodiment of the present application;

FIG. 4 is a flow chart of a method for determining that a power constructor has an ascending action according to the positions of an ascending tool and the power constructor according to an embodiment of the application;

FIG. 5 is a schematic diagram of a minimum circumscribed rectangle of the ascending tool and the power operator according to an embodiment of the present disclosure;

FIG. 6 is a flowchart illustrating a determination that a power constructor has an ascending action when a plurality of ascending tools and power constructors are present in a construction image according to an embodiment of the present disclosure;

FIG. 7 is a flow chart illustrating another method for determining that a power utility worker has an ascending operation based on the position of the ascending tool and the power utility worker according to an embodiment of the present disclosure;

FIG. 8 is a flowchart illustrating a method for determining that a power constructor has an ascending operation according to a two-dimensional posture according to an embodiment of the present disclosure;

FIG. 9 is a schematic view of a human joint provided in an embodiment of the present application;

FIG. 10 is a flow chart of a method for determining that a power constructor has an ascending action based on the position and two-dimensional pose of an ascending tool and the power constructor according to an embodiment of the present application;

FIG. 11 is another flow chart illustrating a determination that a power constructor has an ascent action based on the positions and two-dimensional poses of the ascent tool and the power constructor according to embodiments of the present application;

FIG. 12 is a flowchart illustrating a method for determining that a power constructor has an ascending operation according to a three-dimensional posture according to an embodiment of the present disclosure;

FIG. 13 is a flowchart of a method for determining that a power constructor has an ascending action according to the position and three-dimensional posture of an ascending tool and the power constructor according to an embodiment of the present application;

FIG. 14 is another flow chart illustrating a determination that a power constructor has an ascent action based on the positions and three-dimensional poses of the ascent tool and the power constructor according to embodiments of the present application;

fig. 15 is a block diagram of an electric safety construction protection device according to an embodiment of the present application.

Detailed Description

To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.

In the following, a brief description will be given of an implementation environment related to the electric power safety construction protection method provided in the embodiment of the present application.

Fig. 1 is a schematic diagram of an implementation environment provided in an embodiment of the present application, and as shown in fig. 1, the implementation environment may include an image acquisition device 101, a backend server 102, and a terminal 103, where the image acquisition device 101 may be a device that can acquire an image, such as a camera, a smart phone, and a tablet computer. The image acquisition device 101 may acquire an image of the power construction site and transmit the image of the power construction site to the background server in real time.

The background server 12 may communicate with the image capturing device 101 and the terminal 103 in a wired or wireless manner, respectively. The background server 101 may acquire a construction image of the power construction site according to the image of the power construction site sent by the image acquisition device, detect whether the power construction worker has a climbing action when a climbing tool and the power construction worker appear in the construction image, and generate an alarm message when the power construction worker has the climbing action. And sending an alarm message to the terminal bound by the construction safety worker.

The terminal 103 is bound with a construction security worker, and the terminal 103 can be a smart phone, a wearable device, a tablet computer, a desktop computer and the like. The terminal 103 may receive the alert message sent by the background server 102. And the safety constructor can perform safety supervision on the electric power construction site corresponding to the alarm message according to the alarm message.

Referring to fig. 2, the electric power safety construction protection method provided by the present application may be applied to a backend server as shown in fig. 1, where an internal structure diagram of the backend server may be as shown in fig. 2, and the backend server includes a processor, a memory, and a network interface that are connected through a system bus. Wherein the processor of the background server is configured to provide computing and control capabilities. The memory of the background server comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the background server is used for being connected and communicated with an external terminal through a network. The computer program is executed by a processor to implement a power safety construction protection method.

Those skilled in the art will appreciate that the structure shown in fig. 2 is a block diagram of only a portion of the structure relevant to the present disclosure, and does not constitute a limitation on the computing devices to which the present disclosure may be applied, and that a particular computing device may include more or fewer components than shown in fig. 2, or may combine certain components, or have a different arrangement of components.

Referring to fig. 3, a flowchart of an electric power safety construction protection method provided in an embodiment of the present application is shown, where the electric power safety construction protection method may be applied to a background server in the implementation environment shown in fig. 1, and as shown in fig. 3, the electric power safety construction protection method may include the following steps:

step 301: the background server acquires a construction image of the electric power construction site.

In the embodiment of the application, the image of the power construction site acquired by the image acquisition device may be a video or a photo.

Optionally, when the image of the power construction site acquired by the image acquisition device is a photo, the image acquisition device sends the photo of the power construction site to the background server in real time, and the background server acquires each photo as a construction image of the power construction site.

Optionally, when the image of the power construction site acquired by the image acquisition device is a video, the process of acquiring the construction image of the power construction site by the background server may be: the background server acquires a construction video of the electric power construction site. And the background server acquires a video frame from the construction video and takes the acquired video frame as a construction image. The background server can decompose the construction video into video frames one by one, and each video frame is used as a construction image.

Step 302: when a climbing tool and an electric power constructor appear in the construction image, the background server detects whether the electric power constructor has climbing actions.

Optionally, in this embodiment of the present application, the climbing tool may be a ladder, a lift, or the like.

In the embodiment of the application, the background server firstly detects whether a climbing tool and an electric power constructor exist in a construction image, wherein only the climbing tool does not exist in the construction image, or only the electric power constructor does not exist in the construction image, the background server can judge that the scene in the construction image does not satisfy the basic elements of climbing operation, so that the detection of the construction image can be finished, and the background server can sequentially detect the next construction image.

When a construction image contains both a climbing tool and a power constructor, the scene in the construction image satisfies the basic elements of the climbing work. Under the condition, the background server can detect whether the power constructor in the construction image has the ascending action.

In an alternative implementation, as shown in fig. 4, the process of the background server detecting whether the power constructor in the construction image has the ascending action may include the following steps:

step 401: the background server acquires the minimum external rectangle of the climbing tool and the minimum external rectangle of the power constructor in the construction image.

In the embodiment of the application, the height-ascending tools and the power construction personnel can be identified by adopting the depth convolution neural network respectively, and after identification, the background server can draw the minimum external rectangle of each height-ascending tool and each power construction personnel in the construction image.

Optionally, in this embodiment of the application, the background server may obtain a horizontal coordinate and a vertical coordinate of an upper left corner and a horizontal coordinate of a lower right corner of the minimum circumscribed rectangle of each ascending tool and the power constructor (the upper left corner of the construction image is used as an origin of coordinates).

Optionally, because a plurality of power constructors and a plurality of climbing tools may appear in one construction image at the same time, the background server may obtain the minimum circumscribed rectangle of the plurality of power constructors, and the minimum circumscribed rectangle of each power constructor may be represented as follows:

B_p＝{p_i＝(xmin_i,ymin_i,xmax_i,ymax_i)},i∈{1,2,...,n}。

wherein p is_iIndicates the ith power constructor and n indicates the number of power constructors in the construction image. (xmin)_i,ymin_i) The abscissa and ordinate of the upper left corner are indicated by (xmax)_i,ymax_i) The abscissa and ordinate of the lower right corner are indicated.

Similarly, the background server may obtain the minimum circumscribed rectangle of the climbing tool in the construction image, and the minimum circumscribed rectangle of each climbing tool may be represented as follows:

B_h＝{h_j＝(xmin_j,ymin_j,xmax_j,ymax_j)},j∈{1,2,...,m}

wherein h is_jRepresents the jth ascending tool, m represents the number of ascending tools in the construction image, (xmin)_j,ymin_j) The abscissa and ordinate of the upper left corner are indicated by (xmax)_j,ymax_j) The abscissa and ordinate of the lower right corner are indicated.

Step 402: and the background server determines whether the power construction personnel has the ascending action or not according to the relative position relation between the minimum external rectangle of the ascending tool and the minimum external rectangle of the power construction personnel.

Optionally, the background server may determine the relative position of the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the power constructor according to the position of the minimum circumscribed rectangle of the power constructor in the construction image and the position of the minimum circumscribed rectangle of the ascending tool in the construction image. The relative positions of the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the power constructor can comprise two conditions of position overlapping and position non-overlapping.

Optionally, in this embodiment of the application, the background server may determine that the power constructor in the construction image has the ascending action when the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the power constructor are overlapped in position. Correspondingly, the background server can determine that the electric power constructor in the construction image does not have the ascending action when the positions of the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the electric power constructor are not overlapped.

Optionally, in this embodiment of the application, the process of determining, by the background server, whether the power constructor has the ascending action according to the relative position relationship between the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the power constructor may further be:

a1: the background server can acquire the overlapping area of the minimum circumscribed rectangle of the power constructor and the minimum circumscribed rectangle of the climbing tool.

As shown in FIG. 5, wherein S_PFor power constructor P_iArea of the smallest circumscribed rectangle of (1), S_IFor power constructor P_iMinimum external rectangle and climbing tool h_jOverlap area of the minimum bounding rectangle。

A2: and the background server determines whether the power constructor has a climbing action according to the area of the overlapping area.

In the embodiment of the application, the determination of whether the power constructor has the ascending action or not by the background server according to the area of the overlapping area may be: the overlapping area S of the overlapping area of the minimum circumscribed rectangle of the power constructor and the minimum circumscribed rectangle of the climbing tool_IAnd a climbing tool h_jArea S of the minimum bounding rectangle_hRatio S of_I/S_hWhen the value is larger than the overlap threshold value, the electric power constructor P is judged_iHas the function of ascending a height.

Optionally, the determining, by the background server, whether the power constructor has the ascending action according to the area of the overlapping area may be:

calculate Power constructor P_iMinimum external rectangle and climbing tool h_jOverlap area S of the minimum circumscribed rectangle_IAnd electric power constructor P_iArea S of the minimum bounding rectangle_PRatio S of_I/S_P。

In the embodiment of the present application, an overlap threshold a may be set, where a is an in-range (0, 1)]Is constant. Alternatively, a may be 0.5. Optionally, when the ratio S is_I/S_PWhen the value is larger than the overlap threshold A, the electric power constructor P is judged_iHas the function of ascending a height. When ratio S_I/S_PWhen the value is less than or equal to the overlap threshold A, the electric power constructor P is judged_iThere is no ascending action.

Step 303: and when the power constructor has a climbing action, the background server generates an alarm message.

In the embodiment of the application, when the background server detects that the electric power constructor in the construction image has the ascending action, the alarm message can be automatically generated.

Step 304: and the background server sends an alarm message to the terminal bound by the construction safety worker.

The warning message is used for indicating a construction safety worker to carry out safety supervision on the electric power construction site corresponding to the warning message.

In the embodiment of the application, the background server sends the warning message to the terminal bound by the construction safety worker, and after the construction safety worker receives the warning message through the bound terminal, the construction safety worker can perform safety supervision on the electric power construction site corresponding to the warning message.

Optionally, after receiving the warning message, the construction safety worker may arrive at the electric power construction site in the construction image corresponding to the warning message, and supervise and standardize safety protection measures of the working electric power construction worker and safety performance of the climbing tool. Therefore, after the safety supervision and standard work of one electric power construction site is completed, a construction safety worker can arrive at another electric power construction site for safety supervision according to the received new alarm message.

Optionally, the background server may further send a construction image corresponding to the warning message to a terminal bound by a construction security worker, and the construction security worker may receive the construction image when receiving the warning message, and then may supervise and standardize safety protection measures of a working power construction worker and safety performance of a climbing tool in a power construction site according to the received construction image.

In the process, the construction safety personnel can not move positions, and the safety of working power construction personnel and ascending tools on the power construction site is determined according to the construction image. When the safety of the working power construction personnel and the climbing tool is unreliable, the working power construction personnel can contact with the working power construction personnel on the power construction site through the instant messaging tool so as to complete the safety supervision and standard work on the power construction site. Therefore, the construction safety worker can simultaneously carry out safety supervision on the electric power construction site corresponding to the plurality of warning messages.

Optionally, when the power constructor in the construction image has a climbing action, the background server may send a construction video to the terminal bound by the construction safer, where the construction video is the construction video stated in step 302.

The construction video can be displayed on a terminal bound with a construction safety worker, and the construction safety worker can perform safety supervision on an electric power construction site based on the displayed construction video. Namely, a construction safety worker can monitor and standardize the safety of working power construction workers and climbing tools on a power construction site by watching construction videos.

When the terminal bound with the construction safety worker receives a plurality of warning messages, the construction safety worker can simultaneously carry out safety supervision on the electric power construction site reflected by the construction video corresponding to each warning message.

According to the electric power safety construction protection method provided by the embodiment of the application, when the terminal bound by the construction safety worker receives the alarm message, the construction safety worker conducts safety supervision on the electric power construction site corresponding to the alarm message, and different alarm messages can correspond to different electric power construction sites, so that the construction safety worker can conduct safety supervision on a plurality of electric power construction sites and does not need to be fixedly located in one electric power construction site. Therefore, compared with the prior art, the technical scheme reduces the investment of human resources and improves the working efficiency.

In an alternative implementation manner, since multiple power constructors and multiple climbing tools may simultaneously appear in one construction image, in this case, as shown in fig. 6, the process of the background server detecting whether the power constructor has a climbing action may include the following steps:

step 601: for each of the climbing tools, the backend server determines a plurality of climbing combinations according to the climbing tool and a plurality of power constructors.

The ascending combination comprises the ascending tool and any one electric power constructor.

In the embodiment of the application, for example, there are 3 ascending tools s1, s2 and s3, and four power constructors r1, r2, r3 and r4, so that each ascending tool, for example, ascending tool s1, is combined with four power constructors respectively to obtain four ascending combinations, which may be s1-r1, s1-r2, s1-r3 and s1-r4 respectively. Similarly, four ascending combinations s2-r1, s2-r2, s2-r3, s1-r4, s3-r1, s3-r2, s3-r3 and s3-r4 can be formed for the ascending tools s2 and s3, respectively.

Step 602: for each ascending combination, the background server detects whether the electric power constructor in the ascending combination has ascending actions.

In the embodiment of the application, the background server can acquire the minimum external rectangle of the climbing tool in the climbing combination and the minimum external rectangle of the power constructor.

The background server may determine whether the power constructor has a climbing action in the climbing combination according to a relative position of the minimum circumscribed rectangle of the climbing tool in the climbing combination and the minimum circumscribed rectangle of the power constructor, and may refer to the content disclosed in step 402.

In any one of the plurality of ascending combinations, if the power construction worker in the ascending combination has ascending action, the power construction worker in the construction image is confirmed to have ascending action, and otherwise, the power construction worker in the construction image is confirmed not to have ascending action.

The method provided by the embodiment can be used for processing the condition that a plurality of climbing tools and a plurality of power construction personnel exist in the construction image, can be used for more accurately detecting whether the power construction personnel have climbing actions, and improves the detection accuracy.

In an alternative implementation manner, as shown in fig. 7, the step of determining, by the background server, that the power constructor has the ascending action in the construction process according to the position relationship between the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the power constructor may further include the following steps:

step 701: the background server obtains a first height of a minimum external rectangle of the power constructor, and determines a height threshold value according to the first height.

As shown in fig. 5, the first height of the minimum circumscribed rectangle of the power constructor is a height in a vertical direction, and optionally, the background server may obtain a horizontal ordinate and a vertical ordinate (xmin) of the upper left corner of the minimum circumscribed rectangle of the power constructor_i,ymin_i) And the abscissa (xmax) of the lower right corner_i,ymax_i) Then the first height H1 can be found: h1 ═ ymax_i-ymin_i。

Optionally, in this embodiment of the application, the first height may be used as a height threshold.

Optionally, in this embodiment of the application, the height threshold may be a product of the height coefficient and the first height.

Optionally, in the embodiment of the present application, a height coefficient may be set, and optionally, the height coefficient may be 1/3.

Step 702: the background server acquires a second height from the bottom edge of the minimum external rectangle of the power constructor to the bottom edge of the minimum external rectangle of the climbing tool.

As shown in FIG. 5, the second height may be a horizontal ordinate (xmax) according to a lower right corner of a minimum circumscribed rectangle of the power builder_i,ymax_i) And the abscissa (xmax) of the lower right corner of the minimum bounding rectangle of the climbing tool_j,ymax_j) Calculated, the second height is H2: h2 ═ ymax_j-ymin_i。

Step 703: and when the second height is greater than or equal to the height threshold value, the background server determines that the power construction personnel has the ascending action.

In the embodiment of the application, when the second height is greater than or equal to the height threshold, it is described that the number of overlapping areas of the power constructor and the ascending tool is large, and therefore it can be judged that the power constructor is located on the ascending tool, and therefore the background server can determine that the power constructor has the ascending action.

In an optional implementation manner, the process of determining that the power construction worker has the ascending action in the construction process according to the position relationship between the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the power construction worker by the background server may further be:

the background server can acquire the overlapping area of the minimum circumscribed rectangle of the power constructor and the minimum circumscribed rectangle of the climbing tool.

When the ratio of the area of the overlapping area to the area of the minimum circumscribed rectangle of the power constructor is greater than the overlapping threshold, the background server can obtain a first height of the minimum circumscribed rectangle of the power constructor, and determine the height threshold according to the first height.

The background server acquires a second height from the bottom edge of the minimum external rectangle of the power constructor to the bottom edge of the minimum external rectangle of the climbing tool.

And when the second height is greater than or equal to the height threshold value, the background server determines that the power construction personnel has the ascending action.

In an alternative implementation manner, as shown in fig. 8, the step of determining, by the background server, that the power constructor has the ascending action in the construction process according to the position relationship between the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the power constructor may further include the following steps:

step 801: and the background server intercepts the personnel area image from the construction image according to the minimum external rectangle of the power constructor.

In the embodiment of the application, the background server can intercept the personnel area image in the construction image through the neural network learning model.

Optionally, when the construction image includes a plurality of power constructors, the image of each power constructor may be intercepted, and the personnel area image of each power constructor may be acquired.

Step 802: and the background server inputs the personnel area image into the two-dimensional attitude estimation model to obtain a two-dimensional joint coordinate set of the power construction personnel output by the two-dimensional attitude estimation model.

Wherein the two-dimensional joint coordinate set includes two-dimensional coordinates of each joint of the power constructor presented in the personnel area image.

In the embodiment of the application, the two-dimensional attitude estimation model can be a trained deep convolutional neural network model.

For each personnel area image, the background server inputs the personnel area image into the two-dimensional attitude estimation model, and then a two-dimensional joint coordinate set corresponding to the personnel area image can be obtained, for example:

wherein, K_jTwo-dimensional joint coordinates corresponding to jth person region imageIn the collection of the images, the image data is collected,

coordinates of an ith joint in the jth individual person region image are represented, n represents the number of joints, and m represents the number of person region images included in one construction image.

As shown in FIG. 9, a simplified diagram of human joints is shown in FIG. 9, where 17 joints are shown, and each joint is numbered for ease of distinction. According to the personnel area image, a plurality of joint points which can be directly observed in the personnel area image can be obtained, the coordinates of the plurality of joint points which can be directly observed are obtained by taking the upper left corner of the personnel area image as the origin of coordinates, and the coordinates of the plurality of joint points are combined to form a two-dimensional joint coordinate set.

Step 803: and the background server determines whether the power constructor has a climbing action according to the two-dimensional joint coordinate set of the power constructor.

When the construction image comprises a plurality of electric power construction personnel, the background server needs to judge the two-dimensional joint coordinate set of each electric power construction personnel, and when one electric power construction personnel in the plurality of electric power construction personnel has the ascending action, the electric power construction personnel in the construction image is determined to have the ascending action.

Optionally, the process of the background server determining whether the power constructor has a climbing action according to the two-dimensional joint coordinate set of the power constructor may include the following steps:

step S1: the background server acquires a forearm vector of the power construction worker from a two-dimensional joint coordinate set of the power construction worker.

Since the power constructor may be facing forward toward the image observer or may be facing left or right toward the image observer in the construction image, the forearm vector may be a left forearm vector or a right forearm vector, or a left forearm vector and a right forearm vector.

In the embodiment of the present application, as can be seen from fig. 9, the two joint points of the left forearm are the left elbow joint 6 and the left wrist joint 7, respectively, and the left forearm vector can beComprises the following steps:

for the coordinates of the left elbow joint corresponding to the jth person region image,

the coordinates of the left wrist joint corresponding to the jth personal area image.

The two joint points of the right forearm are a right elbow joint 3 and a right wrist joint 4 respectively, and the right forearm vector can be

The coordinates of the right elbow joint corresponding to the jth person region image,

the coordinates of the right wrist joint corresponding to the jth personal area image.

Step S2: and the background server determines the included angle between the forearm vector and the longitudinal axis vector according to the forearm vector.

When the forearm vector is the left forearm vector, the included angle between the forearm vector and the longitudinal axis vector may be the included angle between the left forearm vector and the longitudinal axis vector

The included angle between the left forearm vector and the longitudinal axis vector can be calculated according to the formula (1)

Wherein, the formula (1) is as follows:

when the front arm vector is the right front arm vector,included angle of forearm vector and longitudinal axis vector the included angle of the right forearm vector and longitudinal axis vector

The included angle between the right forearm vector and the longitudinal axis vector can be calculated according to the formula (2)

Wherein, the formula (2) is as follows:

step S3: and when the included angle is larger than the included angle threshold value, the background server determines that the electric power constructor has the ascending action.

In the embodiment of the present application, an included angle threshold may be set, and an optional included angle threshold may be 60 degrees.

When the included angle is greater than the included angle threshold value, the included angle formed between the forearm of the electric power constructor and the climbing tool is similar to the included angle formed when the electric power constructor climbs, and therefore the background server judges that the electric power constructor has the climbing action.

Optionally, when the forearm vector includes both the left forearm vector and the right forearm vector, the angle between the left forearm vector and the longitudinal axis vector is

And the angle between the right forearm vector and the longitudinal axis vector

If any one of the angle thresholds is larger than the included angle threshold, the background server can determine that the power constructor has the ascending action.

In an alternative implementation, as shown in fig. 10, the process of determining whether the power constructor has the ascending action in combination with the relative positions of the ascending tool and the power constructor and the posture of the power constructor may be:

step 1001: the background server acquires the overlapping area of the minimum external rectangle of the power constructor and the minimum external rectangle of the climbing tool.

Step 1002: and when the ratio of the area of the overlapping area to the area of the minimum external rectangle of the power constructor is greater than the overlapping threshold value, the background server intercepts the personnel area image from the construction image according to the minimum external rectangle of the power constructor.

Step 1003: and the background server inputs the personnel area image into the two-dimensional attitude estimation model to obtain a two-dimensional joint coordinate set of the power construction personnel output by the two-dimensional attitude estimation model.

Step 1004: and the background server determines whether the power constructor has a climbing action according to the two-dimensional joint coordinate set of the power constructor.

In an alternative implementation, as shown in fig. 11, the process of determining whether the power constructor has the ascending action in combination with the relative positions of the ascending tool and the power constructor and the posture of the power constructor may be:

step 1101: the background server obtains a first height of a minimum external rectangle of the power constructor, and determines a height threshold value according to the first height.

Step 1102: the background server acquires a second height from the bottom edge of the minimum external rectangle of the power constructor to the bottom edge of the minimum external rectangle of the climbing tool.

Step 1103: and when the second height is larger than or equal to the height threshold value, the background server intercepts the personnel area image from the construction image according to the minimum circumscribed rectangle of the power constructor.

Step 1104: and the background server inputs the personnel area image into the two-dimensional attitude estimation model to obtain a two-dimensional joint coordinate set of the power construction personnel output by the two-dimensional attitude estimation model.

Step 1105: and the background server determines whether the power constructor has a climbing action according to the two-dimensional joint coordinate set of the power constructor.

In an alternative implementation, the process of determining whether the power constructor has the ascending action in combination with the relative positions of the ascending tool and the power constructor and the posture of the power constructor may be:

And when the second height is larger than or equal to the height threshold value, the background server intercepts the personnel area image from the construction image according to the minimum circumscribed rectangle of the power constructor.

And the background server inputs the personnel area image into the two-dimensional attitude estimation model to obtain a two-dimensional joint coordinate set of the power construction personnel output by the two-dimensional attitude estimation model.

And the background server determines whether the power constructor has a climbing action according to the two-dimensional joint coordinate set of the power constructor.

Because the construction image is a two-dimensional plane image, a visual error occurs in the position relation between the power constructor and the climbing tool in the two-dimensional image, and therefore, whether the power constructor has a climbing action or not is determined according to the two-dimensional joint coordinate set, and misjudgment is easy to occur. In order to improve the determination accuracy, in an optional implementation manner, as shown in fig. 12, the determining, by the background server, that the power constructor has a climbing action during the construction according to the position relationship between the minimum circumscribed rectangle of the climbing tool and the minimum circumscribed rectangle of the power constructor may further include:

step 1201: and the background server intercepts the personnel area image from the construction image according to the minimum external rectangle of the power constructor.

Step 1202: and the background server inputs the personnel area image into the three-dimensional attitude estimation model to obtain a three-dimensional joint coordinate set of the power construction personnel output by the three-dimensional attitude estimation model.

In an alternative implementation, the process of the background server inputting the person region image into the three-dimensional pose estimation model may be: and inputting the personnel area image into the two-dimensional attitude estimation model to obtain a two-dimensional joint coordinate set, and then inputting the two-dimensional joint coordinate set into the three-dimensional attitude estimation model to obtain a three-dimensional joint coordinate set of the power construction personnel.

Wherein the three-dimensional joint coordinate set includes three-dimensional coordinates of each joint of the power constructor presented in the personnel area image.

In the embodiment of the application, the three-dimensional attitude estimation model can be a trained deep convolutional neural network model.

For each person region image, the background server inputs the person region image into the three-dimensional pose estimation model, and may obtain a three-dimensional joint coordinate set corresponding to the person region image, for example:

wherein, T_jA three-dimensional joint coordinate set corresponding to the jth personal area image,

three-dimensional coordinates representing the ith joint in the jth personal region image, n representing the number of joints, and m representing the number of personal region images included in one construction image.

Step 1203: and the background server determines whether the power constructor has a climbing action according to the three-dimensional joint coordinate set of the power constructor.

When the construction image comprises a plurality of electric power construction personnel, the background server needs to judge the three-dimensional joint coordinate set of each electric power construction personnel, and when one electric power construction personnel in the plurality of electric power construction personnel has the ascending action, the electric power construction personnel in the construction image is determined to have the ascending action.

Optionally, the process of determining, by the background server, whether the power constructor has a climbing action according to the three-dimensional joint coordinate set of the power constructor may include the following steps:

b1: and the background server acquires the forearm vector of the electric power constructor from the three-dimensional joint coordinate set of the electric power constructor.

Wherein the forearm vector comprises a left forearm vector and/or a right forearm vector.

Wherein the left forearm vector may be

The three-dimensional coordinates of the left elbow joint corresponding to the jth person region image,

the three-dimensional coordinates of the left wrist joint corresponding to the jth personal area image.

The right forearm vector may be

The three-dimensional coordinates of the right elbow joint corresponding to the jth person region image,

the three-dimensional coordinates of the right wrist joint corresponding to the jth personal area image.

B2: and the background server determines the included angle between the forearm vector and the normal vector of the earth surface according to the forearm vector.

When the forearm vector is the left forearm vector, the included angle between the forearm vector and the normal vector of the earth's surface is

When the forearm vector is the right forearm vector, the included angle between the forearm vector and the normal vector of the earth's surface is

B3: and when the included angle is larger than the included angle threshold value, the background server determines that the electric power constructor has the ascending action.

In the embodiment of the present application, when the forearm vector includes both the left forearm vector and the right forearm vector, the included angle between the left forearm vector and the normal vector of the earth's surface

And the angle between the right forearm vector and the normal vector of the earth's surface is

When any one of the angle thresholds is larger than the included angle threshold, the background server can determine that the power constructor has the ascending action.

In an alternative implementation, as shown in fig. 13, the process of determining whether the power constructor has the ascending action in combination with the relative positions of the ascending tool and the power constructor and the posture of the power constructor may be:

step 1301: the background server acquires the overlapping area of the minimum external rectangle of the power constructor and the minimum external rectangle of the climbing tool.

Step 1302: and when the ratio of the area of the overlapping area to the area of the minimum external rectangle of the power constructor is greater than the overlapping threshold value, the background server intercepts the personnel area image from the construction image according to the minimum external rectangle of the power constructor.

Step 1303: and the background server inputs the personnel area image into the three-dimensional attitude estimation model to obtain a three-dimensional joint coordinate set of the power construction personnel output by the three-dimensional attitude estimation model.

Step 1304: and the background server determines whether the power constructor has a climbing action according to the three-dimensional joint coordinate set of the power constructor.

In an alternative implementation, as shown in fig. 14, the process of determining whether the power constructor has the ascending action in combination with the relative positions of the ascending tool and the power constructor and the posture of the power constructor may be:

step 1401: the background server obtains a first height of a minimum external rectangle of the power constructor, and determines a height threshold value according to the first height.

Step 1402: the background server acquires a second height from the bottom edge of the minimum external rectangle of the power constructor to the bottom edge of the minimum external rectangle of the climbing tool.

Step 1403: and when the second height is larger than or equal to the height threshold value, the background server intercepts the personnel area image from the construction image according to the minimum circumscribed rectangle of the power constructor.

Step 1404: and the background server inputs the personnel area image into the three-dimensional attitude estimation model to obtain a three-dimensional joint coordinate set of the power construction personnel output by the three-dimensional attitude estimation model.

Step 1405: and the background server determines whether the power constructor has a climbing action according to the three-dimensional joint coordinate set of the power constructor.

And the background server inputs the personnel area image into the three-dimensional attitude estimation model to obtain a three-dimensional joint coordinate set of the power construction personnel output by the three-dimensional attitude estimation model.

And the background server determines whether the power constructor has a climbing action according to the three-dimensional joint coordinate set of the power constructor.

The background server can input the two-dimensional joint coordinate set to the three-dimensional attitude estimation model to obtain the three-dimensional joint coordinate set of the power constructor output by the three-dimensional attitude estimation model.

And the background server determines whether the power constructor has a climbing action according to the two-dimensional joint coordinate set and the three-dimensional joint coordinate set of the power constructor.

When the power construction worker is confirmed to have the ascending motion according to any one of the two-dimensional joint coordinate set or the three-dimensional joint coordinate set, the power construction worker in the construction image can be determined to have the ascending motion.

Referring to fig. 15, a block diagram of an electric safety construction guard provided in an embodiment of the present application is shown, where the electric safety construction guard may be configured in a background server in the implementation environment shown in fig. 1. As shown in fig. 15, the electric power safety construction guard may include a construction image acquisition module 1501, a climbing motion detection module 1502, an alert message generation module 1503, and an alert message transmission module 1504, in which:

a construction image acquisition module 1501, configured to acquire a construction image of an electric power construction site; a climbing action detection module 1502 for detecting whether the power constructor has a climbing action when a climbing tool and the power constructor appear in the construction image; the warning message generation module 1503 is used for generating a warning message when the power constructor has a climbing action; and the alarm message sending module 1504 is configured to send an alarm message to the terminal bound by the construction security worker, where the alarm message is used to instruct the construction security worker to perform security supervision on the power construction site corresponding to the alarm message.

In an embodiment of the present application, the construction image acquisition module 1501 is further configured to acquire a construction video of an electric power construction site; and acquiring a video frame from the construction video, and taking the acquired video frame as a construction image.

In an embodiment of the present application, the warning message generating module 1503 is further configured to send a construction video to the terminal when the power constructor has a climbing action, where the construction video is used for displaying at the terminal, so that a construction security worker can perform security supervision on a power construction site based on the displayed construction video.

In an embodiment of the present application, the ascending motion detection module 1502 is further configured to obtain a minimum circumscribed rectangle of the ascending tool and a minimum circumscribed rectangle of the power constructor in the construction image; and determining whether the power constructor has the ascending action according to the relative position relationship between the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the power constructor.

In an embodiment of the present application, the ascending motion detection module 1502 is further configured to obtain an overlapping area of a minimum circumscribed rectangle of the power constructor and a minimum circumscribed rectangle of the ascending tool; and determining whether the power constructor has ascending actions according to the area of the overlapped area.

In one embodiment of the present application, the climbing motion detection module 1502 is further configured to determine that the power constructor has a climbing motion when a ratio of an area of the overlap region to an area of a minimum bounding rectangle of the power constructor is greater than an overlap threshold.

In an embodiment of the present application, the ascending motion detection module 1502 is further configured to obtain a first height of a minimum bounding rectangle of the power constructor, and determine a height threshold according to the first height; acquiring a second height from the bottom edge of the minimum external rectangle of the power constructor to the bottom edge of the minimum external rectangle of the climbing tool; and when the second height is greater than or equal to the height threshold value, determining that the power constructor has the ascending action.

In an embodiment of the present application, the ascending motion detection module 1502 is further configured to intercept a person region image from the construction image according to a minimum bounding rectangle of the power constructor; inputting the personnel area image into a two-dimensional attitude estimation model to obtain a two-dimensional joint coordinate set of the power construction personnel output by the two-dimensional attitude estimation model, wherein the two-dimensional joint coordinate set comprises two-dimensional coordinates of each joint of the power construction personnel presented in the personnel area image; and determining whether the power constructor has ascending actions according to the two-dimensional joint coordinate set of the power constructor.

In one embodiment of the present application, the climbing motion detection module 1502 is further configured to obtain forearm vectors of the power constructor from a two-dimensional joint coordinate set of the power constructor, the forearm vectors including a left forearm vector and/or a right forearm vector; determining an included angle between the forearm vector and the longitudinal axis vector according to the forearm vector; and when the included angle is larger than the included angle threshold value, determining that the electric power constructor has the ascending action.

In an embodiment of the present application, the ascending motion detection module 1502 is further configured to intercept a person region image from the construction image according to a minimum bounding rectangle of the power constructor; inputting a two-dimensional joint coordinate set of the power constructor into a three-dimensional attitude estimation model to obtain a three-dimensional joint coordinate set of the power constructor output by the three-dimensional attitude estimation model, wherein the three-dimensional joint coordinate set comprises three-dimensional coordinates of each joint of the power constructor presented in a personnel area image; and determining whether the power constructor has ascending actions according to the three-dimensional joint coordinate set of the power constructor.

In one embodiment of the present application, the climbing motion detection module 1502 is further configured to obtain forearm vectors of the power constructor from the three-dimensional joint coordinate set of the power constructor, the forearm vectors including a left forearm vector and/or a right forearm vector; determining an included angle between a forearm vector and a normal vector of the earth's surface according to the forearm vector; and when the included angle is larger than the included angle threshold value, determining that the electric power constructor has the ascending action.

In an embodiment of the present application, the ascending motion detection module 1502 is further configured to, for each ascending tool, determine a plurality of ascending combinations including the ascending tool and any one of the power constructors according to the ascending tool and the power constructors; for each ascending combination, whether the power constructor in the ascending combination has ascending action is detected.

For specific limitations of the electric power safety construction protection device, reference may be made to the above limitations of the electric power safety construction protection method, which are not described herein again. All or part of each module in the electric power safety construction protection device can be realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.

In one embodiment of the present application, there is provided a computer device comprising a memory and a processor, the memory storing a computer program, the processor implementing the following steps when executing the computer program:

In one embodiment of the application, the processor when executing the computer program further performs the steps of: acquiring a construction video of an electric power construction site; and acquiring a video frame from the construction video, and taking the acquired video frame as a construction image.

In one embodiment of the application, the processor when executing the computer program further performs the steps of: when the electric power constructor has the ascending action, the construction video is sent to the terminal, and the construction video is used for being displayed at the terminal so that the construction safety worker can carry out safety supervision on the electric power construction site based on the displayed construction video.

In one embodiment of the application, the processor when executing the computer program further performs the steps of: acquiring a minimum external rectangle of a climbing tool and a minimum external rectangle of a power constructor in a construction image; and determining whether the power constructor has the ascending action according to the relative position relationship between the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the power constructor.

In one embodiment of the application, the processor when executing the computer program further performs the steps of: acquiring an overlapping area of a minimum external rectangle of a power constructor and a minimum external rectangle of a climbing tool; and determining whether the power constructor has ascending actions according to the area of the overlapped area.

In one embodiment of the application, the processor when executing the computer program further performs the steps of: and when the ratio of the area of the overlapping area to the area of the minimum circumscribed rectangle of the power constructor is greater than the overlapping threshold value, determining that the power constructor has the ascending action.

In one embodiment of the application, the processor when executing the computer program further performs the steps of: acquiring a first height of a minimum circumscribed rectangle of a power constructor, and determining a height threshold according to the first height; acquiring a second height from the bottom edge of the minimum external rectangle of the power constructor to the bottom edge of the minimum external rectangle of the climbing tool; and when the second height is greater than or equal to the height threshold value, determining that the power constructor has the ascending action.

In one embodiment of the application, the processor when executing the computer program further performs the steps of: intercepting a personnel area image from a construction image according to the minimum external rectangle of the power constructor; inputting the personnel area image into a two-dimensional attitude estimation model to obtain a two-dimensional joint coordinate set of the power construction personnel output by the two-dimensional attitude estimation model, wherein the two-dimensional joint coordinate set comprises two-dimensional coordinates of each joint of the power construction personnel presented in the personnel area image; and determining whether the power constructor has ascending actions according to the two-dimensional joint coordinate set of the power constructor.

In one embodiment of the application, the processor when executing the computer program further performs the steps of: acquiring forearm vectors of the power constructor from a two-dimensional joint coordinate set of the power constructor, wherein the forearm vectors comprise left forearm vectors and/or right forearm vectors; determining an included angle between the forearm vector and the longitudinal axis vector according to the forearm vector; and when the included angle is larger than the included angle threshold value, determining that the electric power constructor has the ascending action.

In one embodiment of the application, the processor when executing the computer program further performs the steps of: intercepting a personnel area image from a construction image according to the minimum external rectangle of the power constructor; inputting a two-dimensional joint coordinate set of the power constructor into a three-dimensional attitude estimation model to obtain a three-dimensional joint coordinate set of the power constructor output by the three-dimensional attitude estimation model, wherein the three-dimensional joint coordinate set comprises three-dimensional coordinates of each joint of the power constructor presented in a personnel area image; and determining whether the power constructor has ascending actions according to the three-dimensional joint coordinate set of the power constructor.

In one embodiment of the application, the processor when executing the computer program further performs the steps of: acquiring forearm vectors of the power constructor from a three-dimensional joint coordinate set of the power constructor, wherein the forearm vectors comprise left forearm vectors and/or right forearm vectors; determining an included angle between a forearm vector and a normal vector of the earth's surface according to the forearm vector; and when the included angle is larger than the included angle threshold value, determining that the electric power constructor has the ascending action.

In one embodiment of the application, the processor when executing the computer program further performs the steps of: for each climbing tool, determining a plurality of climbing combinations according to the climbing tool and a plurality of power construction personnel, wherein each climbing combination comprises the climbing tool and any one power construction personnel; for each ascending combination, whether the power constructor in the ascending combination has ascending action is detected.

The implementation principle and technical effect of the computer device provided by the embodiment of the present application are similar to those of the method embodiment described above, and are not described herein again.

In an embodiment of the application, a computer-readable storage medium is provided, on which a computer program is stored, which computer program, when being executed by a processor, carries out the steps of:

In one embodiment of the application, the computer program, when executed by the processor, may further implement the steps of: acquiring a construction video of an electric power construction site; and acquiring a video frame from the construction video, and taking the acquired video frame as a construction image.

In one embodiment of the application, the computer program, when executed by the processor, may further implement the steps of: when the electric power constructor has the ascending action, the construction video is sent to the terminal, and the construction video is used for being displayed at the terminal so that the construction safety worker can carry out safety supervision on the electric power construction site based on the displayed construction video.

In one embodiment of the application, the computer program, when executed by the processor, may further implement the steps of: acquiring a minimum external rectangle of a climbing tool and a minimum external rectangle of a power constructor in a construction image; and determining whether the power constructor has the ascending action according to the relative position relationship between the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the power constructor.

In one embodiment of the application, the computer program, when executed by the processor, may further implement the steps of: acquiring an overlapping area of a minimum external rectangle of a power constructor and a minimum external rectangle of a climbing tool; and determining whether the power constructor has ascending actions according to the area of the overlapped area.

In one embodiment of the application, the computer program, when executed by the processor, may further implement the steps of: and when the ratio of the area of the overlapping area to the area of the minimum circumscribed rectangle of the power constructor is greater than the overlapping threshold value, determining that the power constructor has the ascending action.

In one embodiment of the application, the computer program, when executed by the processor, may further implement the steps of: acquiring a first height of a minimum circumscribed rectangle of a power constructor, and determining a height threshold according to the first height; acquiring a second height from the bottom edge of the minimum external rectangle of the power constructor to the bottom edge of the minimum external rectangle of the climbing tool; and when the second height is greater than or equal to the height threshold value, determining that the power constructor has the ascending action.

In one embodiment of the application, the computer program, when executed by the processor, may further implement the steps of: intercepting a personnel area image from a construction image according to the minimum external rectangle of the power constructor; inputting the personnel area image into a two-dimensional attitude estimation model to obtain a two-dimensional joint coordinate set of the power construction personnel output by the two-dimensional attitude estimation model, wherein the two-dimensional joint coordinate set comprises two-dimensional coordinates of each joint of the power construction personnel presented in the personnel area image; and determining whether the power constructor has ascending actions according to the two-dimensional joint coordinate set of the power constructor.

In one embodiment of the application, the computer program, when executed by the processor, may further implement the steps of: acquiring forearm vectors of the power constructor from a two-dimensional joint coordinate set of the power constructor, wherein the forearm vectors comprise left forearm vectors and/or right forearm vectors; determining an included angle between the forearm vector and the longitudinal axis vector according to the forearm vector; and when the included angle is larger than the included angle threshold value, determining that the electric power constructor has the ascending action.

In one embodiment of the application, the computer program, when executed by the processor, may further implement the steps of: intercepting a personnel area image from a construction image according to the minimum external rectangle of the power constructor; inputting a two-dimensional joint coordinate set of the power constructor into a three-dimensional attitude estimation model to obtain a three-dimensional joint coordinate set of the power constructor output by the three-dimensional attitude estimation model, wherein the three-dimensional joint coordinate set comprises three-dimensional coordinates of each joint of the power constructor presented in a personnel area image; and determining whether the power constructor has ascending actions according to the three-dimensional joint coordinate set of the power constructor.

In one embodiment of the application, the computer program, when executed by the processor, may further implement the steps of: acquiring forearm vectors of the power constructor from a three-dimensional joint coordinate set of the power constructor, wherein the forearm vectors comprise left forearm vectors and/or right forearm vectors; determining an included angle between a forearm vector and a normal vector of the earth's surface according to the forearm vector; and when the included angle is larger than the included angle threshold value, determining that the electric power constructor has the ascending action.

In one embodiment of the application, the computer program, when executed by the processor, may further implement the steps of: for each climbing tool, determining a plurality of climbing combinations according to the climbing tool and a plurality of power construction personnel, wherein each climbing combination comprises the climbing tool and any one power construction personnel; for each ascending combination, whether the power constructor in the ascending combination has ascending action is detected.

The implementation principle and technical effect of the computer-readable storage medium provided in the embodiment of the present application are similar to those of the method embodiment described above, and are not described herein again.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a non-volatile computer-readable storage medium, and can include the processes of the embodiments of the methods described above when executed. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the claims. It should be noted that, for the person skilled in the art of electrical power construction, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims

1. An electric power safety construction protection method is characterized by comprising the following steps:

acquiring a construction image of an electric power construction site;

when a climbing tool and an electric power constructor appear in the construction image, detecting whether the electric power constructor has climbing actions;

generating an alarm message when the power constructor has a climbing action;

and sending the alarm message to a terminal bound by a construction safety worker, wherein the alarm message is used for indicating the construction safety worker to carry out safety supervision on the electric power construction site corresponding to the alarm message.

2. The method of claim 1, further comprising:

when the electric power constructor has a climbing action, acquiring a construction video of the electric power construction site, and sending the construction video to the terminal, wherein the construction video is used for being displayed at the terminal so that the construction safety worker can safely supervise the electric power construction site based on the displayed construction video.

3. The method of claim 1, wherein the detecting whether the power constructor has an ascending action comprises:

acquiring a minimum circumscribed rectangle of the climbing tool and a minimum circumscribed rectangle of the power constructor in the construction image;

and determining whether the power construction personnel has the ascending action or not according to the relative position relation between the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the power construction personnel.

4. The method of claim 3, wherein the determining whether the power constructor has the ascending action according to the position relationship of the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the power constructor comprises:

acquiring an overlapping area of the minimum circumscribed rectangle of the power constructor and the minimum circumscribed rectangle of the climbing tool;

and when the ratio of the area of the overlapping area to the area of the minimum circumscribed rectangle of the power constructor is greater than an overlapping threshold value, determining that the power constructor has a climbing action.

5. The method of claim 3, wherein the determining whether the power constructor has the ascending action according to the position relationship of the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the power constructor further comprises:

acquiring a first height of a minimum circumscribed rectangle of the power constructor, and determining a height threshold according to the first height;

acquiring a second height from the bottom edge of the minimum circumscribed rectangle of the power constructor to the bottom edge of the minimum circumscribed rectangle of the ascending tool;

when the second height is greater than or equal to the height threshold value, it is determined that the power constructor has an ascending action.

6. The method of claim 3, wherein the determining whether the power constructor has the ascending action according to the position relationship of the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the power constructor comprises:

intercepting a personnel area image from the construction image according to the minimum circumscribed rectangle of the power constructor;

inputting the personnel area image into a two-dimensional attitude estimation model to obtain a two-dimensional joint coordinate set of the power construction personnel output by the two-dimensional attitude estimation model, wherein the two-dimensional joint coordinate set comprises two-dimensional coordinates of each joint of the power construction personnel presented in the personnel area image;

and determining whether the power constructor has ascending actions according to the two-dimensional joint coordinate set of the power constructor.

7. The method of claim 3, wherein the determining whether the power constructor has the ascending action according to the position relationship of the minimum circumscribed rectangle of the ascending tool and the minimum circumscribed rectangle of the power constructor comprises:

inputting the personnel area image into a three-dimensional posture estimation model to obtain a three-dimensional joint coordinate set of the electric power construction personnel output by the three-dimensional posture estimation model, wherein the three-dimensional joint coordinate set comprises three-dimensional coordinates of all joints of the electric power construction personnel presented in the personnel area image;

and determining whether the power constructor has ascending actions according to the three-dimensional joint coordinate set of the power constructor.

8. The method of claim 3, wherein the construction image includes a plurality of climbing tools and a plurality of power constructors, and the detecting whether the power constructor has a climbing action includes:

for each climbing tool, determining a plurality of climbing combinations according to the climbing tool and the plurality of power constructors, wherein the climbing combinations comprise the climbing tool and any one of the power constructors;

and detecting whether the power constructor in the ascending combination has ascending action or not for each ascending combination.

9. An electrical safety construction guard, the device comprising:

the construction image acquisition module is used for acquiring a construction image of an electric power construction site;

the ascending action detection module is used for detecting whether the electric power constructor has ascending actions or not when ascending tools and electric power constructors appear in the construction image;

the warning message generating module is used for generating a warning message when the power constructor has a climbing action;

and the warning message sending module is used for sending the warning message to a terminal bound by a construction safety worker, and the warning message is used for indicating the construction safety worker to carry out safety supervision on the electric power construction site corresponding to the warning message.

10. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor, when executing the computer program, implements the steps of the method of any of claims 1 to 8.