CN115331326A - Method and system for non-intrusive sharing of pop-up windows - Google Patents

Abstract

The present invention provides a non-intrusive sharing processing method and system for pop-up windows, which are used to suppress or close the pop-up windows of a display device. The method includes the following steps: the non-intrusive terminal device publishes the pop-up window data to the information topic of the communication interface; the central processing device subscribes to the information topic to receive the pop-up window data and generates decision data corresponding to the pop-up window according to the pop-up window data, and sends the decision data Publishing to the information topic; and the non-intrusive terminal device receives decision data from the information topic, and suppresses or closes the pop-up window of the display device according to the decision data. Therefore, the method of the present invention can automatically transmit the information and solution of the pop-up window to the same device through the subscription/publishing mechanism, so as to reduce the processing time of the operator.

Description

Non-intrusive shared processing method and system for pop-up windows

technical field

The present invention relates to a method and system for sharing and processing pop-up windows, and in particular, relates to a non-intrusive sharing processing method and system for automatically detecting, closing and suppressing pop-up windows of devices.

Background technique

With the rapid development of industry, the equipment of many factories is gradually moving towards automation and intelligence. Usually, the equipment is equipped with a display screen, and the equipment will display the current production progress or various parameters on the screen, so that the operator can check the operation status of the equipment.

In traditional equipment, when a parameter or value reaches a warning threshold, the equipment alerts the workers on the production line through a signal light. In other words, the operator needs to be near the equipment to handle emergency or abnormal events of the equipment. Furthermore, when the production parameters or values of the equipment need to be counted, it is also necessary for the operators to make regular transcriptions on site. In order to solve the labor cost problem of traditional equipment, technologies and products have been developed to capture screen images and analyze data on the screen, so as to automatically monitor the operation status of equipment.

However, due to the peripheral devices or components installed in the equipment, sometimes notification or warning pop-up windows will appear, such as: the notification window that the charging device has been fully charged, the notification window that the gas supply device has been turned on, and the remaining 30 parts of the supply tray % warning windows etc. Therefore, when a pop-up window appears on the device, the pop-up window may cover the production parameters or data to be detected on the screen, so that the system cannot recognize the data and anomalies occur. The current solution includes the operator going to the device and manually closing the pop-up window, and installing an intrusive control module on the device, and the operator remotely controls the device to close the pop-up window. Since there are many devices in a large factory, even hundreds of them, if each device jumps out of a pop-up window, the operator still needs to close the pop-up window one by one, thereby reducing efficiency and increasing costs. Furthermore, if each device is installed with an intrusive control module, the additionally installed control module will also increase the load on the device, thereby reducing production efficiency. In addition, the same device may encounter the same type of pop-up windows, and operators still need to close the pop-up windows one by one manually or remotely, thereby reducing efficiency.

Therefore, it is necessary to develop a novel automatic processing mechanism for pop-up windows to solve the problems of the prior art.

Contents of the invention

In view of this, the purpose of the present invention is to provide a non-intrusive shared processing method and system for pop-up windows, which can solve the problems of the prior art, reduce the processing time of operators, improve efficiency and save costs, and directly Handle pop-up windows on the device to improve convenience and efficiency.

In order to achieve the above object, the present invention discloses a non-intrusive sharing processing method of a pop-up window, which is used to suppress or close a pop-up window of a display device, and is characterized in that the non-intrusive sharing processing method of the pop-up window includes the following steps :

A first non-intrusive terminal device publishes a pop-up window data of the pop-up window to an information topic in a communication interface;

A central processing device subscribes to the information topic in the communication interface to receive the pop-up window data, generates a decision data corresponding to the pop-up window according to the pop-up window data, and publishes the decision data to the information topic in the communication interface ;as well as

The first non-intrusive terminal device receives the decision data from the information topic in the communication interface, and suppresses or closes the pop-up window of the display device according to the decision data.

Among them, the following steps are further included:

The first non-intrusive terminal device captures a screen image of the display device, and compares the screen image with a default screen image to detect the pop-up window; and

The first non-intrusive terminal device analyzes the pop-up window to generate the pop-up window data.

Wherein, the step of capturing the screen image of the display device by the first non-intrusive terminal device, and comparing the screen image with the default screen image to detect the pop-up window further includes the following steps :

The first non-intrusive terminal device captures the screen image of the display device;

The first non-intrusive terminal device determines whether the default screen image exists;

If not, the first non-intrusive terminal device replaces the screen image with the default screen image; and

If yes, the first non-intrusive terminal device compares the screen image with the default screen image to detect the pop-up window.

Wherein, in the step of analyzing the pop-up window to generate the pop-up window data by the first non-intrusive terminal device, the following steps are further included:

The first non-intrusive terminal device uses an algorithm to analyze and calculate the pop-up window to generate a button data in the pop-up window data, wherein the button data includes a button outline and a button position; and

The first non-intrusive terminal device analyzes the button data by optical character recognition and generates a button text in the button data.

Among them, the following steps are further included:

The first non-intrusive terminal device compares whether the pop-up window data matches a first historical pop-up window data among a plurality of historical pop-up window data stored in a first database, wherein the first database stores a plurality of historical pop-up window data Decision data, and the historical pop-up window data respectively correspond to the historical decision data; and

If yes, the first non-intrusive terminal device suppresses or closes the pop-up window according to the historical decision data corresponding to the first historical pop-up window data.

Wherein, the central processing device subscribes to the information topic in the communication interface to receive the pop-up window data, generates the decision data corresponding to the pop-up window according to the pop-up window data, and publishes the decision data to the communication interface The steps of the news topic further include the following steps:

The central processing device receives the pop-up window data and generates a plurality of solutions corresponding to the pop-up window data;

selecting one of the solutions as the decision data based on the pop-up data of the pop-up; and

The central processing device publishes the decision data to the information topic in the communication interface.

Among them, the following steps are further included:

a second non-intrusive terminal device subscribes to the information topic in the communication interface; and

The second non-intrusive terminal device receives and stores the pop-up window data and the decision data from the information subject in the communication interface to a second database.

Also disclosed is a non-intrusive shared processing system for pop-up windows, which is used to suppress or close a pop-up window on a display device, and is characterized in that the non-intrusive shared processing system for pop-up windows includes:

a communication interface, including an information theme for storing a pop-up window data of the pop-up window and a decision-making data corresponding to the pop-up window; and

A first non-intrusive terminal device, coupled to the communication interface and the display device and subscribing to the information topic of the communication interface, the first non-intrusive terminal device further includes:

an image capture module, used to capture a screen image of the display device;

An image analysis module, connected to the image capture module and storing a default screen image, the image analysis module is used to analyze the screen image and the default screen image to detect the pop-up window and generate the Pop-up window information;

a transmission module for publishing the pop-up window data to the news topic and receiving the decision data from the news topic; and

A processor, coupled to the transmission module and the display device, the processor controls the transmission module to release the pop-up window data and receive the decision data, and the processor suppresses or closes the display device according to the decision data pop-up window.

Wherein, the first non-intrusive terminal device includes a first database connected to the processor, the first database is used to store a plurality of historical pop-up window data and a plurality of historical decision-making data, and the historical pop-up window data are respectively related to According to some historical decision-making data, when the pop-up window data generated by the image analysis module conforms to a first historical pop-up window data among the historical pop-up window data, the processor according to the corresponding first historical pop-up window data The historical decision data suppresses or closes the pop-up window of the display device.

Wherein, further comprising a second non-intrusive terminal device coupled to the communication interface and subscribing to the information subject of the communication interface, the second non-intrusive terminal device includes a second database, the second non-intrusive terminal The device receives the pop-up window data and the decision data from the information topic, and stores the pop-up window data and the decision data in the second database.

Wherein, further comprising a central processing device coupled to the communication interface and subscribing to the information topic of the communication interface, the central processing device receives the pop-up window data from the information topic and uses it to generate the decision data corresponding to the pop-up window, and will The decision data is published to the information topic in the communication interface.

Wherein, the central processing device generates a plurality of solutions corresponding to the pop-up window data according to the pop-up window data, and one of the solutions selected by a user is used as the decision data.

Wherein, the central processing device includes an analysis module, the central processing device generates a plurality of solutions corresponding to the pop-up window data according to the pop-up window data, and the analysis module selects one of the solutions according to the pop-up window data One of them is used as the decision data.

Wherein, it further includes a third non-intrusive terminal device, which is coupled to the communication interface and subscribes to the information topic of the communication interface, and the third non-intrusive terminal device receives the pop-up window data from the information topic and uses it to generate an object The decision data should pop up in the window, and publish the decision data to the information topic in the communication interface.

Wherein, when the default screen image does not exist, the image analysis module replaces the screen image with the default screen image.

Wherein, the image analysis module analyzes the pop-up window with algorithm and optical character recognition to generate a button data in the pop-up window data, wherein the button data includes a button outline, a button position and a button text.

To sum up, the non-intrusive shared processing method and system of the present invention can automatically detect the pop-up window of the device, and the operator can remotely provide solutions through the communication interface, thereby reducing labor costs. Moreover, the non-intrusive shared processing method and system for pop-up windows of the present invention can automatically suppress pop-up windows generated by equipment through non-intrusive terminal devices, thereby reducing labor costs and improving production efficiency. Furthermore, the non-intrusive shared processing method and system for pop-up windows of the present invention can automatically detect and compare pop-up windows processed in the past through the storage device, thereby improving detection efficiency and reducing time cost. Furthermore, the non-intrusive shared processing method and system of pop-up windows of the present invention can also automatically transmit the information and solutions of pop-up windows to the same device through subscription/publishing, so as to reduce the processing time of operators, and further Increase efficiency and save costs. In addition, the non-intrusive shared processing system for pop-up windows of the present invention can also process pop-up windows directly on the device, thereby improving convenience and efficiency.

Description of drawings

FIG. 1 is a flow chart showing the steps of a non-intrusive sharing processing method for pop-up windows according to an embodiment of the present invention.

FIG. 2 is a functional block diagram of a system for non-intrusive shared processing of pop-up windows according to an embodiment of the present invention.

FIG. 3 is a functional block diagram of the non-intrusive terminal device according to FIG. 2 .

FIG. 4 is a flow chart showing the steps of the non-intrusive sharing processing method of pop-up windows according to the embodiment of FIG. 1 .

FIG. 5 is a flow chart showing the steps of the non-intrusive sharing processing method for pop-up windows according to the specific embodiment of FIG. 1 .

FIG. 6 is a flow chart showing the steps of the non-intrusive sharing processing method for pop-up windows according to the specific embodiment of FIG. 1 .

FIG. 7 is a flow chart showing the steps of a non-intrusive sharing processing method for pop-up windows according to an embodiment of the present invention.

FIG. 8 is a functional block diagram of a system for non-intrusive shared processing of pop-up windows according to an embodiment of the present invention.

FIG. 9 is a functional block diagram of a system for non-intrusive shared processing of pop-up windows according to another embodiment of the present invention.

FIG. 10 is a functional block diagram of a system for non-intrusive shared processing of pop-up windows according to another embodiment of the present invention.

Detailed ways

In order to make the advantages, spirit and characteristics of the present invention more easily and clearly understood, specific embodiments will be described and discussed in detail with reference to the accompanying drawings. It should be noted that these specific embodiments are only representative specific embodiments of the present invention, and the specific methods, devices, conditions, materials, etc. exemplified therein are not intended to limit the present invention or the corresponding specific embodiments. Moreover, each device in the figure is only used to express its relative position and is not drawn according to its actual scale, so it will be described first.

In the description of this specification, descriptions with reference to the terms "a specific embodiment", "another specific embodiment" or "partial specific embodiments" mean that specific features, structures, materials or characteristics described in conjunction with the embodiment include In at least one embodiment of the present creation. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment. Furthermore, the particular features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments.

Please refer to Figure 1 to Figure 6. FIG. 1 is a flow chart showing the steps of a non-intrusive sharing processing method for pop-up windows according to an embodiment of the present invention. FIG. 2 is a functional block diagram of a non-intrusive shared processing system 1 for pop-up windows according to an embodiment of the present invention. FIG. 3 is a functional block diagram of the non-intrusive terminal device 11 according to FIG. 2 . FIG. 4 is a flow chart showing the steps of the non-intrusive sharing processing method of pop-up windows according to the embodiment of FIG. 1 . FIG. 5 is a flow chart showing the steps of the non-intrusive sharing processing method for pop-up windows according to the specific embodiment of FIG. 1 . FIG. 6 is a flow chart showing the steps of the non-intrusive sharing processing method for pop-up windows according to the specific embodiment of FIG. 1 . 1 , 4 , 5 and 6 can be executed by the non-intrusive sharing processing system 1 of pop-up window in FIG. 2 and the non-intrusive terminal device 11 in FIG. 3 . As shown in FIG. 1, in this specific embodiment, the non-intrusive sharing processing method of pop-up windows includes the following steps: Step S11: The non-intrusive terminal device 11 captures the screen image of the display device 81, and compares the screen Image and preset screen image to detect pop-up window; Step S12: Non-intrusive terminal device 11 analyzes the pop-up window to generate pop-up window data; Step S13: Non-intrusive terminal device 11 judges whether the pop-up window data matches historical pop-up window data ; If yes, execute step S17: the non-intrusive terminal device 11 suppresses or closes the pop-up window according to the historical decision-making data of the corresponding historical pop-up window data; Data to an information topic 131 in the communication interface 13; Step S15: the central processing device 15 subscribes to the information topic 131 in the communication interface 13 to receive the pop-up window data and generate the decision data corresponding to the pop-up window according to the pop-up window data, and send the decision data Publish to the information topic 131 in the communication interface 13; and step S16: the non-intrusive terminal device 11 receives the decision data from the information topic 131 in the communication interface 13, and suppresses or closes the pop-up window of the display device 81 according to the decision data.

In this embodiment, the non-intrusive shared processing system 1 of pop-up windows includes a non-intrusive terminal device 11 , a communication interface 13 and a central processing device 15 . The non-intrusive terminal device 11 is coupled to the communication interface 13 , and the communication interface 13 is coupled to the central processing unit 15 . Further, the non-intrusive terminal device 11 is connected to the display device 81 . In practice, the display device 81 can be a display screen of the device 8 . The non-intrusive terminal device 11 can communicate with the display device 81 , and the non-intrusive terminal device 11 can communicate with the central processing device 15 through the communication interface 13 .

In practice, the communication interface 13 can be an intermediary software connected with the operating system. The communication interface 13 can generate an information flow, and the information flow can include multiple information topics. And the news topic can contain information about the pop-up window. When the transmission module 113 of the non-intrusive terminal device 11 publishes the pop-up window data to the communication interface 13, the non-intrusive terminal device 11 can create an information topic 131 and publish the information topic 131 including the pop-up window data to the communication interface 13 . Further, the information topic may also include decision data corresponding to the pop-up window. The non-intrusive terminal device 11 can receive decision data from the information topic and suppress or close the pop-up window of the display device 81 according to the decision data. The decision data may be an instruction or a method for processing the pop-up window, so as to prevent the pop-up window from covering the display device 81 of the device.

In this embodiment, the non-intrusive terminal device 11 includes an image capture module 111 , an image analysis module 112 , a transmission module 113 , a processor 114 and a database 115 . The image capturing module 111 is used for capturing a screen image of the display device 81 . The image analysis module 112 is connected to the image capture module 111 and stores a default screen image. The image analysis module 112 is used to analyze the screen image and the preset screen image to detect pop-up windows and analyze the pop-up windows to generate pop-up window data. The transmission module 113 is used for publishing pop-up window data to the information topic 131 and receiving decision data from the data topic 131 . The processor 114 is coupled to the transmission module 113 and the display device 81 . The processor 114 controls the transmission module 113 to issue pop-up windows and receive decision data, and the processor 114 suppresses or closes the pop-up windows of the display device 81 according to the decision data. The database 115 is connected to the processor 114 . The database 115 is used to store a plurality of historical pop-up window data and a plurality of historical decision-making data, and the historical pop-up window data respectively correspond to the historical decision-making data. In practice, the image capture module 111 can be an image capture chip, the image analysis module 112 can be an image analysis chip, the transmission module 113 can be a transceiver, the processor 114 can be a central processing chip, and the database 115 Can be hard disk.

In step S11 of FIG. 1 , the image capture module 111 of the non-intrusive terminal device 11 captures the screen image of the display device 81, and the image analysis module 112 compares the screen image with the previous screen image to detect pop-up window for the device being tested. As shown in the steps of FIG. 4 , the step of detecting the pop-up window of the device by the non-intrusive terminal device 11 further includes: step S111: the image capture module 111 captures the screen image of the display device; step S112: the image analysis module 112 Determine whether the preset screen image exists; if not, execute step S114: the image analysis module 112 replaces the screen image with the preset screen image; if yes, execute step S113: image analysis module 112 Compare the screen image with the default screen image to detect pop-up windows.

In practice, the image capture module 111 can capture screen images of the display device 81 of the device 8 at multiple different time points, and the image analysis module 112 can store default screen images. The default screen image may be a screen image of the device in normal operation. The image analysis module 112 can compare adjacent two-screen images in the form of image difference (such as: image binarization), and then detect the device 8 by means of image erosion, structural elements, and contour calculations. A pop-up window of the display device 81. When the image difference value analyzed by the image analysis module 112 is 0, the image analysis module 112 can store the current screen image instead of the default screen image, so as to match the image captured by the image capture module 111 next time. images for comparison. When the image difference value analyzed by the image analysis module 112 is not 0, the image analysis module 112 can detect the pop-up window of the display device 81 according to the image difference value. In addition, there is no default screen image for non-intrusive end devices when the device is powered on for the first time or restarted. At this time, the image analysis module can use the screen image captured by the image capture module for the first time as the default screen image.

In step S12 of FIG. 1 , after the image analysis module 112 detects the pop-up window of the display device, the image analysis module 112 can generate pop-up window data according to the pop-up window. In practice, pop-up window data can include size, text, buttons, graphics and patterns, etc. Since the device may generate a pop-up window that includes a button and needs to be judged, as shown in the steps of FIG. The method analyzes and calculates the pop-up window to generate the button data in the pop-up window data, wherein the button data includes the button outline and the button position; and step S122: the image analysis module 112 uses optical character recognition to analyze the button data and generates the button in the button data Word.

In practice, the image analysis module 112 can use Canny edge detector, Douglas-Peucker algorithm or other algorithms to calculate the button outline and button position in the pop-up window. Moreover, the image analysis module 112 can also recognize the text of the button through optical character recognition (Optical Character Recognition, OCR). In addition, the image analysis module 112 can also calculate the position of the pop-up window on the display device 81 and the text in the pop-up window. Please note that the image capture module 111 and the image analysis module 112 are not limited thereto, and the image capture module 111 and the image analysis module 112 can also be integrated in the same chip.

In step S13 of FIG. 1 , after the image analysis module 112 generates the pop-up window data of the pop-up window, the processor 114 compares and determines whether the pop-up window data matches the historical pop-up window data stored in the database 115 . In practice, historical pop-up window data and historical decision-making data may be previous pop-up window data and solution data. And the database 115 can pre-store the pop-up window data of various pop-up windows and the decision-making data corresponding to the pop-up window, and can also receive and store the pop-up window data and decision-making data from the information subject 131 of the subscribed communication interface 13 through the transmission module 113 material. The processor 114 can compare the pop-up window data and history generated by the image analysis module 112 through algorithms (such as: template comparison, feature invariant moments, feature vectors, distance convolution product neural network classifier, etc.) Pop-up window information.

In step S17 of FIG. 1 , if the pop-up window data generated by the image analysis module 112 matches the first historical pop-up window data in the historical pop-up window data, it means that the pop-up window generated by the display device 81 of the device 8 has appeared. and have corresponding solutions. At this time, the processor 114 finds historical decision data corresponding to the first historical pop-up window data from the database 115 to suppress or close the pop-up window of the display device 81 . Therefore, the non-intrusive shared processing method and system for pop-up windows of the present invention can automatically detect and compare pop-up windows processed in the past through the storage device, thereby improving detection efficiency and reducing time cost.

In step S14 of FIG. 1 , if the pop-up window data generated by the image analysis module 112 does not match all historical pop-up window data, it means that the pop-up window generated by the display device 81 of the device 8 is new and there is no solution yet. pop-up window. At this time, the processor 114 controls the transmission module 113 to publish the pop-up window data to the communication interface 13 . In practice, the transmission mode of the transmission module 113 can be EdgeSDK, DDS, ROS/ROS2, MQTT, TCP/UDP and other transmission protocols, but not limited thereto. When the processor 114 controls the transmission module 113 to publish the pop-up window data to the communication interface 13 , the processor 114 can simultaneously create an information topic 131 and publish the information topic 131 including the pop-up window data to the communication interface 13 .

In step S15 of FIG. 1 , after the central processing device 15 receives a pop-up window with no solution yet from the information topic 131 of the communication interface 13, the central processing device 15 will generate decision data corresponding to the pop-up window and publish the decision data to the communication interface 13 of 13 topics of information. Further, as shown in FIG. 6, the non-intrusive sharing processing method of pop-up windows further includes the following steps: Step S151: the central processing device 15 receives the pop-up window data and generates multiple solutions corresponding to the pop-up window data; Step S152: according to The pop-up window data of the pop-up window selects one of the solutions as the decision data; and Step S153 : the central processing device 15 publishes the decision data to the information topic 131 in the communication interface 13 .

In practice, the central processing device 15 can be a central control computer. The central processing device 15 can pre-store multiple solutions, and each solution can include different processing methods and processing data. For example, the solution may be to close the popup, minimize the popup, hide the popup, etc. In practice, the central processing device 15 may further include a central processing chip and a display. In step S151 of FIG. 6, after the central processing device 15 obtains the pop-up window data, the central processing chip rebuilds the pop-up window in the display according to the pop-up window data, and rebuilds multiple solutions in the form of buttons on one side of the pop-up window . Then, as shown in step S152 of FIG. 6 , the operator can view the pop-up window through the display of the central processing unit 15, and can select or click a button located on one side of the reconstructed pop-up window according to the pop-up window data to determine the pop-up window s solution. For example, when the operator chooses a solution to hide the pop-up window, the central processing device 15 will use the processing data of hiding the pop-up window as decision data.

In addition to selecting the way to handle pop-up windows from multiple pre-stored solutions, operators can also define their own solutions. After the central processing device receives a pop-up window without a solution from the communication interface, the central processing chip can reconstruct the button of the pop-up window on the display according to the button data in the pop-up window data, and the central processing chip can use but not limited to the mouse The event generates decision data corresponding to the popup window. In practice, the operator can click the button of the pop-up window with the mouse according to the information and type of the pop-up window. At this time, the analysis and processing chip of the central processing device can record the coordinate position of the mouse on the display and the click position of the mouse to generate decision data.

The decision-making data generated by the central processing device can be determined in other ways besides being determined by the operator. In a specific embodiment, the central processing device includes an analysis module. The central processing device generates a plurality of solutions corresponding to the pop-up window data according to the pop-up window data, and the analysis module selects one of the solutions according to the pop-up window data as decision data. In practice, the analysis module can be a machine learning chip, and the analysis module pre-stores decision models. After the central processing device receives the pop-up window data, the analysis module calculates a solution corresponding to the pop-up window according to the pop-up window data and the decision-making model. In another specific embodiment, the central processing unit includes a timer, and when the central processing unit displays the pop-up window for a certain period of time and does not receive a solution, the central processing chip of the central processing unit selects a preset solution as decision data.

In step S153 of FIG. 6 , after the central processing device 15 generates the decision data corresponding to the pop-up window, the central processing device 15 publishes the decision data to the information topic 131 in the communication interface 13 .

In step S16 of FIG. 1 , after the central processing device 15 publishes the decision data to the information topic 131 in the communication interface 13, the processor 114 of the non-intrusive terminal device 11 can control the transmission module 113 to obtain the information from the information topic 131 Corresponding to the decision data of the pop-up window, and the processor 114 can control the screen of the display device 81 of the device 8 according to the decision data, so as to suppress the pop-up window. In practice, when the decision data includes the coordinate position of the mouse and the click position of the mouse, the processor 114 can create a mouse and keyboard command according to the decision data to simulate the input of the mouse and keyboard of the device 8, and then suppress the display Device 81 pop-up window.

The method and system for non-intrusive shared processing of pop-up windows of the present invention firstly detects the pop-up windows of the device through the non-intrusive terminal device, and first compares and judges whether the pop-up windows have appeared and has a processing method. If the pop-up window is an unprocessed pop-up window, then publish it to the news topic in the communication interface. Then, the central processing device can manually or automatically generate the decision data corresponding to the pop-up window, and then release the decision data to the information topic in the communication interface. Finally, the non-intrusive terminal device receives the decision data from the information subject in the communication interface and suppresses or closes the pop-up window of the device according to the decision data. Therefore, the non-intrusive shared processing method and system for pop-up windows of the present invention can automatically detect pop-up windows of equipment, and operators can provide solutions remotely through the communication interface, thereby reducing labor costs. Furthermore, the non-intrusive shared processing method and system for pop-up windows of the present invention can also automatically suppress the pop-up windows of equipment through the non-intrusive terminal device, thereby improving production efficiency.

In addition, the data transmission method of the non-intrusive terminal device and the central processing device may be in addition to the method of the above-mentioned specific embodiments, and may also be in other forms. In one embodiment, when both the non-intrusive terminal device and the central processing device subscribe to the same information topic, the communication interface directly connects the non-intrusive terminal device and the central processing device to each other. When the non-intrusive terminal device publishes the pop-up window data, the pop-up window data is directly transmitted to the central processing device. Similarly, when the central processing device issues decision data, the decision data is directly transmitted to the non-intrusive terminal device.

Although the non-intrusive shared processing system of the pop-up window in Fig. 2 includes only one non-intrusive terminal device, in practice, the production line of the factory may be equipped with multiple identical devices. Therefore, the non-invasive pop-up window of the present invention The shared processing system may also be a shared processing method of pop-up windows among multiple non-intrusive terminal devices. Please refer to Figure 7 and Figure 8. FIG. 7 is a flow chart illustrating the steps of a non-intrusive sharing processing method for pop-up windows according to an embodiment of the present invention. FIG. 8 is a functional block diagram of a non-intrusive shared processing system 2 for pop-up windows according to an embodiment of the present invention. The non-intrusive sharing processing method of the pop-up window in FIG. 7 can be executed by the non-intrusive sharing processing system 2 of the pop-up window in FIG. 8 . The non-intrusive shared processing system 2 of the pop-up window of the present invention can also connect multiple non-intrusive terminal devices to suppress the pop-up windows of the display devices of multiple devices. As shown in FIG. 8 , the difference between this specific embodiment and the previous specific embodiments is that the non-intrusive shared processing system 2 of pop-up windows in this specific embodiment includes a first non-intrusive terminal device 21A and a second non-intrusive terminal device 21A. Intrusive terminal device 21B. Further, the first non-intrusive terminal device 21A is connected to the first display device 81A of the first device 8A, the second non-intrusive terminal device 21B is connected to the second display device 81B of the second device 8B, and the first device 8A and the second device 8A The second device 8B is the same device.

In this embodiment, the first non-intrusive terminal device 21A, the second non-intrusive terminal device 21B and the central processing device 25 all subscribe to the information topic 231 in the communication interface 23 . In the steps of Fig. 7, when the first non-intrusive terminal device 21A analyzes and releases the pop-up window data of the pop-up window and the central processing device 25 releases the decision data corresponding to the pop-up window (steps S21-S24), except for the first non-intrusive In addition to the non-intrusive terminal device 21A receiving the decision data to suppress the pop-up window of the first device 8A (step S25), the second non-intrusive terminal device 21B receives and stores the pop-up window data and decision data in the information topic 231 (step S26). In practice, the factory may set up multiple identical devices to increase production, that is, the second device 8B may also display the same pop-up window as the first device 8A. Therefore, the second non-intrusive terminal device 21B can receive the types of pop-up windows encountered by the first device 8A and their solutions through the information topic 231 in the communication interface 23 . Further, the second non-intrusive terminal device 21B may also include a second database. After the processor of the second non-intrusive terminal device 21B controls the transmission module to receive the pop-up window data and decision data, the processor can store the pop-up window data and decision-making data in the second database as historical pop-up window data and history Decision data. Therefore, the non-intrusive shared processing method and system of pop-up windows of the present invention can also automatically transmit the information and solutions of pop-up windows to the same device, so as to reduce the processing time of operators, thereby improving efficiency and saving costs.

Similarly, when the first non-intrusive terminal device 21A, the second non-intrusive terminal device 21B and the central processing device 25 all subscribe to the information topic 231, the communication interface 23 directly sends the first non-intrusive terminal device 21A, the second non-intrusive terminal device The intrusive terminal device 21B and the central processing device 25 are connected to each other. When the first non-intrusive terminal device 21A releases pop-up window data and the central processing device 25 releases decision data, the pop-up window data and decision data are directly transmitted to the second non-intrusive terminal device 21B.

Please refer to Figure 9. FIG. 9 is a functional block diagram of a non-intrusive shared processing system 3 for pop-up windows according to another embodiment of the present invention. As shown in Figure 9, the difference between this specific embodiment and the previous specific embodiments is that the non-intrusive shared processing system 3 of the pop-up window in this specific embodiment includes a first non-intrusive terminal device 31A, a second non-intrusive An intrusive terminal device 31B, a third non-intrusive terminal device 31C, and a fourth non-intrusive terminal device 31D. The first non-intrusive terminal device 31A is connected to the first display device 81A of the first device 8A, the second non-intrusive terminal device 31B is connected to the second display device 81B of the second device 8B, and the third non-intrusive terminal device 31C is connected to the second display device 81B. The third display device 81C of the third device 8C, and the fourth non-intrusive terminal device 31D are connected to the fourth display device 81D of the fourth device 8D. Further, the communication interface 33 includes a first information topic 331A and a second information topic 331B. While the first non-intrusive terminal device 31A and the second non-intrusive terminal device 31B subscribe to the first information topic 331A, the third non-intrusive terminal device 31C and the fourth non-intrusive terminal device 31D subscribe to the second information topic 331B, and The CPU 35 subscribes to the first information topic 331A and the second information topic 331B.

In practice, the first device 8A and the second device 8B may be devices of the first type, and the third device 8C and the fourth device 8D may be devices of the second type. Although the first device 8A and the second device 8B are different from the third device 8C and the fourth device 8D, the third device 8C may also have the same pop-up window as the first device 8A. Therefore, when the first non-intrusive terminal device 31A publishes the pop-up window data to the first information topic 331A of the communication interface 33 and the central processing device 35 generates decision data according to the pop-up window data, the central processing device 35 can not only publish the decision data to In addition to the first information topic 331A, pop-up window data and decision data can also be published to the second information topic 331B. At this time, the third non-intrusive terminal device 31C can receive and store the pop-up window data and decision data from the second information topic 331B. Similarly, the second non-intrusive terminal device 31B can receive and store pop-up window data and decision data from the first news topic 331Q, and the fourth non-intrusive terminal device 31D can receive and store pop-up window data from the second news topic 331B and decision-making information. Therefore, the non-intrusive shared processing method and system for pop-up windows of the present invention can enable different types of devices to process the same type of pop-up windows through multiple information topics, so as to reduce the processing time of operators, thereby improving efficiency and saving cost.

In addition, although the first device 8A and the third device 8C may display the same window, the first device 8A and the third device 8C may require different solutions due to different parameters or thresholds. Therefore, the first non-intrusive terminal device 31A and the third non-intrusive terminal device 31C can publish pop-up window data to the first information topic 331A and the second information topic 331B respectively, and the central processing device 35 establishes the first device 8A and the A pop-up window for the third device 8C. Then, the operator can respectively select solutions suitable for the pop-up windows of the first device 8A and the third device 8C and generate decision data. Finally, the central processing device 35 publishes the decision data corresponding to the pop-up windows of the first device 8A and the third device 8C to the first information topic 331A and the second information topic 331B, and the first non-intrusive terminal device 31A and the third The non-intrusive terminal device 31C receives decision data from the first information topic 331A and the second information topic 331B respectively. Therefore, the non-intrusive shared processing method and system for pop-up windows of the present invention can also process pop-up windows required by different types of equipment through multiple information topics, so as to reduce the processing time of operators, thereby improving efficiency and saving costs.

Besides the aforementioned central processing device, the decision data can also be generated by other devices. Please refer to Figure 10. FIG. 10 is a functional block diagram of a non-intrusive shared processing system 4 for pop-up windows according to another embodiment of the present invention. As shown in Figure 10, the difference between this specific embodiment and the previous specific embodiments is that the non-intrusive shared processing system 4 of the pop-up window in this specific embodiment includes a first non-intrusive terminal device 41A, a second non-intrusive The intrusive terminal device 41B and the third non-intrusive terminal device 41C do not include a central processing device. Further, the first non-intrusive terminal device 41A is connected to the first display device 81A of the first device 8A, the second non-intrusive terminal device 41B is connected to the second display device 81B of the second device 8B, and the third non-intrusive terminal device 41C is connected to the third display device 81C of the third device 8C, and the first device 8A, the second device 8B, and the third device 8C are the same device. In this specific embodiment, the first non-intrusive terminal device 41A, the second non-intrusive terminal device 41B and the third non-intrusive terminal device 41C all subscribe to the information topic 431 in the communication interface 43 . After the first non-intrusive terminal device 41A publishes the pop-up window data of the pop-up window, the third non-intrusive terminal device 41C receives the pop-up window data from the information topic 431 in the communication interface 43 and uses it to generate the decision data corresponding to the pop-up window, And publish the decision data to the information topic 431 in the communication interface 43 .

In practice, operators can also generate decision-making data from the display device of the equipment. After the first non-intrusive terminal device 41A publishes the pop-up window data of the pop-up window, the processor of the third non-intrusive terminal device 41C may also display the pop-up window data on the third display device 81C of the third device 8C. The operator can execute the processing method through the mouse and keyboard of the third device 8C. At this time, the processor of the third non-intrusive terminal device 41C records the coordinate position of the mouse on the third display device 81C and the click position of the mouse to form decision data. Next, the processor of the third non-intrusive terminal device 41C controls the transmission module to publish the decision data to the information topic 431 in the communication interface 43 . Further, the first non-intrusive terminal device 41A receives decision data from the information topic 431 in the communication interface 43 to suppress the pop-up window of the first display device 81A. In addition, the second non-intrusive terminal device 41B can also receive and store pop-up window data and decision data from the information topic 431 in the communication interface 43 . Therefore, the non-intrusive shared processing system for pop-up windows of the present invention can also process pop-up windows directly on the device, thereby improving convenience and efficiency.

To sum up, the non-intrusive shared processing method and system of the present invention can automatically detect the pop-up window of the device, and the operator can remotely provide solutions through the communication interface, thereby reducing labor costs. Moreover, the non-intrusive shared processing method and system for pop-up windows of the present invention can automatically suppress pop-up windows generated by equipment through non-intrusive terminal devices, thereby reducing labor costs and improving production efficiency. Furthermore, the non-intrusive shared processing method and system for pop-up windows of the present invention can automatically detect and compare pop-up windows processed in the past through the storage device, thereby improving detection efficiency and reducing time cost. Furthermore, the non-intrusive shared processing method and system of pop-up windows of the present invention can also automatically transmit the information and solutions of pop-up windows to the same device through subscription/publishing, so as to reduce the processing time of operators, and further Increase efficiency and save costs. In addition, the non-intrusive shared processing system for pop-up windows of the present invention can also process pop-up windows directly on the device, thereby improving convenience and efficiency.

Through the above detailed description of the preferred embodiments, it is hoped that the characteristics and spirit of the present invention can be described more clearly, and the scope of the present invention is not limited by the preferred embodiments disclosed above. On the contrary, the intention is to cover various changes and equivalent arrangements within the scope of the claimed patent scope of the present invention. Therefore, the scope of the claimed patent scope of the present invention should be interpreted in the broadest way based on the above description, so as to cover all possible changes and equivalent arrangements.

Claims (16)

1. A pop-up window non-intrusive sharing processing method is used for restraining or closing a pop-up window of a display device, and is characterized in that the pop-up window non-intrusive sharing processing method comprises the following steps:

a first non-invasive terminal device issues pop-up window data of the pop-up window to an information subject in a communication interface;

a central processing unit subscribes the information topic in the communication interface to receive the pop-up window data, generates a decision data corresponding to the pop-up window according to the pop-up window data, and issues the decision data to the information topic in the communication interface; and

the first non-invasive terminal device receives the decision data from the information topic in the communication interface and suppresses or closes the pop-up window of the display device according to the decision data.

2. The method for non-intrusive pop-up window sharing processing as defined in claim 1, further comprising the steps of:

the first non-invasive terminal device captures a screen image of the display device and compares the screen image with a preset screen image to detect the pop-up window; and

the first non-invasive terminal device analyzes the pop-up window to generate the pop-up window data.

3. The method as claimed in claim 2, wherein the step of capturing the screen image of the display device by the first non-invasive terminal device and comparing the screen image with the predetermined screen image to detect the pop-up window further comprises the steps of:

the first non-invasive terminal device captures the screen image of the display device;

the first non-invasive terminal device judges whether the preset screen image exists or not;

if not, the first non-invasive terminal device replaces the screen image with the preset screen image; and

if so, the first non-invasive terminal device compares the screen image with the preset screen image to detect the pop-up window.

4. The method of claim 2, wherein the step of the first non-invasive terminal device analyzing the pop-up window to generate the pop-up window data further comprises the steps of:

the first non-invasive terminal device analyzes and calculates the pop-up window by an algorithm to generate a button data in the pop-up window data, wherein the button data comprises a button profile and a button position; and

the first non-invasive terminal device analyzes the button data by optical character recognition and generates a button text in the button data.

5. The method for non-intrusive sharing processing of pop-up windows as defined in claim 2, further comprising the steps of:

the first non-invasive terminal device compares whether the pop-up window data accords with a first historical pop-up window data in a plurality of historical pop-up window data stored in a first database, wherein the first database stores a plurality of historical decision data, and the historical pop-up window data respectively correspond to the historical decision data; and

if so, the first non-invasive terminal device suppresses or closes the pop-up window according to the historical decision data corresponding to the first historical pop-up window data.

6. The method as claimed in claim 1, wherein the step of the central processing device subscribing to the information topic in the communication interface to receive the pop-up window data and generating the decision data corresponding to the pop-up window according to the pop-up window data, and issuing the decision data to the information topic in the communication interface further comprises the steps of:

the central processing unit receives the pop-up window data and generates a plurality of solutions corresponding to the pop-up window data;

selecting one of the solutions as the decision data according to the pop-up window data of the pop-up window; and

the central processing device issues the decision data to the information topic in the communication interface.

7. The method for non-intrusive pop-up window sharing processing as recited in claim 1, further comprising the steps of:

a second non-invasive terminal device subscribes the information subject in the communication interface; and

the second non-invasive terminal device receives the pop-up window data and the decision data from the information topic in the communication interface and stores them in a second database.

8. A pop-up window non-intrusive shared processing system for suppressing or closing a pop-up window of a display device, the pop-up window non-intrusive shared processing system comprising:

a communication interface, which includes an information theme, the information theme is used to store a pop-up window data of the pop-up window and a decision data corresponding to the pop-up window; and

a first non-invasive terminal device coupled to the communication interface and the display device and subscribing the information topic of the communication interface, the first non-invasive terminal device further comprising:

an image capturing module for capturing a screen image of the display device;

the image analysis module is connected with the image acquisition module and stores a preset screen image, and the image analysis module is used for analyzing the screen image and the preset screen image so as to detect the pop-up window and generate pop-up window data;

a transmission module for issuing the pop-up window data to the information subject and receiving the decision data from the information subject; and

a processor coupled to the transmission module and the display device, the processor controlling the transmission module to issue the pop-up window data and receive the decision data, and the processor suppressing or closing the pop-up window of the display device according to the decision data.

9. The system as claimed in claim 8, wherein the first non-invasive terminal device comprises a first database connected to the processor, the first database storing a plurality of historical pop-up window data and a plurality of historical decision data, the historical pop-up window data respectively corresponding to the historical decision data, and the processor suppressing or closing the pop-up window of the display device according to the historical decision data corresponding to the historical pop-up window data when the pop-up window data generated by the image analysis module matches a first historical pop-up window data of the historical pop-up window data.

10. The system of claim 8, further comprising a second non-invasive terminal coupled to the communication interface and subscribing to the information topic of the communication interface, the second non-invasive terminal comprising a second database, the second non-invasive terminal receiving the pop-up window data and the decision data from the information topic and storing the pop-up window data and the decision data in the second database.

11. The system as claimed in claim 8, further comprising a central processing device coupled to the communication interface and subscribing to the information topic of the communication interface, the central processing device receiving the pop-up window data from the information topic and generating the decision data corresponding to the pop-up window, and issuing the decision data to the information topic in the communication interface.

12. The system of claim 11, wherein the central processing unit generates a plurality of solutions corresponding to the pop-up window data according to the pop-up window data, and one of the solutions selected by a user is used as the decision data.

13. The system of claim 11, wherein the CPU comprises an analysis module, the CPU generates a plurality of solutions corresponding to the pop-up window data according to the pop-up window data, and the analysis module selects one of the solutions as the decision data according to the pop-up window data.

14. The system of claim 10, further comprising a third non-invasive terminal device coupled to the communication interface and subscribing to the information topic of the communication interface, the third non-invasive terminal device receiving the pop-up window data from the information topic and generating the decision data corresponding to the pop-up window, and issuing the decision data to the information topic in the communication interface.

15. The non-invasive sharing processing system of pop-up window of claim 8, wherein the image analysis module replaces the screen image with the default screen image when the default screen image is absent.

16. The system of claim 8, wherein the image analysis module analyzes the pop-up window using algorithms and optical character recognition to generate a button data in the pop-up window data, wherein the button data includes a button profile, a button position and a button text.

Images