Detailed Description
Some exemplary embodiments that incorporate the features and advantages of the present disclosure will be described in detail in the specification which follows. It is to be understood that the disclosure is capable of various modifications in various embodiments without departing from the scope of the disclosure, and that the description and drawings are to be regarded as illustrative in nature, and not as restrictive.
Referring to fig. 1 and fig. 2, fig. 1 is a schematic diagram illustrating an architecture of a smart inspection system suitable for a smart inspection method according to the present disclosure, and fig. 2 is a flowchart illustrating the smart inspection method according to an embodiment of the present disclosure. As shown in fig. 1 and 2, according to an embodiment of the present disclosure, the intelligent inspection method includes the following steps: first, as shown in step S100, a gateway 11, a real-time communication system 12 and a wearable electronic device 13 with augmented reality function are provided. The gateway 11 may be, for example, a server, but not limited thereto. The real-time communication system 12 may be a system based on a real-time communication software (or application), such as, but not limited to, Line, Whatsapp, WeChat, Skype, or iMessage. In addition, the wearable electronic device 13 with augmented reality function may be, for example, an augmented reality glasses (AR Glass), but not limited thereto.
Next, as shown in step S200, the wearable electronic device 13 with augmented reality function is worn to perform an inspection in a field, such as a factory or a clean room. Then, as shown in step S300, the wearable electronic device with augmented reality function 13 receives a plurality of operation information of a plurality of devices in the field transmitted by the gateway 11 through the real-time communication system 12. Next, as shown in step S400, a plurality of operation information is displayed in real time at corresponding positions of a plurality of devices in the field of view of the wearable electronic apparatus 13 with augmented reality function. In other words, the wearable electronic device with augmented reality function 13 of the present disclosure can display the operation information related to the device in the field of view, such as the pointer reading, the operation parameter, and the operation state, on the display screen of the wearable electronic device with augmented reality function 13 at the position corresponding to the device through the augmented reality function. The patrol personnel wearing the wearable electronic device 13 with the augmented reality function can be clear at a glance and directly know the operation information of each device. Therefore, the state of the equipment can be inspected in real time, meanwhile, the inspection time can be greatly shortened and the inspection efficiency can be effectively improved because the equipment instrument or the reading is not required to be searched, and in addition, the problems existing in danger and real-time mastering fields can be further avoided.
Referring to fig. 2, fig. 3 and fig. 4, fig. 3 is a block diagram showing an architecture of a smart polling system according to an embodiment of the disclosure, and fig. 4 is a partial flowchart showing a smart polling method according to an embodiment of the disclosure. As shown in fig. 2 to 4, in the intelligent inspection method of the present disclosure, the wearable electronic device 13 with augmented reality function is worn by an inspector, and the gateway 11 is connected with at least one device host 15 or at least one sensor 14 of a plurality of devices to construct an internet of things. Since the wearable electronic device 13 with augmented reality function does not need to hold any object, the technical effects of effectively freeing two hands to increase convenience and avoid safety problems can be achieved. Further, after the aforementioned step S100, i.e., between the steps S100 and S200, between the steps S200 and S300, between the steps S300 and S400, or after the step S400, the intelligent inspection method of the present disclosure may include a step S110, as shown in the step S110, the wearable electronic device 13 with augmented reality function is connected to the remote monitoring device 16 through the real-time communication system 12, so as to facilitate a background manager to monitor. The remote monitoring device 16 may be a remote mobile device or a remote computer (as shown in fig. 1), but not limited thereto.
Several ways that a backend manager may implement the intelligent tour inspection method based on the present disclosure will be described below, but the present disclosure is not limited thereto. Referring to fig. 2 to 4, after the step S110, in a first manner, as shown in step S120, the wearable electronic device 13 with augmented reality function performs one-way video communication or two-way video communication with the remote monitoring device 16 through the real-time communication system 12 to share the visual field to the remote monitoring device 16, where the one-way video communication or the two-way video communication can be determined according to the requirement, or can be determined according to the bandwidth or the field characteristics, but is not limited thereto.
In a second manner, as shown in steps S130 and S140, the remote monitoring device 16 transmits the communication information to the wearable electronic device 13 with augmented reality function through the real-time communication system 12, for example, transmits a real-time text message of the Line software, and displays the communication information on the wearable electronic device 13 with augmented reality function in real time, so that the inspection personnel can immediately and directly view the communication information.
In addition, in the third way, as shown in step S150, the wearable electronic device 13 with the augmented reality function performs voice communication with the remote monitoring device 16 through the real-time communication system 12, so that the inspection personnel can directly communicate with the background manager. Through the mode, the background management personnel can directly watch the visual field seen by the inspection personnel in real time and confirm the field condition, and can instruct the inspection personnel to operate in a microphone or typing mode, so that the operation steps are ensured to be correct, and the work safety accidents are reduced.
In some embodiments, the intelligent inspection method disclosed by the present disclosure may implement more than one of the above three modes at the same time, or may only perform one of the three modes. That is, after step S110, the steps S120, S130, S140 and S150 may be executed at the same time, or the steps S120, S130, S140 and S150 may be executed alternately, or only the steps S120, S130, S140 or S150 may be executed. Meanwhile, the remote monitoring device 16 used by the background manager is not limited to a specific device, and can be used as a remote mobile device or a remote computer only by having a real-time communication function or installing real-time communication software, so that the background manager can control the field condition at any time and in different places.
Referring to fig. 2, fig. 3 and fig. 5, wherein fig. 5 is a detailed flowchart illustrating step S300 of the intelligent inspection method shown in fig. 2. As shown in fig. 2, 3 and 5, according to an embodiment of the present disclosure, the step S300 of the smart polling method may include the following steps: first, as shown in step S310, the gateway 11 transmits a plurality of operation information of a plurality of devices in the field to the real-time communication system 12. Next, as shown in step S320, the real-time communication system 12 transmits a plurality of operation information to the wearable electronic device 13 with augmented reality function in the form of real-time communication information. In some embodiments, the real-time communication system 12 includes a main server 121 and a real-time communication server 122, the gateway 11 synchronously transmits a plurality of operation information to the main server 121 and the real-time communication server 122, and the main server 121 predicts the equipment to be maintained among the plurality of equipment according to the plurality of operation information by big data calculation. Therefore, the equipment which needs to be maintained potentially can be reminded, and the systemic risk can be prevented.
In the present disclosure, the wearable electronic device 13 with augmented reality function adopted in the smart inspection method mainly has two categories, one is that the wearable electronic device 13 with augmented reality function only has a head-mounted display, a camera, a communication element, etc., and the main data transmission and collective operation is performed by using a client device, such as a smart phone, as a carrier; the second is that the wearable electronic device 13 with augmented reality function has sufficient calculation function, and can directly perform data transmission and calculation. Either of these two categories is applicable to the intelligent tour inspection method of the present disclosure. Further, the client devices described herein, which may be stand alone or may be considered part of the real-time communication system 12, are described below.
Referring to fig. 2, fig. 3, fig. 5 and fig. 6, wherein fig. 6 is a flowchart illustrating details of step S320 of the intelligent tour inspection method shown in fig. 5. As shown in fig. 2, 3, 5 and 6, the instant communication system 12 of the present disclosure may further include a client device 123, the client device 123 may be, for example but not limited to, a smart phone, wirelessly connected with the instant communication server 122 and the wearable electronic device 13 with augmented reality function, wherein the connection manner between the client device 123 and the instant communication server 122 is preferably different from the connection manner between the client device 123 and the wearable electronic device 13 with augmented reality function, such as internet and bluetooth communication, respectively, but not limited thereto. In addition, the foregoing step S320 may further include the following detailed steps: first, as shown in step S321, the real-time communication server 122 transmits a plurality of pieces of operation information to the client device 123 in the form of real-time communication information. Then, as shown in step S322, the client device 123 transmits a plurality of operation information to the wearable electronic device with augmented reality function 13 in the form of real-time communication information.
Referring to fig. 2, fig. 3 and fig. 7, fig. 7 is a partial flowchart illustrating a smart polling method according to an embodiment of the disclosure. As shown in fig. 2, 3 and 7, according to an embodiment of the present disclosure, the intelligent inspection method between the step S300 and the step S400 or after the step S400 may further include the following steps: first, as shown in step S500, the main server 121 transmits a maintenance notification to the wearable electronic device 13 with augmented reality function in the form of real-time communication information through the real-time communication server 122. Next, as shown in step S600, the maintenance notification is displayed in real time on the wearable electronic device with augmented reality function. The step S600 described herein may be implemented in a form that directly displays the maintenance notification on the wearable electronic device 13 with the augmented reality function in a warning manner, so that the inspection personnel can receive the notification at the first time; or the device may be displayed at a corresponding position on the wearable electronic device 13 with the augmented reality function when the inspection staff has the device to be repaired corresponding to the maintenance notice in the visual field.
Referring to fig. 2, fig. 3 and fig. 8, fig. 8 is a partial flowchart illustrating a smart polling method according to an embodiment of the disclosure. As shown in fig. 2, fig. 3 and fig. 8, according to an embodiment of the present disclosure, after the step S200, including any step after the step S200, the intelligent inspection method may further include the following steps: first, as shown in step S210, the wearable electronic device with augmented reality function 13 scans one site identification 17 of the plurality of site identifications 17. Next, in step S220, the station corresponding to the station identification 17 is confirmed, and the name of the station is displayed in real time on the wearable electronic device 13 with the augmented reality function. In some embodiments, the site identification 17 may be a barcode, such as, but not limited to, a Quick Response CODE (QR CODE). Wearable electronic device 13 of utensil augmented reality function can be scanned website discernment 17 by the personnel operation of patrolling and examining in particular, or only need scan automatically when having website discernment 17 in the field of vision to the website of discernment place can do benefit to the flow of patrolling and examining the operation or backstage managers's control.
Further, the intelligent tour inspection method of the present disclosure may be applied to a plurality of applications, such as navigation and training. Referring back to fig. 8, according to the present disclosure, after the station is confirmed in step S220, the disclosed intelligent inspection method may further include step S230. In step S230, a standard operation on inspection (SOP) procedure of the corresponding site, a maintenance confirmation item of the corresponding site, an inspection teaching of the corresponding site, or a site guide of the corresponding site to the wearable electronic device 13 with the augmented reality function is displayed in real time. In other words, since the inspection standard operation procedure, maintenance confirmation item, inspection teaching, site guide, etc. corresponding to each site can be established and displayed as required, the intelligent inspection method of the present disclosure can greatly reduce the labor burden and cost when a new person needs to be trained or visitors need to be visited.
Referring to fig. 2, fig. 3 and fig. 9, fig. 9 is a partial flowchart illustrating a smart polling method according to an embodiment of the disclosure. As shown in fig. 2, 3 and 9, after the step S400, the intelligent inspection method of the present disclosure may further include the following steps: first, in step S410, a control command is input to the wearable electronic device 13 with augmented reality function by gesture or voice. Then, as shown in step S420, the wearable electronic device with augmented reality function 13 transmits a control command through the real-time communication system 12. In this embodiment, the inspection personnel wearing the wearable electronic device 13 with augmented reality function can convert the gesture or voice into a control command through the wearable electronic device 13 with augmented reality function by a gesture, such as a gesture of OK or problem (pre-training), or a voice, such as a sentence of "site inspection complete", "machine abnormal", "temperature adjustment increased by 2 degrees", or "site navigation enabled" (pre-training), and then transmit the control command, where the transmission object can be a background manager, a device, or a inspection recording host, but not limited thereto.
Referring to fig. 2, fig. 3 and fig. 10, fig. 10 is a partial flowchart illustrating a smart polling method according to an embodiment of the disclosure. As shown in fig. 2, 3 and 10, the intelligent inspection method of the present disclosure may include an employee safety prevention function, and specifically, after the step S200 of the intelligent inspection method of the present disclosure, including any step after the step S200, the method may further include the following steps: first, as shown in step S240, the wearable electronic device 13 with augmented reality function identifies the staff in the field. Then, as shown in step S250, it is determined whether the equipment worn by the staff meets the requirements and whether the number of times the staff enters or exits the field is normal, and the determination result is displayed in real time on the wearable electronic device 13 with augmented reality function. Therefore, the working personnel can be effectively ensured to meet the safety regulations, and further the work safety incident can be avoided.
Referring to fig. 2, fig. 3 and fig. 11, fig. 11 is a partial flowchart illustrating a smart polling method according to an embodiment of the disclosure. As shown in fig. 2, 3 and 11, the intelligent inspection method of the present disclosure may include an auditing function, and specifically, after the step S200 of the intelligent inspection method of the present disclosure, including any step after the step S200, the method may further include the following steps: first, as shown in step S260, the wearable electronic device 13 with augmented reality function identifies a work area in the field. Next, in step S270, it is determined whether the audit items in the work area meet the field regulations, and the determination result is displayed in the wearable electronic device 13 with the augmented reality function in real time. The audit items can include whether sundries are stacked in the field or not, whether the field is free in a specific range or not, or whether the equipment operation meets specific conditions or not, and the audit items can be judged and realized by an image recognition technology in a pre-training mode, so that the safety of the working area can be realized.
Please refer to fig. 2 again. In combination with the various embodiments described above, the present disclosure provides a smart inspection system 1, which includes a gateway 11, a real-time communication system 12, and a wearable electronic device 13 with augmented reality function. The real-time communication system 12 is connected to the gateway 11 to receive the operation information of the devices transmitted by the gateway 11 and convert the operation information into real-time communication information. On the other hand, the wearable electronic device 13 with augmented reality function is wirelessly connected to the real-time communication system 12, receives a plurality of real-time communication information, and displays a plurality of operation information corresponding to the plurality of real-time communication information in real time at corresponding positions of a plurality of devices in the visual field. It should be noted that the intelligent inspection system 1 provided in the present disclosure is an open system, and any gateway 11, any real-time communication system 12, and any wearable electronic device 13 with augmented reality function can be applied to the aforementioned embodiments only according to the architecture described herein, so that the technical effect of effectively reducing the cost without purchasing specific hardware can be achieved.
In summary, the present disclosure provides a smart inspection method and a smart inspection system, which can display the operation information of the device in real time in the augmented reality through a wearable electronic device with augmented reality function, and can inspect the state of the device in real time. Furthermore, the inspection personnel can be enabled to leave two hands free to increase convenience and avoid safety problems, the inspection personnel can receive the equipment maintenance notice at the first time, background management personnel can control field conditions at any time and in other places, potential equipment needing maintenance can be reminded through big data operation, and systemic risks are prevented. In addition, the system has the advantages that the system is provided with the recognition station, is favorable for inspection operation and can be applied to navigation and training in a diversified manner, so that the labor burden and the cost are greatly reduced. Furthermore, the system can also have the functions of industrial safety prevention and audit, and effectively ensures that the workers meet safety regulations, thereby avoiding industrial safety events and confirming the safety of a working area.
While the present invention has been described in detail with respect to the above embodiments, it will be apparent to those skilled in the art that various modifications can be made without departing from the scope of the invention as defined in the appended claims.