TW202221561A - Protective gear identification system and protective gear identification method - Google Patents
Protective gear identification system and protective gear identification method Download PDFInfo
- Publication number
- TW202221561A TW202221561A TW109140621A TW109140621A TW202221561A TW 202221561 A TW202221561 A TW 202221561A TW 109140621 A TW109140621 A TW 109140621A TW 109140621 A TW109140621 A TW 109140621A TW 202221561 A TW202221561 A TW 202221561A
- Authority
- TW
- Taiwan
- Prior art keywords
- protective gear
- operator
- image
- processor
- identification
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
Landscapes
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Image Analysis (AREA)
- Heat Treatment Of Articles (AREA)
- Gear Transmission (AREA)
- Gears, Cams (AREA)
Abstract
Description
本揭露有關於護具辨識系統以及護具辨識方法。The present disclosure relates to a protective gear identification system and a protective gear identification method.
在半導元件的製造流程中,作業人員需在作業流程如未能做好安全防護來配戴護具,恐有工安疑慮。In the manufacturing process of semiconductor components, workers may have concerns about industrial safety if they fail to take safety precautions to wear protective gear during the operation process.
護具穿戴作業描述於各規範中。針對安全防護,目前的一些作法,僅進行工作人員內部教育訓練以及主管不定時稽核,針對人員防護器具穿戴作業巡檢。舉例而言,針對化學機械平坦化(CMP)人員,僅根據規範進行宣導,並根據規範納入CMP自主稽核管理。這並無法完全有效監控作業人員護具的穿戴狀況。The operation of donning protective gear is described in each specification. For safety protection, some current practices only carry out internal education and training of staff and irregular audits by supervisors, and conduct inspections for personnel wearing protective equipment. For example, for chemical mechanical planarization (CMP) personnel, it is only promoted according to the specification, and it is included in the CMP autonomous audit management according to the specification. This cannot completely and effectively monitor the wearing condition of the operator's protective gear.
本揭露之一態樣有關於一種護具辨識系統。One aspect of the present disclosure relates to a protective gear identification system.
根據本揭露之一實施方式,一種護具辨識系統包括影像擷取裝置以及計算裝置。影像擷取裝置設置以擷取作業人員的影像。計算裝置連接影像擷取裝置並包括處理器、儲存裝置以及護具辨識模型資料庫。儲存裝置連接處理器並用以儲存影像。處理器辨識影像中作業人員的姿態。護具辨識模型資料庫連接處理器並用以儲存護具辨識模型。護具辨識模型記錄護具在姿態下的所在位置。處理器根據護具辨識模型辨識影像中姿態的所在位置是否存在護具並輸出辨識結果。According to an embodiment of the present disclosure, a protective gear identification system includes an image capturing device and a computing device. The image capture device is configured to capture the image of the operator. The computing device is connected to the image capturing device and includes a processor, a storage device, and a database of the protective gear identification model. The storage device is connected to the processor and used for storing images. The processor recognizes the posture of the operator in the image. The protective gear identification model database is connected to the processor and used for storing the protective gear identification model. The protective gear identification model records the position of the protective gear in the posture. The processor recognizes whether there is a protective device at the position of the posture in the image according to the protective device identification model and outputs the recognition result.
在本揭露一或多個實施方式中,前述護具辨識系統進一步包括顯示器。顯示器連接計算裝置。顯示器設置以顯示交互界面。交互界面上呈現複數個選項。處理器根據作業人員的姿態選擇這些選項其中之一。In one or more embodiments of the present disclosure, the aforementioned protective gear identification system further includes a display. The display is connected to the computing device. Display settings to display the interactive interface. Multiple options are presented on the interactive interface. The processor selects one of these options based on the operator's posture.
在本揭露的一些實施方式中,處理器根據作業人員選擇的選項設置作業人員的身分以及需要被辨識的護具。In some embodiments of the present disclosure, the processor sets the identity of the operator and the protective gear to be identified according to the option selected by the operator.
在本揭露一或多個實施方式中,儲存裝置進一步設置以儲存作業人員之機台使用資訊。處理器根據機台使用資訊從護具辨識模型資料庫中選擇出護具辨識模型。In one or more embodiments of the present disclosure, the storage device is further configured to store the machine usage information of the operator. The processor selects the protective gear identification model from the protective gear identification model database according to the machine usage information.
在本揭露一或多個實施方式中,前述護具辨識系統進一步包括伺服器。伺服器遠端連接計算裝置。伺服器用以接收作業人員的影像。伺服器根據影像訓練並提供護具辨識模組至計算裝置的護具辨識模型資料庫。In one or more embodiments of the present disclosure, the aforementioned protective gear identification system further includes a server. The server is remotely connected to the computing device. The server is used to receive the image of the operator. The server trains and provides the protective gear identification module to the protective gear identification model database of the computing device according to the image training.
在本揭露一或多個實施方式中,前述護具辨識系統進一步包括傳送裝置。傳送裝置連接處理器。當處理器輸出辨識結果,傳送裝置傳送影像與辨識結果至個人電子裝置。In one or more embodiments of the present disclosure, the aforementioned protective gear identification system further includes a transmission device. The transfer device is connected to the processor. When the processor outputs the identification result, the transmitting device transmits the image and the identification result to the personal electronic device.
本揭露之一態樣有關於一種護具辨識方法。One aspect of the present disclosure relates to a method for identifying a protective gear.
根據本揭露之一實施方式,一種護具辨識方法包括以下流程。擷取作業人員的影像。辨識作業人員在影像中的姿態。確認影像中的作業人員是否穿戴護具。確認影像中的作業人員是否穿戴護具包括以下流程。根據護具辨識模型獲得護具在姿態下的所在位置。確認作業人員在影像中之姿態的所在位置是否存在護具,以輸出辨識結果。According to an embodiment of the present disclosure, a method for identifying a protective gear includes the following processes. Capture images of workers. Identify the pose of the operator in the image. Check whether the worker in the image is wearing protective gear. Checking whether the worker in the image is wearing protective gear involves the following procedure. Obtain the position of the protective gear in the posture according to the protective gear identification model. Confirm whether there is a protective gear at the position of the operator's posture in the image, and output the recognition result.
在本揭露一或多個實施方式中,前述護具辨識方法進一步包括以下流程。通過顯示器顯示複數個選項。根據作業人員在影像中的姿態選擇這些選項其中之一,以根據作業人員選擇的選項設置作業人員的身分以及需要被辨識的護具。In one or more embodiments of the present disclosure, the aforementioned method for identifying a protective gear further includes the following processes. Displays multiple options through the display. Select one of these options according to the operator's posture in the image to set the operator's identity and the protective gear that needs to be identified according to the option selected by the operator.
在本揭露的一些實施方式中,前述護具辨識方法進一步包括以下流程。傳送作業人員的身分以及辨識結果至個人電子裝置。In some embodiments of the present disclosure, the aforementioned method for identifying a protective gear further includes the following processes. Send the operator's identity and identification results to the personal electronic device.
在本揭露的一些實施方式中,當確認影像中的作業人員是否穿戴護具的流程超過設定時間,顯示器重新顯示選項供作業人員選擇。In some embodiments of the present disclosure, when the process of confirming whether the operator in the image is wearing protective gear exceeds a set time, the display redisplays options for the operator to select.
綜上所述,本揭露提供一種非接觸式的護具辨識系統,以及相應能夠使用的護具辨識方法,利用邊緣運算與機器視覺,結合人工智慧影像影像辨識來輔助安全檢查,當異常配戴時,能立即警示並記錄異常狀況,已達到防護器具的正確配戴性並提升作業人員工安意識。To sum up, the present disclosure provides a non-contact protective gear identification system and a corresponding protective gear identification method that can be used, using edge computing and machine vision, combined with artificial intelligence image recognition to assist safety inspections. It can immediately warn and record abnormal conditions, and achieve the correct wearability of protective equipment and improve the safety awareness of operators.
應理解到,以上的一般說明與以下的詳細描述都是通過示例做進一步說明,旨在為本揭露提供做進一步的解釋。It should be understood that the above general description and the following detailed description are all further descriptions by way of examples, and are intended to provide further explanation of the present disclosure.
下文列舉實施例配合所附圖式進行詳細說明,但所提供之實施例並非用以限制本發明所涵蓋的範圍,而結構運作之描述非用以限制其執行之順序,任何由元件重新組合之結構,所產生具有均等功效的裝置,皆為本發明所涵蓋的範圍。另外,圖式僅以說明為目的,並未依照原尺寸作圖。為使便於理解,下述說明中相同元件或相似元件將以相同之符號標示來說明。The following examples are described in detail in conjunction with the accompanying drawings, but the provided examples are not intended to limit the scope of the present invention, and the description of the structure and operation is not intended to limit the order of its execution. Any recombination of components The structure and the resulting device with equal efficacy are all within the scope of the present invention. In addition, the drawings are for illustrative purposes only, and are not drawn on the original scale. For ease of understanding, the same or similar elements in the following description will be described with the same symbols.
除非另有定義,本文所使用的所有詞彙(包括技術和科學術語)具有其通常的意涵,其意涵是能夠被熟悉此領域者所理解。更進一步的說,上述的詞彙在普遍常用的字典中的定義,在本說明書的內容中應被解讀為與本發明相關領域一致的意涵。除非有特別明確定義,這些詞彙將不被解釋為理想化的或過於正式的意涵。Unless otherwise defined, all terms (including technical and scientific terms) used herein have their ordinary meanings as understood by those skilled in the art. Furthermore, the definitions of the above words in commonly used dictionaries should be interpreted as meanings consistent with the relevant fields of the present invention in the content of this specification. Unless specifically defined, these terms are not to be construed in an idealized or overly formal sense.
關於本文中所使用之『第一』、『第二』、…等,並非特別指稱次序或順位的意思,亦非用以限定本發明,其僅僅是為了區別以相同技術用語描述的元件或操作而已。The terms "first", "second", ... etc. used in this document do not specifically refer to the order or order, nor are they used to limit the present invention, but are only used to distinguish elements or operations described in the same technical terms. That's it.
其次,在本文中所使用的用詞『包含』、『包括』、『具有』、『含有』等等,均為開放性的用語,即意指包含但不限於。Secondly, the terms "comprising", "including", "having", "containing" and the like used in this document are all open-ended terms, which means including but not limited to.
再者,於本文中,除非內文中對於冠詞有所特別限定,否則『一』與『該』可泛指單一個或多個。將進一步理解的是,本文中所使用之『包含』、『包括』、『具有』及相似詞彙,指明其所記載的特徵、區域、整數、步驟、操作、元件與/或組件,但不排除其所述或額外的其一個或多個其它特徵、區域、整數、步驟、操作、元件、組件,與/或其中之群組。Furthermore, in this text, unless the content of the article is particularly limited, "a" and "the" can generally refer to a single one or a plurality of. It will be further understood that the terms "comprising", "including", "having" and similar words used herein designate the recited features, regions, integers, steps, operations, elements and/or components, but do not exclude one or more of its other features, regions, integers, steps, operations, elements, components, and/or groups thereof, described or additional thereto.
為遵守安全規範,半導體的作業人員的護具是必要的。護具包括面罩、圍裙以及手套等等。除了對作業人員宣導外,更需要一種自動且完善的檢查流程,檢查作業人員護具的穿戴情況。同時,檢查流程與整體的系統交互界面,更應要顧慮到作業人員穿上護具後,不方便操作的情況。In order to comply with safety regulations, protective gear for semiconductor workers is necessary. Protective gear includes masks, aprons, and gloves. In addition to publicizing the operator, an automatic and complete inspection process is needed to check the wearing condition of the operator's protective gear. At the same time, the inspection process and the overall system interaction interface should also take into account the inconvenient operation of the operator after wearing the protective gear.
請參照第1圖。第1圖根據本揭露之一實施方式繪示一護具辨識系統100的一示意方塊圖。通過護具辨識系統100,將能夠辨識出作業人員是否穿戴護具。而作業人員也無需通過接觸式的操作,即可啟動護具辨識系統100。Please refer to Figure 1. FIG. 1 is a schematic block diagram of a
如第1圖所示,在本揭露的一實施方式中,護具辨識系統100包括影像擷取裝置110、計算裝置120、顯示器150、遠端伺服器160以及輸入裝置170。影像擷取裝置110連接影像擷取裝置110。顯示器150以及輸入裝置170連接至計算裝置120。護具辨識系統100的計算裝置120能夠遠端分別連接至遠端伺服器160以及個人電子裝置300。As shown in FIG. 1 , in an embodiment of the present disclosure, the
影像擷取裝置110設置以擷取作業人員的影像。具體而言,在一些實施方式中,影像擷取裝置110包括攝影機、相機或是CCD機器視覺。通過影像擷取裝置110來即時擷取作業人員的影像,將能夠即時獲得作業人員的姿態,而使得作業人員能夠通過改變自己的姿態來操作護具辨識系統100。具體請見後續的說明。The
影像擷取裝置110連接計算裝置120。計算裝置120能夠分析影像擷取裝置110擷取的影像,藉以獲得例如包括作業人員姿態的相關資訊。如第1圖所示,在本實施方式中,計算裝置120包括處理器125、儲存裝置130、護具辨識模型資料庫135以及傳送裝置140,儲存裝置130、護具辨識模型資料庫135以及傳送裝置140分別連接至處理器125。The
處理器125能夠辨識影像中作業人員的姿態。舉例而言,處理器能夠根據影像擷取裝置110所擷取的影像,辨識出在影像中的作業人員的分布。在一些實施方式中,處理器能夠通過一些去背的算法,去除作業人員的背景,來獲得影像中作業人員的分布。隨後,對於作業人員的分布,可以通過例機器學習/人工智慧的方式,針對作業人員的不同部位標記定位點與連接線,從而辨別出作業人員的姿態。The
護具辨識模型資料庫135用以儲存護具辨識模型。護具辨識模型記錄護具在作業人員的姿態下的所在位置。舉例而言,在一些實施方式中,處理器125已經分析出影像中作業人員不同部位的定位點,根據護具辨識模型則可以記錄在不同定位點上應穿戴何種護具。如此,處理器125能夠通過物件辨識的算法,辨別出在定位點上,是否存在特定的護具,從而輸出辨識結果。在一些實施方式中,輸出的辨識結果可以詳列影像中作業人員姿態的定位點上是否存在特定護具。The protective gear
在本實施方式中,計算裝置120的儲存裝置130能夠用以儲存處理器125輸出的辨識結果。處理器125輸出的辨識結果,也能夠通過傳送裝置140遠端發送至個人電子裝置300。個人電子裝置300例如是作業人員之上級主管的個人電腦或是伺服器。如此一來,作業人員的上級主管將能夠確認作業人員是否穿戴護具。留存的辨識結果的記錄,也有利於後續的責成與宣導。In this embodiment, the
顯示器150連接計算裝置120。在本實施方式中,顯示器150設置以顯示交互界面。交互界面上呈現複數個選項。處理器125根據作業人員的姿態選擇這些選項其中之一。如此,在作業人員穿戴護具的情況下,無須通過接觸式的介面,即可實現護具辨識系統100的操作。
舉例而言,對防護穿戴資料建檔,計算裝置120的儲存裝置130事先儲存多個作業人員的機台使用資訊,並藉此提供多個選項。在作業人員非接觸地觸發護具辨識系統100後,顯示器150上呈現多個選項。影像擷取裝置110擷取作業人員的影像後,處理器125分析作業人員的影像來獲取作業人員的姿態,並設定以作業人員的手部定位點移動,來對應顯示器150上用於操作之一游標之移動。同時,顯示器150上的交互介面也根據多個作業人員的機台使用資訊提供多個選項。如此,作業人員通過手部定位點的移動來移動游標來選定選項。處理器125將能夠根據作業人員選擇的選項,來設置作業人員的身分以及需要被辨識的護具。For example, to file protective wear data, the
儲存裝置130所儲存的護具辨識模型,能夠通過遠端伺服器160來提供。具體而言,根據本揭露的一些實施方式,在影像擷取裝置110擷取作業人員的影像後,能夠通過計算裝置120的傳送裝置140將作業人員的影像傳送至遠端伺服器160。遠端伺服器160接收作業人員的影像後,能夠客製化的根據作業人員的影像訓練出護具辨識模組。The protective gear identification model stored in the
例如,當作業人員是在廠區的特定位置進行護具檢查,則影像中背景必然是相似的,在這樣的前提下,遠端伺服器160能夠客製化的對影像進行去背並進行姿態辨識的訓練,以機器學習或人工智慧方式訓練出護具辨識模組。以機器學習或人工智慧來訓練,也可以對應特定類型/型號的護具做客製化的物件辨識訓練,如此一來,遠端伺服器160能夠完成護具辨識模組,實現後續處理器125所應用之AI影像辨識模型的建立,進而對作業人員是否穿戴護具的安全防護結果驗證。For example, when the operator checks the protective gear at a specific location in the factory, the background in the image must be similar. Under this premise, the
在遠端伺服器160完成護具辨識模組的訓練後,即可將護具辨識模組傳送至計算裝置120的儲存裝置130儲存。如此一來,計算裝置120的處理器125即可通過護具辨識模組,執行作業人員影像中作業人員的姿態辨識以及護具檢查,實現邊際運算的優勢。After the
在本實施方式中,護具辨識系統100還連接一輸入裝置170。輸入裝置170可以不為作業人員所使用。舉例而言,輸入裝置170可以包括鍵盤及滑鼠,計算裝置120例如是個人電腦。如此,計算裝置120在護具辨識系統100執行前,可以通過輸入裝置170做預先的設置。In this embodiment, the protective
為進一步具體說明護具辨識系統100的執行,請參照第2圖。第2圖根據本揭露之一實施方式繪示一護具辨識方法400的一流程圖。護具辨識方法400包括流程410至流程460。To further describe the execution of the protective
在流程410,護具辨識系統100進入待機模式。在待機模式下,根據獲得的工作排程資訊,護具辨識系統100的儲存裝置130已預載各種身分檢測項目選項(如第6圖)以及相應的護具辨識模型,以供後續流程使用。In
在流程420,作業人員在穿戴護具後,非接觸式地觸發護具辨識系統100。舉例而言,在一些實施方式中,得設置當護具辨識系統100的影像擷取裝置110補捉到包含一作業人員的影像達一定時間後能夠被觸發。當護具辨識系統100觸發後,對應影像擷取裝置110擷取到作業人員的影像,並辨識出作業人員的姿態。In the
請參照第3圖。第3圖示意地繪示影像擷取裝置110捕捉作業人員210之一影像200的一示意圖。如第3圖所示,作業人員210穿戴的護具包括身體上的圍裙215、手臂上的袖套220、手部的手套230、頭部的面罩225以及安全帽235以及腳部的鞋子240。而在第3圖所繪示影像擷取裝置110擷取的影像200中,除作業人員210外,還包括作業人員210身後的背景,被第3圖中為了簡單說明的目的而未繪示。Please refer to Figure 3. FIG. 3 schematically illustrates a schematic diagram of the
第4圖與第5圖根據本揭露之一實施方式示意地繪示護具辨識系統100獲取作業人員210姿態的示意圖。FIG. 4 and FIG. 5 schematically illustrate a schematic diagram of the protective
在第4圖中,基於影像200,護具辨識系統100的處理器125能夠進行去背,使得作業人員210在影像200的分布被取出,而能夠單獨的進行影像分析。In FIG. 4 , based on the
相較於第3圖,在第4圖中,處理器125能夠在作業人員210身上標記多個定位點。這些定位點分別位在作業人員210的不同部位,藉以反映作業人員210姿態的特徵,因此定位點也被稱作是特徵點。在一些實施方式中,定位點(特徵點)可以設置在影像中作業人員不同部位的各個關節,例如手肘、手腕、腰部、膝蓋等等。關於設置定位點的方法,舉例而言,處理器125可以透過姿態辨識的模型,在單獨輸入作業人員210在影像200中的分布後,以人工智慧方式標記出定位點。在一些實施方式中,影像擷取裝置110為攝影機,因此處理器125能夠針對多個連續的去背之作業人員210的影像200做辨識,從而在作業人員210的各個關節上標記定位點。Compared to FIG. 3 , in FIG. 4 , the
如第4圖所示,作業人員210身上的定位點包括頭部上的頭部定位點252、肩膀附近的肩部定位點254、位於脖子的頸部定位點256、位於手臂關節的肘部定位點258、位於手掌位置的手部定位點260、位在腰圍上的腰部定位點262、位在腿部關節的腿部定位點264以及位在腳底的腳部定位點266。As shown in FIG. 4 , the positioning points on the
在這些定位點之間,可以依照人體結構進行連線。舉例而言在第4圖中,肩部定位點254-肘部定位點258-手部定位點260的連線,即對應到作業人員210手臂的姿態。腰部定位點262-腿部定位點264-腳部定位點266的連線,則對應到作業人員210腿部的姿態。因此,綜合上述作業人員210的各個定位點與定位點之間的連線,即可反映出作業人員210的姿態,是以實現作業人員210的姿態辨識。Between these anchor points, lines can be made according to the human body structure. For example, in FIG. 4 , the line connecting the shoulder anchor point 254 - the elbow anchor point 258 - the
應留意到,第4圖繪示的姿態辨識方式僅是本揭露的一實施例,而不應以此限制本揭露所採用的姿態辨識算法。同樣能夠就作業人員210之影像200做影像分析,而能夠定位出作業人員210在影像200中不同部位特徵的算法,也包含在本揭露中。It should be noted that the gesture recognition method shown in FIG. 4 is only an embodiment of the present disclosure, and should not limit the gesture recognition algorithm used in the present disclosure. It is also possible to perform image analysis on the
接續第4圖,在第5圖中,將辨識出的多個定位點以及定位點之間的連線載入影像200中的作業人員210上。一旦作業人員210在影像200中有所移動,各個定位點也將對應作業人員210的不同部位做移動,從而即時反映作業人員210的姿態變化。Continuing from FIG. 4 , in FIG. 5 , the identified multiple positioning points and the connection between the positioning points are loaded onto the
請回到第2圖,並同時參照第6圖。在流程430,作業人員210通過辨識出的姿態,來選擇顯示器150上交互介面呈現的身分檢測項目。第6圖根據本揭露之一實施方式繪示顯示器150上一交互介面的一示意圖。Please go back to Figure 2 and refer to Figure 6 at the same time. In the
在第6圖繪示的顯示器150上,交互介面呈現包括游標275以及多個選項277。選項277上標示時間、身分以及工作類型,對應到在不同作業時間下,不同身分的作業人員210進行不同工作類型的作業。On the
如前所述,在完成作業人員210的姿態辨識後,將可以通過例如作業人員210的一手部定位點260來移動游標275。當游標275移動至特定的選項277上,顯示器150的交互介面能夠對應選項277的工作類型呈現資訊280。如第6圖所示,在本實施方式中,資訊280可以是一表格,表示在選項277對應的工作類型下,應穿戴之防護器具(護具)名稱以及護具所對應之部位。以第6圖呈現的資訊280為例,防酸圍裙215應位在身體、袖套220應位在手臂、面罩225與安全帽235應位在頭部、防酸手套230應位在手部。在本實施方式中,不同的部份,對應到影像200中(如第5圖所示)作業人員210上一或多個定位點。As mentioned above, after the gesture recognition of the
回到第2圖。進入到流程440,在完成身分檢測項目之選項277的選擇後,護具辨識系統100將根據作業人員210的選擇來檢查護具。以第6圖選項277對應的資訊280為例,護具辨識系統100將檢查身體、手臂、頭部與手部。Back to Figure 2. Going to the
此時,護具辨識系統100處理器125將根據作業人員210的選擇來選定儲存裝置130所儲存的護具辨識模型。護具辨識模型記載在作業人員210的姿態中,不同護具的所在位置。具體而言,以本實施方式為例,護具辨識模型記載在不同護具應設置在對應的一或多個定位點上。At this time, the
請參照第7圖。第7圖根據本揭露之一實施方式繪示辨識作業人員210之一護具的一示意圖。在第7圖中繪示護具辨識系統100檢查防酸手套230。此時,護具辨識系統100在影像200上提供檢查框281。為檢查手部,護具辨識系統100設置檢查框281應包括整個手部定位點260,以物件辨識算法確認手部定位點260是否存在防酸手套230。以第7圖為例,作業人員210的二個手部定位點260上均存在防酸手套230。Please refer to Figure 7. FIG. 7 is a schematic diagram of identifying a protective gear of the
第8圖根據本揭露之一實施方式繪示辨識作業人員210另一護具的一示意圖。在第7圖中繪示護具辨識系統100檢查防酸圍裙215。此時,護具辨識系統100在影像200上提供檢查框282。為檢查身體,護具辨識系統100設置檢查框282應包括所有肩部定位點254、腰部定位點262以及腿部定位點264。以第8圖為例,作業人員210在檢查框282包括的範圍,確實對應到作業人員210的身體,而在作業人員210的身體上存在防酸圍裙215。FIG. 8 is a schematic diagram of identifying another protective gear of the
第9圖根據本揭露之一實施方式繪示辨識作業人員210未穿戴一護具的一示意圖。類似於第7圖,在第9圖中繪示出護具辨識系統100檢查防酸手套230。在檢查框281框記出的手部定位點260,護具辨識系統100很容易能夠辨別出作業人員210並未穿戴防酸手套230。FIG. 9 is a schematic diagram of identifying that the
相似的,手臂上袖套220的檢查,可以對應設置二檢查框分別包含一肩部定位點254、一肘部定位點258、一手部定位點260,而在這二組檢查框中是否存在袖套220。針對頭部面罩225以及安全帽235的檢查,則可以設置涵蓋到頭部定位點252的檢查框,並確認這樣的檢查框中是否存在面罩225以及安全帽235。Similarly, for the inspection of the
如此一來,護具辨識系統100將能夠完成流程440,完成對作業人員210護具穿戴之檢查。若作業人員210有未穿戴之護具如第9圖所示,則護具辨識系統100可以在流程440等待一檢查時間,待作業人員210完成護具的穿戴。In this way, the protective
請回到第2圖。在流程450,確認作業人員210在流程440之檢查時間是否超出一設定的檢查時間。如未超時,則代表作業人員210通過檢查,將可進入到後續之流程460。若超時,則對應作業人員210未通過檢查,護具辨識系統100退回流程440,顯示器150的交互介面重新提供選項277供作業人員210確認選擇之身分檢測項目是否正確。Please go back to picture 2. In the
請同時參照第2圖以及第10圖。第10圖根據本揭露之一實施方式繪示傳送至一個人電子裝置300的多個辨識結果。Please refer to Figure 2 and Figure 10 at the same time. FIG. 10 illustrates a plurality of identification results transmitted to a personal
在流程460,護具辨識系統100的處理器125完成護具的檢查後輸出辨識結果,並通過傳送裝置140即時地將多個辨識結果傳送至個人電子裝置300。如前所述,個人電子裝置300例如是作業人員210的主管的個人電腦或是記錄用的伺服器,以利相關單位調閱管理。In the
在第10圖提供的多筆辨識結果以表格呈現,表格的欄位包括時間、身分(類型)、(工作)種類、檢測結果、正面照片以及背面照片。如第10圖所示,時間欄位記錄護具辨識系統100檢查作業人員的時間;身分欄位記錄作業人員的工號;種類欄位記錄工作類型;檢測結果記錄是否通過。如果通過,則提供正面照片與背面照片。The multiple recognition results provided in Figure 10 are presented in a table, and the fields of the table include time, identity (type), (job) type, test result, front photo and back photo. As shown in Fig. 10, the time field records the time when the protective
以工號R20029的作業人員為例,其工作種類為月保,通過護具辨識系統100的檢測(Pass),並提供正面照片(檔名imgfront)以及背面照片(檔名imageback)。Take the worker with the job number R20029 as an example, whose job type is monthly insurance, and passes the detection (Pass) of the protective
對於工號H81806的作業人員,其工作種類為換酸,但未通過護具辨識系統100的檢測(fail)。由於未通過檢測,也無須留下照片。For the worker with job number H81806, his work type is acid replacement, but he fails the detection (fail) of the protective
在檢查完畢後,護具辨識系統100可以回到流程410,進入待機模式,等待其他作業人員觸發。After the inspection is completed, the protective
綜上所述,本揭露提供一種非接觸式的護具辨識系統,以及相應能夠使用的護具辨識方法。如此一來,利用邊緣運算(Edging computing)與CCD(charge coupled device)機器視覺結合人工智慧影像分析技術,將作業人員的安全防護配戴與資料庫或特徵點做比對。於作業前執行標準著裝人工智慧影像辨識。當異常配戴時,能立即警示並記錄異常狀況,已達到防護器具的正確配戴性並提升作業人員工安意識。而本揭露採用主動偵測、非接觸式 AI人工智慧偵測,一切透過辨識作業人員姿態來操作決定工號或取消偵測,以利作業人員在佩戴護具後,仍能夠容易操作進行辨識檢查。在一些實施方式中,本揭露的護具辨識系統以及方法更能夠用於AI工安機器人開發與導入。To sum up, the present disclosure provides a non-contact protective gear identification system and a corresponding protective gear identification method that can be used. In this way, edge computing and CCD (charge coupled device) machine vision combined with artificial intelligence image analysis technology are used to compare the safety protection wear of workers with the database or feature points. Perform standard attire artificial intelligence image recognition before operation. When it is abnormally worn, it can immediately warn and record the abnormal situation, which has achieved the correct wearability of protective equipment and improved the safety awareness of operators. In this disclosure, active detection and non-contact AI artificial intelligence detection are adopted. All operations determine the job number or cancel the detection by identifying the operator's posture, so that the operator can still easily operate for identification and inspection after wearing protective gear. . In some embodiments, the protective gear identification system and method of the present disclosure can be used for the development and introduction of AI industrial safety robots.
雖然本發明已以實施例揭露如上,然其並不用以限定本發明,任何熟習此技藝者,在不脫離本發明的精神和範圍內,當可作各種的更動與潤飾,因此本發明的保護範圍當視後附的申請專利範圍所界定者為準。Although the present invention has been disclosed above by the embodiments, it is not intended to limit the present invention. Anyone skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection of the present invention The scope shall be determined by the scope of the appended patent application.
對於本領域技術人員將顯而易見的是,在不脫離本公開的範圍或精神的情況下,可以對本揭露實施例的結構進行各種修改和變化。鑑於前述內容,本揭露旨在覆蓋各種的修改與變形,只要它們落入所附權利要求的範圍內。It will be apparent to those skilled in the art that various modifications and changes can be made in the structures of the embodiments of the present disclosure without departing from the scope or spirit of the disclosure. In view of the foregoing, the present disclosure is intended to cover various modifications and variations insofar as they fall within the scope of the appended claims.
100:護具辨識系統
110:影像擷取裝置
120:計算裝置
125:處理器
130:儲存裝置
135:護具辨識模型資料庫
140:傳送裝置
150:顯示器
160:伺服器
170:輸入裝置
200:影像
210:作業人員
215:圍裙
220:袖套
225:面罩
230:手套
235:安全帽
240:鞋子
252:頭部定位點
254:肩部定位點
256:頸部定位點
258:肘部定位點
260:手部定位點
262:腰部定位點
264:腿部定位點
266:腳部定位點
275:游標
277:選項
280:資訊
281,282:檢查框
300:個人電子裝置
400:護具辨識方法
410~460:流程
100: Protective gear identification system
110: Image capture device
120: Computing Devices
125: Processor
130: Storage Device
135: Protector Identification Model Database
140: Teleporter
150: Monitor
160: Server
170: Input Device
200: Video
210: Operators
215: Apron
220: Sleeve
225: Mask
230: Gloves
235: Hard hat
240: Shoes
252: head anchor point
254: Shoulder anchor point
256: Neck Anchor Point
258: Elbow anchor point
260: Hand positioning point
262: waist anchor point
264: Leg anchor point
266: Foot Anchor Point
275: Cursor
277:Options
280:
本揭露的優點與圖式,應由接下來列舉的實施方式,並參考附圖,以獲得更好的理解。這些圖式的說明僅僅是列舉的實施方式,因此不該認為是限制了個別實施方式,或是限制了發明申請專利範圍的範圍。 第1圖根據本揭露之一實施方式繪示一護具辨識系統的一示意方塊圖; 第2圖根據本揭露之一實施方式繪示一護具辨識方法的一流程圖; 第3圖示意地繪示捕捉作業人員之一影像的一示意圖; 第4圖與第5圖根據本揭露之一實施方式示意地繪示獲取作業人員姿態的示意圖; 第6圖根據本揭露之一實施方式繪示顯示器上一交互介面的一示意圖; 第7圖根據本揭露之一實施方式繪示辨識作業人員一護具的一示意圖; 第8圖根據本揭露之一實施方式繪示辨識作業人員另一護具的一示意圖; 第9圖根據本揭露之一實施方式繪示辨識作業人員未穿戴一護具的一示意圖;以及 第10圖根據本揭露之一實施方式繪示傳送至一個人電子裝置的多個辨識結果。 The advantages and drawings of the present disclosure should be better understood from the following embodiments and with reference to the drawings. The descriptions of these drawings are merely exemplary embodiments, and therefore should not be construed to limit individual embodiments or to limit the scope of the claimed invention. FIG. 1 shows a schematic block diagram of a protective gear identification system according to an embodiment of the present disclosure; FIG. 2 illustrates a flowchart of a method for identifying a protective gear according to an embodiment of the present disclosure; FIG. 3 schematically illustrates a schematic diagram of capturing an image of an operator; FIG. 4 and FIG. 5 schematically illustrate a schematic diagram of obtaining an operator's posture according to an embodiment of the present disclosure; FIG. 6 shows a schematic diagram of an interactive interface on a display according to an embodiment of the present disclosure; FIG. 7 shows a schematic diagram of identifying a protective gear of an operator according to an embodiment of the present disclosure; FIG. 8 is a schematic diagram of identifying another protective gear of an operator according to an embodiment of the present disclosure; FIG. 9 shows a schematic diagram of identifying that an operator is not wearing a protective gear according to an embodiment of the present disclosure; and FIG. 10 illustrates a plurality of identification results transmitted to a personal electronic device according to an embodiment of the present disclosure.
國內寄存資訊(請依寄存機構、日期、號碼順序註記) 無 國外寄存資訊(請依寄存國家、機構、日期、號碼順序註記) 無 Domestic storage information (please note in the order of storage institution, date and number) none Foreign deposit information (please note in the order of deposit country, institution, date and number) none
100:護具辨識系統 100: Protective gear identification system
110:影像擷取裝置 110: Image capture device
120:計算裝置 120: Computing Devices
125:處理器 125: Processor
130:儲存裝置 130: Storage Device
135:護具辨識模型資料庫 135: Protector Identification Model Database
140:傳送裝置 140: Teleporter
150:顯示器 150: Monitor
160:伺服器 160: Server
170:輸入裝置 170: Input Device
300:個人電子裝置 300: Personal Electronic Devices
Claims (10)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW109140621A TWI779404B (en) | 2020-11-19 | 2020-11-19 | Protective gear identification system and protective gear identification method |
CN202011421033.5A CN114596579A (en) | 2020-11-19 | 2020-12-08 | Protective gear identification system and protective gear identification method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW109140621A TWI779404B (en) | 2020-11-19 | 2020-11-19 | Protective gear identification system and protective gear identification method |
Publications (2)
Publication Number | Publication Date |
---|---|
TW202221561A true TW202221561A (en) | 2022-06-01 |
TWI779404B TWI779404B (en) | 2022-10-01 |
Family
ID=81802261
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW109140621A TWI779404B (en) | 2020-11-19 | 2020-11-19 | Protective gear identification system and protective gear identification method |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN114596579A (en) |
TW (1) | TWI779404B (en) |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWM457227U (en) * | 2013-02-04 | 2013-07-11 | Yong Dong Technology Co Ltd | Real-time identity authentication and image transmission of physiological information system |
US9610476B1 (en) * | 2016-05-02 | 2017-04-04 | Bao Tran | Smart sport device |
CN108399367B (en) * | 2018-01-31 | 2020-06-23 | 深圳市阿西莫夫科技有限公司 | Hand motion recognition method and device, computer equipment and readable storage medium |
CN111801695A (en) * | 2018-03-01 | 2020-10-20 | 3M创新有限公司 | Personal protective equipment identification system |
CN110263605A (en) * | 2018-07-18 | 2019-09-20 | 桂林远望智能通信科技有限公司 | Pedestrian's dress ornament color identification method and device based on two-dimension human body guise estimation |
CN109800665A (en) * | 2018-12-28 | 2019-05-24 | 广州粤建三和软件股份有限公司 | A kind of Human bodys' response method, system and storage medium |
TWM582665U (en) * | 2019-03-28 | 2019-08-21 | 楊宇軒 | Artificial intelligence construction inspection system for construction safety |
CN110674712A (en) * | 2019-09-11 | 2020-01-10 | 苏宁云计算有限公司 | Interactive behavior recognition method and device, computer equipment and storage medium |
CN111199200A (en) * | 2019-12-27 | 2020-05-26 | 深圳供电局有限公司 | Wearing detection method and device based on electric protection equipment and computer equipment |
CN111860422A (en) * | 2020-07-30 | 2020-10-30 | 西北师范大学 | Normative intelligent detection method for wearing protective equipment of medical staff |
-
2020
- 2020-11-19 TW TW109140621A patent/TWI779404B/en active
- 2020-12-08 CN CN202011421033.5A patent/CN114596579A/en active Pending
Also Published As
Publication number | Publication date |
---|---|
TWI779404B (en) | 2022-10-01 |
CN114596579A (en) | 2022-06-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
MassirisFernández et al. | Ergonomic risk assessment based on computer vision and machine learning | |
CN106340217B (en) | Manufacturing equipment intelligent system based on augmented reality technology and its realization method | |
CN105565103B (en) | Elevator faults detection method and device | |
US20190290202A1 (en) | System and method for ergonomic analysis, in particular of a worker | |
US20160070958A1 (en) | Obtaining metrics for a position using frames classified by an associative memory | |
US20140278320A1 (en) | System and method for selecting a respirator | |
CN111860422A (en) | Normative intelligent detection method for wearing protective equipment of medical staff | |
WO2014150739A1 (en) | Virtual mask alignment for fit analysis | |
CN111652192A (en) | Tumble detection system based on kinect sensor | |
Evangelista et al. | Advanced visualization of ergonomic assessment data through industrial Augmented Reality | |
Generosi et al. | A novel platform to enable the future human-centered factory | |
CN112101288A (en) | Method, device and equipment for detecting wearing of safety helmet and storage medium | |
TWI779404B (en) | Protective gear identification system and protective gear identification method | |
JP7636316B2 (en) | Work support system, work object identification device and method | |
JP2020087091A (en) | Skill degree determination system | |
JP7406038B1 (en) | Work support system and work support method | |
WO2023285918A1 (en) | Touch-free seal check systems and methods for respiratory protection devices | |
Lanzoni et al. | Manual tasks real-time ergonomic evaluation for collaborative robotics | |
CN119399673A (en) | A protective clothing donning and doffing assessment system | |
WO2020107113A1 (en) | Apparel for ergonomic evaluation | |
TWM596380U (en) | Artificial intelligence and augmented reality system | |
TWI791407B (en) | Smart health check system and method | |
WO2023080219A1 (en) | Program, working clothes, system, and method | |
US20250094911A1 (en) | Physical demands characterization system and methods | |
CN119379995A (en) | Protective clothing donning and doffing scoring method, device, electronic equipment and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
GD4A | Issue of patent certificate for granted invention patent |