CN114596579A - Protective gear identification system and protective gear identification method - Google Patents
Protective gear identification system and protective gear identification method Download PDFInfo
- Publication number
- CN114596579A CN114596579A CN202011421033.5A CN202011421033A CN114596579A CN 114596579 A CN114596579 A CN 114596579A CN 202011421033 A CN202011421033 A CN 202011421033A CN 114596579 A CN114596579 A CN 114596579A
- Authority
- CN
- China
- Prior art keywords
- operator
- image
- protective gear
- identification
- processor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
Landscapes
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Image Analysis (AREA)
- Heat Treatment Of Articles (AREA)
- Gear Transmission (AREA)
- Gears, Cams (AREA)
Abstract
本发明公开了一种护具辨识系统与护具辨识方法,护具辨识系统包括影像撷取装置以及计算装置。影像撷取装置设置成撷取作业人员的影像。计算装置连接影像撷取装置并包括处理器、储存装置以及护具辨识模型数据库。储存装置连接处理器并用以储存影像。处理器辨识影像中作业人员的姿态。护具辨识模型数据库连接处理器并用以储存护具辨识模型。护具辨识模型记录护具在姿态下的所在位置。处理器根据护具辨识模型辨识影像中姿态的所在位置是否存在护具并输出辨识结果。借此,本发明的护具辨识系统,当作业人员异常配戴护具时,能立即警示并记录异常状况。
The invention discloses a protective gear identification system and a protective gear identification method. The protective gear identification system includes an image capturing device and a computing device. The image capturing device is configured to capture the image of the operator. The computing device is connected to the image capturing device and includes a processor, a storage device, and a database of the protective gear identification model. The storage device is connected to the processor and used for storing images. The processor recognizes the posture of the operator in the image. The protective gear identification model database is connected to the processor and used for storing the protective gear identification model. The protective gear identification model records the position of the protective gear in the posture. The processor recognizes whether there is a protective device at the position of the posture in the image according to the protective device identification model and outputs the recognition result. Thereby, the protective gear identification system of the present invention can immediately warn and record the abnormal condition when the operator wears the protective gear abnormally.
Description
技术领域technical field
本发明是有关于一种护具辨识系统与护具辨识方法。The present invention relates to a protective gear identification system and a protective gear identification method.
背景技术Background technique
在半导元件的制造流程中,作业人员需在作业流程如未能做好安全防护来配戴护具,恐有工安疑虑。In the manufacturing process of semiconductor components, if the operator is required to wear protective gear without adequate safety protection during the operation process, there may be concerns about industrial safety.
护具穿戴作业描述于各规范中。针对安全防护,目前的一些作法,仅进行工作人员内部教育训练以及主管不定时稽核,针对人员防护器具穿戴作业巡检。举例而言,针对化学机械平坦化(CMP)人员,仅根据规范进行宣导,并根据规范纳入CMP自主稽核管理。这并无法完全有效监控作业人员护具的穿戴状况。The operation of donning protective gear is described in each specification. For safety protection, some current practices only carry out internal education and training of staff and irregular audits by supervisors, and conduct inspections for personnel wearing protective equipment. For example, for chemical mechanical planarization (CMP) personnel, it is only promoted according to the specification, and it is included in the CMP autonomous audit management according to the specification. This cannot completely and effectively monitor the wearing condition of the operator's protective gear.
发明内容SUMMARY OF THE INVENTION
本发明的目的在于提供一种护具辨识系统与护具辨识方法,当作业人员异常配戴护具时,其能立即警示并记录异常状况。The purpose of the present invention is to provide a protective gear identification system and a protective gear identification method, which can immediately warn and record the abnormal condition when the operator wears the protective gear abnormally.
本发明的一实施例是有关于一种护具辨识系统。An embodiment of the present invention relates to a protective gear identification system.
根据本发明的一实施方式,一种护具辨识系统包括影像撷取装置以及计算装置。影像撷取装置设置成撷取作业人员的影像。计算装置连接影像撷取装置并包括处理器、储存装置以及护具辨识模型数据库。储存装置连接处理器并用以储存影像。处理器辨识影像中作业人员的姿态。护具辨识模型数据库连接处理器并用以储存护具辨识模型。护具辨识模型记录护具在姿态下的所在位置。处理器根据护具辨识模型辨识影像中姿态的所在位置是否存在护具并输出辨识结果。According to an embodiment of the present invention, a protective gear identification system includes an image capturing device and a computing device. The image capturing device is configured to capture the image of the operator. The computing device is connected to the image capturing device and includes a processor, a storage device and a database of the protective gear identification model. The storage device is connected to the processor and used for storing images. The processor recognizes the posture of the operator in the image. The protective gear identification model database is connected to the processor and used for storing the protective gear identification model. The protective gear identification model records the position of the protective gear in the posture. The processor recognizes whether there is a protective device at the position of the posture in the image according to the protective device identification model and outputs the recognition result.
在本发明一个或多个实施方式中,前述护具辨识系统进一步包括显示器。显示器连接计算装置。显示器设置以显示交互界面。交互界面上呈现多个选项。处理器根据作业人员的姿态选择多个选项其中之一。In one or more embodiments of the present invention, the aforementioned protective gear identification system further includes a display. The display is connected to the computing device. Display settings to display the interactive interface. Multiple options are presented on the interactive interface. The processor selects one of the multiple options based on the operator's posture.
在本发明的一些实施方式中,处理器根据作业人员选择的选项设置作业人员的身份以及需要被辨识的护具。In some embodiments of the present invention, the processor sets the identity of the operator and the protective gear to be identified according to the option selected by the operator.
在本发明一个或多个实施方式中,储存装置进一步设置成储存作业人员的设备使用信息。处理器根据设备使用信息从护具辨识模型数据库中选择出护具辨识模型。In one or more embodiments of the present invention, the storage device is further configured to store the equipment usage information of the operator. The processor selects the protective gear identification model from the protective gear identification model database according to the equipment usage information.
在本发明一个或多个实施方式中,前述护具辨识系统进一步包括服务器。服务器远端连接计算装置。服务器用以接收作业人员的影像。服务器根据影像训练并提供护具辨识模块至计算装置的护具辨识模型数据库。In one or more embodiments of the present invention, the aforementioned protective gear identification system further includes a server. The server is remotely connected to the computing device. The server is used to receive images of workers. The server trains and provides the protective gear identification module to the protective gear identification model database of the computing device according to the image.
在本发明一个或多个实施方式中,前述护具辨识系统进一步包括传送装置。传送装置连接处理器。当处理器输出辨识结果,传送装置传送影像与辨识结果至个人电子装置。In one or more embodiments of the present invention, the aforementioned brace identification system further includes a transmission device. The transfer device is connected to the processor. When the processor outputs the identification result, the transmitting device transmits the image and the identification result to the personal electronic device.
本发明的另一实施例是有关于一种护具辨识方法。Another embodiment of the present invention relates to a method for identifying a protective gear.
根据本发明的一实施方式,一种护具辨识方法包括以下流程。撷取作业人员的影像。辨识作业人员在影像中的姿态。确认影像中的作业人员是否穿戴护具。确认影像中的作业人员是否穿戴护具包括以下流程。根据护具辨识模型获得护具在姿态下的所在位置。确认作业人员在影像中的姿态的所在位置是否存在护具,以输出辨识结果。According to an embodiment of the present invention, a method for identifying a protective gear includes the following processes. Capture images of workers. Identify the pose of the operator in the image. Check if the worker in the image is wearing protective gear. Checking whether the worker in the image is wearing protective gear involves the following procedure. Obtain the position of the protective gear in the posture according to the protective gear identification model. Confirm whether there is a protective gear at the position of the operator's posture in the image, and output the recognition result.
在本发明一个或多个实施方式中,前述护具辨识方法进一步包括以下流程。通过显示器显示多个选项。根据作业人员在影像中的姿态选择多个选项其中之一,以根据作业人员选择的选项设置作业人员的身份以及需要被辨识的护具。In one or more embodiments of the present invention, the aforementioned method for identifying a protective gear further includes the following processes. Display multiple options through the display. Select one of the multiple options according to the operator's posture in the image, so as to set the operator's identity and the protective gear that needs to be identified according to the option selected by the operator.
在本发明的一些实施方式中,前述护具辨识方法进一步包括以下流程。传送作业人员的身份以及辨识结果至个人电子装置。In some embodiments of the present invention, the aforementioned method for identifying a protective gear further includes the following processes. Send the operator's identity and identification results to the personal electronic device.
在本发明的一些实施方式中,当确认影像中的作业人员是否穿戴护具的流程超过设定时间,显示器重新显示选项供作业人员选择。In some embodiments of the present invention, when the process of confirming whether the operator in the image is wearing protective gear exceeds a set time, the display redisplays options for the operator to select.
综上所述,本发明提供一种非接触式的护具辨识系统,以及相应能够使用的护具辨识方法,利用边缘运算与机器视觉,结合人工智能影像辨识来辅助安全检查,当异常配戴时,能立即警示并记录异常状况,已达到防护器具的正确配戴性并提升作业人员工安意识。In summary, the present invention provides a non-contact protective gear identification system and a corresponding protective gear identification method that can be used, using edge computing and machine vision, combined with artificial intelligence image recognition to assist safety inspection, when abnormal wear It can immediately warn and record abnormal conditions, and achieve the correct wearability of protective equipment and improve the safety awareness of operators.
应理解到,以上的一般说明与以下的详细描述都是通过示例做进一步说明,旨在为本发明提供做进一步的解释。It should be understood that both the above general description and the following detailed description are further described by way of example, and are intended to provide further explanation for the present invention.
附图说明Description of drawings
本发明的优点与附图,应由接下来列举的实施方式,并参考附图,以获得更好的理解。这些附图的说明仅仅是列举的实施方式,因此不该认为是限制了个别实施方式,或是限制了权利要求的范围。The advantages of the present invention and the accompanying drawings should be better understood from the embodiments enumerated below, with reference to the accompanying drawings. The descriptions of these drawings are merely illustrative of the embodiments, and therefore should not be construed to limit individual embodiments, or to limit the scope of the claims.
图1根据本发明的一实施方式绘示护具辨识系统的示意方块图;1 shows a schematic block diagram of a protective gear identification system according to an embodiment of the present invention;
图2根据本发明的一实施方式绘示护具辨识方法的流程图;2 is a flowchart illustrating a method for identifying a protective gear according to an embodiment of the present invention;
图3示意地绘示捕捉作业人员的影像的示意图;3 schematically illustrates a schematic diagram of capturing an image of an operator;
图4与图5根据本发明的一实施方式示意地绘示获取作业人员姿态的示意图;FIG. 4 and FIG. 5 schematically illustrate a schematic diagram of obtaining an operator's posture according to an embodiment of the present invention;
图6根据本发明的一实施方式绘示显示器上交互介面的示意图;6 is a schematic diagram illustrating an interactive interface on a display according to an embodiment of the present invention;
图7根据本发明的一实施方式绘示辨识作业人员一护具的示意图;7 is a schematic diagram of identifying a protective gear of an operator according to an embodiment of the present invention;
图8根据本发明的一实施方式绘示辨识作业人员另一护具的示意图;FIG. 8 is a schematic diagram of identifying another protective gear of an operator according to an embodiment of the present invention;
图9根据本发明的一实施方式绘示辨识作业人员未穿戴护具的示意图;以及FIG. 9 is a schematic diagram of identifying that an operator is not wearing protective gear according to an embodiment of the present invention; and
图10根据本发明的一实施方式绘示传送至个人电子装置的多个辨识结果。FIG. 10 illustrates a plurality of identification results transmitted to a personal electronic device according to an embodiment of the present invention.
主要附图标记说明:Description of main reference signs:
100-护具辨识系统,110-影像撷取装置,120-计算装置,125-处理器,130-储存装置,135-护具辨识模型数据库,140-传送装置,150-显示器,160-服务器,170-输入装置,200-影像,210-作业人员,215-围裙,220-袖套,225-面罩,230-手套,235-安全帽,240-鞋子,252-头部定位点,254-肩部定位点,256-颈部定位点,258-肘部定位点,260-手部定位点,262-腰部定位点,264-腿部定位点,266-脚部定位点,275-游标,277-选项,280-信息,281、282-检查框,300-个人电子装置,400-护具辨识方法,410~460-流程。100-protection identification system, 110-image capture device, 120-computing device, 125-processor, 130-storage device, 135-protector identification model database, 140-transmission device, 150-display, 160-server, 170-input device, 200-image, 210-worker, 215-apron, 220-sleeve, 225-mask, 230-glove, 235-hard hat, 240-shoe, 252-head anchor point, 254-shoulder Anchor point, 256-neck anchor point, 258-elbow anchor point, 260-hand anchor point, 262-waist anchor point, 264-leg anchor point, 266-foot anchor point, 275-cursor, 277 - Options, 280 - Information, 281, 282 - Check Boxes, 300 - Personal Electronic Device, 400 - Armor Identification Method, 410 to 460 - Process.
具体实施方式Detailed ways
下文列举实施例配合所附附图进行详细说明,但所提供的实施例并非用以限制本发明所涵盖的范围,而结构运作的描述非用以限制其执行的顺序,任何由元件重新组合的结构,所产生具有均等功效的装置,皆为本发明所涵盖的范围。另外,附图仅以说明为目的,并未依照原尺寸作图。为使便于理解,下述说明中相同元件或相似元件将以相同的符号标示来说明。The following examples are described in detail with the accompanying drawings, but the provided examples are not intended to limit the scope of the present invention, and the description of the structure and operation is not intended to limit the order of its execution. Any recombination of elements The structure and the resulting device with equal efficacy are all within the scope of the present invention. In addition, the drawings are for illustrative purposes only, and are not drawn in full scale. In order to facilitate understanding, the same or similar elements in the following description will be described with the same reference numerals.
除非另有定义,本文所使用的所有词汇(包括技术和科学术语)具有其通常的意涵,其意涵是能够被熟悉此领域者所理解。更进一步的说,上述的词汇在普遍常用的字典中的定义,在本说明书的内容中应被解读为与本发明相关领域一致的意涵。除非有特别明确定义,这些词汇将不被解释为理想化的或过于正式的意涵。Unless otherwise defined, all terms (including technical and scientific terms) used herein have their ordinary meanings as understood by those skilled in the art. Furthermore, the definitions of the above words in commonly used dictionaries should be interpreted as meanings consistent with the relevant fields of the present invention in the content of this specification. Unless specifically defined, these terms are not to be construed in an idealized or overly formal sense.
关于本文中所使用的“第一”、“第二”、…等,并非特别指称次序或顺位的意思,也非用以限定本发明,其仅仅是为了区别以相同技术用语描述的元件或操作而已。Regarding the "first", "second", ... etc. used in this document, it does not mean the order or sequence, nor is it used to limit the present invention, it is only used to distinguish elements described in the same technical terms or Operation only.
其次,在本文中所使用的用词“包含”、“包括”、“具有”、“含有”等等,均为开放性的用语,即意指包含但不限于。Secondly, the terms "comprising", "including", "having", "containing" and the like used herein are all open-ended terms, ie, meaning including but not limited to.
再者,在本文中,除非内文中对于冠词有所特别限定,否则“一”与“该”可泛指单一个或多个。将进一步理解的是,本文中所使用的“包含”、“包括”、“具有”及相似词汇,指明其所记载的特征、区域、整数、步骤、操作、元件与/或组件,但不排除其所述或额外的其一个或多个其它特征、区域、整数、步骤、操作、元件、组件,与/或其中的群组。Furthermore, as used herein, unless the context specifically defines the article, "a" and "the" can generally refer to a single one or a plurality. It will be further understood that "comprising", "including", "having" and similar words used herein designate the recited features, regions, integers, steps, operations, elements and/or components, but do not exclude one or more of its other features, regions, integers, steps, operations, elements, components, and/or groups thereof, described or additional thereto.
为遵守安全规范,半导体的作业人员的护具是必要的。护具包括面罩、围裙以及手套等等。除了对作业人员宣导外,更需要一种自动且完善的检查流程,检查作业人员护具的穿戴情况。同时,检查流程与整体的系统交互界面,更应要顾虑到作业人员穿上护具后,不方便操作的情况。In order to comply with safety regulations, protective gear for semiconductor workers is necessary. Protective gear includes masks, aprons, and gloves. In addition to publicizing the operator, an automatic and complete inspection process is needed to check the wearing condition of the operator's protective gear. At the same time, the inspection process and the overall system interaction interface should also take into account the inconvenient operation of the operator after wearing the protective gear.
请参照图1。图1根据本发明的一实施方式绘示护具辨识系统100的示意方块图。通过护具辨识系统100,将能够辨识出作业人员是否穿戴护具。而作业人员也无需通过接触式的操作,即可启动护具辨识系统100。Please refer to Figure 1. FIG. 1 is a schematic block diagram of a protective
如图1所示,在本发明的一实施方式中,护具辨识系统100包括影像撷取装置110、计算装置120、显示器150、远端服务器160以及输入装置170。影像撷取装置110连接影像撷取装置110。显示器150以及输入装置170连接至计算装置120。护具辨识系统100的计算装置120能够远端分别连接至远端服务器160以及个人电子装置300。As shown in FIG. 1 , in an embodiment of the present invention, the protective
影像撷取装置110设置以撷取作业人员的影像。具体而言,在一些实施方式中,影像撷取装置110包括摄影机、相机或是CCD机器视觉。通过影像撷取装置110来即时撷取作业人员的影像,将能够即时获得作业人员的姿态,而使得作业人员能够通过改变自己的姿态来操作护具辨识系统100。具体请见后续的说明。The
影像撷取装置110连接计算装置120。计算装置120能够分析影像撷取装置110撷取的影像,借以获得例如包括作业人员姿态的相关信息。如图1所示,在本实施方式中,计算装置120包括处理器125、储存装置130、护具辨识模型数据库135以及传送装置140,储存装置130、护具辨识模型数据库135以及传送装置140分别连接至处理器125。The
处理器125能够辨识影像中作业人员的姿态。举例而言,处理器能够根据影像撷取装置110所撷取的影像,辨识出在影像中的作业人员的分布。在一些实施方式中,处理器能够通过一些去背的算法,去除作业人员的背景,来获得影像中作业人员的分布。随后,对于作业人员的分布,可以通过以机器学习/人工智能的方式,针对作业人员的不同部位标记定位点与连接线,从而辨别出作业人员的姿态。The
护具辨识模型数据库135用以储存护具辨识模型。护具辨识模型记录护具在作业人员的姿态下的所在位置。举例而言,在一些实施方式中,处理器125已经分析出影像中作业人员不同部位的定位点,根据护具辨识模型则可以记录在不同定位点上应穿戴何种护具。如此,处理器125能够通过物件辨识的算法,辨别出在定位点上,是否存在特定的护具,从而输出辨识结果。在一些实施方式中,输出的辨识结果可以详列影像中作业人员姿态的定位点上是否存在特定护具。The protective gear
在本实施方式中,计算装置120的储存装置130能够用以储存处理器125输出的辨识结果。处理器125输出的辨识结果,也能够通过传送装置140远端发送至个人电子装置300。个人电子装置300例如是作业人员的上级主管的个人电脑或是服务器。如此一来,作业人员的上级主管将能够确认作业人员是否穿戴护具。留存的辨识结果的记录,也有利于后续的责成与宣导。In this embodiment, the
显示器150连接计算装置120。在本实施方式中,显示器150设置以显示交互界面。交互界面上呈现多个选项。处理器125根据作业人员的姿态选择这些选项其中之一。如此,在作业人员穿戴护具的情况下,无须通过接触式的介面,即可实现护具辨识系统100的操作。
举例而言,对防护穿戴数据建档,计算装置120的储存装置130事先储存多个作业人员的设备使用信息,并借此提供多个选项。在作业人员非接触地触发护具辨识系统100后,显示器150上呈现多个选项。影像撷取装置110撷取作业人员的影像后,处理器125分析作业人员的影像来获取作业人员的姿态,并设定以作业人员的手部定位点移动,来对应显示器150上用于操作的游标的移动。同时,显示器150上的交互介面也根据多个作业人员的设备使用信息提供多个选项。如此,作业人员通过手部定位点的移动来移动游标来选定选项。处理器125将能够根据作业人员选择的选项,来设置作业人员的身份以及需要被辨识的护具。For example, to file protective wear data, the
储存装置130所储存的护具辨识模型,能够通过远端服务器160来提供。具体而言,根据本发明的一些实施方式,在影像撷取装置110撷取作业人员的影像后,能够通过计算装置120的传送装置140将作业人员的影像传送至远端服务器160。远端服务器160接收作业人员的影像后,能够定制化的根据作业人员的影像训练出护具辨识模块。The protective gear identification model stored in the
例如,当作业人员是在厂区的特定位置进行护具检查,则影像中背景必然是相似的,在这样的前提下,远端服务器160能够定制化的对影像进行去背并进行姿态辨识的训练,以机器学习或人工智能方式训练出护具辨识模块。以机器学习或人工智能来训练,也可以对应特定类型/型号的护具做定制化的物件辨识训练,如此一来,远端服务器160能够完成护具辨识模块,实现后续处理器125所应用的AI影像辨识模型的建立,进而对作业人员是否穿戴护具的安全防护结果验证。For example, when the operator checks the protective gear at a specific location in the factory, the background in the image must be similar. Under this premise, the
在远端服务器160完成护具辨识模块的训练后,即可将护具辨识模块传送至计算装置120的储存装置130储存。如此一来,计算装置120的处理器125即可通过护具辨识模块,执行作业人员影像中作业人员的姿态辨识以及护具检查,实现边际运算的优势。After the
在本实施方式中,护具辨识系统100还连接输入装置170。输入装置170可以不为作业人员所使用。举例而言,输入装置170可以包括键盘及鼠标,计算装置120例如是个人电脑。如此,计算装置120在护具辨识系统100执行前,可以通过输入装置170做预先的设置。In this embodiment, the
为进一步具体说明护具辨识系统100的执行,请参照图2。图2根据本发明的一实施方式绘示护具辨识方法400的流程图。护具辨识方法400包括流程410至流程460。To further describe the execution of the protective
在流程410,护具辨识系统100进入待机模式。在待机模式下,根据获得的工作排程信息,护具辨识系统100的储存装置130已预载各种身份检测项目选项(如图6)以及相应的护具辨识模型,以供后续流程使用。In
在流程420,作业人员在穿戴护具后,非接触式地触发护具辨识系统100。举例而言,在一些实施方式中,得设置当护具辨识系统100的影像撷取装置110捕捉到包含作业人员的影像达一定时间后能够被触发。当护具辨识系统100触发后,对应影像撷取装置110撷取到作业人员的影像,并辨识出作业人员的姿态。In the
请参照图3。图3示意地绘示影像撷取装置110捕捉作业人员210的影像200的示意图。如图3所示,作业人员210穿戴的护具包括身体上的围裙215、手臂上的袖套220、手部的手套230、头部的面罩225、安全帽235以及脚部的鞋子240。而在图3所绘示影像撷取装置110撷取的影像200中,除作业人员210外,还包括作业人员210身后的背景,被图3中为了简单说明的目的而未绘示。Please refer to Figure 3. FIG. 3 schematically illustrates a schematic diagram of the
图4与图5根据本发明的一实施方式示意地绘示护具辨识系统100获取作业人员210姿态的示意图。FIGS. 4 and 5 are schematic diagrams illustrating the posture of the
在图4中,基于影像200,护具辨识系统100的处理器125能够进行去背,使得作业人员210在影像200的分布被取出,而能够单独的进行影像分析。In FIG. 4 , based on the
相较于图3,在图4中,处理器125能够在作业人员210身上标记多个定位点。这些定位点分别位在作业人员210的不同部位,借以反映作业人员210姿态的特征,因此定位点也被称作是特征点。在一些实施方式中,定位点(特征点)可以设置在影像中作业人员不同部位的各个关节,例如手肘、手腕、腰部、膝盖等等。关于设置定位点的方法,举例而言,处理器125可以通过姿态辨识的模型,在单独输入作业人员210在影像200中的分布后,以人工智能方式标记出定位点。在一些实施方式中,影像撷取装置110为摄影机,因此处理器125能够针对多个连续的去背的作业人员210的影像200做辨识,从而在作业人员210的各个关节上标记定位点。Compared to FIG. 3 , in FIG. 4 , the
如图4所示,作业人员210身上的定位点包括头部上的头部定位点252、肩膀附近的肩部定位点254、位于脖子的颈部定位点256、位于手臂关节的肘部定位点258、位于手掌位置的手部定位点260、位在腰围上的腰部定位点262、位在腿部关节的腿部定位点264以及位在脚底的脚部定位点266。As shown in FIG. 4 , the anchor points on the
在这些定位点之间,可以依照人体结构进行连线。举例而言在图4中,肩部定位点254-肘部定位点258-手部定位点260的连线,即对应到作业人员210手臂的姿态。腰部定位点262-腿部定位点264-脚部定位点266的连线,则对应到作业人员210腿部的姿态。因此,综合上述作业人员210的各个定位点与定位点之间的连线,即可反映出作业人员210的姿态,是以实现作业人员210的姿态辨识。Between these anchor points, lines can be made according to the human body structure. For example, in FIG. 4 , the line connecting the shoulder anchor point 254 - the elbow anchor point 258 - the
应留意到,图4绘示的姿态辨识方式仅是本发明的一实施例,而不应以此限制本发明所采用的姿态辨识算法。同样能够就作业人员210的影像200做影像分析,而能够定位出作业人员210在影像200中不同部位特征的算法,也包含在本发明中。It should be noted that the gesture recognition method shown in FIG. 4 is only an embodiment of the present invention, and should not limit the gesture recognition algorithm used in the present invention. Similarly, the image analysis can be performed on the
接续图4,在图5中,将辨识出的多个定位点以及定位点之间的连线载入影像200中的作业人员210上。一旦作业人员210在影像200中有所移动,各个定位点也将对应作业人员210的不同部位做移动,从而即时反映作业人员210的姿态变化。Continuing from FIG. 4 , in FIG. 5 , the identified multiple positioning points and the connection between the positioning points are loaded onto the
请回到图2,并同时参照图6。在流程430,作业人员210通过辨识出的姿态,来选择显示器150上交互介面呈现的身份检测项目。图6根据本发明的一实施方式绘示显示器150上交互介面的示意图。Please return to FIG. 2 and refer to FIG. 6 at the same time. In the
在图6绘示的显示器150上,交互介面呈现包括游标275以及多个选项277。选项277上标示时间、身份以及工作类型,对应到在不同作业时间下,不同身份的作业人员210进行不同工作类型的作业。On the
如前所述,在完成作业人员210的姿态辨识后,将可以通过例如作业人员210的手部定位点260来移动游标275。当游标275移动至特定的选项277上,显示器150的交互介面能够对应选项277的工作类型呈现信息280。如图6所示,在本实施方式中,信息280可以是表格,表示在选项277对应的工作类型下,应穿戴的防护器具(护具)名称以及护具所对应的部位。以图6呈现的信息280为例,防酸围裙215应位在身体、袖套220应位在手臂、面罩225与安全帽235应位在头部、防酸手套230应位在手部。在本实施方式中,不同的部分,对应到影像200中(如图5所示)作业人员210上一个或多个定位点。As mentioned above, after the gesture recognition of the
回到图2。进入到流程440,在完成身份检测项目的选项277的选择后,护具辨识系统100将根据作业人员210的选择来检查护具。以图6选项277对应的信息280为例,护具辨识系统100将检查身体、手臂、头部与手部。Back to Figure 2. Going to the
此时,护具辨识系统100处理器125将根据作业人员210的选择来选定储存装置130所储存的护具辨识模型。护具辨识模型记载在作业人员210的姿态中,不同护具的所在位置。具体而言,以本实施方式为例,护具辨识模型记载在不同护具应设置在对应的一个或多个定位点上。At this time, the
请参照图7。图7根据本发明的一实施方式绘示辨识作业人员210的一护具的示意图。在图7中绘示护具辨识系统100检查防酸手套230。此时,护具辨识系统100在影像200上提供检查框281。为检查手部,护具辨识系统100设置检查框281应包括整个手部定位点260,以物件辨识算法确认手部定位点260是否存在防酸手套230。以图7为例,作业人员210的两个手部定位点260上均存在防酸手套230。Please refer to Figure 7. FIG. 7 is a schematic diagram illustrating a protective gear for identifying the
图8根据本发明的一实施方式绘示辨识作业人员210另一护具的示意图。在图7中绘示护具辨识系统100检查防酸围裙215。此时,护具辨识系统100在影像200上提供检查框282。为检查身体,护具辨识系统100设置检查框282应包括所有肩部定位点254、腰部定位点262以及腿部定位点264。以图8为例,作业人员210在检查框282包括的范围,确实对应到作业人员210的身体,而在作业人员210的身体上存在防酸围裙215。FIG. 8 is a schematic diagram of identifying another protective gear of the
图9根据本发明的一实施方式绘示辨识作业人员210未穿戴护具的示意图。类似于图7,在图9中绘示出护具辨识系统100检查防酸手套230。在检查框281框记出的手部定位点260,护具辨识系统100很容易能够辨别出作业人员210并未穿戴防酸手套230。FIG. 9 is a schematic diagram of identifying that the
相似的,手臂上袖套220的检查,可以对应设置两组检查框分别包含肩部定位点254、肘部定位点258、手部定位点260,而在这两组检查框中是否存在袖套220。针对头部面罩225以及安全帽235的检查,则可以设置涵盖到头部定位点252的检查框,并确认这样的检查框中是否存在面罩225以及安全帽235。Similarly, for the inspection of the
如此一来,护具辨识系统100将能够完成流程440,完成对作业人员210护具穿戴的检查。若作业人员210有未穿戴的护具如图9所示,则护具辨识系统100可以在流程440等待检查时间,待作业人员210完成护具的穿戴。In this way, the protective
请回到图2。在流程450,确认作业人员210在流程440的检查时间是否超出设定的检查时间。如未超时,则代表作业人员210通过检查,将可进入到后续的流程460。若超时,则对应作业人员210未通过检查,护具辨识系统100退回流程440,显示器150的交互介面重新提供选项277供作业人员210确认选择的身份检测项目是否正确。Please go back to Figure 2. In
请同时参照图2以及图10。图10根据本发明的一实施方式绘示传送至个人电子装置300的多个辨识结果。Please refer to FIG. 2 and FIG. 10 at the same time. FIG. 10 illustrates a plurality of identification results transmitted to the personal
在流程460,护具辨识系统100的处理器125完成护具的检查后输出辨识结果,并通过传送装置140即时地将多个辨识结果传送至个人电子装置300。如前所述,个人电子装置300例如是作业人员210的主管的个人电脑或是记录用的服务器,以利相关单位调阅管理。In the
在图10提供的多笔辨识结果以表格呈现,表格的栏位包括时间、身份(类型)、(工作)种类、检测结果、正面照片以及背面照片。如图10所示,时间栏位记录护具辨识系统100检查作业人员的时间;身份栏位记录作业人员的工号;种类栏位记录工作类型;检测结果记录是否通过。如果通过,则提供正面照片与背面照片。The multiple recognition results provided in FIG. 10 are presented in a table, and the fields of the table include time, identity (type), (job) type, detection result, front photo and back photo. As shown in FIG. 10 , the time field records the time when the protective
以工号R20029的作业人员为例,其工作种类为月保,通过护具辨识系统100的检测(Pass),并提供正面照片(档名imgfront)以及背面照片(档名imageback)。Take the worker with the job number R20029 as an example, whose job type is monthly insurance, and passes the detection (Pass) of the protective
对于工号H81806的作业人员,其工作种类为换酸,但未通过护具辨识系统100的检测(fail)。由于未通过检测,也无须留下照片。For the worker with job number H81806, his work type is acid replacement, but he fails the detection (fail) of the protective
在检查完毕后,护具辨识系统100可以回到流程410,进入待机模式,等待其他作业人员触发。After the inspection is completed, the protective
综上所述,本发明提供一种非接触式的护具辨识系统,以及相应能够使用的护具辨识方法。如此一来,利用边缘运算(Edging computing)与CCD(charge coupled device)机器视觉结合人工智能影像分析技术,将作业人员的安全防护配戴与数据库或特征点做比对。在作业前执行标准着装人工智能影像辨识。当异常配戴时,能立即警示并记录异常状况,已达到防护器具的正确配戴性并提升作业人员工安意识。而本发明采用主动侦测、非接触式AI人工智能侦测,一切通过辨识作业人员姿态来操作决定工号或取消侦测,以利作业人员在佩戴护具后,仍能够容易操作进行辨识检查。在一些实施方式中,本发明的护具辨识系统以及方法还能够用于AI工安机器人开发与导入。To sum up, the present invention provides a non-contact identification system for protective gear, and a corresponding protective gear identification method that can be used. In this way, edge computing and CCD (charge coupled device) machine vision combined with artificial intelligence image analysis technology are used to compare the safety protection wear of workers with the database or feature points. Perform standard attire AI image recognition before work. When it is abnormally worn, it can immediately warn and record the abnormal situation, which has achieved the correct wearability of protective equipment and improved the safety awareness of operators. The present invention adopts active detection and non-contact AI artificial intelligence detection. All operations determine the job number or cancel the detection by recognizing the posture of the operator, so that the operator can still easily operate the identification and inspection after wearing the protective gear. . In some embodiments, the protective gear identification system and method of the present invention can also be used for the development and introduction of AI industrial safety robots.
虽然本发明已经以实施例发明如上,然其并不用以限定本发明,任何本领域技术人员,在不脱离本发明的精神和范围内,当可作各种变动与润饰,因此本发明的保护范围当视权利要求所界定者为准。Although the present invention has been described above with examples, it is not intended to limit the present invention. Any person skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection of the present invention The scope shall be as defined by the claims.
对于本领域技术人员将显而易见的是,在不脱离本发明的范围或精神的情况下,可以对本发明实施例的结构进行各种修改和变化。鉴于前述内容,本发明旨在覆盖各种的修改与变形,只要它们落入所附权利要求的范围内。It will be apparent to those skilled in the art that various modifications and changes can be made in the structures of the embodiments of the present invention without departing from the scope or spirit of the invention. In view of the foregoing, the present invention is intended to cover various modifications and variations insofar as they fall within the scope of the appended claims.
Claims (10)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW109140621 | 2020-11-19 | ||
TW109140621A TWI779404B (en) | 2020-11-19 | 2020-11-19 | Protective gear identification system and protective gear identification method |
Publications (1)
Publication Number | Publication Date |
---|---|
CN114596579A true CN114596579A (en) | 2022-06-07 |
Family
ID=81802261
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202011421033.5A Pending CN114596579A (en) | 2020-11-19 | 2020-12-08 | Protective gear identification system and protective gear identification method |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN114596579A (en) |
TW (1) | TWI779404B (en) |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108399367A (en) * | 2018-01-31 | 2018-08-14 | 深圳市阿西莫夫科技有限公司 | Hand motion recognition method, apparatus, computer equipment and readable storage medium storing program for executing |
CN109800665A (en) * | 2018-12-28 | 2019-05-24 | 广州粤建三和软件股份有限公司 | A kind of Human bodys' response method, system and storage medium |
CN110263605A (en) * | 2018-07-18 | 2019-09-20 | 桂林远望智能通信科技有限公司 | Pedestrian's dress ornament color identification method and device based on two-dimension human body guise estimation |
CN110674712A (en) * | 2019-09-11 | 2020-01-10 | 苏宁云计算有限公司 | Interactive behavior recognition method and device, computer equipment and storage medium |
CN111199200A (en) * | 2019-12-27 | 2020-05-26 | 深圳供电局有限公司 | Wearing detection method and device based on electric protection equipment and computer equipment |
CN111801695A (en) * | 2018-03-01 | 2020-10-20 | 3M创新有限公司 | Personal protective equipment identification system |
CN111860422A (en) * | 2020-07-30 | 2020-10-30 | 西北师范大学 | Normative intelligent detection method for wearing protective equipment of medical staff |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWM457227U (en) * | 2013-02-04 | 2013-07-11 | Yong Dong Technology Co Ltd | Real-time identity authentication and image transmission of physiological information system |
US9610476B1 (en) * | 2016-05-02 | 2017-04-04 | Bao Tran | Smart sport device |
TWM582665U (en) * | 2019-03-28 | 2019-08-21 | 楊宇軒 | Artificial intelligence construction inspection system for construction safety |
-
2020
- 2020-11-19 TW TW109140621A patent/TWI779404B/en active
- 2020-12-08 CN CN202011421033.5A patent/CN114596579A/en active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108399367A (en) * | 2018-01-31 | 2018-08-14 | 深圳市阿西莫夫科技有限公司 | Hand motion recognition method, apparatus, computer equipment and readable storage medium storing program for executing |
CN111801695A (en) * | 2018-03-01 | 2020-10-20 | 3M创新有限公司 | Personal protective equipment identification system |
CN110263605A (en) * | 2018-07-18 | 2019-09-20 | 桂林远望智能通信科技有限公司 | Pedestrian's dress ornament color identification method and device based on two-dimension human body guise estimation |
CN109800665A (en) * | 2018-12-28 | 2019-05-24 | 广州粤建三和软件股份有限公司 | A kind of Human bodys' response method, system and storage medium |
CN110674712A (en) * | 2019-09-11 | 2020-01-10 | 苏宁云计算有限公司 | Interactive behavior recognition method and device, computer equipment and storage medium |
CN111199200A (en) * | 2019-12-27 | 2020-05-26 | 深圳供电局有限公司 | Wearing detection method and device based on electric protection equipment and computer equipment |
CN111860422A (en) * | 2020-07-30 | 2020-10-30 | 西北师范大学 | Normative intelligent detection method for wearing protective equipment of medical staff |
Also Published As
Publication number | Publication date |
---|---|
TWI779404B (en) | 2022-10-01 |
TW202221561A (en) | 2022-06-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Malaisé et al. | Activity recognition for ergonomics assessment of industrial tasks with automatic feature selection | |
US20190290202A1 (en) | System and method for ergonomic analysis, in particular of a worker | |
CN105565103B (en) | Elevator faults detection method and device | |
US20160070958A1 (en) | Obtaining metrics for a position using frames classified by an associative memory | |
CN111860422A (en) | Normative intelligent detection method for wearing protective equipment of medical staff | |
EP3001281B1 (en) | Obtaining metrics for a position using frames classified by an associative memory | |
Evangelista et al. | Advanced visualization of ergonomic assessment data through industrial Augmented Reality | |
Generosi et al. | A novel platform to enable the future human-centered factory | |
TWI779404B (en) | Protective gear identification system and protective gear identification method | |
CN112101288A (en) | Method, device and equipment for detecting wearing of safety helmet and storage medium | |
JP2020087091A (en) | Skill degree determination system | |
US20250001221A1 (en) | Touch-free seal check systems and methods for respiratory protection devices | |
CN110008870A (en) | Obj State alarm method and device | |
JP7406038B1 (en) | Work support system and work support method | |
Lanzoni et al. | Manual tasks real-time ergonomic evaluation for collaborative robotics | |
Fang et al. | Continuous ergonomic risk perception for manual assembly operations using wearable multi-sensor posture estimation | |
WO2020107113A1 (en) | Apparel for ergonomic evaluation | |
CN111476135B (en) | Abnormal Human Activity Recognition System Using Wearable Electronic Devices | |
Purushothaman et al. | Smart vision-based analysis and error deduction of human pose to reduce musculoskeletal disorders in construction | |
CN119399673A (en) | A protective clothing donning and doffing assessment system | |
US20250094911A1 (en) | Physical demands characterization system and methods | |
Park et al. | Next-Generation Custom-Fit Reusable Respiratory Protective Device with Continuous Fit Monitoring–Part I: Custom-Fit Design | |
TWI791407B (en) | Smart health check system and method | |
Fan et al. | Real-Time Ergonomic Risk Assessment Approach for Construction Workers Based on Computer Vision | |
Yu et al. | 3D posture estimation from 2D posture data for construction workers |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |