CN111855656A - Hand washing effect detection device and method - Google Patents
Hand washing effect detection device and method Download PDFInfo
- Publication number
- CN111855656A CN111855656A CN202010705292.4A CN202010705292A CN111855656A CN 111855656 A CN111855656 A CN 111855656A CN 202010705292 A CN202010705292 A CN 202010705292A CN 111855656 A CN111855656 A CN 111855656A
- Authority
- CN
- China
- Prior art keywords
- hand
- visible light
- light camera
- area
- highlight area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/107—Static hand or arm
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Image Processing (AREA)
Abstract
The invention discloses a hand washing effect detection device and method. A hand washing effectiveness detecting apparatus, comprising: a visible light camera and a non-visible light camera provided with an infrared lamp; the visible light camera and the non-visible light camera are arranged above or laterally above the hand washing sink; moreover, the visible light camera and the non-visible light camera equipped with infrared lamps can simultaneously identify the hands in the identification area. The invention has the beneficial effects that: by combining the visible light and non-visible light image recognition technologies, the problem that a visible light camera cannot recognize whether the hand sanitizer is applied or not by using chromatic aberration is solved, the problem that a non-visible light camera can only recognize the hand sanitizer is solved, and various defects caused by using a single technology are overcome.
Description
Technical Field
The invention relates to the field of hand washing detection, in particular to a hand washing effect detection device and method.
Background
The prior art cannot monitor the direct effect of hand washing and can only infer the hand washing effect in an indirect way. For example, whether the hand washing reaches a certain time is indirectly judged by monitoring the use time points of a faucet switch and a dryer, and if the hand washing reaches the certain time, the hand washing is considered to be in accordance with the requirements, so that the hand washing is effective;
For another example, whether the hand washing gesture conforms to the standard gesture is visually recognized through the camera, so that whether the hand washing effect is achieved is judged. The defect of the judgment mode is that the visual identification failure rate is high, and the quick action is difficult to judge; the hand washing effect can be indirectly inferred only by the posture, which is a necessary and insufficient condition for the hand washing effect.
Disclosure of Invention
The invention aims to solve the technical problem of providing a hand washing effect detection device and method, which directly monitor two core points of whether a hand sanitizer is uniformly applied and whether clear water is flushed completely, and can determine whether the hand washing effect is achieved no matter which method is used by a hand washer.
In order to solve the above technical problems, the present invention provides a hand washing effect detection apparatus, comprising: a visible light camera and a non-visible light camera provided with an infrared lamp; the visible light camera and the non-visible light camera are arranged above or laterally above the hand washing sink; moreover, the visible light camera and the non-visible light camera equipped with infrared lamps can simultaneously identify the hands in the identification area.
In one embodiment, the device further comprises a calibration plate, and the calibration plate is arranged in the identification area.
Based on the same inventive concept, the invention also provides a hand washing effect detection method of the hand washing effect detection device, which comprises the following steps:
the visible light camera identifies hands placed in the identification area, wherein the hand is coated with a hand sanitizer added with glass bead powder before identification;
the non-visible light camera shoots a hand placed in the identification area to form a highlight area;
and comparing the image containing the hand shot by the visible light camera with the highlight area, and if the image containing the hand shot by the visible light camera is superposed with the highlight area and no black spot exists in the highlight area, determining that the hand sanitizer is uniformly smeared.
In one embodiment, the hand is a single hand or two hands.
In one embodiment, the hand sanitizer is prompted to be uniformly applied by characters in the process of comparing the image of the hand shot by the visible light camera and containing the hand with the highlight area, and if the image of the hand shot by the visible light camera is overlapped with the highlight area and no black dot exists in the highlight area.
In one embodiment, the hand sanitizer is prompted to be uniformly applied by sound in the process of comparing the image of the hand shot by the visible light camera and containing the hand with the highlight area, and if the image of the hand shot by the visible light camera is overlapped with the highlight area and no black dot exists in the highlight area.
In one embodiment, the method further comprises the following steps: and comparing the image containing the hand shot by the visible light camera with the highlight area, and if the highlight area is missing or a black spot or an area with large brightness deviation exists in the highlight area compared with the image containing the hand shot by the visible light camera, determining that the hand sanitizer is not uniformly coated.
In one embodiment, in the step of comparing the image of the hand including the hand shot by the visible light camera with the highlight area shot by the non-visible light camera, and determining that the hand sanitizer is not uniformly applied if the highlight area is missing or has a black spot or a region with large brightness deviation in the highlight area compared with the image of the hand shot by the visible light camera, the hand sanitizer is not uniformly applied through characters.
In one embodiment, in the step of comparing the image of the hand including the visible light camera with the highlight area of the non-visible light camera, and determining that the hand sanitizer is not uniformly applied if the highlight area is missing from the image of the hand including the hand photographed by the visible light camera or the highlight area has a black spot or an area with large brightness deviation, the hand sanitizer is not uniformly applied through voice prompt.
In one embodiment, the method further comprises the following steps:
identifying a hand placed in the identification area by a visible light camera, and cleaning the hand with clean water to remove the hand sanitizer smeared with the glass bead powder;
if the hand placed in the identification area is shot by the non-visible light camera and no light reflection area or light reflection point is found, the hand is considered to be washed clean; if the non-visible camera shoots the hand placed in the identification area and finds the light reflection area or the light reflection point, the hand sanitizer is not washed clean.
The invention has the beneficial effects that:
by combining the visible light and non-visible light image recognition technologies, the problem that a visible light camera cannot recognize whether the hand sanitizer is applied or not by using chromatic aberration is solved, the problem that a non-visible light camera can only recognize the hand sanitizer is solved, and various defects caused by using a single technology are overcome.
Drawings
Fig. 1 is a schematic structural view of the hand washing effect detection device of the present invention.
Fig. 2 is a flow chart of the hand washing effect detection method of the invention.
Detailed Description
The present invention is further described below in conjunction with the following figures and specific examples so that those skilled in the art may better understand the present invention and practice it, but the examples are not intended to limit the present invention.
Referring to fig. 1, a hand washing effect detecting apparatus includes: a visible light camera and a non-visible light camera provided with an infrared lamp; the visible light camera and the non-visible light camera are arranged above or laterally above the hand washing sink; moreover, the visible light camera and the non-visible light camera equipped with infrared lamps can simultaneously identify the hands in the identification area.
Wherein, the camera that is furnished with the infrared lamp's effect is: the infrared lamp is coaxial with the camera and emits infrared light, and the infrared light is captured by the non-visible light camera after being reflected by an object, so that an infrared light image is obtained. If the non-visible light camera sets fixed parameter photosensitive parameters and the intensity of the infrared light is fixed, the reflecting performance of the object determines the definition of the infrared image. Adjusting parameters of a non-visible light camera and infrared light until an environment image becomes completely dark (common environment cannot be imaged due to reflection)
In one embodiment, the device further comprises a calibration plate, and the calibration plate is arranged in the identification area.
Wherein, in the identification area, mark the camera with the calibration board, article in the identification area can be discerned by visible light camera and non-visible light camera simultaneously.
Significance of the recognition area: influence of environment reflection is reduced, interference of other reflection points exists in the range of a camera, an identification area is defined (for example, the area is approximately in the chest of a regular person), the reflection points outside the range of the identification area can not be identified and judged, and the interference is reduced; and secondly, the identification range is reduced, and the calculation amount can be reduced.
The significance of calibration is as follows: the calibration board can be used for determining the conversion relation between the physical size and the pixels and determining the mutual relation between the three-dimensional geometric position of a certain point on the surface of the space object and the corresponding point in the image, so that the formed image can be more accurate. Secondly, after calibration is finished, the visible light image and the non-visible light image establish a corresponding relation, and the visible light image and the non-visible light image can be compared subsequently.
It should be noted that, when the hand washing effect detection device provided by the invention is used, the hand washing solution added with the glass bead powder is needed to be used, the glass bead powder is added into the hand washing solution, the glass beads have extremely strong retro-reflection performance, more than 85% of light can be reflected to the light source, coaxial infrared light emitted by the infrared lamp is retro-reflected by the glass beads in the hand washing solution, and after being captured by the non-visible light camera, the coaxial infrared light becomes a highlight area with a great contrast with the background in an image.
Based on the same inventive concept, the invention also provides a hand washing effect detection method of the hand washing effect detection device, which comprises the following steps:
the visible light camera identifies hands placed in the identification area, wherein the hand is coated with a hand sanitizer added with glass bead powder before identification;
the non-visible light camera shoots a hand placed in the identification area to form a highlight area;
and comparing the image containing the hand shot by the visible light camera with the highlight area, and if the image containing the hand shot by the visible light camera is superposed with the highlight area and no black spot exists in the highlight area, determining that the hand sanitizer is uniformly smeared.
The image of the hand shot by the visible light camera is overlapped with the highlight area, which indicates that the hand edge is coated with the liquid soap, and when no black dot is arranged in the highlight area, the hand edge is coated with the liquid soap.
In one embodiment, the hand is a single hand or two hands. That is, the present invention is applicable to either one hand or both hands.
In one embodiment, the hand sanitizer is prompted to be uniformly applied by characters in the process of comparing the image of the hand shot by the visible light camera and containing the hand with the highlight area, and if the image of the hand shot by the visible light camera is overlapped with the highlight area and no black dot exists in the highlight area.
In one embodiment, the hand sanitizer is prompted to be uniformly applied by sound in the process of comparing the image of the hand shot by the visible light camera and containing the hand with the highlight area, and if the image of the hand shot by the visible light camera is overlapped with the highlight area and no black dot exists in the highlight area.
It is understood that the prompting mode is not limited to text prompting or voice prompting, and certainly, the prompting mode can be a light flashing mode, or a mode of sending fragrance, or a vibrating mode. The present invention does not limit the specific manner of presentation, as long as the effect is achieved.
In one embodiment, the method further comprises the following steps: and comparing the image containing the hand shot by the visible light camera with the highlight area, and if the highlight area is missing or a black spot or an area with large brightness deviation exists in the highlight area compared with the image containing the hand shot by the visible light camera, determining that the hand sanitizer is not uniformly coated.
And if the highlight area is missing compared with the image of the hand shot by the visible light camera, the inner page of the edge of the hand is coated with the hand sanitizer, and if the area has a black spot or a large brightness deviation, the hand is not coated with the hand sanitizer.
In one embodiment, in the step of comparing the image of the hand including the hand shot by the visible light camera with the highlight area shot by the non-visible light camera, and determining that the hand sanitizer is not uniformly applied if the highlight area is missing or has a black spot or a region with large brightness deviation in the highlight area compared with the image of the hand shot by the visible light camera, the hand sanitizer is not uniformly applied through characters.
In one embodiment, in the step of comparing the image of the hand including the visible light camera with the highlight area of the non-visible light camera, and determining that the hand sanitizer is not uniformly applied if the highlight area is missing from the image of the hand including the hand photographed by the visible light camera or the highlight area has a black spot or an area with large brightness deviation, the hand sanitizer is not uniformly applied through voice prompt.
It is understood that the prompting mode is not limited to text prompting or voice prompting, and certainly, the prompting mode can be a light flashing mode, or a mode of sending fragrance, or a vibrating mode. The present invention does not limit the specific manner of presentation, as long as the effect is achieved.
In one embodiment, the method further comprises the following steps:
identifying a hand placed in the identification area by a visible light camera, and cleaning the hand with clean water to remove the hand sanitizer smeared with the glass bead powder;
if the hand placed in the identification area is shot by the non-visible light camera and no light reflection area or light reflection point is found, the hand is considered to be washed clean; if the non-visible camera shoots the hand placed in the identification area and finds the light reflection area or the light reflection point, the hand sanitizer is not washed clean.
It can be understood that when a light reflecting region or a light reflecting point appears, it indicates that the hand sanitizer is not cleaned, because the glass bead powder is added into the hand sanitizer, the glass bead has a high light reflecting effect, and once the non-visible light camera finds that the hand sanitizer added with the glass bead powder can form the light reflecting region or the light reflecting point.
The invention has the beneficial effects that:
by combining the visible light and non-visible light image recognition technologies, the problem that a visible light camera cannot recognize whether the hand sanitizer is applied or not by using chromatic aberration is solved, the problem that a non-visible light camera can only recognize the hand sanitizer is solved, and various defects caused by using a single technology are overcome.
A specific application scenario of the present invention is described below:
Referring to fig. 2, the visible light camera and the non-visible light camera with the infrared lamp are arranged above or laterally above the hand sink, a camera identification area is set by the calibration plate, and hands (which can be single hands or double hands) in the identification area can be identified by the visible light camera and the non-visible light camera simultaneously.
Glass bead powder (glass beads have a high light reflection effect) is added into the hand sanitizer, when hands are washed, the hand sanitizer added with the glass bead powder is used for rubbing hands according to hand washing specifications, and when a hand sanitizer is considered to be evenly smeared on the hands, the hands are placed in an identification area. At the moment, the optical camera can identify an object and judge the object as a hand, the image containing the hand shot by the visible light camera is compared with the highlight area shot by the non-visible light through the data processing terminal, if the two images are overlapped and no black spot exists in the highlight area shot by the non-visible light camera, the hand sanitizer is considered to be uniformly smeared, and voice prompt (or text prompt) is given; if the highlight area shot by the non-visible light camera is compared with the visible light shot image, the highlight area is missing or the area with black dots, black spots and large brightness deviation exists in the highlight area compared with the image of the hand shot by the visible light camera, the hand sanitizer is considered not to be uniformly coated, and voice reminding (or text reminding) is performed.
When the hand-washing of the hand-washing person is finished, the hand is placed in the identification area again after the hand-washing person washes the hands, the optical camera can identify the object and judge the object as the hand, if the non-visible light camera does not find the light reflection area or point in the identification area, the washing is considered to be clean, and the voice prompt is given; if the non-visible light camera finds the light reflecting area and the point in the identification area, the hand sanitizer is not washed clean, and the voice is used for reminding.
The visible light camera and the non-visible light camera provided with the infrared lamp can be arranged above or laterally above the hand washing sink.
The above-mentioned embodiments are merely preferred embodiments for fully illustrating the present invention, and the scope of the present invention is not limited thereto. The equivalent substitution or change made by the technical personnel in the technical field on the basis of the invention is all within the protection scope of the invention. The protection scope of the invention is subject to the claims.
Claims (10)
1. A hand washing effectiveness detecting apparatus, comprising: a visible light camera and a non-visible light camera provided with an infrared lamp; the visible light camera and the non-visible light camera are arranged above or laterally above the hand washing sink; moreover, the visible light camera and the non-visible light camera equipped with infrared lamps can simultaneously identify the hands in the identification area.
2. The hand washing performance testing method of claim 2, further comprising a calibration plate disposed in the identification zone.
3. A hand washing effectiveness detecting method using the hand washing effectiveness detecting apparatus according to claim 1 or 2, comprising:
the visible light camera identifies hands placed in the identification area, wherein the hand is coated with a hand sanitizer added with glass bead powder before identification;
the non-visible light camera shoots a hand placed in the identification area to form a highlight area;
and comparing the image containing the hand shot by the visible light camera with the highlight area, and if the image containing the hand shot by the visible light camera is superposed with the highlight area and no black spot exists in the highlight area, determining that the hand sanitizer is uniformly smeared.
4. The hand washing effect detection method of claim 2, wherein the hand is one hand or both hands.
5. The hand washing effect detection method of claim 2, wherein the hand-containing image captured by the visible light camera is compared with the highlight area, and if the hand image captured by the visible light camera is overlapped with the highlight area and no black dot is in the highlight area, the hand washing solution is prompted to be uniformly applied through characters.
6. The hand washing effect detection method of claim 2, wherein the hand-containing image captured by the visible light camera is compared with the highlight area, and if the hand image captured by the visible light camera is coincident with the highlight area and no black dot is in the highlight area, the hand washing solution is prompted to be evenly applied through a sound.
7. The hand washing effect detection method of claim 2, further comprising: and comparing the image containing the hand shot by the visible light camera with the highlight area, and if the highlight area is missing or a black spot or an area with large brightness deviation exists in the highlight area compared with the image containing the hand shot by the visible light camera, determining that the hand sanitizer is not uniformly coated.
8. The hand washing effect detection method of claim 2, wherein the hand washing solution is considered not to be uniformly applied in the process that the image of the hand including the hand shot by the visible light camera is compared with the highlight area shot by the non-visible light camera, and the highlight area is compared with the image of the hand shot by the visible light camera and has a missing combination or a black spot or an area with large brightness deviation in the highlight area, and the hand washing solution is indicated not to be uniformly applied by characters.
9. The hand washing effect detection method of claim 2, wherein the hand washing solution is considered not to be uniformly applied in the process that the image of the hand including the hand shot by the visible light camera is compared with the highlight area shot by the non-visible light camera, and the highlight area is compared with the image of the hand shot by the visible light camera and has a defect, or a black spot or an area with large brightness deviation exists in the highlight area, and the hand washing solution is prompted not to be uniformly applied through voice.
10. The hand washing effect detection method of claim 2, further comprising:
identifying a hand placed in the identification area by a visible light camera, and cleaning the hand with clean water to remove the hand sanitizer smeared with the glass bead powder;
if the hand placed in the identification area is shot by the non-visible light camera and no light reflection area or light reflection point is found, the hand is considered to be washed clean; if the non-visible camera shoots the hand placed in the identification area and finds the light reflection area or the light reflection point, the hand sanitizer is not washed clean.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010705292.4A CN111855656A (en) | 2020-07-21 | 2020-07-21 | Hand washing effect detection device and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010705292.4A CN111855656A (en) | 2020-07-21 | 2020-07-21 | Hand washing effect detection device and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111855656A true CN111855656A (en) | 2020-10-30 |
Family
ID=73001974
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010705292.4A Pending CN111855656A (en) | 2020-07-21 | 2020-07-21 | Hand washing effect detection device and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111855656A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114549809A (en) * | 2022-02-23 | 2022-05-27 | 深圳Tcl新技术有限公司 | Gesture recognition method and related equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050105778A1 (en) * | 2003-11-19 | 2005-05-19 | Samsung Electronics Co., Ltd. | Apparatus and method for human distinction using infrared light |
| CN101210883A (en) * | 2007-12-21 | 2008-07-02 | 广州珠江啤酒股份有限公司 | Method for checking surface cleaning validity of sterile filling equipment |
| US20130215245A1 (en) * | 2010-09-27 | 2013-08-22 | Budapesti Muszaki Es Gazdasagtudomanyi Egyetem | Method and apparatus for hand disinfection quality control |
| CN109726668A (en) * | 2018-12-25 | 2019-05-07 | 大连海事大学 | Hand washing and disinfecting flow normative automatic detection method based on computer vision |
| CN110100268A (en) * | 2016-12-14 | 2019-08-06 | 手扫描股份有限公司 | The method of disinfection and the sterilisation quality's control of hand for user and the equipment for executing this method |
-
2020
- 2020-07-21 CN CN202010705292.4A patent/CN111855656A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050105778A1 (en) * | 2003-11-19 | 2005-05-19 | Samsung Electronics Co., Ltd. | Apparatus and method for human distinction using infrared light |
| CN101210883A (en) * | 2007-12-21 | 2008-07-02 | 广州珠江啤酒股份有限公司 | Method for checking surface cleaning validity of sterile filling equipment |
| US20130215245A1 (en) * | 2010-09-27 | 2013-08-22 | Budapesti Muszaki Es Gazdasagtudomanyi Egyetem | Method and apparatus for hand disinfection quality control |
| CN110100268A (en) * | 2016-12-14 | 2019-08-06 | 手扫描股份有限公司 | The method of disinfection and the sterilisation quality's control of hand for user and the equipment for executing this method |
| CN109726668A (en) * | 2018-12-25 | 2019-05-07 | 大连海事大学 | Hand washing and disinfecting flow normative automatic detection method based on computer vision |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114549809A (en) * | 2022-02-23 | 2022-05-27 | 深圳Tcl新技术有限公司 | Gesture recognition method and related equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200116652A1 (en) | Method and device for detecting defect of cover lens in laser welding system on automobile production line | |
| CN107154039B (en) | Rubber tube online defect detection method | |
| KR20180004046A (en) | Apparatus and method for inspection | |
| JP2012045610A (en) | Apparatus and method for determining shape of end of bead | |
| CN110441316B (en) | Battery surface defect detection method and detection system | |
| JP2008170325A (en) | Spot defect detection method and spot defect detection apparatus | |
| JP2007285754A (en) | Defect detection method and defect detection apparatus | |
| JP2010019667A (en) | Image measuring apparatus and computer program | |
| CN103389312B (en) | Copper pipe detection system | |
| CN110021012B (en) | Mobile phone lens window glass defect detection method based on machine vision technology | |
| CN111855656A (en) | Hand washing effect detection device and method | |
| CN115791806B (en) | Imaging method, electronic device, and medium for detecting automobile paint surface defects | |
| CN105205803A (en) | Display panel defect detection method | |
| JP6967131B2 (en) | Polarizing plate inspection method and inspection equipment | |
| CN103018254A (en) | Automatic detection device based on image identification technology | |
| CN113984791A (en) | Defect detection method, defect detection device, optical imaging system, optical imaging equipment and storage medium | |
| CN108362227A (en) | Wheel hub detection method, device, system and control device | |
| CN103175841B (en) | CTP (Computer to Plate) plate surface detection method and system based on machine vision | |
| CN113960071B (en) | Quality detection method and system for color printing products | |
| CN116413284A (en) | Method, device, equipment and storage medium for detecting front and back surfaces of embossed glass | |
| CN113658169A (en) | Image speckle detection method, apparatus, medium, and computer program product | |
| KR102117697B1 (en) | Apparatus and method for surface inspection | |
| CN109060831B (en) | Automatic dirt detection method based on bottom plate fitting | |
| KR20160101436A (en) | Method for inspectiong the outside of panels | |
| CN202693494U (en) | Copper pipe detection system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201030 |
|
| RJ01 | Rejection of invention patent application after publication |