JP2025017562A - Life Support System - Google Patents

Abstract

To provide a life support system that is extremely easy to use and is excellent in practicality.SOLUTION: A life support system includes: a mirror surface-type display device 1 which has a mirror surface part and a display part that can display an image in a manner of being superimposed on a mirror image; a treatment tool 3 which is used for grooming or beautifying a face part including hair of a user or oral cavity part; and a control part. The treatment tool 3 includes: a treatment head part which performs the grooming or beautification; and a camera part which captures a proximate image including a treatment object to be treated with the treatment head part. The control part is configured to acquire the proximate image captured by the camera part and display the proximate image in a manner of being superimposed on the mirror image of the user reflected on the mirror surface part by the display part.SELECTED DRAWING: Figure 1

Description

The present invention relates to a life support system.

Patent Document 1 discloses a technology in which an electric shaver is equipped with a camera for capturing images of facial hair, and the images captured by the camera are sent to a processing terminal such as a smartphone that performs processing to determine whether or not there is any hair that has not been shaved, and the results are notified by voice or other means.

Patent Document 2 also discloses a technology in which a toothbrush is equipped with a camera that takes pictures of the inside of the mouth, and the images taken by the camera are sent to a display such as a smartphone, allowing the user to brush their teeth thoroughly while visually checking the image of the inside of the mouth displayed on the display.

Patent Document 3 also discloses a technology in which the results (health and illness information) of an analysis using signals from biosensors (urine testing equipment, blood pressure and heart rate sensor, weight and tissue meter) installed in the home are displayed on a mirror display device that allows the user to simultaneously see an image displayed on a screen and a mirror image of the user reflected by the mirror, thereby projecting health and illness information in the mirror that reflects the user's image, allowing the user to naturally obtain health and illness information when looking at their own mirror image.

Patent No. 6444152 Utility Model Registration No. 3203253 JP 2018-42812 A

According to the technologies of Patent Documents 1 and 2, it is possible to prevent missed spots by photographing parts that are difficult to see even with a mirror with a camera and making them easier to see, but this is troublesome in that a separate processing terminal and display must be prepared, and when a separate processing terminal and display are used, since only the processing terminal and display are visible, it is not possible to completely eliminate missed spots, just as it is not possible to eliminate missed spots by enlarging a beard with a magnifying glass and checking the enlarged image while shaving (as the whole picture cannot be seen).

In other words, shaving and brushing one's teeth are usually done in front of a mirror at a bathroom sink, but using a separate processing terminal or display in conjunction with a mirror is troublesome (it requires an extra step in addition to the everyday grooming tasks that have been performed habitually up until now), and so it has not yet become widespread.

The technology in Patent Document 3 also requires the installation of biosensors in various places in the home in addition to the display device with a mirror surface, making it difficult to use.

The present invention aims to provide a life support system that is extremely easy to use and highly practical by providing a display function to the mirror of a washbasin, which is used daily when caring for or beautifying the face or oral cavity, and by providing a camera in a treatment tool such as a razor or toothbrush, and by superimposing a captured image on the mirror image of the user, an image of the user's facial hair or the inside of the oral cavity can be displayed. This allows the user to view their own mirror image and enlarged images of their facial hair or the inside of the oral cavity with the minimum necessary eye movement, without significantly changing their current habits.

Another objective is to provide a user-friendly life support system that can automatically perform simple health checks during everyday life without the need to install biosensors in various places in the home.

The gist of the present invention will be explained with reference to the attached drawings.

A life support system including a mirror-type display device 1 having a mirror surface and a display unit capable of displaying an image so as to be superimposed on the mirror image reflected on the mirror surface, a treatment tool 3 for grooming or beautifying a user's face including hair or oral cavity, and a control unit,
The processing tool 3 has a processing head unit for performing the maintenance or beautification, and a camera unit for taking a close-up image including a processing object to be processed by the processing head unit,
The control unit of this invention relates to a life assistance system characterized in that it is configured to acquire the close-up image taken by the camera unit and display it on the display unit by superimposing it on the mirror image of the user reflected on the mirror surface.

The life support system described in claim 1 is characterized in that the mirror-type display device 1 is provided on the washstand 2.

The life support system according to claim 1 is characterized in that the control unit performs visibility improvement processing to increase the visibility of the processing target object in the close-up image captured by the camera unit, and causes the display unit to display the close-up image after the visibility improvement processing.

The life support system described in claim 3 is characterized in that the processing tool 3 is provided with a lighting unit.

The life support system according to claim 2 is characterized in that the control unit performs visibility improvement processing to increase the visibility of the processing target object in the close-up image captured by the camera unit, and causes the display unit to display the close-up image after the visibility improvement processing.

The life support system described in claim 5 is characterized in that the processing tool 3 is provided with a lighting unit.

The present invention also relates to a life support system according to any one of claims 1 to 6, characterized in that the treatment tool 3 is a shaving tool and the treatment target is beard.

The life support system described in claim 7 is characterized in that the visibility improvement processing includes processing to enlarge the close-up image and processing to flip the close-up image horizontally.

The life support system described in claim 8 is characterized in that the visibility improvement processing includes processing for detecting the whiskers in the close-up image and highlighting the whiskers.

The present invention also relates to a life support system according to any one of claims 1 to 6, characterized in that the treatment tool 3 is a toothbrush and the treatment target is teeth and gums.

The life support system according to claim 10 is characterized in that the visibility improvement processing includes processing to enlarge the close-up image and processing to flip the close-up image horizontally.

The life support system described in claim 11 is characterized in that the visibility improvement processing includes processing for detecting areas of plaque or gingival inflammation in the close-up image and highlighting the areas of plaque or gingival inflammation.

The life support system according to claim 10 is characterized in that the control unit is configured to analyze the close-up image of the oral cavity and, if the analysis results indicate a health abnormality, to notify a medical institution or the user's relatives.

Also, a life support system including a washstand 2 equipped with a mirror-type display device 1 having a mirror surface and a display unit that displays an image so as to be superimposed on a mirror image reflected on the mirror surface, a camera unit, and a control unit,
the camera unit is provided at a position where it can capture an image of the face of the user reflected in the mirror surface of the mirror type display device 1;
The control unit is configured to measure biometric information from an image of the face captured by the camera unit, analyze the health condition of the user by comparing the measured values with values in a database of the user's past measurement results, and display the analysis results by the display unit, superimposing them on the mirror image of the user reflected in the mirror unit. This life assistance system is characterized in that it is configured to measure biometric information from an image of the face captured by the camera unit, analyze the health condition of the user by comparing the measured values with values in a database of the user's past measurement results, and display the analysis results by the display unit, superimposed on the mirror image of the user reflected in the mirror unit.

The life support system described in claim 14 is characterized in that the biological information is pulse wave, heart rate, SpO2 (oxygen saturation), pupil size, or facial color.

The life support system described in claim 15 is characterized in that the control unit performs analysis by comparing values measured by a toothbrush having a sensor capable of measuring pulse waves, heart rate, or SpO2 with values in the database of past measurement results.

The life support system described in claim 15 is characterized in that the washstand is provided with a speaker and a microphone, and the control unit is configured to acquire the user's response voice in response to the call, analyze the acquired response voice, and display the analysis result on the mirror surface.

The life support system described in claim 16 is characterized in that the washstand is provided with a speaker and a microphone, and the control unit is configured to acquire the user's response voice in response to the call, analyze the acquired response voice, and display the analysis result on the mirror surface.

The life support system according to any one of claims 14 to 18 is characterized in that the control unit is configured to notify a medical institution or the user's relatives if the analysis results indicate a health abnormality.

The present invention is configured as described above, so that users can view their own mirror image and images of their beard and the inside of their mouth with the minimum amount of eye movement necessary, without significantly changing their current habits, making it an extremely easy-to-use and highly practical life support system.

The invention described in claim 14 also provides a user-friendly life support system that can automatically perform simple health checks during everyday life without the need to install biosensors in various places in the home.

FIG. 1 is a schematic diagram illustrating a configuration of a first embodiment. FIG. 1 is a schematic explanatory perspective view of a washbasin. FIG. 2 is an explanatory diagram of a usage state when the shaver is used. FIG. 13 is an explanatory diagram of a state in which a toothbrush is used. 13 is a flowchart showing an example of an algorithm for highlighting plaque and the like. FIG. 2 is an image of teeth and gums before highlighting. FIG. 13 is an image of teeth and gums after highlighting. 11 is a flowchart showing an example of an algorithm for analyzing a health condition. 11 is a flowchart showing an example of an algorithm for analyzing a health condition.

The preferred embodiment of the present invention will be briefly explained below, showing the operation of the invention based on the drawings.

For example, when using the mirror surface of the mirror-type display device 2 installed on a washstand 1 used daily, when caring for the face or oral cavity (shaving, brushing teeth, etc.) or beautifying (applying makeup, etc.), a close-up image of the treatment area (cheeks or chin) including the beard, which is the treatment target, can be superimposed on the user's mirror image and enlarged without the need for a separate treatment terminal or display. The close-up image is explicitly displayed on the user's mirror image by AR (augmented reality), allowing the user to clearly see the treatment target while grasping the position and application of the treatment head of the treatment tool 3 (the user can see the close-up image with the minimum necessary eye movement while viewing their own mirror image on the mirror surface), thereby eliminating areas left unshaved or unbrushed as much as possible. This makes it possible to perform the care and beautification more easily and efficiently while still feeling the same as in the user's previous lifestyle.

In addition, in the invention described in claim 14, the health condition of the user who uses the washbasin 1 is analyzed using an image of the face, and the analysis results are displayed on the mirror surface, so that a simple health check can be performed automatically just by standing in front of the washbasin 1 every day. Also, for example, if a health abnormality is detected, a message can be automatically sent to a medical institution or relatives, making it possible to check the safety of the user on a daily basis.

Specific examples of the present invention will be described with reference to the drawings.

This embodiment is a life support system that includes a washstand 2 equipped with a mirror-type display device 1 having a mirror surface and a display unit that can display an image so as to be superimposed on the mirror image reflected in the mirror surface, a treatment tool 3 for grooming or beautifying the user's face, including hair, or oral cavity, and a control unit.

Specifically, the processing tool 3 has a processing head unit for performing the maintenance or beautification, and a camera unit for taking close-up images including the object to be processed by the processing head unit. The processing tool 3 also has a lighting unit for taking good images. The processing tool 3 also has a transmission unit for transmitting the close-up images taken by the camera unit to the control unit (each processing tool 3 and the control unit are connected via a network).

The control unit is also configured to acquire the close-up image captured by the camera unit and display the image on the display unit so as to be superimposed on the mirror image of the user reflected on the mirror surface.

Each part will be explained in detail.

Figure 1 is a schematic diagram of the configuration of this embodiment, and Figure 2 is a schematic perspective view of the washbasin. In the figure, the symbol M is the mirror image of the user, and A is the close-up image display area.

The washstand 1 (vanity unit) has a mirror section at the top that can reflect at least part of the upper body, including the face, which is a mirror-type display device 2, and the faucet, bowl, storage section, etc. at the bottom can be configured in the same way as known washstands. For example, a commercially available washstand can be used in which the mirror section has been replaced with the mirror-type display device 2.

The mirror-type display device 2 can be a display with a known mirror function, such as a half-mirror type display in which a display unit is provided on the rear side of the reflective surface of a transparent half-mirror, allowing the user to simultaneously view their own mirror image reflected in the half-mirror and the image on the display unit that passes through the half-mirror.

The display is a touch panel, allowing the display of close-up images to be turned on and off and the display area of the close-up images to be changed using the same operations as on a smartphone or tablet. The washbasin 1 (mirror display device 2) may also be provided with a camera and microphone for photographing the user, allowing the control unit to configure the display as a smart display that can be operated using gestures and voice.

The treatment tool 3 may be a toothbrush with a camera, a shaver with a camera (electric shaver), an earpick with a camera, a nose hair trimmer with a camera, or a hair and makeup tool with a camera. In this embodiment, examples using a toothbrush and a shaver in particular will be described.

The control unit can be configured, for example, by a computer having a processor, memory, storage, a transceiver, I/O, etc.

In this embodiment, the control unit is provided in the washstand 1 (behind the mirror-type display device 2). The control unit acquires the close-up images transmitted from each processing tool 3, and controls the display unit to appropriately display the close-up images in the close-up image display area A of the mirror-type display device 2.

In this embodiment, the control unit is configured to perform visibility improvement processing to increase the visibility of the processing target object in the close-up image captured by the camera unit while appropriately using the illumination unit, and to cause the display unit to display the close-up image that has been subjected to the visibility improvement processing.

Figure 3 shows an example of a close-up image superimposed on the mirror image M of a user shaving with a razor. In this embodiment, the close-up image display area A is a vertically elongated ellipse, but it can be set appropriately to a rectangular shape, a horizontally elongated ellipse, or other shape. The area, position, magnification, etc. of the close-up image display area A can also be set appropriately. It is preferable to display the close-up image display area A below the face of the mirror image M of the user.

In the case of a razor, the control unit processes the close-up image to enlarge it and to invert (mirror) it. If necessary, the control unit may also process the close-up image to invert or rotate it.

The control unit also detects whiskers as processing objects in the close-up image and processes the whiskers to highlight them. Specifically, for example, the control unit divides the close-up image into units (cells) of a certain size, and determines whether or not a whisker is present for each cell (for example, determining that a whisker is present when the cell contains black, brown, and white colors), and fills the cells that are determined to contain whiskers with a color that is recognizable as a whisker.

By explicitly showing the location of your beard, you can be sure you know which beards you need to shave, and you can minimize the amount of hair you miss.

Figure 4 shows an example of superimposing a close-up image on a mirror image M of a user brushing their teeth with a toothbrush.

In the case of a toothbrush, the control unit performs processing to enlarge the close-up image, processing to flip the close-up image from left to right, and processing to detect plaque and inflamed areas of the gums and teeth as the processing target in the close-up image and highlight the plaque and inflamed areas of the gums. Note that the close-up image may also be flipped upside down or rotated as necessary.

By clearly displaying areas of plaque and inflamed gums, users can easily understand which areas to focus on brushing and can eliminate any areas left unbrushed.

Specifically, the highlighting of plaque and inflamed areas of the gums (areas of the gums with periodontal disease) is performed using, for example, the algorithm shown in Figure 5. Figure 6 shows an image of the teeth and gums before highlighting, and Figure 7 shows an image of the teeth and gums after highlighting.

Each step (S) in FIG. 5 will be described.
S51: When a close-up image is acquired, image analysis is started.
S52: The proximity image is divided into units (cells) of a certain size.
S53: A cell to be analyzed is selected.
S54: The attributes (color, brightness, etc.) of the data in the selected cell are compared with the attributes of sample data measured in the past.
S55: If it is determined that the attributes of the data of the selected cell are similar to the attributes of the data of normal teeth, proceed to S61.
S56: If it is determined that the attributes of the data of the selected cell are similar to the attributes of the data of normal gums (gingiva), the process proceeds to S61.
S57: If it is determined that the attributes of the data in the selected cell are similar to the attributes of the plaque data, the cell is filled in with a color that indicates plaque (S58), and the process proceeds to S61.
S59: If it is determined that the attributes of the data in the selected cell are similar to the attributes of data for periodontal disease (inflamed gums), the cell is filled in with a color that indicates periodontal disease (S60), and the process proceeds to S61.
S61: It is determined whether the comparison of attributes of all cells has been completed. If there are any remaining cells, the process returns to S53, and is repeated until the comparison of attributes of all cells has been completed.
S62: End image analysis.

By highlighting important parts in the close-up image as described above, it is possible to display them clearly and in an extremely easy-to-understand manner to the user, allowing them to shave and brush their teeth efficiently and minimizing missed areas when shaving or brushing.

In this embodiment, an example is described in which a shaver and a toothbrush are used as the treatment tool 3, but the same applies to other treatment tools 3. For example, in the case of an earpick, earwax is highlighted, and in the case of a nose hair trimmer, nose hair is highlighted, allowing for efficient care.

In addition, when using a toothbrush, the control unit may be configured to analyze close-up images to determine whether there are any health abnormalities in the oral cavity, and if there are any abnormalities, to notify a medical institution (the user's dentist) or the user's relatives of the abnormality or to automatically make a medical appointment (similarly, it may be possible to notify or make an appointment with a dermatologist for shaving tools, and an otolaryngologist for nose hair trimmers and ear picks). In addition, if there are any abnormalities, the mirror may display a message recommending a visit to the hospital or a dental checkup, or display findings or messages calling the user's attention (such as stress building up, or a value higher or lower than usual), or display promotional information such as information on recommended medicines or health foods.

Since this embodiment is configured as described above, when the mirror surface of the mirror-type display device 2 installed on the washstand 1 used daily is used to care for and beautify the face and oral cavity, a close-up image of the treatment area (cheeks and chin) including the whiskers, which is the treatment object, can be superimposed on the mirror image of the user and enlarged and displayed without the need for a separate treatment terminal or display. Since the close-up image is explicitly displayed on the user's own mirror image by AR (augmented reality), the user can clearly see the treatment object while grasping the position and application of the treatment head of the treatment tool 3 (the close-up image can be seen with the minimum necessary line of sight movement while seeing the mirror image of the user), and therefore, it is possible to eliminate areas that are left unshaved or unbrushed as much as possible. Therefore, the care and beautification can be performed more easily and efficiently while feeling the same as in the past.

As a result, this embodiment is a life support system that is extremely easy to use and highly practical.

Example 2 is an example of monitoring daily health conditions using a washstand 2 equipped with a mirror-type display device 1 similar to that of Example 1.

Specifically, the life support system is composed of a washstand 2 equipped with the above-mentioned mirror-type display device 1, a camera unit, and a control unit.

The camera unit in this embodiment is provided in a position where it can capture an image of the user's face reflected in the mirror surface of the mirror-type display device 1, and the control unit is configured to measure vital signs (physical information) such as pulse wave, heart rate, SpO2 (oxygen saturation), pupil size, or facial color from the image (video) of the face captured by the camera unit, analyze the health condition by comparing the measured values with values in a database of the user's past measurement results (AI may also be used), and display the analysis results by superimposing them on the mirror image of the user reflected in the mirror surface by the display unit. In this embodiment, the values of each vital sign are measured by analyzing changes in the brightness value of the image.

The measurement results database accumulates the values of each vital sign for each individual on each measurement date.

Specifically, health condition analysis from facial images is performed using the algorithm shown in Figure 8, for example.

Each step (S) in FIG. 8 will be described.
S81: Analysis begins.
S82: An image of the face is obtained.
S83: Identify an individual based on facial features.
S84: By analyzing the change in luminance value of the image, the pulse wave, heart rate, SpO2, pupil size, facial color, etc. are measured.
S85: The measured information is recorded for each individual in a database (S86) and is also displayed on the mirror surface.
S87: The current vital sign information (S84) is compared with the information in the database (S86) and analyzed, and health information is displayed.
S88: End the analysis.

The control unit may also be configured to perform analysis based on the results of comparing values measured by a toothbrush sensor capable of measuring pulse waves, heart rate, or SpO2 with values in the database of past measurement results, in addition to values measured from an image of the face.

In this case, the analysis can be performed, for example, using the algorithm shown in Figure 9.

Each step (S) in FIG. 9 will be described.
S91 to S93 are similar to S81 to S83 in Fig. 8. Also, S95 to S97 are similar to S85 to S87 in Fig. 8.
S94: By analyzing the change in luminance value of the image and the information acquired by the toothbrush sensor (S98), the pulse wave, heart rate, SpO2, pupil size, facial color, etc. For example, for vital signs that can be acquired by the toothbrush sensor, the values acquired by the toothbrush are used.
S99: The analysis ends.

The washbasin is also provided with a speaker and a microphone, and the control unit is configured to acquire the user's voice response to the call, analyze the acquired voice response, and display the analysis results on the mirror unit. For example, mental illnesses such as depression can be detected and displayed by voice analysis.

The control unit is also configured to notify a medical institution (family doctor) or the user's relatives of a message to that effect, or to automatically schedule a medical appointment, if the analysis results indicate a health abnormality. If an abnormality is indicated, the control unit may display a message on the mirror surface recommending a visit to a hospital or a dental checkup, display findings or messages calling the user's attention (such as stress building up, or high or low XX compared to normal), or display promotional information such as information on recommended medicines or health foods.

The configuration of Example 2 may also be added to the configuration of Example 1.

Since this embodiment is configured as described above, the health condition of the user who uses the washbasin 1 is analyzed using an image of the face, and the analysis results are displayed on the mirror surface, allowing a simple health check to be performed automatically by simply standing in front of the washbasin 1 every day.

In addition, if any health abnormalities are detected, messages can be automatically sent to medical institutions and relatives, making it possible to check on the safety of individuals on a daily basis.

This embodiment therefore provides a user-friendly life support system that can automatically perform simple health checks during everyday life.

The rest is the same as in Example 1.

1 Mirror-type display device 2 Washstand 3 Processing tool

Claims (19)

A life support system including a mirror-type display device having a mirror surface and a display unit capable of displaying an image so as to be superimposed on a mirror image reflected on the mirror surface, a treatment tool for grooming or beautifying a user's face including hair or an oral cavity, and a control unit,
the processing tool includes a processing head unit for performing the maintenance or beautification, and a camera unit for taking a close-up image including a processing object to be processed by the processing head unit,
The control unit is configured to acquire the close-up image captured by the camera unit and display it on the display unit by superimposing it on the mirror image of the user reflected on the mirror surface. The life support system according to claim 1, characterized in that the mirror-type display device is provided on a washstand. A life support system according to claim 1, characterized in that the control unit performs visibility improvement processing to increase the visibility of the processing target object in the close-up image captured by the camera unit, and causes the display unit to display the close-up image after the visibility improvement processing. The life support system according to claim 3, characterized in that the processing tool is provided with a lighting unit. The life support system according to claim 2, wherein the control unit performs visibility improvement processing to increase the visibility of the processing target object in the close-up image captured by the camera unit, and causes the display unit to display the close-up image after the visibility improvement processing. The life support system according to claim 5, characterized in that the processing tool is provided with a lighting unit. The life support system according to any one of claims 1 to 6, wherein the treatment tool is a shaving tool, and the treatment target is beard. The life support system according to claim 7, characterized in that the visibility improvement processing includes processing to enlarge the close-up image and processing to horizontally invert the close-up image. The life support system according to claim 8, wherein the visibility improvement processing includes processing for detecting the whiskers in the close-up image and highlighting the whiskers. The life support system according to any one of claims 1 to 6, wherein the treatment tool is a toothbrush, and the treatment object is teeth and gums. The life support system according to claim 10, characterized in that the visibility improvement processing includes processing to enlarge the close-up image and processing to horizontally invert the close-up image. A life support system according to claim 11, characterized in that the visibility improvement processing includes processing for detecting plaque or inflamed areas of the gums in the close-up image and highlighting the plaque or inflamed areas of the gums. The life support system according to claim 10, wherein the control unit is configured to analyze the close-up image of the oral cavity, and if the analysis results indicate a health abnormality, to notify a medical institution or the user's relatives. A life assistance system including a washstand equipped with a mirror-type display device having a mirror surface and a display unit that displays an image so as to be superimposed on a mirror image reflected on the mirror surface, a camera unit, and a control unit,
the camera unit is provided at a position where it can capture an image of a face of a user reflected in the mirror surface of the mirror type display device,
The control unit is configured to measure biometric information from an image of the face captured by the camera unit, analyze the health condition of the user by comparing the measured values with values in a database of the user's past measurement results, and display the analysis results by the display unit, superimposed on the mirror image of the user reflected in the mirror unit. The life support system according to claim 14, wherein the biological information is pulse wave, heart rate, SpO2 (oxygen saturation), pupil size, or facial color. The life support system according to claim 15, wherein the control unit performs analysis by comparing values measured by a toothbrush having a sensor capable of measuring pulse waves, heart rate, or SpO2 with values in the database of past measurement results. The life support system according to claim 15, characterized in that the washstand is provided with a speaker and a microphone, and the control unit is configured to acquire the user's response voice in response to the call, analyze the acquired response voice, and display the analysis result on the mirror surface. The life support system according to claim 16, characterized in that the washstand is provided with a speaker and a microphone, and the control unit is configured to acquire the user's response voice in response to the call, analyze the acquired response voice, and display the analysis result on the mirror unit. The life support system according to any one of claims 14 to 18, wherein the control unit is configured to notify a medical institution or the user's relatives if the analysis results indicate a health abnormality.

Images