JP6930536B2 - Bio-monitoring system and bio-monitoring system program - Google Patents

Description

The present invention relates to, for example, a technique for monitoring a respiratory abnormality of a monitored person, with a person requiring nursing care or a person requiring nursing care (hereinafter, a person requiring nursing care, etc.) as the monitored person.

Japan (Japan) is an aging society, more specifically, the ratio of the population aged 65 and over to the total population due to the improvement of living standards, sanitary environment and medical standards accompanying the postwar high economic growth. It is a super-aging society with an aging rate of over 21%. According to the statistics of September 2013, the elderly population is about 31.86 million, the aging rate is 25.0%, and one in four is elderly. By 2035, the elderly population will be about 37.41 million, and it is predicted that one in three will be elderly (Statistics Bureau, Ministry of Internal Affairs and Communications, Japan). In such an aging society, the number of nurses required due to illness, injury, aging, etc. is expected to increase compared to a normal society that is not an aging society.

Such nurses requiring nursing care enter hospitals and facilities such as welfare facilities for the elderly (short-term admission facilities for the elderly, nursing homes for the elderly, special nursing homes for the elderly, etc. under Japanese law) and receive their nursing and long-term care. In such facilities such as hospitals and welfare facilities for the elderly, for example, a person who cares for or cares for a nurse or a caregiver so that the nurse or the like can spend comfortably and with peace of mind (hereinafter referred to as a nurse or a caregiver). Nurses, etc.) confirm their safety by patrols on a regular basis. However, compared to the day shift hours, the number of nurses and the like decreases during the semi-night shift and night shift hours, and the work load per person increases. Therefore, it is required to reduce the work load. For this reason, in recent years, a monitored person monitoring device that monitors (monitors) a nurse requiring nursing care as a monitored person has been researched and developed.

As a technique for monitoring a monitored person, for example, there are a biological monitoring device that monitors the living body of the monitored person and a posture detecting device that detects the sleeping posture of the monitored person. As the former, for example, Patent Document 1 generates moving amount waveform data by projecting infrared rays onto a sleeping monitored person and performing image processing on continuously captured images (frames). A device for detecting a respiratory abnormality of a monitored person is disclosed using the movement amount waveform data. As the latter, for example, Patent Document 2 irradiates the monitored person with microwaves and detects a microwave reflected by the monitored person, and a respiratory component contained in the microwave detected by the detection unit. A device for detecting the sleeping posture of a monitored person is disclosed, which comprises an extraction unit for extracting and a determination unit for determining a sleeping position based on the signal intensity of a respiratory component extracted by the extraction unit. ing.

When the monitored person has a respiratory disorder, information on the sleeping posture of the monitored person and the orientation of the monitored person's face, chin, and mouth (hereinafter referred to as the orientation of the face, etc.) is available. This is important information for investigating the cause of respiratory abnormalities and coping with respiratory abnormalities (for example, securing the airway). Specifically, sleep apnea syndrome, which is a type of respiratory disorder, is caused by the airway being blocked by the tongue sinking into the throat due to gravity when a person is sleeping in a lying position. It is said to be. When the sleep apnea syndrome occurs, the posture in which the monitored person is sleeping and the orientation of the monitored person's face or the like are information for investigating the cause of the sleep apnea syndrome. Therefore, when a respiratory abnormality of the monitored person is detected, a technique capable of acquiring the information is desired.

Japanese Unexamined Patent Publication No. 2002-175582 Japanese Unexamined Patent Publication No. 2014-207934

An object of the present invention is to provide a biological monitoring device, a biological monitoring method, and a biological monitoring system capable of acquiring information on the posture in which the monitored person is sleeping and the orientation of the face, etc., when a respiratory abnormality of the monitored person is detected. To provide.

The biological monitoring device according to the first aspect of the present invention includes an acquisition unit, a detection unit, a storage unit, and a processing unit. The acquisition unit acquires the biological signal of the monitored person to be monitored. The detection unit detects whether or not the person being monitored has abnormal breathing based on the biological signal acquired by the acquisition unit. When the detection unit detects a respiratory abnormality of the monitored person, the processing unit captures an image of the monitored person captured by the imaging unit during a time zone including the time when the respiratory abnormality is detected. It is stored in the storage unit.

The above and other objectives, features and advantages of the present invention will become apparent from the following detailed description and accompanying drawings.

It is explanatory drawing explaining the structure of the monitored person monitoring system which concerns on embodiment. It is a schematic diagram which shows the living room in which a sensor device is arranged. It is a block diagram which shows the structure of the sensor device provided in the monitored person monitoring system which concerns on embodiment. It is explanatory drawing explaining various respiratory waveform patterns. It is a block diagram which shows the structure of the mobile terminal apparatus provided in the monitored person monitoring system which concerns on embodiment. It is a block diagram which shows the structure of the management server apparatus provided in the monitored person monitoring system which concerns on embodiment. It is a flowchart explaining the respiratory abnormality detection and image recording executed by the monitored person monitoring system which concerns on embodiment. It is a block diagram which shows the structure of the sensor device provided in the modification 1. It is a flowchart explaining the respiratory abnormality detection and image recording executed by the monitored person monitoring system which concerns on modification 1. FIG. It is a block diagram which shows the structure of the sensor device provided in the modification 2. It is a block diagram which shows the structure of the management server apparatus provided in the modification 2.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In each figure, the configurations with the same reference numerals indicate that they are the same configuration, and the description of the configurations already described will be omitted. In the present specification, when they are generically referred to, they are indicated by reference numerals without subscripts, and when they refer to individual configurations, they are indicated by reference numerals with subscripts.

The monitored person monitoring system according to the embodiment is a system that monitors a monitored person (in other words, a watching target person who is a watching target to be watched) to be monitored by using a plurality of devices, and is a terminal device. And a monitored person monitoring device that is communicably connected to the terminal device, detects a predetermined event (event) related to the monitored person, and notifies the terminal device of the event. The monitored person monitoring device may be integrally configured by one device, but in the present specification, the monitored person monitoring device is communicably connected to the sensor device and each of the sensor device and the terminal device. By providing the management server device to be used, each of the two types of devices is configured as a separate body. The sensor device detects the predetermined event related to the monitored person and notifies (notifies, transmits) the management server device. When the management server device receives the notification from the sensor device, the management server device manages the event for which the notification has been received, and re-notifies (re-notifies, re-notifies) the event to a predetermined terminal device associated with the sensor device. Send. The terminal device may be one type of device, but in the present specification, the terminal device is two types of devices, a fixed terminal device and a mobile terminal device. The main difference between these fixed terminal devices and mobile terminal devices is that the fixed terminal devices are operated in a fixed manner, and the mobile terminal devices are carried and operated by observers NS (users) such as nurses and caregivers, for example. It is a point. Since these fixed terminal devices and mobile terminal devices are substantially the same, the mobile terminal devices will be mainly described below.

FIG. 1 is an explanatory diagram illustrating a configuration of a monitored person monitoring system MS according to an embodiment. More specifically, the monitored person monitoring system MS includes, for example, one or more sensor devices SU (SU-1 to SU-4), a management server device SV, a fixed terminal device SP, and one or more. It is equipped with a portable terminal device TA (TA-1, TA-2) and a private branch exchange (PBX, Private Branch eXchange) CX, which are wired or wireless and have a network (network, communication) such as a LAN (Local Area Network). Line) Connected so that communication is possible via NW. The network NW may be provided with repeaters such as repeaters, bridges, and routers that relay communication signals. In the example shown in FIG. 1, the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, the plurality of mobile terminal devices TA-1, TA-2, and the premises exchange CX are L2 switches. Concentrators (hubs, HUBs) LS and access point APs are connected to each other so as to be communicable with each other by a mixed wired and wireless LAN (for example, a LAN according to the IEEE802.11 standard) NW. More specifically, the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, and the private branch exchange CX are connected to the line concentrator LS, and the plurality of mobile terminal devices TA-1 and TA-2 are connected. Is connected to the concentrator LS via the access point AP. Then, the network NW constitutes a so-called intranet by using a group of Internet protocols such as TCP (Transmission Control Protocol) and IP (Internet Protocol). The private branch exchange CX is connected to the telephone TL by the public switched telephone network PN.

The monitored person monitoring system MS is arranged at an appropriate place according to the monitored person Ob. The monitored person Ob is, for example, a person who needs nursing care due to illness or injury, a person who needs nursing care due to deterioration of physical ability, or a person living alone. In particular, from the viewpoint of enabling early detection and early response, the monitored person Ob may be a person who needs the detection when a predetermined inconvenient event such as an abnormal state occurs in the person. preferable. Therefore, the monitored person monitoring system MS is suitably arranged in buildings such as hospitals, welfare facilities for the elderly, and dwelling units, depending on the type of monitored person Ob. In the example shown in FIG. 1, the monitored person monitoring system MS is arranged in a plurality of living room RMs in which a plurality of monitored person Obs move in, or in a building of a nursing facility having a plurality of rooms such as a nurse station.

The sensor device SU has a communication function for communicating with other devices SV, SP, TA via the network NW, detects a predetermined event related to the monitored person Ob, and detects the detected event as the management server device SV. Is a device that notifies to, makes a voice call with the terminal devices SP and TA, generates an image including a moving image, and distributes the moving image to the terminal devices SP and TA. The predetermined event preferably includes an event that needs to be dealt with.

In FIG. 1, four first to fourth sensor devices SU-1 to SU-4 are shown as an example, and the first sensor device SU-1 is Mr. A who is one of the monitored persons Ob. The second sensor device SU-2 is arranged in the living room RM-1 (not shown) of Ob-1, and is arranged in the living room RM-2 (not shown) of Mr. B Ob-2 who is one of the monitored persons Ob. The third sensor device SU-3 is installed in the living room RM-3 (not shown) of Mr. C Ob-3, who is one of the monitored persons Ob, and the fourth sensor device SU-4 is installed. It is arranged in the living room RM-4 (not shown) of Mr. D Ob-4, who is one of the monitored persons Ob.

The management server device SV has a communication function for communicating with other devices SU, SP, and TA via the network NW, and when it receives a notification of a predetermined event related to the monitored person Ob from the sensor device SU, the monitored person It is a device that manages information (monitoring information) related to monitoring for Ob. When the management server device SV receives the first event notification communication signal as the notification of the event from the sensor device SU, the management server device SV relates to monitoring the monitored person Ob based on each information stored in the first event notification communication signal. A predetermined terminal device that stores (records) the monitoring information and previously associates the communication signal (second event notification communication signal) containing the monitoring information regarding the monitoring of the monitored person Ob with the sensor device SU. Send to SP and TA. For this purpose, the management server device SV indicates the notification destination (re-notification destination, re-notification destination, transmission destination) of the first event notification communication signal or the like transmitted from the sensor device SU, and the sensor ID as the transmission source and the notification. The correspondence relationship (notification destination correspondence relationship) with the terminal ID which is the destination (re-notification destination) and the communication address thereof are stored. The terminal ID (terminal device identifier) is an identifier for identifying and identifying the terminal device SP and TA. Then, the management server device SV provides the client with data according to the request of the client (fixed terminal device SP, mobile terminal device TA, etc. in this embodiment). Such a management server device SV can be configured by, for example, a computer having a communication function.

The fixed terminal device SP is a device that functions as a user interface (UI) of the monitored person monitoring system MS. In order to achieve this function, the fixed terminal device SP provides a communication function for communicating with other devices SU, SV, and TA via the network NW, a display function for displaying predetermined information, and predetermined instructions and data. It is equipped with an input function and the like for inputting predetermined instructions and data to be given to the management server device SV and the mobile terminal device TA, and displaying monitoring information obtained by the sensor device SU. Such a fixed terminal device SP can be configured by, for example, a computer having a communication function.

The mobile terminal device TA is carried by the observer NS. The mobile terminal device TA has a communication function for communicating with other devices SV, SP, and SU via a network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and a voice call. It is equipped with a call function to perform, inputting predetermined instructions and data to be given to the management server device SV and the sensor device SU, and monitoring information (including moving images) obtained by the sensor device SU by notification from the management server device SV. It is a device for displaying and answering or calling a nurse call by voice call with the sensor device SU.

The sensor device SU will be described in detail. In addition to the above-mentioned functions (for example, a function of generating a moving image of the monitored person Ob, a function of making a voice call with the terminal devices SP and TA), the sensor device SU detects a respiratory abnormality of the monitored person Ob. By doing so, it has a function of monitoring the living body of the monitored person Ob. The sensor device SU will be described in detail from the viewpoint of this function. FIG. 2 is a schematic view showing a living room RM in which the sensor device SU is arranged. The living room RM is provided with a bed 1 for the monitored person Ob. The bed 1 is a futon 5 laid on the bed 3. The bed 1 is not limited to this, and may be, for example, a futon 5 laid on a tatami mat or a futon 5 laid on the floor. FIG. 2 shows a state in which the monitored person Ob is sleeping on the bed 1, and only the head of the monitored person Ob appears in the body of the monitored person Ob. A sensor device SU is attached to the ceiling 7 of the living room RM.

FIG. 3 is a block diagram showing a configuration of a sensor device SU provided in the monitored person monitoring system MS according to the embodiment. The sensor device SU (biological monitoring device, respiratory abnormality detection device) includes a Doppler sensor unit 10, a respiratory abnormality detection unit 11, an imaging unit 12, an imaging control unit 13, an image recording unit 14, and a sensor-side control processing unit (SU control processing unit). ) 15, and a sensor-side communication interface unit (SU communication IF unit) 16. In FIG. 2, among the blocks constituting the sensor device SU, the imaging unit 12 and the Doppler sensor unit 10 are shown, and the other blocks are omitted.

The Doppler sensor unit 10 is a device that detects the biological signal of the monitored person Ob. The Doppler sensor unit 10 functions as an acquisition unit and acquires the biological signal of the monitored person Ob. The Doppler sensor unit 10 is a body motion sensor that transmits a transmitted wave, receives a reflected wave of the transmitted wave reflected by an object, and outputs a Doppler signal DS of a Doppler frequency component based on the transmitted wave and the reflected wave. When an object is moving, the frequency of the reflected wave shifts in proportion to the moving speed of the object due to the so-called Doppler effect, so that a difference (Doppler frequency component) occurs between the frequency of the transmitted wave and the frequency of the reflected wave. The Doppler sensor unit 10 generates a signal of this Doppler frequency component as a Doppler signal DS. The transmitted wave may be an ultrasonic wave, a microwave, or the like, but in the embodiment, it is a microwave. Since the microwave can pass through the clothes and be reflected on the body surface of the monitored person Ob, the movement of the body surface can be detected even if the monitored person Ob is wearing clothes, which is preferable.

With reference to FIG. 2, the Doppler sensor unit 10 is installed on the ceiling surface above the bed 3 used by the monitored person Ob. The installation location of the Doppler sensor unit 10 is not limited to this, and the Doppler sensor unit 10 may be installed, for example, under the mat of the bed 3 used by the monitored person Ob, or at a position on the side of the bed 3 (bed). It may be installed at a position where a transmitted wave is transmitted from the direction of the side of 3 toward the monitored person Ob).

With reference to FIG. 3, the respiratory abnormality detection unit 11 includes a waveform generation unit 111, a waveform pattern selection unit 112, and a match determination unit 113. The respiratory abnormality detection unit 11 functions as a detection unit. The detection unit detects whether or not the breathing of the monitored person Ob is abnormal based on the biological signal acquired by the acquisition unit (Doppler sensor unit 10).

The waveform generation unit 111 extracts the respiratory signal component from the Doppler signal DS output by the Doppler sensor unit 10 by using wavelet analysis or the like. The waveform generation unit 111 uses this respiratory signal component to generate a respiratory signal indicating the relationship between time and signal intensity. The waveform of this breathing signal indicates the breathing state of the monitored person Ob. In this way, the waveform generation unit 111 functions as a generation unit, and uses the biological signal acquired by the acquisition unit (Doppler sensor unit 10) to generate a respiratory signal indicating the respiratory state of the monitored person Ob.

The respiratory waveform pattern indicated by the respiratory signal will be described. FIG. 4 is an explanatory diagram illustrating various respiratory waveform patterns P. FIG. 4 shows a respiratory waveform pattern PA for normal breathing, a respiratory waveform pattern PB for respiratory arrest, a respiratory waveform pattern CC for sleep apnea syndrome, a respiratory waveform pattern PD for slow breathing, and tachycardia. Breathing waveform pattern PE, low breathing waveform pattern PF, hyperventilation breathing waveform pattern PG, chain stalk breathing breathing waveform pattern PH, Kusmaul breathing breathing waveform pattern PI, and , Respiratory waveform pattern PJ of ataxic respiration (Biot respiration) is shown.

Except for the respiratory waveform pattern PA of normal breathing, it is the respiratory waveform pattern P of respiratory abnormality. The respiratory waveform pattern P of abnormal breathing has a different waveform pattern. In the respiratory waveform pattern BP of respiratory arrest, the respiratory waveform continues to be flat. When the respiratory waveform continues to be flat, the respiratory abnormality detection unit 11 determines that the respiratory arrest is stopped. Whether or not it corresponds to a respiratory abnormality other than respiratory arrest is determined by using pattern matching described later. There are eight types of respiratory waveform patterns P for respiratory abnormalities that are subject to pattern matching (respiratory waveform patterns CC to respiratory waveform patterns PJ). These respiratory waveform patterns P are specific examples of a plurality of respiratory waveform patterns showing each of a plurality of types of respiratory abnormalities.

When there are many types of respiratory waveform patterns for respiratory abnormalities that are the targets of pattern matching, there is a high possibility of erroneous judgment in pattern matching due to the existence of similar patterns among these respiratory waveform patterns. Become. Misjudgment may include determining that the patient is breathing abnormally despite normal breathing, and erroneously determining the type of respiratory abnormality. The former causes unnecessary rushing of the observer NS, and the latter causes a delay in coping with respiratory abnormalities. Therefore, in the embodiment, there is a possibility of erroneous determination in pattern matching by reducing the types of respiratory waveform patterns of respiratory abnormalities that are the targets of pattern matching based on the index indicating the health condition of the monitored person Ob. To lower.

It is known that there is a relationship between the index indicating the health condition of the monitored person Ob and the type of respiratory abnormality. The index showing the health condition will be described by taking body weight as an example. It has been found that if the amount of weight loss is large, bradypnea, Cheyne-Stokes breathing, or biot's respiration is likely, and other types of respiratory abnormalities are unlikely. The present inventor created an example of a table showing the relationship between the index showing the health condition of the monitored person Ob and the type of respiratory abnormality. This is shown in Table 1. Indicators of health status are examples of body temperature, weight, blood pressure, food intake, and sleep time.

When the body temperature during the day is high (for example, when the temperature is 37.5 degrees or higher), the respiratory waveform pattern P of the respiratory abnormality to be pattern-matched is the respiratory waveform pattern PE (tachypnea). When the body temperature during the day is low (for example, when the temperature is 35.5 degrees or less), the respiratory waveform pattern P of the respiratory abnormality to be pattern-matched is the respiratory waveform pattern PE (tachypnea) and the respiratory waveform pattern. PG (hyperventilation). The body temperature during the day is the body temperature measured when the monitored person Ob is awake other than during sleep. Generally, the body temperature of the monitored person Ob is measured after breakfast, before bathing (around 15:00), and after dinner at a welfare facility for the elderly.

When the body is losing weight (for example, when the body weight is reduced by 10% or more compared to one month ago), the respiratory pattern P of the respiratory abnormality to be pattern-matched is the respiratory waveform pattern PD. (Slow respiration), respiration waveform pattern PH (Cheyne-Stokes respiration), and respiration waveform pattern PJ (disordered respiration (Biot respiration)). When the body is gaining weight (for example, when the body weight is increased by 10% or more compared to one month ago), the respiratory waveform pattern P of the respiratory abnormality to be the target of pattern matching is the respiratory waveform pattern PC. (Sleep apnea syndrome), respiratory waveform pattern PF (hypopnea), and respiratory waveform pattern PI (xumaul breathing).

When the blood pressure is decreasing (for example, when the diastolic blood pressure (minimum blood pressure) in normal times is reduced by 10% or more compared to one week ago), the respiratory waveform pattern P of the respiratory abnormality to be the target of pattern matching. Respiratory waveform pattern PD (slow breathing), respiratory waveform pattern PE (tachycardia), respiratory waveform pattern PH (chain stalk breathing), and respiratory waveform pattern PJ (dysfunctional breathing (Biot)). Breathing)). When the blood pressure is increasing (for example, when the systolic blood pressure (maximum blood pressure) in normal times is increased by 10% or more compared to one week ago), the respiratory waveform pattern P of the respiratory abnormality to be the target of pattern matching Is a respiratory waveform pattern CC (sleep apnea syndrome), a respiratory waveform pattern PF (low breathing), and a respiratory waveform pattern PI (Kussmaul breathing).

When the amount of food is reduced (for example, when the amount of food is reduced by 20% or more compared to 3 days ago), the respiratory waveform pattern P of the respiratory abnormality to be the target of pattern matching is the respiratory waveform pattern PD (gradual). Respiration), respiration waveform pattern PE (tachycardia), respiration waveform pattern PH (chainstalk respiration), and respiration waveform pattern PJ (disordered respiration (Biot respiration)).

When the sleep time is reduced (for example, when the sleep time is reduced by 20% or more compared to one week ago), the respiratory waveform pattern P of the respiratory abnormality to be the target of pattern matching is the respiratory waveform pattern P-. C (sleep apnea syndrome), respiratory waveform pattern PF (hypopnea), and respiratory waveform pattern PG (hypopnea).

As described above, the types of respiratory waveform patterns P to be pattern-matched can be reduced based on the index indicating the health condition of the monitored person Ob.

With reference to FIG. 3, the waveform pattern selection unit 112 is selected from the respiratory waveform patterns CC to the respiratory waveform patterns PJ based on the results determined by the condition determination unit 32 (FIG. 6) described later. , Select one or more respiratory waveform patterns P to be pattern-matched. Respiratory waveform patterns CC to respiratory waveform patterns PJ are specific examples of a plurality of waveform patterns showing each of a plurality of types of respiratory abnormalities. With reference to FIG. 4 and Table 1, for example, when the body temperature of the monitored person Ob is 35.5 degrees or less, the waveform pattern selection unit 112 determines the respiratory waveform pattern PE (tachypnea) and the respiratory waveform pattern. Select PG (hyperventilation). This is because when the body temperature of the monitored person Ob is 35.5 degrees or less, there is a possibility of tachypnea or hyperventilation, but there is no possibility of other respiratory abnormalities (almost no). As described above, the waveform pattern selection unit 112 functions as a selection unit, and a plurality of respiratory waveforms indicating each of the plurality of types of respiratory abnormalities are used by using a predetermined index which is an index indicating the health condition of the monitored person Ob. One or more respiratory waveform patterns P are selected from the patterns P.

The matching determination unit 113 pattern-matches the waveform of the respiratory signal generated by the waveform generation unit 111 with each of the one or more respiratory waveform patterns P selected by the waveform pattern selection unit 112. As a result, the match determination unit 113 determines whether or not the waveform of the respiratory signal generated by the waveform generation unit 111 matches any one or more respiratory waveform patterns P selected by the waveform pattern selection unit 112. In this way, the match determination unit 113 functions as a determination unit, and the waveform of the respiratory signal generated by the generation unit (waveform generation unit 111) and one or more selected by the selection unit (waveform pattern selection unit 112). Using the respiration waveform pattern P, it is determined whether or not the waveform of the respiration signal generated by the generation unit corresponds to any one or more respiration waveform patterns P selected by the selection unit.

When the match determination unit 113 determines that they match, the respiratory abnormality corresponding to the corresponding respiratory waveform pattern P is determined to be the type of respiratory abnormality of the monitored person Ob. In addition, the condition that the respiratory rate per minute is 9 times or less is further added to the determination of bradypnea (FIG. 4). The determination of tachypnea (FIG. 4) is further subject to the condition that the respiratory rate per minute is 25 or more. The determination of hypopnea (FIG. 4) is further subject to the condition that the amplitude of the respiratory waveform is reduced to 50% or less of the amplitude of the normal respiratory waveform for 10 seconds or longer.

As described above, in addition to the pattern matching, the respiratory abnormality detection unit 11 measures the respiratory rate for one minute based on the respiratory signal, and measures the amplitude value of the respiratory waveform indicated by the respiratory signal. The respiratory abnormality detection unit 11 uses these to detect whether or not the respiratory abnormality is present and to detect the type of the respiratory abnormality.

The respiratory abnormality detection unit 11 includes hardware such as a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), an HDD (Hard Disk Drive), and a respiratory abnormality detection unit 11. It is realized by the program and data for executing the functions of. Regarding the functions of the respiratory abnormality detection unit 11, some or all of the functions may be realized by processing by the DSP (Digital Signal Processor) in place of or in combination with the processing by the CPU. Similarly, a part or all of the functions of the respiratory abnormality detection unit 11 may be realized by processing by a dedicated hardware circuit in place of or in combination with processing by software. The above description has been described later in the imaging control unit 13 (FIGS. 3, 8, 10), the image recording unit 14 (FIG. 3, 8, 11), and the SU control processing unit 15 (FIGS. 3, 8, 8). FIG. 10), display control unit 22 (FIG. 5), TA control processing unit 24 (FIG. 5), long-term care recording unit 31 (FIGS. 6 and 11), condition determination unit 32 (FIGS. 6 and 11), SV control processing. The same applies to the part 33 (FIGS. 6 and 11).

The image pickup unit 12 is a device that takes an image of the image pickup target and generates an image of the image pickup target. Images include still images and moving images. The imaging unit 12 is arranged so that the space where the monitored person Ob is scheduled to be located (location space, the living room RM of the arrangement location in the example shown in FIG. 1) can be monitored, and the location space is taken as an imaging target from above. It takes an image and generates an image that gives a bird's-eye view of the imaged object. Preferably, since it is highly probable that the entire monitored person Ob can be imaged, the imaging unit 12 is scheduled to position the head of the monitored person Ob in the bedding (for example, a bed) on which the monitored person Ob lies. It is arranged so that the imaging target can be imaged from directly above the preset head position (usually, the pillow arrangement position). The sensor device SU acquires an image of the monitored person Ob from above the monitored person Ob, preferably an image taken from directly above the planned head position, by the imaging unit 12.

Such an imaging unit 12 may be a device that generates an image of visible light, but in the embodiment, it is a device that generates an infrared image so that the monitored person Ob can be monitored even in a relatively dark place. For example, in the embodiment, such an imaging unit 12 is arranged with an imaging optical system that forms an infrared optical image of an imaging target on a predetermined imaging surface, and a light receiving surface that coincides with the imaging surface. An image sensor that converts an infrared optical image of the imaging target into an electrical signal, and image data that represents an infrared image of the imaging target by image processing the output of the image sensor. It is a digital infrared camera provided with an image processing unit or the like to generate. In the embodiment, the imaging optical system of the imaging unit 12 is preferably a wide-angle optical system (so-called wide-angle lens (including a fisheye lens)) having an angle of view capable of imaging the entire living room RM in which the imaging unit 12 is arranged.

The image pickup control unit 13 controls the image pickup unit 12 and causes the image pickup unit 12 to take an image of a moving image to be imaged. Instead of the moving image, a plurality of still images (slide images) arranged in chronological order may be used. In this way, the image pickup control unit 13 functions as a control unit, and has a function of causing the image pickup unit 12 to continuously image the monitored person Ob.

The image recording unit 14 records an image of the monitored person Ob. The image recording unit 14 includes a non-volatile storage unit 141, a ring buffer 142, and a storage processing unit 143.

The non-volatile storage unit 141 (storage unit) has a function (that is, non-volatile) of holding stored information (data) even when the power of the sensor device SU is turned off, and is provided by a hard disk drive, a flash memory, or the like. It will be realized.

The ring buffer 142 can store a predetermined amount of information (data), and when storing new information (data), the ring buffer 142 stores a predetermined amount of information (data) endlessly by discarding the oldest information (data) in order. Has the function of

The storage processing unit 143 stores the moving image captured by the imaging unit 12 in the ring buffer 142. As a result, the ring buffer 142 endlessly stores a moving image composed of a frame set a predetermined time before the latest frame.

When the respiratory abnormality is detected by the respiratory abnormality detection unit 11, the storage processing unit 143 reads out from the ring buffer 142 a frame imaged at a predetermined timing before the respiratory abnormality is detected, and reads the non-volatile storage unit. It is stored in 141 (storage unit). This frame shows an image of the monitored person Ob before the time when the respiratory abnormality was detected. From this frame, the posture in which the observer Ob is sleeping and the orientation of the face and the like can be known before the respiratory abnormality is detected. Therefore, this frame provides information for investigating the cause of respiratory abnormalities.

The frame imaged at a predetermined timing is, for example, a frame imaged from several seconds to several tens of seconds before the reference when a respiratory abnormality is detected (for example, imaged 5 seconds before). Frame). As a result, the still image (one frame) of the monitored person Ob immediately before the detection of the respiratory abnormality is stored in the non-volatile storage unit 141. Not limited to still images, moving images may be used.

The storage processing unit 143 may generate a silhouette image in which the image of the monitored person Ob included in the frame (image) read from the ring buffer 142 is a silhouette, and store the silhouette image in the non-volatile storage unit 141. good. A silhouette is an image in which the outline is filled with a single color. From the silhouette of the monitored person Ob, the face of the monitored person Ob cannot be seen. Therefore, even if the image stored in the non-volatile storage unit 141 leaks out, the privacy of the monitored person Ob can be protected. Since the posture in which the monitored person Ob is sleeping and the orientation of the face and the like can be known from the silhouette image, the silhouette image serves as information for investigating the cause of the respiratory abnormality.

As described above, the storage processing unit 143 functions as a processing unit. The processing unit is the subject imaged by the imaging unit 12 during the time period including when the detection unit (respiratory abnormality detection unit 11) detects the respiratory abnormality of the monitored person Ob and when the respiratory abnormality is detected. An image of the observer Ob is acquired, and the acquired image is stored in the non-volatile storage unit 141.

The SU communication IF unit 16 is a communication circuit connected to the SU control processing unit 15 and for performing communication under the control of the SU control processing unit 15. The SU communication IF unit 16 generates a communication signal containing data to be transferred input from the SU control processing unit 15 according to the communication protocol used in the network NW of the monitored person monitoring system MS, and this generated communication. The signal is transmitted to other devices SV, SP, TA via the network NW. The SU communication IF unit 16 receives communication signals from other devices SV, SP, and TA via the network NW, extracts data from the received communication signals, and the SU control processing unit 15 can process the extracted data. It is converted into data in a different format and output to the SU control processing unit 15. The SU communication IF unit 16 is configured to include, for example, a communication interface circuit according to the IEEE802.11 standard or the like.

The SU control processing unit 15 makes each unit of the sensor device SU (Doppler sensor unit 10, respiratory abnormality detection unit 11, imaging unit 12, imaging control unit 13, image recording unit 14, SU communication IF unit 16) into the functions of the respective units. It controls each of them accordingly, detects a predetermined event related to the monitored person Ob, notifies the detected event to the management server device SV, makes a voice call with the terminal devices SP and TA, and then makes a moving image. This is a device for distributing a moving image of an image including the above to the terminal devices SP and TA.

The sensor device SU functions as a biological monitoring device by including the respiratory abnormality detection unit 11 and the image recording unit 14. From this point of view, the monitored person monitoring system MS is a biological monitoring system.

The sensor device SU functions as a respiratory abnormality detecting device by including the respiratory abnormality detecting unit 11. From this point of view, the monitored person monitoring system MS is a respiratory abnormality detection system. In this case, the sensor device SU may not include the image pickup unit 12, the image pickup control unit 13, and the image recording unit 14.

The mobile terminal device TA will be described in detail. FIG. 5 is a block diagram showing a configuration of a mobile terminal device TA provided in the monitored person monitoring system MS according to the embodiment. The mobile terminal device TA includes a display unit 21, a display control unit 22, an operation unit 23, a terminal side control processing unit (TA control processing unit) 24, and a terminal side communication interface unit (TA communication IF unit) 25.

The display unit 21 is realized by a liquid crystal display or the like. The display control unit 22 controls the display unit 21 to display an image (for example, a moving image). The operation unit 23 is a device for inputting a command or the like for operating the mobile terminal device TA. The operation unit 23 is realized by a touch panel or the like.

The TA communication IF unit 25 is a communication circuit connected to the TA control processing unit 24 and for performing communication under the control of the TA control processing unit 24. The TA communication IF unit 25 generates a communication signal containing data to be transferred input from the TA control processing unit 24 according to the communication protocol used in the network NW of the monitored person monitoring system MS, and this generated communication. The signal is transmitted to other devices SU, SV, SP via the network NW. The TA communication IF unit 25 receives communication signals from other devices SU, SV, and SP via the network NW, extracts data from the received communication signals, and the TA control processing unit 24 can process the extracted data. It is converted into data in a different format and output to the TA control processing unit 24. The TA communication IF unit 25 is configured to include, for example, a communication interface circuit according to the IEEE802.11 standard or the like.

The TA control processing unit 24 controls each unit (display unit 21, display control unit 22, operation unit 23, TA communication IF unit 25) of the mobile terminal device TA according to the function of each unit, and controls the monitored person Ob. It is a device that receives and displays monitoring information, accepts input of implementation intention information, and responds to and calls out to nurse calls.

The observer NS operates the operation unit 23 of the mobile terminal device TA to input information to be a care record of the monitored person Ob every day. Information includes vital data (eg, body temperature, weight, systolic blood pressure, diastolic blood pressure, etc.), daily diet, and daily sleep time. The TA control processing unit 24 gives an instruction to the TA communication IF unit 25 to transmit the information to the management server device SV. The TA communication IF unit 25 transmits the information to the management server SV. The information is recorded as a long-term care record in the long-term care record unit 31 (FIG. 6), which will be described later.

The management server device SV will be described. FIG. 6 is a block diagram showing a configuration of a management server device SV provided in the monitored person monitoring system MS according to the embodiment. The management server device SV includes a care recording unit 31, a condition determination unit 32, a management server side control processing unit (SV control processing unit) 33, and a management server side communication interface unit (SV communication IF unit) 34.

The long-term care record unit 31 creates and stores a long-term care record for each monitored person Ob. The long-term care record is created on a daily basis and includes vital data (eg, body temperature, weight, systolic blood pressure, diastolic blood pressure, etc.), daily dietary intake, and daily sleep time.

The condition determination unit 32 refers to the care record of the monitored person Ob at a predetermined timing, and the health condition of the monitored person Ob is the eight condition C (condition C-1 to condition C-) shown in Table 1. Whether or not any of 8) is applicable is determined for each monitored person Ob. As for the predetermined timing, for example, body temperature information indicating the body temperature measured after dinner (body temperature measured at the end of the day) is sent from the mobile terminal device TA to the long-term care recording unit 31, and the long-term care recording unit 31 sends the body temperature information. , It is the timing when the body temperature indicated by the body temperature information is recorded in the long-term care record.

The SV communication IF unit 34 is a communication circuit connected to the SV control processing unit 33 and for performing communication under the control of the SV control processing unit 33. The SV communication IF unit 34 is a communication circuit similar to the SU communication IF unit 16, and includes, for example, a communication interface circuit according to the IEEE 802.11 standard or the like.

The SV control processing unit 33 controls each unit (nursing recording unit 31, condition determination unit 32, SV communication IF unit 34) of the management server device SV according to the function of each unit, and the sensor device SU sends the predetermined event. When the notification is received, the monitoring information related to the monitoring of the monitored person Ob is managed, the predetermined event is notified (transmitted) to the client (here, the predetermined terminal device SP, TA), and the request of the client is met. It is a device for providing data to the client and managing the entire monitored person monitoring system MS.

The respiratory abnormality detection and image recording executed by the monitored person monitoring system MS according to the embodiment will be described. FIG. 7 is a flowchart illustrating this. Take Ob-1 (Fig. 1) as an example. With reference to FIG. 6, whether the condition determination unit 32 meets any of the eight conditions C shown in Table 1 using the long-term care record of the monitored person Ob-1 recorded in the long-term care recording unit 31. Judge whether or not. It may not meet any of the eight conditions C, it may meet any one, or it may meet two or more. Here, an example corresponding to condition C-4 (when the body weight has increased by 10% or more compared to one month ago) will be described. The SV control processing unit 33 instructs the SV communication IF unit 34 to transmit the condition information indicating the condition C-4 to the sensor device SU-1. The SV communication IF unit 34 transmits the condition information to the sensor device SU-1.

With reference to FIG. 3, the SU communication IF unit 16 of the sensor device SU-1 receives the condition information, and the SU control processing unit 15 stores the condition information in the waveform pattern selection unit 112. The waveform pattern selection unit 112 is a target of pattern matching based on the conditions indicated by the condition information from the respiratory waveform patterns CC to the respiratory waveform patterns PJ (FIG. 4) stored in advance. The respiratory waveform pattern P is selected (step S1). Here, since the condition C-4 is satisfied, the respiratory waveform pattern CC (sleep apnea syndrome), the respiratory waveform pattern PF (hypopnea), and the respiratory waveform pattern PI (Kussmaul breathing) are present. Be selected.

In the sensor device SU-1, the imaging unit 12 images a moving image of the imaged object including the monitored person Ob-1, and the storage processing unit 143 stores the captured moving image in the ring buffer 142 (step). S2). In parallel with this, the waveform generation unit 111 extracts the respiratory signal component from the Doppler signal DS output by the Doppler sensor unit 10. The waveform generation unit 111 uses this respiratory signal component to generate a respiratory signal indicating the relationship between time and signal intensity (step S2). The waveform of the respiratory signal indicates the respiratory state of the monitored person Ob-1.

The respiratory abnormality detection unit 11 uses the respiratory signal generated in step S2 to determine whether or not respiratory arrest is occurring (step S3). Specifically, the respiratory abnormality detection unit 11 determines that respiratory arrest occurs when the state in which the respiratory waveform is flat continues for a predetermined period.

When the respiratory abnormality detection unit 11 determines that the respiratory disorder is not stopped (No in step S3), the matching determination unit 113 determines that the waveform of the respiratory signal generated in step S2 is the respiratory waveform pattern PC (sleep apnea). It is determined by using pattern matching whether or not it corresponds to any of the respiratory waveform pattern PF (low respiration) and the respiration waveform pattern PI (Kusumaul respiration) (step S4). If none of the eight conditions C shown in Table 1 is met, the process of step S4 is not performed.

The coincidence determination unit 113 uses the respiratory signal waveforms generated in step S2 as the respiratory waveform pattern CC (sleep aspiration syndrome), the respiratory waveform pattern PF (low breathing), and the respiratory waveform pattern P-. When it is determined that none of I (Kusumaul breathing) is applicable (No in step S4), the respiratory abnormality detection unit 11 determines that the respiratory state of the monitored person Ob-1 is normal breathing (step S5). The process returns to step S2.

The coincidence determination unit 113 uses the respiratory signals generated in step S2 as respiratory waveform patterns CC (sleep apnea syndrome), respiratory waveform patterns PF (hypopnea), and respiratory waveform patterns PI ( When it is determined that any of (Kussmaul breathing) is applicable (Yes in step S4), the SU control processing unit 15 instructs the SU communication IF unit 16 to transmit the abnormality occurrence information to the management server device SV. The abnormality occurrence information includes information for identifying the occurrence of respiratory abnormality, the monitored person Ob-1 in which the respiratory abnormality has occurred (for example, the name of the monitored person Ob-1 and the number of the living room RM), and the type of respiratory abnormality. include. The abnormality occurrence information further includes an image of the monitored person Ob-1 stored in the non-volatile storage unit 141 in step S7, which will be described later. The SU communication IF unit 16 transmits the abnormality occurrence information to the management server device SV (step S6).

With reference to FIGS. 5 and 6, the management server device SV receives the abnormality occurrence information and transfers it to each mobile terminal device TA. As a result, each mobile terminal device TA notifies the observer NS of the occurrence of an abnormality. For example, the mobile terminal device TA sounds an alarm sound and causes the display unit 21 to display an image indicating the occurrence of an abnormality. This image includes an image of the monitored person Ob-1 stored in the non-volatile storage unit 141 in step S7. The storage processing unit 143 shown in FIG. 3 performs a process of converting the image of the monitored person Ob-1 into a silhouette image (an image in which the image of the monitored person Ob-1 is made into a silhouette) to obtain the silhouette image. When stored in the non-volatile storage unit 141, the image of the monitored person Ob-1 included in the abnormality occurrence information is not a silhouette image, but an image of the monitored person Ob-1 before the silhouette processing (monitored person Ob-1). It is an image that can recognize the face of. When the image to be displayed on the display unit 21 is switched from the image of the monitored person Ob-1 before the silhouette processing to another image, the display control unit 22 erases the data of the image. As a result, the image of the monitored person Ob-1 before the silhouette processing is not stored in the memory of the mobile terminal device TA, so that the privacy of the monitored person Ob-1 can be protected.

With reference to FIGS. 3 and 7, in parallel with step S6, the memory processing unit 143 captures a frame (for example, a frame) imaged at a predetermined timing prior to the time when the respiratory abnormality is detected by the respiratory abnormality detecting unit 11. The frame captured 5 seconds ago) is read from the ring buffer 142 and stored in the non-volatile storage unit 141. As a result, an image of the monitored person Ob-1 before the respiratory abnormality is detected is recorded (step S7).

When the respiratory abnormality detection unit 11 determines that the breathing of the monitored person Ob-1 is stopped (Yes in step S3), the respiratory abnormality detection unit 11 performs the processes of steps S6 and S7. The abnormality occurrence information in step S6 includes information for identifying the occurrence of respiratory arrest and the monitored person Ob-1 in which the respiratory arrest has occurred (for example, the name of the monitored person Ob-1 and the number of the living room RM). Is done. The memory processing unit 143 reads out from the ring buffer 142 a frame imaged at a predetermined timing before the time when the respiratory abnormality detection unit 11 determines that the respiratory arrest is performed (for example, a frame imaged 5 seconds before). It is stored in the non-volatile storage unit 141. As a result, an image of the monitored person Ob-1 before the determination of respiratory arrest is recorded (step S7).

The main effects of the embodiments are effects 1 to 4. The explanation will be given from effect 1. With reference to FIGS. 3 and 7, when the sensor device SU (biological monitoring device, respiratory abnormality detecting device) detects the respiratory abnormality of the monitored person Ob (Yes in step S3, Yes in step S4), the respiratory abnormality The frame (image) of the monitored person Ob captured at a predetermined timing prior to the time when is detected is read from the ring buffer 142 and stored in the non-volatile storage unit 141 (step S7). In this frame, the posture in which the monitored person Ob is sleeping and the orientation of the face and the like are captured. Therefore, according to the embodiment, when the respiratory abnormality of the monitored person Ob is detected, the information regarding the sleeping posture of the monitored person Ob and the orientation of the face or the like can be acquired at the same time.

Effect 2 will be described. A frame imaged at a predetermined timing prior to the detection of the respiratory abnormality of the monitored person Ob (for example, a frame imaged several seconds to several tens of seconds before the detection of the respiratory abnormality) is covered. Immediately before the respiratory abnormality of the observer Ob is detected, the sleeping posture of the monitored person Ob and the orientation of the face and the like are photographed. These are important information for investigating the cause of respiratory abnormalities. With reference to FIGS. 3 and 7, in the embodiment, the imaging unit 12 is made to image the moving image MI of the monitored person Ob before the respiratory abnormality of the monitored person Ob is detected, and the moving image MI is transferred to the ring buffer 142. Store (step S2). As a result, the non-volatile storage unit 141 can store the frame imaged at a predetermined timing before the time when the respiratory abnormality of the monitored person Ob is detected without providing a large-capacity storage device (). Step S7).

Effect 3 will be described. With reference to FIGS. 3 and 7, the embodiment is in a plurality of respiratory waveform patterns indicating each of a plurality of types of respiratory abnormalities, using a predetermined index which is an index indicating the health condition of the monitored person Ob. Select one or more respiratory waveform patterns from (step S1). As a result, the types of respiratory waveform patterns of respiratory abnormalities can be reduced (because they can be narrowed down), and therefore, in determining whether or not the respiratory signal waveform of the monitored person Ob corresponds to the respiratory waveform pattern of respiratory abnormalities (because it can be narrowed down). Step S4), erroneous determination can be reduced. Therefore, according to the present embodiment, it is possible to improve the accuracy of determining whether or not there is a respiratory abnormality and the accuracy of determining the type of respiratory abnormality.

Effect 4 will be described. With reference to FIGS. 4 and 7, in determining whether or not the waveform of the respiratory signal of the monitored person Ob corresponds to the respiratory waveform pattern P of the respiratory abnormality (step S4), it is determined that the waveform patterns are similar. As a reason, we have empirically known combinations that are prone to misjudgment. Combination of respiratory waveform pattern PC (sleep apnea syndrome) and respiratory waveform pattern PD (bradypnea), and respiratory waveform pattern PD (bradypnea) and respiratory waveform pattern PI (bradypnea) ).

When the monitored person Ob has sleep apnea syndrome, the matching determination unit 113 (FIG. 3) should determine that the respiratory signal waveform of the monitored person Ob matches the respiratory waveform pattern CC. , May be determined to match the respiratory waveform pattern PD. On the contrary, when the monitored person Ob is bradypnea, the matching determination unit 113 should determine that the respiratory signal waveform of the monitored person Ob matches the respiratory waveform pattern PD, but the respiratory waveform pattern. It may be determined that it matches with PC. The same can be said for the combination of the respiratory waveform pattern PD and the respiratory waveform pattern PI.

In the embodiment, since the waveform pattern selection unit 112 selects the respiratory waveform pattern P using the condition C shown in Table 1 (step S1), the respiratory waveform patterns CC and the respiratory waveform patterns PD are simultaneously used. May not be selected. For example, when only the condition C-4 shown in Table 1 is satisfied, the respiratory waveform pattern CC is selected, but the respiratory waveform pattern PD is not selected. In such a case, the match determination unit 113 should determine that the waveform of the respiratory signal of the monitored person Ob matches the respiratory waveform pattern CC, but determines that it matches the respiratory waveform pattern PD. Does not occur. The same can be said for the combination of the respiratory waveform pattern PD and the respiratory waveform pattern PI.

In the embodiment, there are a modification 1 and a modification 2. The first modification will be described. In the embodiment, the image of the monitored person Ob before the respiratory abnormality is detected is stored in the non-volatile storage unit 141. On the other hand, in the modified example 1, the image of the monitored person Ob when the respiratory abnormality is detected is stored in the non-volatile storage unit 141.

FIG. 8 is a block diagram showing a configuration of the sensor device SU provided in the first modification. The difference from the sensor device SU provided in the embodiment shown in FIG. 3 will be described. The configuration of the image recording unit 14 is different between the first modification and the embodiment. In the first modification, when the respiratory abnormality is detected by the respiratory abnormality detection unit 11, the image pickup control unit 13 causes the image pickup unit 12 to take an image of the image to be imaged including the monitored person Ob-1. The storage processing unit 143 stores the image in the non-volatile storage unit 141. According to the first modification, the ring buffer 142 becomes unnecessary.

The respiratory abnormality detection and image recording executed by the monitored person monitoring system MS according to the first modification will be described. FIG. 9 is a flowchart illustrating this. The differences from the flowchart shown in FIG. 7 are as follows.

In the first modification, step S2a is executed instead of step S2. In step S2a, the respiratory abnormality detection unit 11 generates a respiratory signal of the monitored person Ob-1. This process is the same as the generation of the respiratory signal in step S2.

In the first modification, step S6a is executed instead of step S6. In step S6a, the SU communication IF unit 16 transmits the abnormality occurrence information to the management server device SV. This process is the same as in step S6. Further, in step S6a, when the respiratory abnormality detection unit 11 determines the respiratory arrest of the monitored person Ob-1 (Yes in step S3), or the respiratory signal generated in step S2a, the respiratory waveform pattern P- When it is determined that any of C (sleep apnea syndrome), respiratory waveform pattern PF (low breathing), and respiratory waveform pattern PI (xumaul breathing) is applicable (Yes in step S4), imaging control is performed. The unit 13 causes the imaging unit 12 to image an image (still image or moving image) to be imaged including the monitored person Ob-1.

In the first modification, step S7a is executed instead of step S7. In step S7a, the storage processing unit 143 stores the image captured in step S6a in the non-volatile storage unit 141. As a result, the image of the monitored person Ob-1 when the respiratory abnormality is detected is recorded.

Modification 2 will be described. In the second modification, the management server device SV has a function of a biological monitoring device (respiratory abnormality detection device). FIG. 10 is a block diagram showing a configuration of the sensor device SU provided in the second modification. FIG. 11 is a block diagram showing a configuration of the management server device SV provided in the second modification. The differences between the sensor device SU and the server device SV provided in the embodiments shown in FIGS. 3 and 6 will be described.

In the embodiment, the respiratory abnormality detection unit 11 and the image recording unit 14 are provided in the sensor device SU. On the other hand, in the second modification, these are provided in the management server device SV. The SU control processing unit 15 instructs the SU communication IF unit 16 to transmit the Doppler signal DS and the moving image MI to the management server device SV. The SU communication IF unit 16 changes the Doppler signal DS and the moving image MI into a communication signal capable of communicating with the SV communication IF unit 34, and transmits the Doppler signal DS and the moving image MI to the management server device SV.

In the embodiment, the Doppler sensor unit 10 functions as an acquisition unit that acquires the biological signal of the monitored person Ob. On the other hand, in the second modification, the SV communication IF unit 34 has the function of the acquisition unit. In the embodiment, the image of the monitored person Ob captured by the image pickup unit 12 during the time zone including the time when the memory processing unit 143 detects the respiratory abnormality of the monitored person Ob and the time when the respiratory abnormality is detected. Has the function of acquiring. On the other hand, in the second modification, the SV communication IF unit 34 has that function.

(Summary of embodiments)
The biological monitoring device according to the first aspect of the present embodiment is the monitored body based on the acquisition unit that acquires the biological signal of the monitored person to be monitored and the biological signal acquired by the acquisition unit. During the time period including the detection unit for detecting whether or not the person's breathing is abnormal, the storage unit, and the time zone including when the monitored person's respiratory abnormality is detected by the detection unit and when the respiratory abnormality is detected. The storage unit includes a processing unit that stores the image of the monitored person captured by the imaging unit in the storage unit.

The image of the monitored person captured by the imaging unit during the time zone including the time when the respiratory abnormality is detected is the image of the monitored person captured by the imaging unit before the respiratory abnormality is detected (first). Image), the image of the monitored person captured by the imaging unit when the respiratory abnormality is detected (second image), and the image of the monitored person captured by the imaging unit after the respiratory abnormality is detected (third image). (Image), an image containing all of them, or two images selected from these images (for example, a first image and a second image).

The acquisition unit includes, for example, a Doppler sensor unit that outputs a Doppler signal of a Doppler frequency component as a biological signal based on a transmitted wave and a reflected wave of the transmitted wave.

The biological monitoring device according to the first aspect of the present embodiment is an image of the monitored person captured by the imaging unit during a time zone including when the monitored person's respiratory abnormality is detected and when the respiratory abnormality is detected. Is stored in the storage unit. This image shows the posture in which the monitored person is sleeping and the orientation of the face and the like. Therefore, according to the biological monitoring device according to the first aspect of the present embodiment, when a respiratory abnormality of the monitored person is detected, information on the posture in which the monitored person is sleeping and the orientation of the face or the like is acquired. can.

In the above configuration, the imaging unit further includes a control unit for continuously imaging the monitored person and a ring buffer, and the processing unit is the monitored person continuously imaged by the imaging unit. The image is stored in the ring buffer, and when the detection unit detects the respiratory abnormality, the processing unit captures the image of the monitored person at a predetermined timing before the detection of the respiratory abnormality. The image is read from the ring buffer and stored in the storage unit.

The image captured at a predetermined timing prior to the detection of the respiratory abnormality of the monitored person (for example, the image captured 5 seconds before the detection of the respiratory abnormality) includes the respiratory abnormality of the monitored person. The posture in which the monitored person is sleeping and the orientation of the face, etc., immediately before the abnormality is detected are shown. These are important information for investigating the cause of respiratory abnormalities. In this configuration, the image pickup unit continuously images the monitored person even before the monitored person's respiratory abnormality is detected, and the image is stored in the ring buffer. As a result, the image captured at a predetermined timing prior to the detection of the respiratory abnormality of the monitored person can be stored in the storage unit without providing a large-capacity storage device.

In the above configuration, when the respiratory abnormality is detected by the detection unit, the imaging unit further includes a control unit for capturing an image of the monitored person, and the processing unit detects the respiratory abnormality by the detection unit. The image of the monitored person captured by the imaging unit at the time of this is stored in the storage unit.

In this configuration, when a respiratory abnormality of the monitored person is detected, the image pickup unit is made to take an image of the monitored person, and this image is stored in the storage unit. Therefore, the ring buffer becomes unnecessary.

In the above configuration, the processing unit generates a silhouette image in which the image of the monitored person included in the image of the monitored person is a silhouette, and stores the silhouette image in the storage unit.

A silhouette is an image in which the outline is filled with a single color. From the silhouette of the monitored person, the face of the monitored person cannot be seen. Therefore, even if the image stored in the storage unit is leaked, the privacy of the monitored person can be protected. Since the posture in which the monitored person is sleeping and the orientation of the face and the like can be known from the silhouette image, the silhouette image serves as information for investigating the cause of the respiratory abnormality.

The biological monitoring method according to the second aspect of the present embodiment is based on the acquisition step of acquiring the biological signal of the monitored person to be monitored and the biological signal acquired by the acquisition step, and the monitored biological signal. During the time period including the detection step of detecting whether or not the person's breathing is abnormal, the time when the monitored person's breathing abnormality is detected by the detection step, and the time when the breathing abnormality is detected, the imaging unit It includes a processing step of storing the captured image of the monitored person in the storage unit.

The biological monitoring method according to the second aspect of the present embodiment defines the biological monitoring device according to the first aspect of the present embodiment from the viewpoint of the method, and the biological monitoring according to the first aspect of the present embodiment. It has the same effect as the device.

The biological monitoring system according to the third aspect of the present embodiment is a biological monitoring system including a biological monitoring device and a terminal device, and the biological monitoring device acquires a biological signal of a monitored person to be monitored. Based on the acquisition unit, the biological signal acquired by the acquisition unit, the detection unit that detects whether or not the monitored person's breathing is abnormal, the storage unit, and the detection unit of the monitored person. When the respiratory abnormality is detected, the processing unit that stores the image of the monitored person captured by the imaging unit in the storage unit and the detection unit during the time zone including the time when the respiratory abnormality is detected. When a respiratory abnormality of the monitored person is detected, the terminal device includes a transmitting unit that transmits an image of the monitored person captured by the imaging unit during the time zone, and the terminal device is provided by the transmitting unit. It includes a receiving unit that receives the transmitted image of the monitored person, and a display control unit that displays the image of the monitored person received by the receiving unit on the display unit.

The biological monitoring system according to the third aspect of the present embodiment defines the biological monitoring device according to the first aspect of the present embodiment from the viewpoint of the system, and the biological monitoring according to the first aspect of the present embodiment. It has the same effect as the device.

This application is based on Japanese Patent Application No. 2016-128649 filed on June 29, 2016, the contents of which are included in the present application.

In order to express the present invention, the present invention has been appropriately and sufficiently described through the embodiments with reference to the drawings described above, but those skilled in the art can easily change and / or improve the above-described embodiments. It should be recognized that it can be done. Therefore, unless the modified or improved form implemented by a person skilled in the art is at a level that deviates from the scope of rights of the claims stated in the claims, the modified form or the improved form is the scope of rights of the claims. It is interpreted as being comprehensively included in.

According to the present invention, it is possible to provide a biological monitoring device, a biological monitoring method, and a biological monitoring system.

Claims (11)

An acquisition unit that acquires the biological signal of the monitored person to be monitored, and
Based on the biological signal acquired by the acquisition unit, a detection unit that detects whether or not the person being monitored has abnormal breathing, and a detection unit.
An imaging unit that captures the image of the monitored person, and
When the breathing of the person being monitored by the detecting unit abnormality is detected, during the time zone including the time at which the breathing abnormality is detected, an image of the monitored person captured by the imaging unit to the serial憶部Processing unit to memorize and
In response to the detection of the respiratory abnormality of the monitored person by the detection unit, information indicating the occurrence of the respiratory abnormality and the image of the monitored person captured by the imaging unit are transmitted to the mobile terminal. A biological monitoring system including a transmitter to perform . A control unit that causes the imaging unit to continuously image the monitored person,
With a ring buffer,
The processing unit stores the image of the monitored person continuously imaged by the imaging unit in the ring buffer.
When the respiratory abnormality is detected by the detection unit, the processing unit reads out from the ring buffer an image of the monitored person captured at a predetermined timing before the detection of the respiratory abnormality. The biological monitoring system according to claim 1, wherein the storage unit stores the living body. When the respiratory abnormality is detected by the detection unit, the image pickup unit is further provided with a control unit for capturing an image of the monitored person.
The biological monitoring system according to claim 1, wherein the processing unit stores an image of the monitored person captured by the imaging unit when the respiratory abnormality is detected by the detection unit in the storage unit. The processing unit generates a silhouette image in which the image of the monitored person included in the image of the monitored person is a silhouette, and stores the silhouette image in the storage unit. Any one of claims 1 to 3. The biological monitoring system described in. The acquisition unit according to any one of claims 1 to 4, wherein the acquisition unit includes a Doppler sensor unit that outputs a Doppler signal of a Doppler frequency component as a biological signal based on a transmitted wave and a reflected wave of the transmitted wave. Biological monitoring system . The biological monitoring system according to any one of claims 1 to 5, wherein the imaging unit captures a plurality of still images arranged in a time series . Prior Symbol detector, on the basis of the waveform of the respiration signal based on the biological signal, the person being monitored for breathing to detect whether abnormal or not, biological monitoring system according to any one of claims 1 to 6 .. The detection unit detects whether or not the monitored person's respiration is abnormal based on the respiration waveform pattern of the respiration signal, the respiration rate, and the amplitude value of the respiration waveform indicated by the respiration signal, according to claim 7. The described biomonitoring system . The detection unit selects a respiratory abnormality to be detected from among a plurality of types of respiratory abnormalities based on an index indicating the health condition of the monitored person, and selects one or more respiratory abnormalities to be detected. The biological monitoring system according to claim 8, wherein for each of them, it is detected whether or not the monitored person's respiration is abnormal . Any of claims 1 to 9, further comprising a mobile terminal that receives the information indicating the occurrence of the respiratory abnormality and the image of the monitored person, and displays the image of the monitored person together with the information indicating the occurrence of the respiratory abnormality. The biological monitoring system according to item 1 . On the computer
The acquisition step to acquire the biological signal of the monitored person to be monitored, and
Based on the biological signal acquired by the acquisition step, a detection step for detecting whether or not the person being monitored has abnormal breathing , and a detection step.
When the respiratory abnormality of the monitored person is detected by the detection step, the image of the monitored person captured by the imaging unit is stored in the storage unit during the time zone including the time when the respiratory abnormality is detected. Processing steps and
A transmission step of transmitting information indicating the occurrence of the predetermined respiratory state and an image of the monitored person to the mobile terminal in response to the detection of the respiratory abnormality of the monitored person by the detection step .
A program of a biological monitoring system that executes .

Images