JP4728886B2 - Perceptual information presentation device - Google Patents

Description

  The present invention relates to a perceptual information presentation device that presents an amount estimated to be perceived by a person with respect to any stimulus of the human senses such as taste and hearing.

  Conventionally, sensing devices such as a thermometer, a hygrometer, an anemometer, a seismometer, and a microphone measure changes in physical quantities existing in the environment. For example, a microphone converts sound into an electrical signal, and measures the loudness from the value of the electrical signal. Further, the thermometer uses a physical phenomenon that varies depending on the temperature, and measures the physical quantity that varies depending on the change in the physical phenomenon, thereby grasping the temperature.

  Other examples of sensing devices that detect changes in this type of physical phenomenon include Non-Patent Documents 1 to 5, for example.

  Non-Patent Document 1 discloses a system that detects the movement of a person in the home and estimates the physical condition based on the sensing data.

  Non-Patent Document 2 discloses a technique for quantitatively evaluating the taste of rice using a membrane potential response type multi-channel taste sensor of a lipid polymer membrane.

  Non-Patent Document 3 discloses a highly sensitive gas sensor using a microchannel gas sensor using IC technology as one of semiconductor thin film gas sensors.

  In Non-Patent Document 4, a technique aimed at realizing robust odor sensing that is not easily affected by disturbances such as temperature and odor concentration and disturbance such as humidity by using a high-speed and high-concentration odor supply method to the sensor cell. Is disclosed.

  Non-Patent Document 5 discloses a method for measuring biological information of an animal at the time of electric beam therapy using an air dynamic pressure sensor as an example of a physiological information sensing device.

On the other hand, humans perceive various stimuli due to such changes in physical phenomena. In other words, perception is to mean a stimulus felt from the outside world. Based on sensory information such as visual sense, auditory sense, touch sense, taste sense, smell sense, somatic sense, sense of balance, etc., this process is reconstructed as a subjective experience of “hot”, “heavy”, “hard”, etc. It can also be said.
Shinichiro Otsuka, Masayuki Inoue, Koichiro Kubo, Yuichi Fujino, Hiroki Kuwano, “Proposal of physical condition detection system focusing on the life of the elderly”, The Institute of Electrical Engineers of Japan, March 2002, Kogakuin University Hide Ezaki, Rei Watanabe, Satoru Iiyama, Kiyoshi Toko, “Taste Extraction Method of Rice and Application to Taste Sensor”, The Institute of Electrical Engineers of Japan, March 2002, Kogakuin University Akihito Ito, Kazuhiro Hara, "Study on microchannel gas sensor for gas selectivity improvement", IEEJ National Convention, March 2002, Kogakuin University Nagafumi Sumitomo, Takamichi Nakamoto, “Study on Odor Sensing System Using Sensor Cell Directly Concentrating Element”, IEEJ National Conference, March 2002, Kogakuin University Hiroaki Kuno, Shigeo Hara, Hitomi Takahashi, Toshiyuki Saito, Mitsuru Takashima, Hiroaki Ohkawai, “Measurement of Animal Biological Information During Electrobeam Therapy Using Air Dynamic Pressure Sensors”

  In this way, perception includes many subjective elements, so even if a person is subjected to the same physical stimulus, how much information is perceived by others and how much information is appropriate? It is difficult to grasp quantitatively whether it is only small. Therefore, there is no technique for presenting how much a person feels with respect to a certain stimulus, that is, how much it is perceived.

  For this reason, for example, you may be louder than necessary during a conversation, or conversely, continue speaking in a voice that the other person cannot hear, or add a chili pepper while the other person feels painful while eating, There is a problem that it may give the other stimulus more than necessary, or misunderstood behavior, such as misunderstanding that the nose is fully enjoyed even though the nose is clogged.

  The present invention has been made in view of such circumstances, and when the physical quantity of the environment changes and a person is stimulated, the amount perceived by the person is determined based on the change of the physical quantity of the environment. An object of the present invention is to provide a perceptual information presentation device capable of estimating and presenting an estimation result.

  In order to achieve the above object, the present invention takes the following measures.

  That is, the perceptual information presentation device of the invention of claim 1 includes a stimulus physical quantity sensing means, an input means, a database unit, a stimulus perception amount estimating means, and an output means. Then, the stimulus physical quantity sensing means senses a stimulus physical quantity that is a physical quantity that stimulates one of the five senses of a person, and outputs a sensing result. In addition, a subjective sense amount for the stimulus perceived by the person who receives the stimulus is input to the input means by the person. Further, the database unit holds history information in which the sensory quantity input by the input unit and the stimulus physical quantity sensed by the stimulus physical quantity sensing unit corresponding to the sensory quantity are stored in association with each other. Then, in the stimulus perception amount estimation means, when the sensing result is output from the stimulus physical quantity sensing means, it is output based on the history information before the sensing result is accumulated in the database section and the output sensing result. The estimated amount of stimulus perception estimated to be perceived by a person based on the stimulus physical quantity corresponding to the sensing result obtained is obtained. In the output means, the sensory quantity input to the input means by a person who has received a stimulus corresponding to the stimulus physical quantity and the stimulus perception estimated quantity obtained by the stimulus perceptual quantity estimation means are output in association with the stimulus physical quantity. Is done.

  Next, the invention of claim 2 is the perceptual information presentation device of claim 1, wherein the physiological response amount of the person who receives the stimulus is synchronized with the input of the sensory amount to the input means made by this person. And a physiological response amount sensing means for sensing and outputting a sensing result. The database unit, as history information, in addition to the sensory quantity and the stimulus physical quantity, the corresponding stimulus perceptual estimated quantity obtained by the stimulus perceptual quantity estimating means and the corresponding sensed by the physiological response quantity sensing means. History information accumulated in association with physiological reaction amounts is held. In addition, when the sensing result is output from the physiological response amount sensing unit, the stimulus perception amount estimation unit is based on the history information before the sensing result is accumulated in the database unit and the output sensing result, A stimulus perception estimator that is estimated to be perceived by a human by a stimulus corresponding to the output sensing result is obtained.

  Next, in the perceptual information presentation device according to the second aspect of the present invention, when the sensing perception amount estimation means outputs the sensing result from the physiological response amount sensing means, the sensing result is output to the database unit. It is presumed that a person perceived by a stimulus corresponding to a physiological response amount that is a sensing result only when the sensory amount and the stimulus physical quantity are not stored in a one-to-one correspondence in the history information before accumulating Obtain the estimated stimulus perception.

  According to a fourth aspect of the present invention, in the perceptual information presentation device according to the second or third aspect of the present invention, the apparatus further comprises a clustering unit that clusters the physiological response amounts sensed by the physiological response amount sensing unit. Then, the database unit holds history information in which physiological response amounts clustered by the clustering unit are accumulated as history information instead of physiological response amounts. When the sensing result is output, the stimulus perception estimation unit outputs a classification result based on the history information before the sensing result is accumulated in the database unit, the clustering result by the clustering unit, and the output sensing result. A stimulus perception estimator estimated to be perceived by a human by a stimulus corresponding to the corresponding physiological response amount is obtained.

  According to a fifth aspect of the present invention, in the perceptual information presentation device according to the first aspect of the present invention, the information on the environment to which the person who has been exposed is exposed is synchronized with the input of the sensory amount to the input means made by this person. Environmental information sensing means for sensing and outputting the sensing result. In addition to the sensory amount and the stimulus physical quantity, the database unit holds history information that is stored in association with the environmental information sensed by the environmental information sensing means, as history information. Further, when the sensing result is output from the environmental information sensing unit, the stimulus perception estimation unit is output based on the history information before the sensing result is accumulated in the database unit and the output sensing result. A stimulus perception estimator that is estimated to be perceived by a person due to a stimulus received by the person in an environment corresponding to the sensing result is obtained.

  According to the present invention, when the physical quantity of the environment changes and the person is stimulated, the amount perceived by the person is estimated based on the change of the physical quantity of the environment, and the estimation result is presented. A possible perceptual information presentation device can be realized.

  The best mode for carrying out the present invention will be described below with reference to the drawings.

  FIG. 1 is a functional block diagram showing a configuration example of a perceptual information presentation device according to an embodiment of the present invention.

  That is, the perceptual information presentation device 10 according to the embodiment includes a stimulus physical quantity sensing unit 12, a physiological response quantity sensing unit 13, a subjective input unit 14, an environment information sensing unit 15, and a storage device that stores a database. 16, a stimulus perception amount estimation unit 18, a perception information presentation unit 20, and a clustering unit 21.

  As described above, perception includes five senses such as vision, hearing, touch, taste, and smell, and sensory information such as somatic sensation and balance sensation. Therefore, the perceptual information presentation apparatus 10 determines the optimum configuration such as the type of sensor applied to each part and the hardware depending on which of these is perceived.

  Therefore, the functional block diagram shown in FIG. 1 is a general-purpose basic configuration example shown for the purpose of easily understanding the concept of the perceptual information presentation apparatus of the present invention. The configuration shown in FIG. The perceptual information presentation apparatus of the present invention is based on the basic configuration example as shown in FIG. 1 and selects an appropriate sensor according to the target perception, adds necessary functions, integrates, transforms, partially changes, etc. It is understood that these are also realized within the technical scope of the present invention.

  In FIG. 1 showing such a basic configuration example, the stimulus physical quantity sensing unit 12 senses a stimulus physical quantity that is a physical quantity that stimulates one of the five senses of the person, and outputs the sensing result to the clustering unit 21. And output to the stimulus perception amount estimation unit 18.

  The subjective input unit 14 is an input means for the person to input a subjective sensory amount perceived by the person who has received the stimulus. The sensory amount does not need to be a strict value, and may be a stepped amount such as excessive, appropriate, or excessive. In addition, the threshold values at these stages can be set to arbitrary initial values so as to be appropriate by the user or developer. However, since this initial value can be updated by the subsequent subjectivity of the person, setting accuracy is not required anyway. The timing at which a person inputs to the subjective input unit 14 is basically immediately after receiving a stimulus. However, in the case of a stimulus that is not instantaneously perceived, such as a taste, it may be input at an appropriate timing according to the stimulus, such as input after perception. Then, the subjective input unit 14 writes the input sensory amount in a database stored in the storage device 16 and outputs it to the perceptual information presentation unit 20.

  The physiological response amount sensing unit 13 senses the physiological response amount of the person who receives the stimulus in synchronization with the sensing by the stimulus physical quantity sensing unit 12. Then, the physiological response amount as the sensing result is output to the clustering unit 21 and the perceptual information presentation unit 20.

  The environment information sensing unit 15 senses environment information (environment information) to which a person who has been exposed is exposed in synchronization with sensing by the stimulus physical quantity sensing unit 12. Then, the sensing result is output to the clustering unit 21 and also output to the stimulus perception amount estimation unit 18.

  The clustering unit 21 uses the stimulation physical quantity sensing unit 12, the physiological response quantity sensing unit 13, and the environment information sensing unit 15 to obtain the stimulation physical quantity, the physiological response quantity, and the environment information, which are sensing results, for example, a support vector machine. Are respectively clustered, and the clustered stimulus physical quantity, physiological response quantity, and environment information are written in a database stored in the storage device 16.

  The storage device 16 is composed of hardware such as a hard disk and a memory, and stores a database. This database holds history information that is accumulated by associating stimulus physical quantities, physiological response quantities, and environmental information, which are clustered sensing results output from the clustering unit 21.

  When a stimulus physical quantity that is a sensing result is output from the stimulus physical quantity sensing unit 12, the stimulus perception amount estimating unit 18 outputs history information before the sensing result is accumulated in the database stored in the storage device 16, and this output. Based on the stimulus physical quantity that is the sensing result obtained, a stimulus perception estimation amount that is estimated to be perceived by a person is obtained from the stimulus physical quantity. Further, when a corresponding sensing result is output from the clustering unit 21, in the history information before the sensing result is accumulated in the database, the sensory quantity and the stimulus physical quantity are not accumulated in one-to-one correspondence. Only, based on historical information before this sensing result is accumulated in the database and the output physiological response amount, the stimulus perception estimation that is estimated to be perceived by the stimulus corresponding to this physiological response amount Find the amount. Further, when environmental information that is a sensing result from the environmental information sensing unit 15 is output, based on history information before the sensing result is accumulated in the database and the output sensing result, A stimulus perception estimator estimated to be perceived by a person due to a stimulus received in an environment corresponding to certain environmental information is obtained. The stimulus perception estimator does not need to be a strict value, and may be a stepwise process such as overstimulation, appropriate stimulation, or understimulation. In addition, the stimulus perception estimation amount is obtained with a slight delay from the output of the sensing result. Then, the calculated estimated amount of stimulus perception (for example, excessive stimulus, appropriate stimulus, or under stimulus) is output to the perceptual information presentation unit 20.

  The perceptual information presentation unit 20 is input to the subjective input unit 14 by a person who receives a stimulus corresponding to the stimulus physical quantity, and is output from the subjective input unit 14, and a stimulus perceptual quantity estimation unit for the stimulus physical quantity. 18 is output in association with the estimated amount of stimulus perception obtained by 18.

  Next, a detailed configuration example for a specific stimulus of the perceptual information presentation device 10 according to the present embodiment will be described. First, a specific example of the stimulus physical quantity sensing unit 12 will be described.

  Sound stimulation corresponds to sound volume, sound frequency, and the like. Therefore, when sensing the physical quantities of these stimuli, a microphone or a sound level meter is used as the stimulus physical quantity sensing unit 12.

  Next, stimuli for taste and smell will be described. Both taste and olfaction belong to chemical sensations because chemical substances such as molecules, ions, and gases act on the receptors, and the receptors are called chemoreceptors. Substances that produce taste and odor are usually numerous and chemoreceptors are organs that collect information on many of these substances.

  Therefore, as a stimulus for olfaction, a quantitative ratio of various kinds of chemical substances constituting gas can be considered. Therefore, as the stimulus physical quantity sensing unit 12, a gas sensor capable of detecting many kinds of chemical substances is used.

  On the other hand, as a stimulus for taste, the ratio of various kinds of chemical substances constituting food as well as olfaction can be considered. The surface of human taste cells consists of lipid membranes and proteins. On this cell membrane surface, the five basic tastes, which are the basic elements of taste, are received by different mechanisms. It is thought that sour, salty, and bitter substances are adsorbed nonspecifically on lipid membranes, and sugars, umami substances, etc. are adsorbed specifically on proteins to generate signals. Therefore, as the stimulus physical quantity sensing unit 12, a taste sensor simulating such a taste cell structure is used. This taste sensor is composed of an electrode in which a plurality of different types of artificial lipid membranes are impregnated in an organic membrane and immobilized on a substrate. The membrane potential generated when the tastant is adsorbed on the plurality of electrodes is measured as a sensing result.

  Moreover, the pressure with respect to skin can be considered as a stimulus for tactile sense, and a pressure sensor, seismometer, hygrometer, and anemometer are used as the stimulus physical quantity sensing unit 12.

  A temperature may be considered as a stimulus for the warm sense, and a temperature sensor is used as the stimulus physical quantity sensing unit 12.

  Lightness (light quantity and luminous flux), saturation, and hue are considered as stimuli for vision, and an imaging device, a light meter, an illuminometer, and the like are used as the stimulus physical quantity sensing unit 12.

  The sensing result from the stimulus physical quantity sensing unit 12 that is appropriately selected according to the type of stimulus does not need to correlate accurately or directly with the subjective sensory amount felt by the person. It is only necessary to have an indirect relationship that there is a possibility that the subjective sensory amount felt by a person may be affected.

  Next, a specific example of the subjective input unit 14 will be described. As described above, the subjective input unit 14 is an input means for the person to input a subjective sense amount for the stimulus perceived by the person who has received the stimulus. An example of such a subjective input unit 14 includes two input buttons including first to second inputs. Then, when a person receives a stimulus, the subject's subjectivity is judged to be in one of three stages: a large amount of sensation, an appropriate amount of sensation, or a small amount of sensation. Then, the first button is pressed when the stimulus is felt to be excessive (the sensory amount is large), and the second button is pressed when the stimulus is felt to be too small (the sensory amount is small). On the other hand, when the user feels appropriate (appropriate sensory amount), the user does not press any button. Alternatively, for example, it is possible to make a two-stage determination of only appropriate or inappropriate. In this case, if the user feels inappropriate, the first button is pressed. If the user feels appropriate, the second button is pressed.

  For example, in the case of stimuli for hearing, judgment is made in three stages: sudden volume and steady volume (noise, etc.), noisy (excessive), appropriate amount (appropriate), and too quiet (not too low). Similarly, in the case of a stimulus for pain sensation, judgment is made in three stages: painful (excessive), non-painful (appropriate), or unfeeling (undersized). Also, if the stimulus for warm sense is hot (excessive), appropriate temperature (appropriate), cold (underestimated), or if the stimulus for odor sense is odor (bad), you don't mind (normal) Judgment is made in three stages of smell (good). On the other hand, in the case of stimuli to taste, it is roughly classified and judged in two steps: poor (bad) or delicious (good), or sweet (excess), appropriate (appropriate), or not sweet (under-) Or spicy (excessive), appropriate (appropriate), not spicy (excessive), sour (excessive), appropriate (appropriate), not sour (excessive), bitter (excessive), appropriate (appropriate) It is also possible to make a judgment in three steps: whether it is not bitter (too small), has a large amount of umami components (excess), is appropriate (appropriate), or has a small amount of umami components (under). If it is in two stages, it is a sensation that the stimulation in the case of a deficiency is appropriate.

  When the subjective input unit 14 determines in three stages, any of the information indicating the high sensory amount when the first button is pressed, and the information indicating the low sensory amount when the second button is pressed, When the button is not pressed, information indicating that the sensory amount is appropriate is written in the database stored in the storage device 16 and output to the sensory information presentation unit 20. On the other hand, when the determination is made in two stages, the information stored in the storage device 16 includes information indicating inappropriateness when the first button is pressed and information indicating appropriateness when the second button is pressed. And output to the perceptual information presentation unit 20.

  Next, details of the stimulus perception estimation amount estimated in consideration of the physiological response amount sensing unit 13 and the physiological response amount that is a sensing result by the physiological response amount sensing unit 13 will be described.

  The amount of subjective sensation that a person receives by stimulation varies depending on the condition of the person even if the amount of stimulation is constant. For example, even if a certain sound stimulus is given, it may feel “noisy” when a person is concentrating on work or study, but if it is not, it may feel “appropriate” unknown.

  Therefore, the physiological response amount sensing unit 13 senses a person's physiological response amount, and reflects the sensing result in the estimation of the stimulus perception estimation amount performed in the stimulus perception amount estimation unit 18, thereby providing a subjective response. Considering the fluctuation of the sensation, more accurate estimation of the stimulus perception estimator according to the human condition is performed.

  Physiological response amount refers to all information that can be acquired from the human body, such as heart rate, brain waves, myoelectricity, blood components, eye movement, pulse rate, respiratory rate, sweating, gaze direction, blood pressure, walking or sitting balance. Sure.

  Sensing the physiological response amount and reflecting the sensing result in the estimation of the stimulus perception estimation amount performed in the stimulus perception amount estimation unit 18 is that the sensory amount is one-to-one for stimuli having the same stimulus physical quantity. It is effective when it does not correspond to. In this case, the sensory amount corresponding to the same stimulus physical quantity is a combination of an excess stimulus and an appropriate stimulus, or a combination of an appropriate stimulus and an understimulation.

  The clustering unit 21 pays attention to this, and outputs at least one or more physiological information output from the physiological response amount sensing unit 13 (in the case of obtaining a plurality of patterns, a numerical array pattern thereof, when clustering with a support vector machine) Select the two axes that are likely to have the greatest impact), and cluster them into the overstimulus and appropriate stimulus clusters, or into the appropriate and understimulus clusters using a support vector machine, for example. The sensory amount is stored in the history information of the database so that the sensory amount uniquely corresponds to the input of one cluster of the stimulus amount and physiological information.

  Then, the stimulus perception amount estimation unit 18 uses this history information to estimate a stimulus perception estimation amount in consideration of human physiological information with respect to a certain physical stimulus amount.

  Next, details of the estimated amount of stimulus perception estimated in consideration of the environmental information sensing unit 15 and the environmental information that is a sensing result by the environmental information sensing unit 15 will be described.

  By using the environment information sensing unit 15 instead of the physiological response amount sensing unit 13, it is possible to obtain the estimated stimulus perception amount in consideration of the environment information instead of the physiological response amount. The environmental information is information on the environment accompanied by a stimulus other than the physical stimulus. Such environmental information also has an element that affects the amount of human sense. Therefore, unlike the stimulus physical quantity sensing unit 12, the environment information sensing unit 15 that senses such environment information is not used to detect a physical stimulus, but a stimulus that humans cannot perceive subjectively. Even so, it senses what seems to have some influence on people. Examples of such a device include an ultraviolet intensity meter, an electromagnetic wave measuring device, an ultrasonic detection device, a low frequency detection device, and a metal detector.

  Next, the operation of the perceptual information presentation device 10 according to the present embodiment will be described using the flowchart shown in FIG.

  First, when a stimulus is given to a person, the stimulus physical quantity sensing unit 12 senses a stimulus physical quantity that is a physical quantity corresponding to the stimulus, and the sensing result is output to the clustering unit 21 and the stimulus perception quantity estimation is performed. The data is output to the unit 18 (S1).

  In addition, the physiological response amount sensing unit 13 senses the physiological response amount of the person who has received this stimulus in synchronization with the sensing by the stimulus physical quantity sensing unit 12. Then, the physiological response amount as a sensing result is output to the clustering unit 21 and the perceptual information presentation unit 20 (S2).

  Furthermore, the environment information sensing unit 15 senses information on the environment (environment information) where the person who received the stimulus was exposed in synchronization with the sensing by the stimulus physical quantity sensing unit 12. Then, the sensing result is output to the clustering unit 12 and is also output to the stimulus perception amount estimation unit 18 (S3).

  In addition, the person who has received this stimulus inputs a subjective sensory amount (for example, whether it is excessive, appropriate, or insufficient) to the subjective input unit 14. The input sensory amount is written in the database stored in the storage device 16 and is output to the sensory information presentation unit 20 (S4).

  In the flowchart shown in FIG. 2, steps S1 to S3 are described separately, but as described above, the operations of steps S1 to S3 are performed in synchronization.

  On the other hand, in the clustering unit 21, each sensing result is clustered using, for example, a support vector machine, and the clustered stimulus physical quantity, physiological response quantity, and environment information are written in the database stored in the storage device 16 ( S5).

  A history stored in the database stored in the storage device 16 in association with sensory quantities output from the subjective input unit 14, stimulus physical quantities corresponding to the sensory quantities, physiological reaction quantities, and environmental information. Information is retained.

  When the stimulus physical quantity sensing unit 12 outputs a stimulus physical quantity that is a sensing result from the stimulus physical quantity sensing unit 12, the stimulus perceptual quantity estimating unit 18 outputs history information before the clustered sensing results are accumulated in the database stored in the storage device 16. Then, based on the stimulus physical quantity that is the output sensing result, a stimulus perception estimation amount that is estimated to be perceived by a person is obtained from the stimulus physical quantity. Further, when a physiological response amount, which is a sensing result, is output from the physiological response amount sensing unit 13, the sensory amount and the stimulus physical amount are one-to-one in the history information before the clustered sensing results are accumulated in the database. Only when this sensing result that has been clustered is stored in the database, and corresponding to the physiological response amount, only when the response is not stored corresponding to A stimulus perception estimator estimated to be perceived by a person due to the stimulus is obtained. Further, when environmental information that is a sensing result from the environmental information sensing unit 15 is output, based on the history information before the clustered sensing results are stored in the database and the output sensing results, A stimulus perception estimator estimated to be perceived by a person due to a stimulus received in an environment corresponding to environmental information as a sensing result is obtained. The stimulus perception estimator does not need to be a strict value, and may be a stepwise process such as overstimulation, appropriate stimulation, or understimulation. Further, the determination of the stimulus perception estimation amount is performed almost in real time when the sensing result is output, and the determined stimulus perception estimation amount (for example, the overstimulation, the appropriate stimulation, or the understimulation) 20 (S6).

  The above description regarding the stimulus perception amount estimation unit 18 describes an estimation method in the case where data that matches the data clustered by the clustering unit 21 exists in the database. If there is no data in the database that matches the data clustered by the clustering unit 21, the ambiguity is estimated as follows.

  That is, in the stimulus perception amount estimation unit 18, when there is no data in the database that matches the data clustered by the clustering unit 21, only the stimulus physical amount from the stimulus physical quantity sensing unit 12 is seen and a specific cluster is obtained. Check whether it can be determined. If a cluster is uniquely determined for this stimulus physical quantity, the discrimination is ended and the result is output.

  On the other hand, when a cluster is not uniquely determined, a plurality of not all physiological response amounts and environmental information (which may be composed of a plurality of data) obtained at the time of detecting a stimulus physical quantity are not all. Based on the data, if there is a data string that matches in the past and a cluster can be uniquely determined, the determination is terminated and the result is output.

  If there is still no matching data, the cluster with high likelihood is based on the statistics (eg, distribution average, median, etc.) of the divided clusters (eg, three: excess, appropriate amount, and under). And output the result.

  In the perceptual information presentation unit 20, the sensory amount output from the subjective input unit 14 and the stimulus perception estimation amount obtained by the stimulus perception amount estimation unit 18 are output in association with the stimulus physical amount (S 7). .

  As described above, in the perceptual information presentation device 10 according to the present embodiment, when the physical quantity of the environment changes and a person is stimulated by the above-described action, the change in the physical quantity of the environment A subjective sensory amount of how much a person has received is accumulated as history information in association with the corresponding physical stimulus quantity. Then, by using this accumulated history information, when the physical quantity of the environment changes, the stimulus perception estimator that estimates how much stimulus the person perceives subjectively from the change in the physical quantity And present the results.

  Also, the subjective amount of sensation that a person receives by stimulation varies depending on the person's condition even if the amount of stimulation is constant. Therefore, in the perceptual information presentation device 10 according to the present embodiment, the physiological response amount sensing unit 13 senses a human physiological response amount, and reflects this sensing result in the estimation of the stimulus perception estimation amount. Thus, it is possible to obtain a more accurate stimulus perception estimator according to the human condition in consideration of subjective sensory fluctuations and present the result.

  In this way, sensing the physiological response amount and reflecting the sensing result in the estimation of the stimulus perception estimation amount performed in the stimulus perception amount estimation unit 18 is particularly effective for stimuli having the same stimulus physical quantity. This is effective when the sensory amount does not correspond one-on-one.

  On the other hand, environmental information, which is environmental information with stimuli other than those targeted as physical stimuli, also has an element that affects the amount of human sense. Since the perceptual information presentation device 10 according to the present embodiment includes the environmental information sensing unit 15, it is possible to obtain the estimated stimulus perception amount in consideration of the environmental information and present the result.

  As described above, the perceptual information presentation device 10 according to the present embodiment can more accurately determine the stimulus perception estimation amount.

  The best mode for carrying out the present invention has been described above with reference to the accompanying drawings, but the present invention is not limited to such a configuration. Within the scope of the invented technical idea of the scope of claims, a person skilled in the art can conceive of various changes and modifications. The technical scope of the present invention is also applicable to these changes and modifications. It is understood that it belongs to.

  For example, some specific examples of the perceptual information presentation apparatus 10 according to the present embodiment as described above will be described below. These are the perceptual information presentation apparatus according to the present embodiment as described above. Based on 10 basic configurations, it is realized by selecting appropriate hardware according to the specific application, adding necessary components, integrating, transforming, changing parts, etc. It is understood that it belongs to the technical scope of the present invention.

(Example 1)
The perceptual information presentation device 30 whose functional block diagram is shown in FIG. 3 is a modification of the perceptual information presentation device 10 according to the present embodiment. This perceptual information presentation device 30 includes a stimulus physical quantity sensing unit 31, a physiological response quantity sensing unit 13, a physiological response quantity sensing unit 13, and a physiological response quantity sensing unit 32 corresponding to the subjective input unit 14 shown in FIG. A subjective input unit 33 is provided. Further, a physiological information clustering unit 34 corresponding to the clustering unit 21 in FIG. 1 is provided. In addition, although there is no corresponding portion in FIG. 1, a subjective input value clustering unit 35 is provided in a portion corresponding to between the subjective input unit 14 and the stimulus perception amount estimating unit 18 in FIG. 1. Further, a detailed subjective value estimation unit 36, a subjective value estimation unit 37, and a subjective value relative physical quantity calculation unit 38 are provided as parts corresponding to the stimulus perception amount estimation unit 18 in FIG. Furthermore, a subjective value relative physical quantity display device 39 corresponding to the perceptual information presentation unit 20 in FIG. 1 is provided.

  In such a perceptual information presentation device 30, when a person receives a physical stimulus, the subjective input unit 33 is used to input an excessive, appropriate, or insufficient sensory amount. This input information is output to the subjective input value clustering unit 35 and the physiological information clustering unit 34. The subjective input value clustering unit 35 clusters input information to the subjective input unit 33 and holds the result as a database. The results held in this database can be acquired by the subjective value estimation unit 37.

  In addition, the physiological response amount sensing unit 32 measures a physiological response amount (for example, a pulse, an electroencephalogram, etc.) of a person who has been stimulated in synchronization with the sensory amount input to the subjective input unit 33. The measurement result is output to the physiological information clustering unit 34 and the detailed subjective value estimation unit 36, and the stimulus physical quantity sensing unit 31 calculates the physical quantity of the physical stimulus in synchronization with the sensory quantity input to the subjective input unit 33. The measurement result is output to the physiological information clustering unit 34, the detailed subjective value estimation unit 36, the subjective value estimation unit 37, and the subjective value relative physical quantity calculation unit 38.

  The physiological information clustering unit 34 performs clustering on the results output from the stimulus physical quantity sensing unit 31, the physiological response quantity sensing unit 32, and the subjective input unit 33, and holds the results as a database. The result held in this database can be acquired by the detailed subjective value estimation unit 36.

  Based on the information output from the physical quantity sensing unit 31 and the physiological response quantity sensing unit 32, and the information stored in the database of the physiological information clustering unit 34, the detailed subjective value estimation unit 36 performs physical stimulation on the physical stimulus. It is estimated how much subjective sensation the person has received, and the estimation result is output to the subjective value relative physical quantity calculator 38.

  The subjective value estimation unit 37 is based on the information output from the stimulus physical quantity sensing unit 31 and the information stored in the database of the subjective input value clustering unit 35 to determine how subjective the person is with respect to the physical stimulus. It is estimated whether the sensory quantity has been received, and the estimation result is output to the subjective value relative physical quantity calculation unit 38.

  The subjective value relative physical quantity calculation unit 38 calculates the estimation result based on the estimation results output from the detailed subjective value estimation unit 36 and the subjective value estimation unit 37 and the sensing result output from the stimulus physical quantity sensing unit 31. A relative comparison between each subjective value and the stimulus physical quantity is performed, and the comparison result is output to the subjective value relative physical quantity display device 39.

  The subjective value relative physical quantity display device 39 displays the comparison result output from the subjective value relative physical quantity calculation unit 38.

(Example 2)
The perceptual information presenting apparatus 10 according to the present embodiment changes the installation location of the stimulus physical quantity sensing unit 12 according to the application, so that a sensory quantity (a large sensory quantity, appropriate sensory quantity, sensory quantity) for a stimulus that a person wants to know. Small amount). For example, let the person wear the entire apparatus or attach at least the stimulus physical quantity sensing unit 12 and send the sensing result from the stimulus physical quantity sensing unit 12 to the storage device 16 and the stimulus perception amount estimating unit 18 via the wireless network. To do. At this time, the physical quantity acquired by the stimulus physical quantity sensing unit 12 is considered to be equivalent to the stimulus quantity received by the wearer. Then, the person presents the subjective amount of sensation received by the stimulus (for example, excessive or appropriate or small) to the operator, and the operator inputs the presented sensation amount to the subjective input unit 14. The stimulus perception estimation amount is obtained by the stimulus perception amount estimation unit 18, and the sensory amount output from the subjective input unit 14 and the stimulus perception physical amount are obtained by the stimulus perception amount estimation unit 18 by the perception information presentation unit 20. The estimated amount of stimulus perception is output in association with it.

(Example 3)
An example in the case of perceiving an auditory stimulus using the perceptual information presentation device 10 according to the present embodiment is shown in FIG. This is a device 40 having a headphone type configuration that is worn on a person's ear, and is provided with the ear wearing portion 41 so that the entire device 40 is worn on the person's ear. In this case, a microphone 42 having a sound collecting function is applied as the stimulus physical quantity sensing unit 12 in FIG. 1, and a button 44 (# 1) for inputting an excess stimulus and a button 44 (# 1) for inputting a less stimulus are used as the subjective input unit 14. 1), and the perceptual information presentation unit 20 in FIG. 1 has a light-emitting device 43 that can emit two or more colors for indicating overstimulation or understimulation such as an LED, and is physiological. A pulse meter or electroencephalograph 45 is applied as the reaction amount sensing unit 13.

  Further, a form in which a person holds the stimulus physical quantity sensing unit 12 and directs the stimulus physical quantity sensing unit 12 to a stimulus around the person is also conceivable. Alternatively, a form in which a person installs and manages the stimulus physical quantity sensing unit 12 remotely or operates it is also conceivable. In these cases, the person can know whether the stimulation is excessive, appropriate, or insufficient before receiving the stimulation by presenting the stimulation perception estimation amount from the stimulation perception amount estimation unit 18 to the person.

Example 4
FIG. 5 shows another example in the case of perceiving auditory stimulation using the perceptual information presentation device 10 according to the present embodiment. This is a microphone-type device 50 provided with a grip part 51 held by a person, and has, for example, a microphone 52 having a sound collection function as the stimulus physical quantity sensing unit 12 in FIG. . Further, the subjective input unit 14 in FIG. 1 includes a button 53 (# 1) for a person to input an excess stimulus and a button 53 (# 2) for an input of an understimulation. Further, the sensory information presenting unit 20 in FIG. 1 has a light emitting unit 54 that can emit two or more colors for indicating an overstimulation or understimulation such as an LED, and the physiological reaction amount sensing unit 13 has a pulse meter or myoelectricity. Sensor 55 is applied.

(Example 5)
FIG. 6 shows an example in which an ID tag is applied to the perceptual information presentation device 10 according to the present embodiment. In this case, the physical sensing 61 is not directly sensed by the stimulating physical quantity sensing unit 12, but an ID tag 62 is provided in advance to an object having the physical stimulation 61, whereby an ID sensing device 63 and a storage device 64 are provided. The physical stimulus 61 is sensed by the database 65 of the physical stimulus and ID stored in FIG. This can be used when it is difficult to measure ingredients directly like food.

  The subjective value estimation unit 67 corresponds to a part of the function of the stimulus perception amount estimation unit 18 in FIG. 1, estimates the subjective sensory amount for the physical stimulus 61, and uses the estimation result as the subjective value relative physical quantity calculation unit 68. Output to. The detailed subjective value estimation unit 66 also corresponds to a part of the function of the stimulus perception amount estimation unit 18 in FIG. 1, and is based on the physical stimulus and ID stored in the database 65 and is subjective to the physical stimulus 61. The sensory amount is estimated in detail, and the estimation result is output to the subjective value relative physical quantity display device 69.

  The subjective value relative physical quantity calculation unit 68 corresponds to a part of the function of the stimulus perception amount estimation unit 18 in FIG. 1 and is output from the physical stimulus and ID accumulated in the database 65 and the subjective value estimation unit 67. Based on the estimation result, a relative physical quantity of the estimation result with respect to the physical stimulus 61 is calculated, and the calculation result is output to the subjective value relative physical quantity display device 69. The subjective value relative physical quantity display device 69 corresponds to the perceptual information presentation unit 20 in FIG. 1, and shows the estimation result output from the detailed subjective value estimation unit 66 and the calculation result output from the subjective location relative physical quantity calculation unit 68. Display together.

(Example 6)
FIG. 7 shows an example when the perceptual information presentation device 10 according to the present embodiment is applied to a hearing aid. In this case, the sound pickup unit 72 corresponding to the stimulus physical quantity sensing unit 12 in FIG. 1 picks up the utterance sound 71 (for example, ydB sound) as a stimulus, and for each utterance break with an interval of 1 second or more. Average RMS is calculated.

  When the person determines whether the stimulation by the utterance sound 71 is excessive or appropriate, the person inputs an excess, appropriate or insufficient using the subjective value input button 75 corresponding to the subjective input unit 14 in FIG. This input information is output to the subjective input value clustering unit 76. The subjective input value clustering unit 76 is a part provided between the subjective input unit 14 and the storage device 16 in FIG. 1, clusters xdB stimuli, and holds the result as a database. The results held in this database can be acquired by the subjective value estimation unit 77.

  The pulse meter and electroencephalograph 78 correspond to the physiological response amount sensing unit 13 in FIG. 1, and measure a pulse and an electroencephalogram when a person is stimulated by the utterance sound 71 and operates the subjective value input button 75. The measurement result is output to the physiological information clustering unit 79. The physiological information clustering unit 79 corresponds to the clustering unit 21 in FIG. 1, performs clustering of measurement results, and accumulates the results in a database. The results accumulated in this database can be acquired by the detailed subjective value estimation unit 80.

  The detailed subjective value estimation unit 80 estimates how much subjective sense amount the person 74 receives with respect to the physical stimulus based on the clustering result accumulated in the database of the physiological information clustering unit 79, The estimation result is output to the subjective value estimation unit 77.

  Based on the estimation result from the detailed subjective value estimation unit 80 and the result accumulated in the database of the subjective input value clustering unit 76, the subjective value estimation unit 77 determines how much the person 74 is with respect to the physical stimulus of ydB. Is received, and the estimation result is output to the subjective value relative physical quantity calculation unit 73.

  The subjective value relative physical quantity calculation unit 73 determines whether ydB, which is the estimation result output from the subjective value estimation unit 77, is an excessive stimulus, an appropriate stimulus, or an insufficient stimulus for a person, and outputs the determination result to the two-color display 81. To do.

  Here, the detailed subjective value estimation unit 80, the subjective value estimation unit 77, and the subjective value relative physical quantity calculation unit 73 all correspond to the stimulus perception amount estimation unit 18 in FIG.

  The two-color display 71 corresponds to the perceptual information presentation unit 20 in FIG. 1, and according to the determination result from the subjective value relative physical quantity calculation unit 73, in the case of overstimulation, red indicating overstimulation is displayed in red. Presents a blue light indicating understimulation.

  As another example, instead of calculating the average RMS for each utterance break with an interval of 1 second or more in the sound collection unit 72, the sound collection unit 72 generates the sound for the utterance sound 71 that is the stimulus. The sound pressure for each frequency band may be acquired, the average RMS may be calculated, and this result may be used instead in the following processing.

The functional block diagram which shows the structural example of the perceptual information presentation apparatus which concerns on embodiment of this invention. The flowchart which shows the operation example of the perceptual information presentation apparatus which concerns on this Embodiment. The functional block diagram which shows the modification of the perceptual information presentation apparatus which concerns on this Embodiment. The functional block diagram which shows the Example (headphone type) in the case of perceiving auditory stimulation using the perceptual information presentation apparatus which concerns on this Embodiment. The functional block diagram which shows another Example (microphone type) in the case of perceiving an auditory stimulus using the perceptual information presentation apparatus which concerns on this Embodiment. The functional block diagram which shows the Example at the time of applying an ID tag to the perceptual information presentation apparatus which concerns on this Embodiment. The functional block diagram which shows the Example at the time of applying the perceptual information presentation apparatus which concerns on this Embodiment to a hearing aid.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Perception information presentation apparatus, 12 ... Stimulus physical quantity sensing part, 13 ... Physiological response quantity sensing part, 14 ... Subjective input part, 15 ... Environmental information sensing part, 16 ... Memory | storage device, 18 ... Stimulus perception quantity estimation part, 20 ... perceptual information presentation unit, 21 ... clustering unit, 30 ... perceptual information presentation device, 31 ... stimulus physical quantity sensing unit, 32 ... physiological response quantity sensing unit, 33 ... subjective input unit, 34 ... physiological information clustering unit, 35 ... Subjective input value clustering unit 36 ... Detailed subjective estimation unit 37 37 Subjective value estimation unit 38 38 Subjective value relative physical quantity calculation unit 39 39 Subjective value relative physical quantity display device 40 40 Perceptual information presentation device 41 41 Ear wearing unit , 42 ... microphone, 43 ... light emitting device, 44 ... input unit, 45 ... pulse meter or electroencephalograph, 4550 ... perceptual information presentation device, 51 ... grip part, 2 ... Microphone, 53 ... Button, 54 ... Light emitting part, 55 ... Myoelectric sensor, 61 ... Physical stimulation, 62 ... ID tag, 63 ... ID sensing device, 64 ... Storage device, 65 ... Database, 66 ... Detailed subjective value Estimating unit, 67 ... Subjective value estimating unit, 68 ... Subjective ground relative physical quantity calculating unit, 69 ... Subjective value relative physical quantity display device, 71 ... Speech sound, 72 ... Sound collecting unit, 73 ... Subjective value relative physical quantity calculating unit, 75 ... Subjective value input button, 76 ... Subjective input value clustering section, 77 ... Subjective value estimation section, 78 ... Pulse meter or electroencephalograph, 79 ... Physiological information clustering section, 80 ... Detailed subjective value estimation section, 81 ... Two-color display

Claims (5)

A stimulus physical quantity sensing means that senses a stimulus physical quantity that is a physical quantity that stimulates one of the five senses of a person and outputs a sensing result;
An input means for the person to input a subjective sensory amount perceived by the person who has received the stimulus;
A database unit that holds history information that is stored in association with the sensory quantity input by the input unit and the stimulus physical quantity sensed by the stimulus physical quantity sensing unit corresponding to the sensory quantity;
When a sensing result is output from the stimulus physical quantity sensing means, it corresponds to the output sensing result based on history information before the sensing result is accumulated in the database unit and the output sensing result. A stimulus perception amount estimating means for obtaining a stimulus perception estimation amount estimated to be perceived by the person based on a stimulus physical amount
Output that associates and outputs the sensory quantity input to the input means by the person who has received a stimulus corresponding to the stimulus physical quantity, and the stimulus perception estimated quantity obtained by the stimulus perceptual quantity estimation means with respect to the stimulus physical quantity And a perceptual information presentation device. In the perceptual information presentation device according to claim 1,
A physiological response amount sensing means for sensing the physiological response amount of the person who has received the stimulus in synchronization with an input of a sensory amount to the input means made by the person, and outputting a sensing result;
In addition to the sensory quantity and the stimulus physical quantity, the database unit senses the corresponding stimulus perception estimated quantity obtained by the stimulus perceptual quantity estimating means and the physiological response quantity sensing means as the history information. The history information accumulated and associated with the corresponding physiological response amount,
When a sensing result is output from the physiological response amount sensing unit, the stimulus perception amount estimation unit is based on history information before the sensing result is accumulated in the database unit and the output sensing result. And a perceptual information presentation device for obtaining an estimated amount of stimulus perception estimated to be perceived by the person by a stimulus corresponding to the output sensing result. In the perceptual information presentation device according to claim 2,
When a sensing result is output from the physiological response amount sensing unit, the stimulus perception amount estimation unit has a one-to-one correspondence between a sensory amount and a stimulation physical amount in history information before the sensing result is accumulated in the database unit. A perceptual information presentation device that obtains a stimulus perception estimation amount that is estimated to be perceived by the person by a stimulus corresponding to a physiological response amount that is the sensing result only when there is no corresponding accumulation. In the perceptual information presentation device according to claim 2 or claim 3,
Further comprising clustering means for clustering physiological response quantities sensed by the physiological response quantity sensing means,
The database unit retains the history information in which the physiological response amount clustered by the clustering unit is accumulated instead of the physiological response amount as the history information,
When the sensing result is output, the stimulus perception estimating unit is based on history information before the sensing result is accumulated in the database unit, a clustering result by the clustering unit, and the output sensing result. A perceptual information presentation device for obtaining an estimated amount of stimulus perception estimated by the person to be perceived by a stimulus corresponding to a physiological response amount corresponding to the classification result. In the perceptual information presentation device according to claim 1,
It further comprises environmental information sensing means for sensing information on the environment to which the person who received the stimulus was exposed in synchronization with an input of a sensory amount to the input means made by the person, and outputting a sensing result,
In addition to the sensory quantity and the stimulus physical quantity, the database unit holds history information stored in association with environmental information sensed by the environmental information sensing means, as the history information,
When the stimulus perception estimation unit outputs a sensing result from the environment information sensing unit, the stimulus perception estimation unit is configured to store the sensing result in the database unit based on history information before the sensing result and the output sensing result. A perceptual information presentation device for obtaining an estimated amount of stimulus perception estimated to be perceived by the person due to the stimulus received by the person in an environment corresponding to the output sensing result.

Images