KR102318218B1 - Doll and its system for the handicapped and one person households to share their feelings - Google Patents

Abstract

The doll according to an aspect of the present invention includes a network connection unit for transmitting and receiving data with a remote server, a voice communication unit for outputting a voice received from a network connection unit including a speaker and a microphone to the speaker, and a sensor unit 140 including a plurality of sensors ) and a controller for transmitting state information determined from a plurality of sensing data from a plurality of sensors and voice information from the microphone to the server through a network connection unit, wherein the voice received from the network connection unit is a monitor connected to the doll through the server voice input through the microphone of

Description

A doll and its system for the handicapped and one person households to share their feelings}

The present invention relates to a doll and a system for emotional empathy, and more specifically, to dynamically recognize the state of a doll and a user through contact with the doll through an emotional empathy doll as a medium, and to communicate and exchange emotions according to the recognized state. It relates to a doll for emotional empathy and its system.

What the disabled people most want is to participate in the daily life enjoyed by normal people and share the same sensibility with them. In the meantime, although the prejudice and environment for the marginalized disabled people have been greatly improved, prejudice and discrimination still exist in certain areas, which is the difficulty of dating with the disabled or with normal people. In other words, the opportunity and environment to enjoy emotional and emotional empathy have not been sufficiently created.

These difficulties are not only experienced by the disabled, but also by single-person households, which are rapidly increasing in recent years. According to most surveys, the greatest difficulty faced by single-person households in their 20s to 60s was loneliness rather than financial difficulties.

Accordingly, many efforts have been made to solve these emotional difficulties experienced by the disabled and normal people by using ICT (Information and Communication Technologies) technology.

For example, Registered Patent No. 10-0701237 (application number 10-2005-0074425, filing date August 12, 2005, KR) has a body having the appearance of a person with built-in visual, tactile, olfactory, and auditory sensors. Internet emotional robot technology that can express emotions by downloading emotional content programs is presented.

Another registered patent No. 10-0831566 (application number 10-2007-0056199, filing date June 08, 2007 KR) uses a character doll with a cute shape like an animal as an Internet terminal, and provides various information through the doll. In addition to providing it, the technology that allows character dolls to express simple emotions according to a pre-planned method was presented.

Another registered patent No. 10-1113058 (application number 10-2010-0023232, filing date March 16, 2010 KR) discloses personal information such as texts or images entered by the sender using a virtual life form in an application of a mobile terminal. After growing by using the technology, the final growth state of the personalized virtual creature is delivered to the receiver so that the sender's continuous quality can be easily recognized visually by the receiver.

The above-cited registered patents and other known inventions are mostly puppets that are mechanically pre-made and express promised emotions, or virtual characters in the Internet space.

In other words, it is not a human-human emotional emotional exchange, but a programmed emotional exchange between a human and a machine. Due to these limitations, it is difficult to fundamentally solve the loneliness currently experienced by the disabled and single-person households, and new technologies are needed to solve this problem.

The present invention has been devised to solve the above-described problems, and an object of the present invention is to provide a doll and a system for emotional empathy that can provide the same or similar effect as a direct emotional exchange between people.

In addition, an object of the present invention is to provide a doll and a system for emotional empathy capable of estimating the user's current state according to the recognition of the dynamic state of the doll the user is dealing with, and enabling accurate consultation or emotional exchange accordingly.

In addition, an object of the present invention is to provide a doll and system for emotional empathy that can provide an emotional exchange path that can avoid risks and burdens caused by face-to-face emotional exchange while providing similar effects to face-to-face emotional exchange. .

In addition, an object of the present invention is to provide a doll and a system for emotional empathy capable of counseling and emotional exchange according to the user's state grasped according to the contact with the doll by the user through the doll equipped with a shape detection sensor.

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the following description. will be able

A doll according to an aspect of the present invention includes a network connection unit for transmitting and receiving data with a remote server; a voice communication unit for outputting a voice received from the network connection unit to the speaker, including a speaker and a microphone; a sensor unit including a plurality of sensors; and a control unit configured to transmit state information determined from a plurality of sensing data from the plurality of sensors and voice information from the microphone through the network connection unit, wherein the voice received from the network connection unit is transmitted through the server This is the voice input through the microphone of the monitor connected to the doll's network.

In the above doll, the sensor unit includes a plurality of gyro sensors installed on the first type part of the doll and a plurality of shape detection sensors installed on the second type part of the doll, wherein the shape detection sensor is applied by a user It is configured to be able to sense a shape that changes according to contact or pressure.

In the above-described doll, the plurality of gyro sensors are installed in the joint portion of the doll, and the plurality of shape sensing sensors are installed in the elastic portion having elasticity of the doll.

In the above doll, the shape detection sensor includes a plurality of detectors for sensing a signal source, the doll constitutes a shape detection vector including sensing data from the plurality of detectors, and the shape detection vector is the It is possible to estimate the deformed appearance of the elastic part corresponding to the shape detection sensor.

In the doll, further comprising: an artificial intelligence sensor data analysis unit for estimating the state of the doll from a plurality of sensing data of the plurality of sensors, wherein the artificial intelligence sensor data analysis unit configures the shape detection vector and The shape corresponding to the shape detection vector is estimated through an artificial intelligence algorithm.

In the above doll, the shape detection sensor includes a plurality of photodetectors as the plurality of detectors and a light source as the signal source located at a predetermined distance from the plurality of photodetectors, or a plurality of magnetic field sensors as the plurality of detectors and and a magnet positioned at a predetermined distance from the plurality of magnetic field sensors and serving as the signal source.

In addition, the system according to an aspect of the present invention is the above-described doll; a server connected to the doll through a network; and a monitor connected to the doll according to control through the server.

In the above system, the server receives the state information from the doll, estimates the state of the doll and the user state using the doll from the received state information, and receives state estimation information indicating the state of the doll and the user state It is transmitted to the monitor, and the monitor displays the state estimation information as an image.

In the above system, the server executing the artificial intelligence algorithm estimates the contact area and the changed shape of the doll using a plurality of sensing data included in the state information and measured from a plurality of sensors, and The state of the user having a relationship corresponding to the sensed data is estimated, and state estimation information including the changed state image of the doll and the state image of the user is transmitted to the monitor.

In the above system, the server executing the artificial intelligence algorithm estimates the deformed appearance of the elastic part of the doll corresponding to the shape detection sensor from the shape detection vector of the shape detection sensor included in the state information.

In the system described above, the monitor displaying the image transmits voice information including voice input from a counterpart to the doll through a network.

In the above system, the monitor used by the counterpart selected by the user of the doll transmits a text message input by the counterpart to the server, and the server converts the text message into a designated voice and transmits the text message to the doll .

In the doll and system for emotional empathy according to the present invention as described above, exchanges and voice conversations are made between people through a doll that a user can touch and feel instead of an information device, so that it is the same as or similar to the face-to-face emotional exchange with people. effect can be provided.

In addition, the doll and system for emotional empathy according to the present invention as described above estimates the current state of the user according to the recognition of the dynamic state of the doll the user is dealing with, and accordingly allows the other party (emotional friend) to check the remote user's state. By making it possible to understand, it has the effect of enabling more faithful counseling and emotional exchange.

In addition, the doll and system for emotional empathy according to the present invention as described above has the effect of avoiding the risks and burdens caused by the direct emotional exchange while providing an effect similar to the direct emotional exchange.

In addition, the doll and system for emotional empathy according to the present invention as described above has the effect of more accurately grasping the user's state and behavior through a doll equipped with a shape detection sensor.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned may be clearly understood by those of ordinary skill in the art to which the present invention belongs from the following description. will be.

1 is a diagram illustrating an exemplary system configuration for emotional empathy.
2 is a diagram illustrating an exemplary block diagram of a doll constructed in accordance with the present invention.
3 is a diagram illustrating an example of a sensor configuration installed on a doll.
4 is a diagram illustrating the principle of a general pressure sensor.
5 is a diagram illustrating a problem of a general pressure sensor.
6 is a diagram illustrating an example of a shape detection sensor configured according to the present invention.
7 is a view showing the operating principle of an exemplary shape detection sensor constructed according to the present invention.
8 is a diagram illustrating an exemplary block diagram of a monitor.
9 is a diagram illustrating an exemplary control flow for emotional exchange between a doll and a monitor in a system for emotional empathy.
10 is a diagram illustrating an example of a shape detection vector measured in response to a deformed shape according to a user contact action with respect to the shape detection sensor.
11 is a diagram illustrating an example of the state of the doll and the user inferred from the measured sensor data set.

The above-described objects, features, and advantages will become more clear through the detailed description described below in detail with reference to the accompanying drawings, and accordingly, those of ordinary skill in the art to which the present invention pertains can understand the technical spirit of the present invention. can be easily implemented. In addition, in describing the present invention, if it is determined that a detailed description of a known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating an exemplary system configuration for emotional empathy.

According to FIG. 1 , a system capable of exchanging emotions or emotions (emotions) through voice transmission and reception with other counterparts includes one or more dolls 100 , a server 200 , and one or more monitors 300 . The doll 100, the server 200, and the monitor 300 may be connected to each other through a network to transmit/receive various data.

Briefly looking at the system through FIG. 1 , the doll 100 is a device available to users who require emotional or emotional exchange through voice communication with another counterpart (emotional friend). The doll 100 has a human shape and can recognize various requests or touches of the user, and is configured to empathize with the user's emotions or emotions or to interact with each other through a voice response through a remote counterpart. The doll 100 may be installed for a user who needs to solve loneliness, for example, it may be installed for the disabled, the elderly, a single householder, and the like. The doll 100 serves as a medium for conveying emotions and exchanging emotions of the user.

The doll 100 will be described in detail with reference to FIGS. 2, 3, and 9 .

The server 200 is connected to the doll 100 and the monitor 300 through a network, and performs and manages various controls such as the connection between the doll 100 and the monitor 300 . For example, the server 200 may receive various information from the doll 100 , estimate the state of the doll 100 therefrom, and transmit the estimated state to the monitor 300 connected to the doll 100 .

The server 200 includes a communication interface (communication unit) for connecting to a network, a storage unit for storing various information or data, and one or more processors (control unit) for processing various information or data, the doll 100 and the monitor 300 may be connected to each other, and various types of information may be transmitted/received.

The control of the server 200 will be described in detail with reference to FIG. 9 .

The monitor 300 is a device capable of displaying the recognized doll 100 and the state of the user through the doll 100 and performing voice conversations according to the recognized doll 100 and the state of the remote user.

The monitor 300 is connected to a specific doll 100 through a network according to the control through the server 200 and outputs the voice received from the doll 100 to the speaker 321 equipped with the microphone 323. It is possible to transmit the voice of the selected partner input through the network to the specific doll 100 .

The monitor 300 is a device that the counterpart (emotional friend) can use, and may be, for example, a mobile phone, a smart phone, a tablet PC, a notebook computer, a personal PC, or the like. The monitor 300 is provided with at least a display 330, a microphone 323, and a speaker 321 to output various images, to output a voice received from the doll 100, and to connect voice information corresponding to the voice of the other party. (100) can be transmitted.

The monitor 300 will be described in more detail with reference to FIGS. 8 and 9 .

The network may transmit/receive various data between the doll 100, the server 200, and the monitor 300. The network may consist of one or more combinations of wired and wireless networks and preferably constitute the Internet.

2 is a diagram illustrating an exemplary block diagram of a doll 100 constructed in accordance with the present invention.

According to FIG. 2 , a doll 100 capable of communicating with another party through a network and recognizing an action (contact, pressing, etc.) applied to the doll by the user includes a network connection unit 110 , a heat generator 120 , and a voice It includes a communication unit 130 , a sensor unit 140 , a control unit 150 , and an artificial intelligence sensor data analysis unit 160 . According to a design example, some blocks of FIG. 2 may be omitted. For example, the doll 100 may omit the configuration of the heat generating unit 120 and/or the artificial intelligence sensor data analyzing unit 160 .

Looking at the configuration of the doll 100 through FIG. 2 , the network connection unit 110 transmits and receives data to and from the remote server 200 and/or the monitor 300 through a network. The network connection unit 110 includes a wired LAN interface, a wireless LAN interface, and/or a mobile communication interface that can use a mobile communication network to transmit data such as status information to the server 200 and control or output various types from the server 200 . can receive data for

The heat generating unit 120 is installed inside the doll 100 to generate heat. The heat generating unit 120 includes a known heat generating means and generates heat so that a temperature equal to or within a certain range from the standard body temperature of a person can be recognized under the control of the control unit 150 .

The voice communication unit 130 includes a speaker 131 and a microphone 133 to perform a voice communication function with a counterpart (such as a friend user selected for emotional and emotional exchange). The voice communication unit 130 outputs the voice of the voice information received from the network connection unit 110 to the speaker 131 under the control of the control unit 150 and the voice of the microphone 133 input from the user of the doll 100 ( signal) may be output to the controller 150 .

The sensor unit 140 measures or senses various physical quantities assigned to each of the plurality of sensors, including a plurality of sensors.

The sensor unit 140 includes various types of sensors capable of measuring different physical quantities. The sensor unit 140 may include, for example, one or more shape detection sensors 141 , a temperature sensor 142 , one or more gyro sensors 143 , an optical sensor 144 , one or more pressure sensors 145 , and an acceleration sensor ( 146), a proximity sensor 147, an alcohol concentration sensor 148, a carbon dioxide sensor 149, or the like, or may include a portion thereof.

The sensor unit 140 is required to accurately inform at least the state of the doll 100 to the counterpart connected through the network, and the state information configured through the sensor unit 140 is the current state (eg, posture) of the doll 100 . direction) as well as the state of the user using the doll 100 (eg, posture or direction).

The sensor unit 140 may include various sensors, and the type and number of sensors installed may vary according to the performance of the doll 100 required by the user.

As in the example of FIG. 3 , the sensor unit 140 may include a plurality of shape detection sensors 141 , a plurality of gyro sensors 143 , and an alcohol concentration sensor 148 , and these sensors are the human body of the doll 100 . It can be installed in the shape. The gyro sensor 143 and the shape detection sensor 141 may be installed on a specific type of part of the doll 100 .

For example, the gyro sensor 143 is a sensor capable of measuring the absolute direction, and each body part (knee, elbow, ankle, etc.) connected by joints of the doll 100 and a part (chest) advantageous for recognizing a change in posture of the doll 100 , forehead, etc.) is configured to measure the bending or rotation direction of the joint, or configured to measure the posture direction of the doll 100 (eg, the gyro sensor 143 of the chest or forehead). The alcohol concentration sensor 148 is installed in the mouth of the doll 100 to measure the user's blood alcohol concentration and the like, and accordingly, it is possible to measure whether or not drinking.

The shape detection sensor 141 is preferably installed on an elastic portion having elasticity of the doll 100 . For example, the shape detection sensor 141 is fixedly installed at positions such as the stomach, chest, thigh, calf. Even though it is installed on the elastic part by the shape detection sensor 141, it is preferably configured to recognize the shape (the shape of the elastic part) that changes according to the contact or pressure applied by the user. That is, the shape detection sensor 141 is configured to measure or recognize the shape of an object having elasticity, not a hard solid, that is deformed according to a force applied externally (by a user) and its strength.

According to the present invention, the configured shape detection sensor 141 will be described in detail with reference to FIGS. 4 to 7 .

The example of FIG. 3 shows an example installed in the doll 100 , and the sensor unit 140 may include various other sensors. Looking briefly at the other sensors, the temperature sensor 142 is a sensor that measures the outside of the doll 100, the surface temperature of the doll 100 or its change. The light sensor 144 is a sensor that measures the intensity of light recognized from the outside of the doll 100 .

The pressure sensor 145 is a sensor that measures the pressure applied to the surface of the doll 100 . One or more commonly known pressure sensors 145 may be installed on a hard body part of the surface of the doll 100 . On the other hand, the shape detection sensor 141 is installed on a body part having elasticity (tummy, chest, thigh), etc., and the installation position thereof may be different from each other.

The acceleration sensor 146 measures acceleration according to the movement of the doll 100 , and the proximity sensor 147 recognizes the user's approach. The proximity sensor 147 may sense whether the user approaches by a predetermined distance or less. The carbon dioxide sensor 149 is a sensor capable of measuring whether the user is breathing.

In this way, the sensor unit 140 may include various sensors capable of measuring or monitoring the state of the user, the doll 100, etc., and may output the sensing data measured through the sensor to the control unit 150 .

The controller 150 controls and manages the doll 100 . The control unit 150 is provided with an execution unit capable of executing the instructions of the program, such as a processor, CPU, MPU, central processing unit, etc., and performs a program on a memory or hard disk built in the doll 100 to perform the program on the doll 100 . can be controlled and managed.

For example, the control unit 150 receives a plurality of sensing data from a plurality of sensors of the sensor unit 140 , configures state information from the plurality of received sensing data, and periodically connects the server 200 through the network connection unit 110 . ) is sent to

The control unit 150 includes an ADC (Analog Digital Converter) therein to convert the sensing signals from a plurality of sensors including the shape sensing sensor 141 into digital sensing data or extract digital sensing data from the sensing signals. . In addition, the control unit 150 receives a voice signal from the microphone 133 of the voice communication unit 130 , configures voice information corresponding to the voice signal, and connects to the server 200 and/or the network through the network connection unit 110 . It is transmitted to the connected monitor 300 .

In addition, the control unit 150 receives the voice information from the monitor 300 connected through the network connection unit 110 directly from the monitor 300 or via the server 200, and receives the voice of the received voice information from the voice communication unit ( 130) and output to the speaker 131. The voice received through the network connection unit 110 and output to the speaker 131 is the voice input (received) through the microphone 323 provided in the monitor 300 connected to the network with respect to the doll 100 . Accordingly, the user of the doll 100 and the counterpart of the monitor 300 can exchange emotions and emotions with each other through voice.

The main control performed by the controller 150 will be described in more detail with reference to FIG. 9 .

The artificial intelligence sensor data analysis unit 160 , which may be omitted according to a design example, estimates the state of the doll 100 from a plurality of sensing data sensed by a plurality of sensors of the sensor unit 140 . The artificial intelligence sensor data analysis unit 160 includes a pre-learned artificial intelligence algorithm to estimate the state of the doll 100 corresponding to (classified) the plurality of sensing data according to learning from the plurality of sensing data.

The artificial intelligence sensor data analysis unit 160 will be described in more detail with reference to FIGS. 9 and 10 .

4 to 7 are diagrams for explaining the necessity, principle, and configuration of the shape detection sensor 141 included in the doll 100 .

4 shows the principle of measuring the pressure of a general pressure sensor, the conventional pressure sensor measures the pressure using a pressure reaction material that responds to the pressure when an external pressure is applied. As shown in (b) of FIG. 4 , when pressure is applied to the pressure-reacting material, the thickness of the pressure-reacting material is changed by the amount of pressure. As can be seen in FIG. 4 , the change in the thickness of the pressure reactant is possible when the pressure reactant is placed on a rigid support.

The example of FIG. 5 is a diagram for illustrating the problems of a general pressure sensor when applied to the doll 100 etc. constructed according to the present invention, and the pressure sensor is made of a flexible material (eg, water, jelly, even air, etc.). ), it is not easy to measure the pressure from the outside. This is because the opposite side of the side to which the pressure is applied is not fixed to the support which does not move or shake. As can be seen from (c) and (d) of Figure 5, even when pressure is applied from the outside, the pressure-reactive material does not change its thickness, so the pressure can be measured with the pressure-reactive material moving in the elastic medium. none.

On the other hand, the doll 100 constructed according to the present invention preferably has the same shape, shape, touch, etc. as a human. When the doll 100 provides the same feeling as a real person, the user can feel a similar sensibility to dealing with a person. Therefore, the doll 100 should preferably be made of a soft and elastic material (material) such as silicone.

When the doll 100 is made of an elastic material such as silicone, when the user presses a specific part of the doll 100 (eg, a soft and elastic body part such as a belly or chest), this is detected through a sensor You need a way to do it. In the case of using the conventional pressure sensor as shown in Figs. 4 and 5, the pressure cannot be recognized or the sensitivity is low due to the elastic material in the stomach, chest, etc., which are configured to recognize the same or similar contact or touch as a person. Accordingly, it is not easy to transmit pressure or contact on the specific part to the other party.

6 and 7 are views for explaining the structure and principle of the shape detection sensor 141 configured to solve this problem, and the shape detection sensor 141 according to an example (the example of FIG. 141-1), a signal source 141-3, and an elastic medium 141-5.

The shape of the shape sensor 141 may have various external shapes, such as a spherical shape, a rectangular parallelepiped shape, a cube shape, and a cylindrical shape, depending on a design example. Alternatively, the shape detection sensor 141 may be embedded in a specific body part, such as the doll 100, without having a separate distinct external shape, or may have the same shape as the specific body part.

Looking at the shape detection sensor 141 in detail, the signal source 141-3 outputs a specified signal. For example, the signal source 141-3 may be a light source emitting (radiating) light to the outside or a magnet emitting (radiating) a magnetic field signal to the outside.

The plurality of detectors 141-1 of the shape detection sensor 141 sense the signal source 141-3. For example, the plurality of detectors 141-1 sense a specified physical quantity based on a single signal source 141-3 and output measured sensing data. When the signal source 141-3 is a light source, the detector 141-1 may be a photodetector that senses the intensity of the light of the light source. When the signal source 141-3 is a magnet, it may be a magnetic field sensor for sensing the strength (or strength and direction) of a magnetic field signal from the magnet.

As in the example of FIG. 6 , the single signal source 141-3 and the plurality of detectors 141-1 are located apart from each other by a specified distance or more. For example, the plurality of detectors 141-1 included in the sphere may be located at the same distance from the single signal source 141-3. The single signal source 141-3 is positioned at a designated central position inside the spherical shape and can radiate a designated signal out of 360 degrees omnidirectionally from the installed position. Each of the plurality of detectors 141-1 is installed on the inner surface of the spherical shape and is located at the same distance from the signal source 141-3 to measure the signal strength of the designated signal of the signal source 141-3, etc. do.

Alternatively, the plurality of detectors 141-1 included in the rectangular parallelepiped shape may be located apart from each other by a set distance to sense the signal strength of the signal source 141-3 installed in the center of the rectangular parallelepiped shape.

In this way, the distance between the plurality of detectors 141-1 and the signal source 141-3 may be the same or different, and at least when there is no contact or pressure by the user, the distance between the signal source 141-3 is located at a preset distance. ), and the like can be sensed.

As in the example of FIG. 6 , the signal source 141-3 is positioned more than a specified distance from each of the plurality of detectors 141-1 to output a signal designated by the plurality of detectors 141-1 in the shape detection sensor 141 . and each of the plurality of detectors 141-1 may sense the intensity of a signal output from the signal source 141-3 and output signal intensity sensing data.

The phenomenon detection sensor 141 may further include an elastic medium 141-5 positioned between the plurality of detectors 141-1 and the signal source 141-3. The elastic medium 141 - 5 is made of a material that can flow according to an external pressure, such as water, jelly, air, silicone, and the like. When the shape detection sensor 141 has a spherical shape, the elastic medium 141-5 is filled inside the surface of the spherical shape.

When pressure, contact, etc. occurs on the shape detection sensor 141 or the body part provided with the shape detection sensor 141 by the user, etc., the shape corresponding to the shape detection sensor 141 is formed through the elastic medium 141-5. appearance is transformed.

As in the example of (a) of FIG. 7 , a plurality of detectors 141-1 located at a specified distance (eg, the same distance) to the signal source 141-3 (light source or magnet) when there is no external contact, etc. The (photodetector or magnetic field sensor) may sense the signal strength of the signal source 141-3 at a specified distance and output the sensed data P1, P2, ..., Pn.

For example, a photodetector positioned at the same distance from the light source senses the intensity of light and outputs sensing data representing the sensed intensity of light, and a magnetic sensor positioned at the same distance from the magnet senses the intensity of the magnetic field signal and the sensed magnetic field Sensing data indicating signal strength is output. In the case of no external contact, the detectors 141-1 located at the same distance output the same or similar sensing data within a threshold.

7 (b) as in the example, when pressure is applied to the shape detection sensor 141 or its shape from the outside, the distance between the signal source 141-3 and the plurality of detectors 141-1 is applied by external pressure It varies depending on the area, size, location, etc. The detector 141-1 may sense the signal strength of the signal source 141-3 at the changed distance and output the sensed data P'1, P'2, ..., P'n.

For example, the photodetector, which was located at the same distance when no pressure is applied, is located at a changed distance from the central light source according to the pressure application and the flow of the elastic medium 141-5 and senses the light intensity of the light source at the changed position, You can print this out. Alternatively, the magnetic field sensor located at the same distance when no pressure is applied is located at a changed distance from the central magnet according to the pressure application and the flow of the elastic medium 141-5 and senses the magnetic field signal strength of the magnet at the changed position and outputs it can do. The sensed data measured at the changed position is different from the sensed data measured at the original position due to a difference in distance from the signal source 141-3.

In this way, each of the plurality of detectors 141-1 is located at a changed distance from the signal source 141-3 due to the external pressure to the elastic medium 141-5 and measures the signal strength output from the signal source 141-3. It is possible to measure and output signal strength sensing data respectively.

The sensing data from the plurality of detectors 141-1 may be configured as a vector (hereinafter, referred to as a “shape detection vector”) for shape detection by the doll 100 (controller 150 of the doll 100 ). The shape detection vector is configured to recognize a change in the shape (eg, the shape of the doll 100 ) corresponding to the shape detection sensor 141 . That is, the shape detection vector composed of a plurality of signal strength sensing data enables estimation of the changed appearance of the shape detection sensor 141 according to the signal strength measured for the signal source 141-3.

6 and 7, the shape detection sensor 141 according to the present invention was examined. In the example of FIGS. 6 and 7 , it has been described that the signal source 141-3 is provided in the shape detection sensor 141 . On the other hand, the shape detection sensor 141 may be configured by omitting the signal source 141-3.

For example, the shape detection sensor 141 may be configured as a plurality of detectors 141-1, including gravity acceleration sensors or gyro sensors for sensing the acceleration of gravity based on the gravity of the shape detection sensor 141 . The shape detection sensor 141 including gravity acceleration sensors or gyro sensors in the elastic medium 141 - 5 may sense the gravity acceleration or posture that changes according to an external pressure and output the sensed data.

8 is a diagram illustrating an exemplary block diagram of the monitor 300 .

According to FIG. 8 , the monitor 300 that enables conversation with the user of the doll 100 through the network and recognizing the user's state is a monitor network connection unit 310 , a monitor voice communication unit 320 , a display 330 , It includes a data input unit 340 and a monitor control unit 350 . According to a design example, the monitor 300 may further include other blocks.

Looking at the monitor 300 through FIG. 8 , the monitor network connection unit 310 transmits and receives data to and from the remote server 200 and/or the doll 100 through a network. The monitor network connection unit 310 may include a wired LAN interface, a wireless LAN interface, and/or a mobile communication interface using a mobile communication network. The monitor network connection unit 310 may transmit/receive voice information to and from the connected doll 100 and may receive state estimation information from the server 200 .

The monitor voice communication unit 320 performs a voice communication function with the user of the doll 100 including the monitor speaker 321 and the monitor microphone 323 . The monitor voice communication unit 320 outputs the voice of the voice information received from the doll 100 connected through the monitor network connection unit 310 to the monitor speaker 321 under the control of the monitor control unit 350 . Also, the monitor voice communication unit 320 may output a voice (signal) of the monitor microphone 323 input from a counterpart using the monitor 300 to the monitor control unit 350 .

The display 330 is connected to the monitor controller 350 to display an image received from the monitor controller 350 . The display 330 may include a display-module such as LCD, LED, and OLED to display an image according to the state estimation information.

The data input unit 340 receives an input of a counterpart. The data input unit 340 includes input means such as a keyboard, a touch pad, and a touch panel, so that a counterpart can input various data or information.

The monitor control unit 350 controls and manages the monitor 300 . The monitor control unit 350 includes an execution unit capable of executing a program command, such as a processor, CPU, MPU, central processing unit, etc. ) can be controlled and managed.

The monitor control unit 350 may display, on the display 330 , at least a connection to the server 200 , communication with the server 200 , voice communication with the connected doll 100 , and an image received from the server 200 .

The main control performed in the monitor 300 will be looked at in more detail with reference to FIG. 9 .

9 is a diagram illustrating an exemplary control flow in which emotional exchange between the doll 100 and the monitor 300 is performed in a system for emotional empathy.

The control flow performed in the monitor 300 is performed by the monitor control unit 350 , and the control flow performed in the doll 100 is performed by the control unit 150 . The server 200 is preferably implemented by a control unit that executes a program stored in the storage unit, including a communication unit, a storage unit, and a control unit.

First, a user who can use the doll 100 logs in to the server 200 through an app (APP) provided in a mobile terminal (eg, a smartphone) (see ①), and emotional / emotional in the server 200 Select the person with whom the exchange will be made (refer to ②). The user can check the profile of a partner with various backgrounds, hobbies, personalities, etc. and select a specific partner through the app.

The server 200 transmits a connection request to the monitor 300 used by the counterpart selected by the user and receives a connection acceptance response (see ③). Upon receiving the connection acceptance response, the server 200 connects the voice communication unit 130 of the doll 100 corresponding to the mobile terminal and the monitor voice communication unit 320 of the selected monitor 300 to each other so that mutual voice calls are possible. set it to

The doll 100 connected to the monitor 300 through the network receives a plurality of sensing data from a plurality of sensors through the sensor unit 140 (see ④). For example, the doll 100 may collect sensing data from the gyro sensor 143 , the pressure sensor 145 , the alcohol concentration sensor 148 , the shape detection sensor 141 , and the like installed on the body part.

The doll 100 configures state information from the collected sensing data (see ⑤). The state information is configured according to a format agreed with the server 200 and may include sensing data from various sensors or doll state data estimating the state of the doll 100 from various sensing data.

When the state information includes various types of sensing data, the sensing data collected from the plurality of detectors 141-1 in response to the shape sensing sensor 141 may be configured as a shape sensing vector.

In the case of estimating the state of the doll, the artificial intelligence sensor data analysis unit 160, which may be further included in the doll 100, analyzes sets of various sensor data collected periodically to estimate what state the doll 100 is in. have. The artificial intelligence sensor data analysis unit 160 may estimate the state of the doll 100 by applying an artificial intelligence algorithm. The description of the artificial intelligence sensor data analysis unit 160 will be described in more detail in the description of the server 200 below.

The doll 100 transmits the state information to the server 200 and the server 200 receives it (see ⑥).

When the received state information is composed of measured sensor data, the server 200 stores (a set of sensor data) in a storage unit, etc., and the state of the doll 100 and further the doll ( 100) to estimate the user's state (see ⑦).

The server 200 (or the artificial intelligence sensor data analysis unit 160 of the doll 100) receives the posture of the doll 100 and the deformed shape of the doll 100 from a plurality of sensor data measured using an artificial intelligence algorithm. , the user's state and the user's drinking (having a relationship corresponding to a plurality of measured sensor data) corresponding to the doll's state, such as the contact part with the user, the action applied to the doll 100 by the user, etc. status can be estimated.

First, the server 200 (or the artificial intelligence sensor data analysis unit 160 of the doll 100) uses an artificial intelligence algorithm to detect the change of the shape appearance(s) corresponding to the shape detection sensor 141(s) Detect and estimate the changed (altered) shape appearance(s).

10 is a view showing an example of an appearance changed according to an action such as a user's contact with the shape detection sensor 141 and an example of a shape detection vector measured in response thereto, which is installed on the doll 100 as shown in (a) When the shape of the shape detection sensor 141 of the elastic part is deformed according to the user's contact, pressing, etc., the detectors 141-1 of the shape detection sensor 141 change the signal source 141- 3) of measuring the signal strength, the doll 100 may construct a shape sensing vector (refer to FIG. 10(c)) corresponding to the deformed appearance (refer to (b) of FIG. 10).

A specific shape corresponds to (pattern of) a specific shape detection vector, and the shape detection vector corresponding to the shape deformed according to a user action is matched and stored as a table (non-volatile memory, etc.) in the doll 100 or server 200 or can be learned by artificial intelligence algorithms.

The server 200 (or the artificial intelligence sensor data analysis unit 160 of the doll 100) measures by the shape detection sensor 141 of the doll 100 (using a table or learned) using an artificial intelligence algorithm. It is possible to estimate the corresponding shape of the installed elastic part from the shape detection vector.

In addition, the server 200 (or the artificial intelligence sensor data analysis unit 160 of the doll 100) receives a sensor data set (a plurality of measured sensing data) and a shape detection sensor 141 using an artificial intelligence algorithm. The current state of the doll 100 is estimated by periodically analyzing the deformed appearance of . For example, the server 200 (or the artificial intelligence sensor data analysis unit 160 of the doll 100) may determine the deformed appearance of the shape detection sensor 141, the pressure of the pressure sensor 145, and the gyro sensor 143. The posture of the doll 100, the contact area with the user, the changed shape, etc. are estimated using the sensing value of .

In addition, the server 200 (or the artificial intelligence sensor data analysis unit 160 of the doll 100 ) estimates the state of a user having a relationship corresponding to a plurality of measured sensing data.

11 is a diagram showing an example of the state of the doll 100 and the user inferred from the measured sensor data set, the server 200 (or the artificial intelligence sensor data analysis unit 160 of the doll 100) is measured The contact area of the doll 100 is determined from the sensor data set (P or S). For example, it may be determined that there are three contact parts from the sensor data set P, and it may be determined that there are one contact parts from the sensor data set S.

Along with the determination of the contact area, the server 200 (or the artificial intelligence sensor data analysis unit 160 of the doll 100) determines the relationship between the user and the doll 100, which is most likely to produce the measured sensor data set. It can be searched or inferred through an artificial intelligence algorithm.

When the received state information includes the estimated state of the doll 100 or the user state is omitted, the server 200 may further estimate the user's state corresponding to the estimated state.

The server 200 configures the state estimation information to be transmitted to the monitor 300 connected to the network to the doll 100 (see ⑧). For example, the server 200 may configure state estimation information including the estimated state of the doll 100 and/or the estimated state of the user. The state included in the state estimation information may be composed of an image or according to an agreed format. When expressed as an image, the state of the doll 100 may be composed of an image representing a changed state (appearance, etc.) of the doll 100 and the user's state is an image having a relationship corresponding to the changed state of the doll 100 can be composed of

The server 200 transmits the configured state estimation information to the monitor 300 and the monitor 300 receives the state estimation information (see ⑨).

The monitor 300 may display the received state estimation information as an image (see ⑩). For example, the monitor 300 constructs or extracts an image corresponding to the doll's state from the received state estimation information and constructs or extracts an image corresponding to the user's state. The monitor 300 displays the image of the doll state and/or the image of the user state on the display 330 , and the counterpart of the monitor 300 may recognize it.

The process of displaying the image from the sensing data reception of the doll 100 (④ to ⑩ in FIG. 9 ) may be periodically or repeatedly performed a plurality of times.

The other party can check the posture, state, etc. of the doll 100 and the user from a virtual image rather than an image of the user, and can indirectly recognize and communicate with the user's emotions and emotions. The counterpart may perform voice communication with the user based on their emotions or feelings. Accordingly, the monitor 300 and the doll 100 transmit and receive voice information including the voice of the user or the other party to each other.

The counterpart, who has confirmed the user's image state, may have a voice conversation through voice communication directly through the monitor voice communication unit 320 . Alternatively, the counterpart may configure reaction information through the data input unit 340 and transmit it to the server 200 (refer to ⑪). The response information may include a text message input by the other party through the data input unit 340 .

The server 200 converts the text message of the response information into a specified specific voice and transmits the converted voice information to the doll 100 (see ⑫), and the doll 100 can output it through the provided speaker 131. have.

The user can express his/her feelings and emotions through the doll 100, and the conversation partner can recognize it through the changed doll image or the changed user image, and empathy, reaction, and exchange are possible by the human counterpart, not the machine. make it so

The present invention described above, for those of ordinary skill in the art to which the present invention pertains, various substitutions, modifications and changes are possible without departing from the technical spirit of the present invention. It is not limited by the drawing.

100 : doll
110: network connection unit 120: heat generating unit
130: voice communication unit
131: speaker 133: microphone
140: sensor unit
141: shape detection sensor
141-1: detector 141-3: signal source
141-5: elastic medium
142: temperature sensor
143: gyro sensor 144: light sensor
145: pressure sensor 146: acceleration sensor
147: proximity sensor 148: alcohol concentration sensor
149: carbon dioxide sensor
150: control unit
160: artificial intelligence sensor data analysis unit
200 : server
300 : monitor
310: monitor network connection unit 320: monitor voice communication unit
321: monitor speaker 323: monitor microphone
330: display 340: data input unit
350: monitor control unit

Claims (12)

delete delete A system comprising: a doll used by a user; and a monitor used by a remote party who has conversations and emotional exchanges with the user,
The monitor is
Receiving state estimation information indicating the state of the doll and the state of the user, and displaying a virtual image indicating the appearance of the doll and a virtual image indicating the appearance of the user,
A server connected to the doll and the monitor through a network, receiving state information from the doll, and estimating the state of the doll and the state of the user from the received state information; further comprising,
The doll is
a network connection unit for transmitting and receiving data; a voice communication unit for outputting the voice of the voice information received from the network connection unit to the speaker, including a speaker and a microphone; a sensor unit 140 including a plurality of sensors; and a control unit configured to transmit the state information determined from a plurality of sensing data from the plurality of sensors and the voice information from the microphone through the network connection unit;
The sensor unit 140 includes a plurality of gyro sensors installed on the first type portion of the doll and a plurality of shape detection sensors installed on the second type portion of the doll,
The shape detection sensor is configured to sense a shape that changes according to the contact or pressure applied by the user,
The plurality of gyro sensors are installed in the joint portion of the doll, and the plurality of shape detection sensors are installed in the elastic portion having elasticity of the doll,
system. A system comprising: a doll used by a user; and a monitor used by a remote party who has conversations and emotional exchanges with the user,
The monitor is
Receiving state estimation information indicating the state of the doll and the state of the user, and displaying a virtual image indicating the appearance of the doll and a virtual image indicating the appearance of the user,
A server connected to the doll and the monitor through a network, receiving state information from the doll, and estimating the state of the doll and the state of the user from the received state information; further comprising,
The doll is
a network connection unit for transmitting and receiving data; a voice communication unit for outputting the voice of the voice information received from the network connection unit to the speaker, including a speaker and a microphone; a sensor unit 140 including a plurality of sensors; and a control unit configured to transmit the state information determined from a plurality of sensing data from the plurality of sensors and the voice information from the microphone through the network connection unit;
The sensor unit 140 includes a plurality of gyro sensors installed on the first type portion of the doll and a plurality of shape detection sensors installed on the second type portion of the doll,
The shape detection sensor is configured to sense a shape that changes according to the contact or pressure applied by the user,
The shape detection sensor includes a plurality of detectors for sensing a signal source,
The doll constitutes a shape detection vector including sensing data from the plurality of detectors,
The shape detection vector allows to estimate the deformed appearance of the elastic part corresponding to the shape detection sensor,
system. 5. The method of claim 4,
Further comprising; an artificial intelligence sensor data analysis unit for estimating the state of the doll from a plurality of sensing data of the plurality of sensors,
The artificial intelligence sensor data analysis unit configures the shape detection vector and estimates a shape corresponding to the shape detection vector through an artificial intelligence algorithm,
system. 5. The method of claim 4,
The shape detection sensor is
A plurality of photodetectors as the plurality of detectors and a light source as the signal source located at a specified distance from the plurality of photodetectors, or a plurality of magnetic field sensors as the plurality of detectors and a plurality of magnetic field sensors located at a specified distance and the signal containing a cause magnet,
system. delete delete 5. The method of claim 4,
The server performs an artificial intelligence algorithm by a stored program, estimates the contact area and the changed shape of the doll using a plurality of sensing data included in the state information and measured from the plurality of sensors, and Estimating the state of the user having a relationship corresponding to the sensed data,
system. 5. The method of claim 4,
The server performs an artificial intelligence algorithm by a stored program, and estimates the deformed appearance of the elastic part of the doll corresponding to the shape detection sensor from the shape detection vector of the shape detection sensor included in the state information,
system. 5. The method of claim 3 or 4,
The monitor displaying the image transmits voice information including voice input from the counterpart to the doll through a network,
system. 5. The method of claim 3 or 4,
The monitor transmits a text message input by the counterpart to the server,
The server converts the text message into a designated voice and transmits it to the doll,
system.

Images