JP2013164554A - Electronic device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To appropriately provide to a user whether or not an opponent of a telephone conversation is the opponent whom the user talked to in the past.SOLUTION: The electronic device comprises: a storage device that stores voiceprint data about a voiceprint; a discrimination device that discriminates a user using the device; a determination device that determines whether or not the user has ever heard a voice of the opponent who is having a telephone conversation with the user by means of the device based on the voiceprint data stored in the storage device and a discrimination result of the discrimination device; and a display device that displays a determination result of the determination device.

Description

  The present invention relates to an electronic device.

If a dangerous keyword registered in advance is included in the conversation during a call, the caller is authenticated by the caller's voiceprint and PIN, and the current call is fraudulent if the authentication fails. There is known a fraudulent telephone detection / notification system that allows a responder to listen to a sound that calls attention to a dangerous thing such as a risk (for example, Patent Document 1).
[Prior art documents]
[Patent Literature]
[Patent Document 1] JP 2011-135328 A

  Conventionally, there has been a problem that whether or not the user has spoken in the past cannot be appropriately presented to the user.

  In one aspect of the present invention, an electronic device includes a storage device that stores voiceprint data relating to a voiceprint, a determination device that determines a user who is using the device, and a partner who is talking to the user using the device. A determination device that determines whether or not the user has heard the voice based on voiceprint data stored in the storage device and a determination result of the determination device, and a determination result of the determination device are displayed. A display device.

  It should be noted that the above summary of the invention does not enumerate all the necessary features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.

1 shows a schematic configuration of a fixed telephone 1 according to an embodiment. A block diagram of the fixed telephone 1 is shown. An example of the user information memorize | stored in ROM10 is shown. An example of the other party information memorize | stored in ROM10 is shown. An example of call history information stored in the ROM 10 is shown. An example of the screen 60 displayed on the display unit 9 is shown. An example of the screen 70 displayed on the display unit 9 is shown. 4 is a flowchart showing an example of control by the CPU 8 during a call on the fixed telephone 1.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 shows a schematic configuration of a fixed telephone 1 according to an embodiment. In this example, the fixed telephone 1 is a stationary type telephone. The fixed telephone 1 is connected to a telephone line of a fixed telephone network. The fixed telephone 1 includes a main body 2 and a receiver 3. The receiver 3 is connected to the main body 2 by a cord. The receiver 3 includes a biological sensor 6, a contact sensor 4, a microphone unit 7, and a speaker unit 5.

  For example, a liquid crystal display element can be applied to the display unit 9 provided in the main body unit 2. The display unit 9 displays images and various information. Examples of various information include the telephone number of the caller at the time of incoming call. When making a call, the telephone number of the callee can be exemplified. Further, the display unit 9 may be provided with a touch panel function, and the user who uses the fixed telephone 1 may be registered using the touch panel. As the touch panel, a resistive film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, and a capacitance method may be appropriately selected and used.

  The built-in camera 13 provided in the main body 2 is provided on the upper side of the main body 2. The built-in camera 13 includes a photographing lens and an image sensor. The built-in camera 13 can capture the facial expression of the user who is talking. When a wide-angle lens is used as the imaging lens, it is possible to capture a facial expression of a person located in the vicinity of the user in addition to the user. For example, the built-in camera 13 can capture the facial expression of a person next to the user. As the image sensor, an individual image sensor such as a CCD or CMOS can be used. The image sensor may have a color filter in which the three primary colors RGB are arranged in a Bayer array. Thereby, a color signal corresponding to each color can be obtained from the image sensor. The built-in camera 13 is an example of an imaging device that images a user.

  The biosensor 6 is provided in the receiver 3. The biosensor 6 is provided at a position where the user touches the user's hand when holding the handset 3. For example, the biosensor 6 is provided on the side surface of the handset 3 on the long side. The biometric sensor 6 detects user biometric information. Thus, the biosensor 6 that detects the biometric information of the user is provided in the microphone held by the user. The detection result by the biosensor 6 is used for control in the main body 2.

  Examples of the biological sensor 6 include a pulse sensor. As the pulse sensor, a sensor that detects a pulse by irradiating irradiation light toward a living body with an LED and receiving light reflected from the living body with respect to the irradiation light can be applied. As the pulse sensor, for example, a configuration disclosed in Japanese Patent Application Laid-Open No. 2001-276012 (US Pat. No. 6,526,315) can be applied. The biological sensor 6 may include a sweating amount sensor that detects the sweating amount in addition to the pulse sensor. As the perspiration amount sensor, a configuration in which the perspiration amount of the user is detected by providing a perspiration sensor having a plurality of electrodes can be applied. As the biological sensor 6, a temperature sensor that measures body temperature, a blood pressure sensor that measures blood pressure, and the like can also be provided. It is also possible to cooperate with a wristwatch type biosensor as disclosed in JP 2007-215749 A (US Patent Application Publication No. 2007/0191718). That is, a biosensor provided separately from the main body 2 or the handset 3 and in contact with the user's living body can be applied to control in the main body 2. For example, the main body 2 may acquire the detection result of the biosensor by communication and use the acquired detection result for control.

  In addition, the biological sensor 6 may include a pressure sensor provided on the side surface or the like on the long side of the receiver 3. The detection of the biological information described above may be started by detecting that the user holds the handset 3 with a pressure sensor. That is, when the power of the main body 2 is turned on, the pressure sensor is turned on, and other biological sensors and various sensors, and the analysis section for performing various analyzes in the main body 2 are turned off. Also good. Further, based on the output of the pressure sensor, it can be determined whether or not the user is holding the handset 3 stronger than usual.

  The contact sensor 4 is provided around the speaker unit 5 of the receiver 3 so that the speaker unit 5 is close to the user's ear when the user holds the receiver 3. This is to detect whether or not the user is placing the handset 3 on the ear. The contact sensor 4 may detect information corresponding to the distance to the object, for example, by irradiating the object with irradiation light and receiving light reflected by the object with respect to the irradiation light. Further, the contact sensor 4 may detect information corresponding to the distance from the object based on the detection result of light by an illuminance sensor or the like. For example, the contact sensor 4 may detect information corresponding to the distance from the object based on whether or not external light is received by the illuminance sensor. The contact sensor 4 may detect information corresponding to the distance to the object based on the detection result of the ultrasonic wave. For example, the contact sensor 4 may calculate the distance from the object by outputting an ultrasonic wave and detecting the time until it returns after being reflected by the object.

  FIG. 2 shows a block diagram of the fixed telephone 1. The components of the fixed telephone 1 will be described with reference to this block diagram. The fixed telephone 1 includes the calendar unit 14, the ROM 10, the voice analysis unit 11, the image analysis unit 12, and the CPU 8 in addition to the components described with reference to FIG. 1. The calendar unit 14, the ROM 10, the voice analysis unit 11, the image analysis unit 12, and the CPU 8 are provided in the main body unit 2.

  The calendar unit 14 outputs time information such as year, month, date, and time to the CPU 8. The calendar unit 14 has a timekeeping function.

  The ROM 10 is a nonvolatile memory such as a flash memory. The ROM 10 stores a program for controlling the fixed telephone 1, various parameters, and the like. The ROM 10 stores various data detected by various sensors, face data registered by the user, data related to facial expression data, and the like. Of these, facial expression data includes images of smiles, crying faces, angry faces, surprised faces, anxious faces, mysterious expressions, facial expressions with eyebrows in between the eyebrows, nervous expressions, relaxed expressions, etc. Contains data. The facial expression with the eyebrows between the eyebrows is an example of an unpleasant facial expression. It may be determined whether the user is frustrated from the combination of these faces and expressions. In addition, image data such as face data may be registered by transmitting image data from another device (for example, a personal computer) using a communication unit (not shown) of a fixed telephone. You may make it image a user's face with a built-in camera.

  In addition to the phrases and keywords registered in advance, the ROM 10 stores specific phrases and keywords registered by the user using the touch panel. In the present embodiment, it is assumed that words related to transfer fraud such as transfer and ATM and words related to solicitation such as purchase and sale are registered in the ROM 10 as keywords. Further, it is assumed that the phrase “please apply again after 10 minutes” is registered in the ROM 10. In the present embodiment, the ROM 10 records and saves the content of a call when a specific phrase or keyword registered by the conversation partner or the user is issued. At this time, the other party is notified that the contents of the call are recorded and saved. When a specific word such as a specific frame or keyword is detected, a warning can be given to the other party. This function can be applied to scenes such as wire fraud. Details will be described later.

  The ROM 10 functions as a storage device that stores voiceprint data relating to the voiceprint of the user's talking partner. The ROM 10 stores voiceprint data obtained by analyzing the voice captured by the fixed telephone 1. In the fixed telephone 1, the talking partner may be a calling partner.

  The voice analysis unit 11 analyzes the voice captured from the speaker unit 5 provided in the receiver 3. The voice analysis unit 11 has a voiceprint analysis function. The voice analysis unit 11 compares the captured voice with a voiceprint registered by the user, thereby determining whether the other party is the person who has called for the first time or the person who has called in the past. . For example, the voice analysis unit 11 determines the user who is using the voice based on the captured voice print, and determines whether or not the determined user is talking to the speaking partner for the first time.

  The voice analysis unit 11 analyzes the voice of the other party. Analyzes the voice of the other party captured by the fixed telephone 1. The CPU 8 compares the voice voice of the voice of the talk partner that has been captured with the voice print stored in the ROM 10 to discriminate the talk partner, and judges whether or not the discriminated user is talking to the talk partner for the first time.

  Thus, the voice analysis unit 11 functions as a determination device that determines the user. Further, the CPU 8 functions as a determination device that determines whether or not the user has heard the voice of the other party who is talking to the user based on the voice pattern of the other party and the data stored in the ROM 10.

  The voice analysis unit 11 has a voice recognition dictionary. The voice analysis unit 11 analyzes the voice of the other party with reference to the voice recognition dictionary. Note that voice recognition software is installed in the fixed telephone 1, and the voice may be recognized using the installed software. Furthermore, commercially available software may be installed separately and used for voice recognition. Specifically, the CPU 8 may execute voice recognition processing by operating according to software.

  The voice analysis unit 11 detects whether or not a specific phrase or keyword registered by the user is included in the voice of the conversation partner in addition to the phrase or keyword registered in advance in the ROM 10. Thus, the voice analysis unit 11 functions as a detection device that detects whether or not a specific word is included in the voice of the talking partner. When the voice analysis unit 11 detects a specific word, the CPU 8 warns the talking partner. The display unit 9 functions as a display device that displays the determination result by the voice analysis unit 11.

  The image analysis unit 12 analyzes an image captured by the built-in camera 13. The image analysis unit 12 includes a face recognition unit 16 and a facial expression detection unit 17.

  The face recognition unit 16 detects a face from an image captured by the built-in camera 13 and compares the detected face with a face stored in the ROM 10 to recognize a person captured by the built-in camera 13. The face recognition unit 16 compares faces by pattern matching, for example. Since the built-in camera 13 is provided on the same side as the display unit 9 as described above, the user's face can be mainly imaged. For this reason, the face recognition unit 16 can also recognize the user's face.

  The facial expression detection unit 17 detects the facial expression of the person captured by the built-in camera 13 by comparing the facial expression of the facial region image detected by the face recognition unit 16 with the facial expression data stored in the ROM 10. . The facial expression detection unit 17 has various functions such as a smiling face, a crying face, an angry face, a surprised face, an anxious face, a strange expression, a facial expression with a habit between the eyebrows, a tense expression, and a relaxed facial expression. Detects different types of facial expressions. The ROM 10 stores a plurality of types of facial expression data. Note that the method described in US Patent Application Publication No. 2008-0037841 can be applied to smile detection. Moreover, the method described in US Patent Application Publication No. 2008-0292148 can be applied to the detection of eyebrows between eyebrows.

  The CPU 8 controls the fixed telephone 1 as a whole. In the present embodiment, control is performed so as to record the contents of the call in accordance with the user's facial expression, phrases or keywords uttered by the user or the other party, and the user's wording. The power supply unit 15 supplies power to each part of the main body unit 2 and the receiver 3.

  FIG. 3 shows an example of user information stored in the ROM 10. The user information is, for example, data in which a user ID, name, voiceprint data, and image data are associated with each other. The user ID is information for identifying a user who uses the fixed telephone 1. The user ID may be information such as a numerical value given by the CPU 8 at the time of user registration.

  The name is a user name used for display on the display unit 9 and may be registered by the user. At home, information indicating a blood relationship such as “father” and “mother” may be used as a name, or a first name may be used. Names, titles, etc. can be used as names in organizations such as companies.

  The voiceprint data is information for specifying user voiceprint data corresponding to the user ID. The image data is information that specifies data of an image obtained by capturing the user corresponding to the user ID. Data such as the user's face captured by the built-in camera 13 may be stored as image data.

  Here, for the sake of easy understanding, the file name of a file storing data is shown as an example of voiceprint data or image data. However, information specifying the storage location of data in the ROM 10 such as information on the memory location where the data is stored in the ROM 10 can be applied as audio data or image data.

  The voice analysis unit 11 determines a user who is using the fixed telephone 1 based on the voice print of the voice captured by the microphone unit 7 and the user information. Specifically, the voice analysis unit 11 specifies a user ID stored in association with voice print data similar to the voice print of the voice captured by the microphone unit 7. Further, the face recognition unit 16 determines a user who is using the fixed telephone 1 based on the user image captured by the built-in camera 13 and the user information. Specifically, the face recognition unit 16 specifies a user ID stored in association with image data similar to a user image captured by the built-in camera 13.

  FIG. 4 shows an example of talk partner information stored in the ROM 10. The talk partner information is, for example, data in which a talk partner ID and voiceprint data are associated with each other. The talk partner ID is information for identifying the talk partner. The talk partner ID may be information such as a numerical value given by the CPU 8. When a call is received from a partner with whom no user has made a call in the past, the CPU 8 adds the talk partner ID and voiceprint data assigned to the partner as talk partner information. Note that the conversation partners may be grouped into relatives or friends and stored in the ROM 10, and such grouping can be performed using the touch panel described above.

  The voice analysis unit 11 discriminates the user's talk partner based on the voice print of the talk partner's voice captured by the fixed telephone 1 and the real talk partner information. Specifically, the voice analysis unit 11 specifies a talk partner ID stored in association with voice print data similar to the voice print of the voice of the talk partner.

  FIG. 5 shows an example of call history information stored in the ROM 10. The call history information is, for example, data in which a talker ID, a user ID, and a call time are associated with each other.

  The talk partner ID corresponds to the talk partner ID included in the talk partner information described above. The user ID corresponds to the user ID included in the user information described above. The call time is date and time information indicating the date and time when the talk partner identified by the talk partner ID and the user identified by the user ID talked. Date / time information may include information such as date, time, and the like. The date information is determined based on the time information supplied from the calendar unit 14. Note that the call time may include at least one of a call start time at which a call is started and a call end time at which the call time is ended.

  The CPU 8 determines, based on the call history information, which user the caller has talked with in the past. Further, the CPU 8 causes the display unit 9 to display call history information between the other party who has called and the user based on the call call information and the user information described above.

  FIG. 6 shows an example of a screen 60 displayed on the display unit 9. This screen 60 is an example of a screen when a user makes a call with a partner for the first time. As shown in this screen 60, the CPU 8 notifies the user by displaying on the display unit 9 that the person is the first person, such as “This person is the first person”.

  In addition, when it is determined based on the call history information that the other party who has called has made a call with another user in the past, the CPU 8 further displays the call history with the other party on the display unit 9. . The call history includes date and time and recipient information. The date information is specified based on the call history information and user information. The receiver information is specified based on the call history information and the user information. As described above, when the voice print data of the conversation partner who is talking to the user is stored in the ROM 10, the display unit 9 performs display related to the person who has heard the voice.

  FIG. 7 shows an example of a screen 70 displayed on the display unit 9. This screen 70 is an example of a screen when the user makes a call with a partner who is not the first time. As shown in this screen 70, the CPU 8 notifies the user by displaying on the display unit 9 that he / she is not the first partner, such as “I have talked twice with this person”.

  Further, the CPU 8 further causes the display unit 9 to display a call history between the other party who has called and the user as the receiver. The call history includes a list of date and time information. The date information is specified based on the call history information and user information. As described above, when the user has heard the voice of the other party, the display unit 9 displays the time when the user heard the voice.

  FIG. 8 is a flowchart showing an example of control by the CPU 8 during a call on the fixed telephone 1. This flow is started when a call is received from the other party. At this time, the CPU 8 acquires the call start date and time by the calendar unit 14 and causes the calendar unit 14 to measure the call time.

  In step 80, the CPU 8 determines who is the user as the receiver from the voice print of the receiver and the image of the built-in camera 13. For example, it is determined that the mother is the recipient based on the user information.

  In step 82, the CPU 8 causes the voice analysis unit 11 to analyze the partner's voiceprint captured by the fixed telephone 1. In step 84, the CPU 8 discriminates the partner from the analyzed voiceprint. Specifically, the CPU 8 compares the analyzed voice print with the voice print data stored as the partner information in the ROM 10. When voiceprint data similar to the analyzed voiceprint is not stored as the other party information, it is determined as the first voiceprint. When the voice print data similar to the voice print of the other party is stored as the talk partner information, the CPU 8 specifies the talk partner ID associated with the voice print data.

  If it is determined that the voiceprint is the first voiceprint, the CPU 8 adds the voiceprint data of the partner and the assigned talk partner ID to the voiceprint information in step 86. Further, the CPU 8 displays on the display unit 9 that the other party who has made the call is the first time. Further, the CPU 8 may add information on the talk partner ID, user ID, and call start time to the call history. On the other hand, if the first voiceprint is not determined in step 84 (that is, if there is a call history), the CPU 8 proceeds to step 88.

  In step 88, the CPU 8 determines from the call history stored in the ROM 10 whether the partner has a history of using dangerous terms. If there is a history using the dangerous term, the CPU 8 displays the call history together with the dangerous term on the display unit 9 in step S90, and proceeds to step 94. Here, the CPU 8 may display the registered dangerous terms and the number of times they are used on the display unit 9, and the higher-level concepts (hierarchical expression) such as fraud and solicitation from the used dangerous terms. You may make it display with. In addition, when there is a history of using dangerous terms or when the call is from the other party for the first time, the CPU blinks the display unit 9 or changes the display color to a different color (for example, red). The visibility may be increased by increasing the size of the display. On the other hand, if there is no history using the dangerous term, the CPU 8 displays the display history on the display unit 9 in step 92. In this case, the CPU 8 determines whether or not the receiver and the speaking partner are the first time. For example, the CPU 8 determines whether or not the opponent's voiceprint is a voiceprint of a voice that the mother hears for the first time. Specifically, the CPU 8 determines whether the recipient and the talking partner are new for the first time based on the call history information.

  If there is a call history of the mother, it is determined that the recipient and the speaking partner are not the first time, and the CPU 8 causes the display unit 9 to display the screen illustrated in FIG. 7 as the call history. Thereby, the fixed telephone 1 of the present embodiment can notify the user of the date and time of the last call. At this time, the CPU 8 may display the call time measured by the calendar unit 14 or the average call time on the display unit 9. Further, when the mother's call history is not present, it is determined that the other party is the first call partner for the receiver, and the CPU 8 displays the call history with another user as illustrated in FIG. 6 based on the call history information. Display.

  In step 94, the CPU 8 starts recording the call and stores the recorded data in the ROM 10. The recorded data includes the user's voice and the voice of the other party. Further, the CPU 8 detects the presence / absence of a registered dangerous term by the voice analysis unit 11.

  In step 96, the CPU 8 acquires the biological information detected by the biological sensor 6 and analyzes the situation of the mother who is the user. For example, the CPU 8 analyzes the mother's pulse detected by the biosensor 6, the mother's sweating amount, blood pressure, and the like. The CPU 8 determines whether the pulse rate within a certain period has exceeded a predetermined reference value, whether the mother's sweating amount has exceeded a predetermined reference value, and has the blood pressure exceeded a predetermined reference value You may decide whether or not.

  In step 98, the CPU 8 analyzes the facial expression of the user from the image captured by the built-in camera 13. For example, the CPU 8 causes the facial expression detection unit 17 to detect whether a predetermined facial expression is present. Examples of the predetermined facial expression include an anxious expression, a mysterious expression, an unpleasant expression, an angry expression, and an irritated expression.

  In step 100, the CPU 8 recognizes whether a predetermined dangerous term is detected in the conversation. The CPU 8 proceeds to step 102 if there is a dangerous term, and proceeds to step 106 if there is no dangerous term.

  In step 102, the CPU 8 determines whether or not it is the first time that the process proceeds to step S102 in this flowchart. This is to prevent the next step 104 from being repeated. In step 104, the CPU 8 informs the other party of the recording of the call. In this case, the CPU 8 outputs audio data (phrase) stored in the ROM 10. Specifically, a voice alerting the other party such as “This call has been recorded” is superimposed on the voice inputted from the microphone unit 7 and outputted to the telephone line. The warning voice may be output instead of the voice input from the microphone unit 7. In this flow, recording is started in step 94, but recording may be started at the timing of notification in step 104.

  In step 106, the CPU 8 determines whether or not the call has ended. Specifically, the CPU 8 determines whether or not the call is ended by detecting whether or not the contact sensor 4 provided in the receiver 3 is placed on the main body unit 2. If the call is ended, the step is performed. Proceed to 108, and if the call has not ended, proceed to step 110.

  When the CPU 8 proceeds to step 108, it displays the call summary on the display unit 9. In the present embodiment, the CPU 8 uses the voice analysis unit 11 to extract keywords related to date and time and place, and causes the display unit 9 to display a meeting place and a meeting date and time with a talking partner (for example, a friend). Further, the CPU 8 also ends the time counting by the calendar unit 14, stores the call history including the call time in the ROM 10, and deletes the recorded voice. Note that the CPU 8 may delete the recorded voice immediately after the call ends, or after a predetermined time has elapsed (for example, 24 hours).

  On the other hand, if the call has not ended, the CPU 8 determines in step 110 whether or not the operation mode of the fixed telephone 1 is set to the answering machine mode. For example, the CPU 8 determines whether or not to enter the answering machine mode based on the analysis result of the biological information in step 96 and the analysis result of the facial expression in step 98. In the present embodiment, the CPU 8 determines to enter the answering machine mode when it is determined that the predetermined facial expression continues to be detected beyond the predetermined length. Further, the CPU 8 determines that the answering machine mode is set when the pulse rate exceeding the reference value is detected, the perspiration amount exceeding the reference value is detected, or the blood pressure exceeding the reference value is detected. These reference values may be set for each user ID, and normal biological information is acquired by the biological sensor 6 from the conversation partner ID during a call with a friend or relative, and stored in the ROM 10. What should I do? Further, the CPU 8 may analyze the mother's wording using the voice analysis unit 11 and determine whether or not to set the answering machine mode according to the analysis result. Specifically, the CPU 8 may determine that the answering machine mode is to be selected when the mother issues the words “I refuse”, “It ’s fine”, “I ’m in time”, or when the ending is rough.

  Note that the CPU 8 may present to the user that the answering machine mode should be set when it is determined that the answering machine mode should be set based on the biological information analysis or facial expression analysis. For example, the CPU 8 may display on the display unit 9 that there is a possibility of fraud. Further, the CPU 8 may cause the display unit 9 to display a phrase that should be asked to the other party when the mother's condition is not normal but tense. In the present embodiment, it is assumed that the CPU 8 displays “Please apply again after 10 minutes” on the display unit 9 as a phrase. Such a phrase may be stored in the ROM 10 according to the dangerous term, or may be registered by a touch panel. Further, the CPU 8 may cause the display unit 9 to display an inquiry as to whether or not to set the answering machine mode. The CPU 8 may determine that the answering machine mode is selected when the user selects to set the answering machine mode.

  If the CPU 8 determines that the operation mode is the answering machine mode, the CPU 8 proceeds to step 112, sets the operation mode to the answering machine mode, stores the call record including the dangerous terms in the ROM 10, and ends this flow. In this case, the CPU 8 may ask the user whether to keep the recorded voice stored in the ROM 10 or erase it, and set the timing of erasure twice as usual (for example, 48 hours). It may be. On the other hand, if not in the answering machine mode, the process returns to step 96.

  There is a case where a person who is trying to do so-called oleo fraud tries to execute fraud on the next and subsequent telephones after notifying the telephone in advance that the telephone number has been changed falsely as a relative or the like. However, according to the fixed telephone 1 of the present embodiment, for example, even when the father responds to the phone at the first call, the mother is the first person to talk to when the mother responds at the next call. Since this is displayed on the display unit 9 to call attention, it is possible to reduce the possibility of the mother being deceived. Even if the recipient and the other party are not the first time, if the number of times the recipient has made a call with the other party is less than a predetermined value, or if the call has been made within a predetermined period (for example, 48 hours) from the first call, A phrase that calls attention may be displayed on the display unit 9. In this way, even if a person who tries to scam makes a phone call that pretends a phone number in advance, if the frequency of calls with the person is low, the receiver will be frustrated by performing a display to alert the display unit 9 The possibility of being lost can be reduced.

  In the above description, the processing described as the operation of the CPU 8 is realized by the CPU 8 controlling each hardware of the fixed telephone 1 according to a program. That is, in the processing described in relation to the fixed telephone 1 of the present embodiment, the hardware operates including the processor, the memory, etc., and the program by the processor operating according to the program and controlling the hardware. It can be realized by operating. That is, the process can be realized by a so-called computer device. The computer device may load a program for controlling the execution of the above-described process, operate according to the read program, and execute the process. The computer device can load the program from a computer-readable recording medium storing the program.

  In the present embodiment, the fixed telephone 1 as an example of the communication device has been described. However, as the fixed telephone 1, a so-called cordless fixed telephone in which the handset 3 and the main body 2 are connected by radio can be applied. In this case, even when the user is in a position where the built-in camera 13 cannot capture the user, the user can be identified from the voice print of the voice input to the microphone unit 7. In addition, a mobile phone can be applied as a call device. The telephone line in the present embodiment is an example of a telephone line. As a telephone line, a mobile telephone line or the like can be applied in addition to a fixed telephone line. In addition, various communication lines such as the Internet and satellite communication can be applied as a telephone line.

  Moreover, in this embodiment, the scene which uses the fixed telephone 1 at home was mainly demonstrated. However, the present invention can also be applied to scenes where a telephone device such as the fixed telephone 1 is used in an organization such as a company. For example, the present invention can be applied to a call device having a telephone operator as a user. As an example, it can be used in a scene where it is used by a customer or complaint receptionist. For example, a function for displaying whether or not the user has heard the voice of the other party and the call history can be applied as a function of the call device.

  The functions of the fixed telephone 1 can be incorporated into various electronic devices, not as a so-called telephone alone. For example, the function of the fixed telephone 1 can be incorporated into a general-purpose computer device such as a personal computer, an electronic device having a function other than the telephone function, such as a television. As for the camera function, a form externally attached to the electronic device can be adopted in addition to a form built in the electronic device as a built-in camera.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior to”. It should be noted that the output can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for convenience, it means that it is essential to carry out in this order. It is not a thing.

  DESCRIPTION OF SYMBOLS 1 Fixed telephone, 2 Main-body part, 3 Handset, 4 Contact sensor, 5 Speaker part, 6 Biosensor, 7 Microphone part, 8 CPU, 9 Display part, 10 ROM, 11 Voice analysis part, 12 Image analysis part, 13 Built-in camera , 14 Calendar section, 15 Power supply section, 16 Face recognition section, 17 Expression detection section

Claims (12)

A storage device for storing voiceprint data relating to a voiceprint;
A discriminating device for discriminating a user using the device;
Determining whether the user has heard the voice of the other party who is talking to the user by the device based on the voice print data stored in the storage device and the determination result of the determination device A determination device to
A display device for displaying a determination result of the determination device;
Electronic equipment comprising.   The electronic device according to claim 1, further comprising: a recording device that stores the voice print of the other party when the voice print of the other party is not stored in the storage device. The storage device can store a specific word of the opponent,
The electronic device according to claim 1, further comprising a warning unit that warns the user when the specific word is stored in the storage device.   The electronic device according to any one of claims 1 to 3, further comprising a control device that performs a display related to the call on the display device after the call. The electronic device according to any one of claims 1 to 4, wherein, when the user has heard the voice of the other party, the display device performs a display regarding a time when the user heard the voice. 6. The display device according to claim 1, wherein when the voice print data of the voice print of the other party who is talking to the user is stored in the storage device, the display device displays the person who has heard the voice. The electronic device as described in any one. The electronic device according to any one of claims 1 to 6, further comprising a detection device that detects whether or not a specific word is included in the voice of the other party. The electronic device according to claim 7, further comprising: a warning unit that issues a warning to the opponent when the detection device detects the specific word. The electronic device according to any one of claims 1 to 8, further comprising an imaging device that images the user.   The electronic device according to claim 1, wherein a biological sensor that detects biological information is provided in a holding unit of the device.   The electronic device according to claim 10, wherein the display device performs display according to a detection result of the biological sensor. A recording unit for recording the call;
The electronic device according to any one of claims 1 to 11, further comprising a determination unit that determines a timing of erasing the voice recorded by the recording unit according to the content of the call.

Images