WO2024009743A1 - Information providing device, information providing method, program, and recording medium - Google Patents

Abstract

An information providing device comprising: a situation detection unit that detects a current situation of a moving object or an occupant of the moving object; a call originating unit that originates a call to a first contact on the basis of the situation detected by the situation detection unit; and a providing unit that provides a second contact with telephone call information generated on the basis of voices of the telephone call between the occupant and the first contact as a result of the originated call or access information for access to this telephone call information.

Description

Information provision device, information provision method, program and recording medium

The present invention relates to an information providing device, an information providing method, a program, and a recording medium, and relates to an information providing device, an information providing method, a program, and a recording medium, for example, for detecting that some kind of abnormality has occurred in a moving object or a passenger of the moving object, and providing the information to the outside. The present invention relates to a device, an information providing method, a program, and a storage medium.

As a reporting system that notifies you in the event of an emergency situation such as a vehicle accident or driver abnormality, it detects driver abnormality or the occurrence of an accident, and sends a robot voice to emergency contacts such as the police or home contacts. An emergency notification system for making notifications has been proposed (for example, Patent Document 1).

JP2008-293208A

Although an emergency call system like the above-mentioned conventional technology can automatically send a call to multiple contacts, it is not possible to explain the detailed situation.

An issue that one aspect of the present invention aims to solve is that in the emergency call system such as the above-mentioned conventional technology, it is not possible to explain the detailed situation when making a call, which increases the anxiety of the person receiving the call. An example of this is the problem of sometimes being stored away.

Further, as a problem that one aspect of the present invention attempts to solve, the emergency call system such as the above-mentioned conventional technology is a system that voluntarily makes a report to a contact registered in advance. An example of this is the problem of not being able to deal with the situation if it occurs.

Note that the description of these problems does not preclude the existence of other problems, and one embodiment of the present invention solves at least one of the problems described above. Furthermore, it is possible to extract problems other than these from the description, drawings, claims, etc.

The present invention has been made in view of the above points, and one of its objects is to provide an information providing device that can notify detailed information to multiple contacts when an emergency situation occurs.

The invention according to claim 1 is an information providing apparatus, which includes: a situation detection section that detects a current situation of a moving object or a passenger of the moving object; a calling unit that makes a call to a contact, and call information generated based on the voice of the call between the passenger and the first contact due to the call, or an access for accessing the call information; and a providing unit that provides information to the second contact.

The invention according to claim 8 is an information providing method executed by an information providing device, comprising: a situation detecting step of detecting the current situation of a moving object or a passenger of the moving object; a calling step of making a call to a first contact based on the situation; and call information generated based on the audio of the call between the passenger and the first contact based on the call, or the call information. and an information providing step of providing access information for accessing the second contact to the second contact.

The invention according to claim 9 is a program, comprising: a situation detection step for detecting the current situation of a moving body or a passenger of the moving body; a calling step of making a call to a first contact, and call information generated based on the audio of the call between the passenger and the first contact due to the call, or a call information for accessing the call information. and an information providing step of providing access information to the second contact.

The invention according to claim 10 includes a situation detection step of detecting a current situation of a moving object or a passenger of the moving object, and a step of detecting a situation of a first contact based on the situation detected in the situation detection step. a calling step of making a call, and a second call information generated based on the voice of the call between the passenger and the first contact due to the call, or access information for accessing the call information. The information provision step to be provided to the contact information, and the program for executing the step are recorded.

1 is a block diagram showing the configuration of an information providing device according to a first embodiment; FIG. 3 is a flowchart showing a processing routine of call voice acquisition processing. 7 is a flowchart showing a processing routine of a first process in the first embodiment. 7 is a flowchart showing a processing routine of second processing in the first embodiment. FIG. 2 is a block diagram showing the configuration of an information providing device according to a modification of the first embodiment. It is a flowchart which shows the process routine of the 1st process of a modification. FIG. 2 is a block diagram showing the configuration of an information providing device according to a second embodiment. 7 is a flowchart illustrating a processing routine of a first process according to a second embodiment. 12 is a flowchart showing a processing routine of second processing in the second embodiment. FIG. 7 is a block diagram showing the configuration of an information providing device according to a modification of the second embodiment. It is a flowchart which shows the process routine of the 1st process of a modification. FIG. 3 is a block diagram showing the configuration of an information providing device according to a third embodiment. 12 is a flowchart illustrating a processing routine of a first process in Example 3. 12 is a flowchart showing a processing routine of second processing in the third embodiment. FIG. 12 is a block diagram showing the configuration of an information providing device according to a modification of the third embodiment. It is a flowchart which shows the process routine of the 1st process of a modification. 2 is a block diagram showing the configuration of an information providing system that is a modification of the first embodiment. FIG. FIG. 2 is a block diagram showing the configuration of an information providing system that is a modification of the second embodiment.

Preferred embodiments of the present invention will be described in detail below. In the following description of each embodiment and the accompanying drawings, substantially the same or equivalent parts are designated by the same reference numerals.

FIG. 1 is a block diagram showing the configuration of the information providing device 10 of this embodiment. The information providing device 10 is a device that detects that an abnormality has occurred in a moving object or a passenger of the moving object, and provides information to the outside. The information providing device 10 includes, for example, an in-vehicle navigation device mounted on a vehicle as a moving object.

The information providing device 10 includes an image information acquisition section 11, a sensor information acquisition section 12, a situation detection section 13, a contact storage section 14, a processing control section 15, a telephone transmission section 16, a call voice acquisition section 17, a reproduction processing section 18, and It has a telephone receiving section 19.

The image information acquisition unit 11 acquires images taken by an outside camera and an inside camera provided in the vehicle.

The sensor information acquisition unit 12 acquires measurement results of various sensors mounted on the vehicle as sensor information. For example, the sensor information acquisition unit 12 acquires vehicle position information acquired by a GPS (Global Positioning System) sensor. Further, the sensor information acquisition unit 12 acquires information on the acceleration of the vehicle measured by an IMU (Inertial Measurement Unit). Further, the sensor information acquisition unit 12 acquires biological information of the passenger (for example, information such as the driver's heart rate and blood pressure) acquired by a biological sensor mounted on the vehicle.

The situation detection unit 13 detects the current situation of the vehicle and the passenger based on at least one of the image information acquired by the image information acquisition unit 11 and the sensor information acquired by the sensor information acquisition unit 12.

Specifically, the situation detection unit 13 detects the occurrence of a vehicle failure or accident based on the sensor information about the vehicle acquired by the sensor information acquisition unit 12. For example, the situation detection unit 13 detects the occurrence of an accident based on changes in acceleration and information on vehicle position. Further, the situation detection unit 13 detects changes in the health condition of the vehicle occupant based on information such as heart rate and blood pressure acquired by the sensor information acquisition unit 12.

The contact storage unit 14 is comprised of a nonvolatile storage device such as a hard disk, flash memory, and SSD (Solid State Drive). The contact storage unit 14 stores information on a plurality of contacts.

In this embodiment, the contact information storage unit 14 stores the telephone number of the destination to which a report is to be made when an emergency situation occurs as contact information. The plurality of contacts are stored in a ranked order such as a first contact, a second contact, etc., depending on the type of emergency. For example, as contact information when an accident occurs, the telephone numbers of the police, roadside assistance, and family members are stored as first contact information, second contact information, and third contact information, respectively. In addition, for example, emergency (fire), family, and workplace phone numbers are stored as the first contact, second contact, and third contact, respectively, in case a passenger suddenly becomes ill. has been done.

Further, the contact storage unit 14 stores contact information of the person to whom information is provided as an automatic response when a telephone call is received from outside when an emergency situation occurs. For example, the contact storage unit 14 stores phone numbers of workplaces and friends as registered phone numbers that should be automatically answered.

The processing control unit 15 is composed of an arithmetic processing device such as a CPU (Central Processing Unit). The processing control unit 15 not only controls the operation of each unit of the information providing device 10 but also executes various processes related to detecting an emergency situation and providing information to the outside.

For example, the processing control unit 15 determines whether an emergency situation such as an accident or sudden illness that requires notification to the outside has occurred based on the current situation of the vehicle and the passenger detected by the situation detection unit 13. In addition, the processing control unit 15 selects the first contact and the second and subsequent contacts from among the plurality of contacts stored in the contact storage unit 14 according to the type of emergency detected by the situation detection unit 13. Select a contact.

The telephone calling unit 16 makes a telephone call (calling) to the first contact selected by the processing control unit 15. Further, after the telephone call with the first contact is completed, the telephone calling unit 16 sequentially calls the second and subsequent contacts.

The call audio acquisition unit 17 acquires the call audio of a call between the vehicle passenger and the first contact (hereinafter referred to as the first call). In this embodiment, the call audio acquisition unit 17 records the call audio of the first call and acquires it as recorded data.

The playback processing unit 18 plays back the recorded data acquired by the call audio acquisition unit 17 during the phone call between the vehicle passenger and the second and subsequent contacts. In addition, when a call is received from a registered contact stored in the contact storage unit 14 after the call audio acquisition unit 17 acquires the audio of the first call, the playback processing unit 18 is configured to Play recorded data during calls with already completed contacts.

The telephone receiving unit 19 receives a telephone call from outside when an emergency situation occurs.

Next, the operation of the information providing device 10 of this embodiment will be explained. After acquiring the call audio of the first call made with the first contact, the information providing device 10 calls the second and subsequent contacts and reproduces the call audio of the first call. and a second process of receiving a call from a registered contact and reproducing the voice of the first call.

First, the call voice acquisition process that is the premise of the first process and the second process will be described. FIG. 2 is a flowchart showing a processing routine of call voice acquisition processing.

The situation detection unit 13 detects the current situation of the vehicle or the occupant of the vehicle based on at least one of the image information acquired by the image information acquisition unit 11 and the various sensor information acquired by the sensor information acquisition unit 12. (STEP 101).

Based on the situation detected by the situation detection unit 13, the processing control unit 15 determines whether an emergency situation requiring notification to the outside has occurred (STEP 102).

If it is determined that an emergency situation has not occurred (STEP 102: NO), the process returns to STEP 101, and the situation detection unit 13 continues to detect the current situation of the vehicle and the passenger.

On the other hand, if it is determined that an emergency situation has occurred (STEP 102: YES), the processing control unit 15 selects information from among the contacts stored in the contact storage unit 14 according to the type of emergency situation that has occurred. The first contact to be the other party is selected (STEP 103).

The telephone calling unit 16 makes a call (outgoing telephone call) to the selected first contact (STEP 104).

The processing control unit 15 determines whether a call connection has been established (STEP 105). If it is determined that the call connection has not been established (STEP 105: NO), the telephone calling unit 16 is controlled to make a call to the first contact again.

If it is determined that the call connection has been established (STEP 105: YES), the call audio acquisition unit 17 acquires the call audio of the first call, which is the call between the passenger and the first contact (STEP 106).

Through the above processing, a call is made to the first contact, and the audio of the conversation between the passenger and the first contact is obtained. The following first process and second process are executed on the premise that the call voice of the first call has been acquired in the call voice acquisition process.

Next, the processing operation of the first process of this embodiment will be explained. FIG. 3 is a flowchart showing the processing routine of the first process.

The processing control unit 15 selects a second contact from among the plurality of contacts stored in the contact storage unit 14, depending on the type of emergency that has occurred (STEP 107).

The telephone calling unit 16 calls the selected second contact (STEP 108).

The processing control unit 15 determines whether a call connection has been established (STEP 109).

If it is determined that the call connection has not been established (STEP 109: NO), the processing control unit 15 determines whether or not a predetermined number of calls have been attempted (STEP 110). If it is determined that the predetermined number of calls have not been made (STEP 110: NO), the process returns to STEP 108, and the processing control unit 15 controls the telephone calling unit 16 to make the call again.

On the other hand, if it is determined that the call connection has been established (STEP 109: YES), the voice of the first call is played back in the call resulting from the call connection (STEP 111).

After STEP 111 ends, or if it is determined in STEP 110 that a predetermined number of calls have been made (STEP 110: YES), the processing control unit 15 stores the information stored in the contact storage unit 14 based on the type of emergency that has occurred. It is determined whether there is another contact (next contact) among the plurality of contacts to which information should be continuously provided (STEP 112).

If it is determined that there is a next contact (STEP 112: YES), the processing control unit 15 selects the next contact as the target of the call (STEP 113). Returning to STEP 108, the processing control unit 15 controls the telephone calling unit 16 to make a call.

If it is determined that there is no next contact (STEP 112: NO), the process ends.

The information providing device 10 executes the first process using the processing routine as described above.

In the first process, when an emergency situation such as an accident or sudden illness occurs, a telephone call is automatically made to the first contact point selected according to the type of emergency situation, and the passenger and the first contact point are automatically called. The call audio of the first call, which is a call with a contact, is acquired. Subsequently, a call is made to the second contact, and the voice of the first call is reproduced during the call with the second contact.

According to the first process, the passenger does not need to explain again the contents explained during the phone call with the first contact during the phone call with the second contact, which reduces the burden on the passenger. be able to. In addition, the content of the notification is what the passenger actually said with his or her own mouth, so unlike when the facts are mechanically communicated using a robot voice, the other party cannot understand what happened to the vehicle or the passenger. It becomes possible to know detailed contents about Tanaka.

Next, the processing operation of the second process of this embodiment will be explained. FIG. 4 is a flowchart showing the processing routine of the second process.

Among the contacts stored in the contact storage unit 14, the processing control unit 15 selects contacts (hereinafter referred to as registered (STEP 114).

If a call is received from a registered contact (STEP 114: YES), the telephone receiving unit 19 receives the call (STEP 115).

The reproduction processing unit 18 reproduces the call audio of the first call in a call with a registered contact for whom a call connection has been established by an incoming call (STEP 116).

According to the processing routine as described above, the information providing device 10 executes the second processing.

In the second process, after acquiring the call audio of the first call, when a call from a registered contact is received, the call audio of the first call is played back in the call with the registered contact.

According to this second process, the burden on the passenger can be reduced, for example, when it is difficult for the passenger to respond by telephone due to reasons such as being busy dealing with the accident. In addition, the contact information of a workplace or a specific friend, for example, may be stored in advance in the contact information storage unit 14 as a person to whom an automatic response is to be performed in the second process when a telephone call is received in the event of an emergency situation. This makes it possible to notify the other party of the emergency situation only when a call is received from the workplace or a specific friend.

In addition, in the above explanation, the case where the call audio of the first call is played as is in the call with the second contact or the registered contact was shown as an example, but the present invention is not limited to this, and for example, the call audio of the first call You may also play a summarized audio summary.

FIG. 5 is a block diagram showing the configuration of a modified information providing device 10A that provides information based on summarized audio. The information providing device 10A includes a summary audio generation section 24.

The summary audio generation unit 24 generates a summary audio of the first call based on the call audio of the first call acquired by the call audio acquisition unit 17. The summarized speech generation unit 24 generates summarized speech using, for example, AI (Artificial Intelligence).

FIG. 6 is a flowchart showing a processing routine of the first process executed by the information providing device 10A of the modification.

The first process of the modification is also executed on the premise of the above call voice acquisition process (STEPs 101 to 106 in FIG. 2).

The summary audio generation unit 24 generates summary audio data based on the call audio of the first call acquired by the call audio acquisition unit 17 (STEP 106A).

The processing control unit 15 selects a second contact from among the plurality of contacts stored in the contact storage unit 14, depending on the type of emergency that has occurred (STEP 107). The telephone calling unit 16 calls the selected second contact (STEP 108).

The processing control unit 15 determines whether a call connection has been established (STEP 109). If it is determined that the call connection has not been established (STEP 109: NO), the processing control unit 15 determines whether or not a predetermined number of calls have been attempted (STEP 110). If it is determined that the predetermined number of calls have not been made (STEP 110: NO), the process returns to STEP 108, and the processing control unit 15 controls the telephone calling unit 16 to make the call again.

On the other hand, if it is determined that the call connection has been established (STEP 109: YES), the summarized audio data generated in STEP 106A is played back during the call based on the call connection (STEP 111A).

After STEP 111A ends, or if it is determined that a predetermined number of calls have been made in STEP 110 (STEP 110: YES), the processing control unit 15 stores the information stored in the contact storage unit 14 based on the type of emergency that has occurred. It is determined whether there is another contact (next contact) among the plurality of contacts to which information should be continuously provided (STEP 112).

If it is determined that there is a next contact (STEP 112: YES), the processing control unit 15 selects the next contact as the target of the call (STEP 113). Thereafter, the process returns to STEP 108, and the processes of STEP 108 to STEP 112 (calling, establishment of call connection, reproduction of summarized audio data) are executed again.

If it is determined that there is no next contact (STEP 112: NO), the process ends.

According to the processing routine as described above, the information providing device 10A of the modified example executes the first processing. Note that the second process of the modification is also similar to the first process of the modification, in which the reproduction of the call audio of the first call in the second process of the above embodiment is changed to the reproduction of summarized audio data.

In the processing of these modified examples, summarized audio data is generated based on the call audio of the first call, and the summarized audio data is reproduced during the call with the second contact or the registered contact. According to such processing, the situation can be conveyed in a shorter time than in the case where the audio data of the first call voice is played back as is, so the time for providing information can be shortened.

Next, Example 2 of the present invention will be described.

FIG. 7 is a block diagram showing the configuration of the information providing device 20 of this embodiment. The information providing device 20 includes an image information acquisition section 11 , a sensor information acquisition section 12 , a situation detection section 13 , a contact storage section 14 , a processing control section 15 , a telephone transmission section 16 , a call voice acquisition section 17 , and a speech text conversion section 21 and a mail sending/receiving section 22.

The voice-to-text conversion unit 21 converts the call voice of the first call acquired by the call voice acquisition unit 17 into text, and converts the voice of the first call into text into text data (hereinafter referred to as text data of the first call). ) is generated.

The email sending/receiving unit 22 sends and receives emails to and from each of the plurality of contacts stored in the contact storage unit 14.

Specifically, in the first process of this embodiment, the email sending/receiving unit 22 sends an email containing the text data of the first call (for example, an email or a data file in which the text data of the first call is written in the body). (with attached email) to the second contact. Further, in the second process of this embodiment, when receiving an email from a registered contact, the email sending/receiving unit 22 sends an email containing the text data of the first call to the registered contact as a reply to the email. Send first.

Next, the operation of the information providing device 20 of this embodiment will be explained. After the first call is made with the first contact and the call audio of the first call is acquired, the information providing device 20 generates text data based on the call audio of the first call. Then, a first process of transmitting to the second and subsequent contacts, and a second process of transmitting text data of the first call as a response when an email is received from a registered address are executed.

First, the processing operation of the first process of this embodiment will be explained. FIG. 8 is a flowchart showing the processing routine of the first process. Note that this embodiment is also based on the same call voice acquisition process as in the first embodiment (STEPs 101 to 106 in FIG. 2), so its explanation will be omitted here.

The voice-to-text conversion unit 21 converts the voice of the first call acquired by the voice call acquisition unit 17 into text, and generates text data of the first call (STEP 201).

The processing control unit 15 generates a notification email including the text data of the first call (STEP 202).

The processing control unit 15 selects a second contact from among the plurality of contacts stored in the contact storage unit 14, depending on the type of emergency that has occurred (STEP 203). In STEP 203, it is possible to select a plurality of contacts as second contacts depending on the type of emergency that has occurred.　

The email sending/receiving unit 22 sends the notification email generated in STEP 202 to the second contact (STEP 204), and then the processing control unit 15 ends the process.

The information providing device 20 executes the first process using the processing routine as described above.

In the first process, when an emergency situation such as an accident or sudden illness occurs, a call is automatically made to the first contact, and the first call is a call between the passenger and the first contact. Get the call audio. Then, the voice of the first call is converted into text data, and an email containing the text data is sent to the second contact.

According to the first process, the passenger can automatically notify the second contact of the content explained during the call with the first contact, thereby reducing the burden on the passenger. can. In addition, the content of the notification is a text version of what the passenger actually said with his or her own mouth, so unlike when the facts are mechanically communicated using a robot voice, the other party is not aware of the vehicle or passenger. It becomes possible to know the details of what happened to the person.

In addition, in the first process of this embodiment, information is provided using email, so unlike the case where information is provided by telephone, it is possible to notify all necessary contacts all at once. Information can be provided without delay. Furthermore, the other party can check the information at a time convenient for him/her.

Next, the processing operation of the second process of this embodiment will be explained. FIG. 9 is a flowchart showing the processing routine of the second process.

The processes in STEP 201 and 202 are the same as the first process. That is, in the second process, the voice-to-text conversion unit 21 converts the call voice of the first call into text to generate text data (STEP 201), and the process control unit 15 converts the call voice of the first call into text to generate text data, and the processing control unit 15 converts the call voice of the first call into text to generate text data. Generate an email (STEP 202).

Among the contacts stored in the contact storage unit 14, send an email from a contact who is stored as a target for providing information regarding the type of emergency situation determined to have occurred in STEP 102 (hereinafter referred to as a registered contact). It is determined whether there is an incoming call (STEP 207).

If it is determined that an email has arrived (STEP 207: YES), the email sending/receiving unit 22 sends the notification email created in STEP 202 as an automatic reply to the email that has arrived (STEP 208).

According to the processing routine as described above, the information providing device 20 executes the second processing.

In the second process, after acquiring the call audio of the first call, when an email from a registered contact is received, an email containing the text of the call audio of the first call is sent to the registered contact. Send to.

According to this second process, when it is difficult for the passenger to respond to an email due to, for example, being busy responding to an accident, it becomes possible to automatically respond. In addition, when an emergency situation occurs and an email is received, the contact information (email address) of a specific friend at work or a specific friend may be stored in advance in the contact storage unit 14 as the person to whom the second process will automatically respond. By memorizing this, you can notify the other party of the emergency situation only when you receive an email from the workplace or a specific friend.

Note that in the above description, the case where the text data obtained by converting the call voice of the first call into text is sent to the second contact or the registered contact was shown as an example. However, the text data to be transmitted is not limited to the voice of the first call that is converted into text as it is, and for example, summary text data that summarizes the content of the first call may be transmitted.

FIG. 10 is a block diagram showing the configuration of a modified information providing device 20A that provides information using summary text data. The information providing device 20A includes a summary text generation section 23.

The summary text generation unit 23 generates summary text data that summarizes the content of the first call based on the call audio of the first call acquired by the call audio acquisition unit 17. For example, the summary text generation unit 23 generates summary text data by converting the voice of the first call into text data and summarizing the text data using AI.

FIG. 11 is a flowchart showing the processing routine of the first process executed by the information providing device 20A of the modification.

The first process of the modification is also executed on the premise of the above call voice acquisition process (STEPs 101 to 106 in FIG. 2).

The summary text generation unit 23 generates summary text data based on the call audio of the first call acquired by the call audio acquisition unit 17 (STEP 201A).

The processing control unit 15 generates a notification email including summary text data (STEP 202).

The subsequent processing in STEP 203 and STEP 204 is the same as the above explanation, so the explanation will be omitted here. Note that, similarly to the first processing of the modification, the second processing of the modification also uses the text data of the call audio of the first call used in the second processing of the above embodiment (i.e., the text data of the call audio is converted into text as it is). (text data), a notification email containing summary text data is sent.

In the processing of these modified examples, summary text data is generated based on the voice of the first call and sent to the second contact or the registered contact. According to such processing, the main points can be extracted and notified, so that the other party can efficiently understand the situation.

Next, Example 3 of the present invention will be described.

FIG. 12 is a block diagram showing the configuration of the information providing device 30 of this embodiment. The information providing device 30 includes an image information acquisition section 11, a sensor information acquisition section 12, a situation detection section 13, a contact storage section 14, a processing control section 15, a telephone transmission section 16, a call voice acquisition section 17, a mail transmission/reception section 22, and It has a server communication section 31.

The server communication unit 31 is a communication device that transmits and receives data via a communication network, and is composed of a network adapter such as a NIC (Network Interface Card), for example. The server communication unit 31 accesses the server and uploads the audio data of the first call acquired by the call audio acquisition unit 17 to the server.

The email sending/receiving unit 22 sends an email containing link information for accessing the address of the uploaded audio data. Specifically, in the first process of this embodiment, the email sending/receiving unit 22 sends an email containing link information for accessing the audio data to the second contact. Further, in the second process of this embodiment, when receiving an email from a registered contact, the email sending/receiving unit 22 sends an email containing link information for accessing the audio data to the registered contact as a reply to the email. Send to your contacts.

Next, the operation of the information providing device 30 of this embodiment will be explained. The information providing device 30 acquires the call audio of the first call made with the first contact, uploads the audio data to the server, and sends a notification containing link information for accessing the audio data. A first process of sending an email to a second and subsequent contacts is executed, and a second process of sending a notification email as a response when an email is received from a registered address.

First, the processing operation of the first process of this embodiment will be explained. FIG. 13 is a flowchart showing the processing routine of the first process. Note that this embodiment is also based on the same call voice acquisition process as in the first embodiment (STEPs 101 to 106 in FIG. 2), so its explanation will be omitted here.

The server communication unit 31 uploads the voice data of the call voice of the first call acquired by the call voice acquisition unit 17 to the server (STEP 301).

The processing control unit 15 generates a notification email containing link information for accessing the audio data (STEP 302).

The processing control unit 15 selects a second contact from among the plurality of contacts stored in the contact storage unit 14, depending on the type of emergency that has occurred (STEP 303). In STEP 303, it is possible to select a plurality of contacts as second contacts depending on the type of emergency that has occurred.

The email sending/receiving unit 22 sends the notification email generated in STEP 302 to the second contact (STEP 304), and then the processing control unit 15 ends the process.

The information providing device 30 executes the first process using the processing routine as described above.

In the first process, when an emergency situation such as an accident or sudden illness occurs, a call is automatically made to the first contact, and the first call is a call between the passenger and the first contact. Get the call audio. Then, the voice data of the first call is uploaded to the server, and an email containing link information for accessing the voice data is sent to the second contact.

As another example of the first process, when an emergency situation such as an accident or sudden illness occurs, the information providing device 30 automatically makes a call to the first contact, and at the same time sends a call to the second contact. An email containing the link information is sent to the server, and the audio data of the call audio is sequentially uploaded to the server from the start of the first call between the passenger and the first contact, and the server sends the link information to the server. The audio data of the call audio may be streamed to the viewer who has accessed through the website.

According to the first process, the passenger can automatically notify the second contact of the content explained during the call with the first contact, thereby reducing the burden on the passenger. can. In addition, by accessing the server, the other party who receives the notification can listen to what the passenger actually said in his or her own mouth, so he or she can learn more about what happened to the vehicle or the passenger. becomes possible.

In addition, in the first process of this embodiment, information is provided using email, so unlike the case where information is provided by telephone, it is possible to notify all necessary contacts all at once. Information can be provided without delay. Furthermore, the other party can check the information at a timing convenient for him/her. Furthermore, in the first process of this embodiment, the other party can listen to the audio of the actual call by accessing the server, which provides a more realistic experience than when information is provided only through text data. It is possible to obtain information.

Next, the processing operation of the second process of this embodiment will be explained. FIG. 14 is a flowchart showing the processing routine of the second process.

The processes in STEP 301 and 302 are the same as the first process. That is, in the second process, the server communication unit 31 uploads the voice data of the call voice of the first call to the server (STEP 301), and the process control unit 15 uploads a notification email containing link information for accessing the voice data. is generated (STEP 302).

Among the contacts stored in the contact storage unit 14, send an email from a contact who is stored as a target for providing information regarding the type of emergency situation determined to have occurred in STEP 102 (hereinafter referred to as a registered contact). It is determined whether there is an incoming call (STEP 307).

If it is determined that an email has arrived (STEP 307: YES), the email sending/receiving unit 22 sends the notification email created in STEP 302 as an automatic reply to the email that has arrived (STEP 308).

According to the processing routine as described above, the information providing device 30 executes the second processing.

In the second process, when an email from a registered contact is received after acquiring the voice of the first call, the email containing link information for accessing the audio data of the voice of the first call is sent to the corresponding email. Send to registered contacts.

According to this second process, when it is difficult for the passenger to respond to an email due to, for example, being busy responding to an accident, it becomes possible to automatically respond. In addition, when an emergency situation occurs and an email is received, the contact information (email address) of a specific friend at work or a specific friend may be stored in advance in the contact storage unit 14 as the person to whom the second process will automatically respond. By memorizing this, you can notify the other party of the emergency situation only when you receive an email from the workplace or a specific friend.

In addition, in the above explanation, the audio data of the call audio of the first call is uploaded to the server, and a notification email containing link information for accessing the audio data is sent to the second contact or the registered contact. The case is shown as an example. However, the audio data to be uploaded to the server is not limited to the voice data of the first call itself, and for example, summarized voice data that summarizes the content of the first call may be uploaded to the server.

FIG. 15 is a block diagram showing the configuration of a modified information providing device 30A that provides information by uploading summarized audio data to a server. The information providing device 30A includes a summary audio generation section 24.

The summarized audio generating unit 24 generates a summarized audio of the first call using AI, based on the call audio of the first call acquired by the call audio acquiring unit 17.

The server communication unit 31 uploads the audio data of the summarized audio generated by the summarized audio generator 24 to the server.

FIG. 16 is a flowchart showing the processing routine of the first process executed by the information providing device 30A of the modification.

The first process of the modification is also executed on the premise of the above call voice acquisition process (STEPs 101 to 106 in FIG. 2).

The summary audio generation unit 24 generates summary audio data based on the call audio of the first call (STEP 310).

The server communication unit 31 uploads the summarized audio data of the first call generated by the summarized audio generator 24 to the server (STEP 301).

The subsequent processes of STEP 302 to 304 are the same as described above, so the description will be omitted here. Note that, similarly to the first process of the modification, the second process of the modification also uploads summarized audio data instead of uploading the call audio itself of the first call, and provides a link for accessing the summarized audio data. It sends notification emails containing information.

According to the processing of these modified examples, the other party can listen to a summary of the contents of the call as audio, making it possible to efficiently understand the situation.

Note that the present invention is not limited to what is shown in each of the above embodiments. For example, in the first embodiment, a case has been described in which the voice of a first call is played back in a call with a second contact or a registered contact. However, in addition to playing the call audio, additional information may be notified. For example, information on the current location of the vehicle may be notified by a robot voice. Furthermore, prior to the reproduction of the telephone call audio, an announcement may be made using a robot voice or the like to foretell that the telephone call audio will be reproduced.

In addition, in the above embodiments 2 and 3, when a notification email containing link information for accessing the text data or voice of the first call is sent to the second contact or the registered contact. was explained as an example. However, the content included in the notification email is not limited to this, and an email containing additional information may be sent. For example, the passenger's biological information, vehicle acceleration information, etc. acquired by the sensor information acquisition unit 12 may be attached to the email as additional information and transmitted. Further, the still image or moving image acquired by the image information acquisition unit 11 may be attached to an email and sent.

Furthermore, in the first and second embodiments described above, the case where information is provided using email has been described as an example. However, the means of providing information is not limited to e-mail, and may be any means that sends messages to provide information, such as short messages and various SNS (Social Networking Services).

Furthermore, in each of the above embodiments, the information providing device is constructed from a navigation device mounted on a vehicle. However, the information providing device is not limited to this, and may be a portable terminal device such as a smartphone or a tablet terminal. At this time, the situation detection unit may detect the situation by acquiring information from a camera or sensor installed in the terminal device itself, or may acquire various information in cooperation with a camera or sensor installed in the vehicle. Good too.

Further, in each of the above embodiments, the case where the information providing device independently executes the first process and the second process has been described as an example, but for example, the first process and the second process can be executed by the terminal device and the server device cooperating. It may be configured to execute two processes.

FIG. 17 is a block diagram showing the configuration of an information providing system 100 including a plurality of terminal devices 10-1 to 10-n (n is an integer of 2 or more) and a server device 40 as a further modification of the first embodiment. be. The terminal devices 10-1 to 10-n and the server device 40 are configured to be able to send and receive data to and from each other through wireless communication.

Each of the terminal devices 10-1 to 10-n includes an image information acquisition section 11, a sensor information acquisition section 12, a situation detection section 13, a contact storage section 14, a processing control section 15, and a telephone transmission section 16. The server device 40 includes a call audio acquisition section 41, a communication section 42, and a reproduction processing section 43.

In the information providing system 100 of the modified example, when the telephone calling unit 16 of each terminal device 10-1 makes a call to the first contact and a call connection is established, the call audio acquisition unit 41 of the server device 40 makes a call to the first contact. Obtain the call audio of the first call. The communication unit 42 of the server device 40 makes a call to the second contact, and the reproduction processing unit 43 reproduces the voice of the call during the call with the second contact.

Similarly, FIG. 18 is a block diagram showing the configuration of an information providing system 200 including a plurality of terminal devices 10-1 to 10-n and a server device 50 as a modification of the second embodiment. The server device 50 includes a call voice acquisition section 51, a voice text conversion section 52, and a communication section 53.

In the information providing system 200 of the modified example, the call voice acquisition unit 51 of the server device 50 acquires the call voice of the first call, and the voice-to-text conversion unit 52 converts the call voice of the first call into text and converts it into text. Generate data. The communication unit 42 of the server device 40 sends a notification email containing text data to the second contact.

According to these configurations, since the functions are distributed between the terminal device and the server device, it is possible to reduce the device scale of the terminal device compared to the case where the terminal device operates as an information providing device alone.

Furthermore, in each of the above embodiments, the case where the information providing device executes the first process and the second process has been described as an example, but the information providing device may perform one of the first process and the second process. may be configured to execute.

Further, the series of processes described in each of the above embodiments can be performed by computer processing according to a program stored in a recording medium such as a ROM (Read Only Memory).

10, 20, 30 Information providing device 11 Image information acquisition section 12 Sensor information acquisition section 13 Situation detection section 14 Contact storage section 15 Processing control section 16 Telephone transmission section 17 Call audio acquisition section 18 Reproduction processing section 19 Telephone reception section 21 Voice Text conversion unit 22 Mail transmission/reception unit 23 Summary text generation unit 24 Summary audio generation unit 31 Server communication unit 40, 50, 60 Server device 41, 51, 61 Call audio acquisition unit 42, 53, 63 Communication unit 43 Playback processing unit 52 Audio Text conversion section 62 Audio reproduction section

Claims (10)

a situation detection unit that detects the current situation of a moving object or a passenger of the moving object;
a calling unit that makes a call to a first contact based on the situation detected by the situation detection unit;
a provision unit that provides a second contact with call information generated based on the voice of the call between the passenger and the first contact through the call, or access information for accessing the call information; and,
An information providing device comprising: comprising an audio acquisition unit that acquires audio of a phone call between the passenger and the first contact as a first phone call audio;
The providing unit makes a call to the second contact and reproduces audio data based on the first call audio during the call between the passenger and the second contact. The information providing device according to claim 1, wherein the information providing device provides the call information. a summary audio generation unit that generates summary audio data summarizing the content of the phone call between the passenger and the first contact based on the first phone call audio acquired by the audio acquisition unit;
3. The providing unit provides the call information by reproducing the summarized audio data during the call between the passenger and the second contact through the call. Information provision device. a text generation unit that generates text data representing the content of the call based on the audio of the call between the passenger and the first contact;
The information providing device according to claim 1, wherein the providing unit provides the call information by transmitting a message including the text data to the second contact. The text generation unit generates summary text data summarizing the content of the call between the passenger and the first contact,
The information providing device according to claim 4, wherein the providing unit provides the call information by transmitting a message including the summary text data to the second contact. an audio acquisition unit that acquires audio of a phone call between the passenger and the first contact as a first phone call audio;
a communication unit that uploads audio data based on the first call audio to a server;
has
2. The providing unit provides the access information by sending a message to the second contact including link information for accessing the audio data on the server. information provision device. a summary audio generation unit that generates summary audio data summarizing the content of the phone call between the passenger and the first contact based on the first phone call audio acquired by the audio acquisition unit;
The communication unit uploads the audio data to the server,
7. The providing unit provides the access information by transmitting a message including link information for accessing the summarized audio data on the server to the second contact. The information providing device described. An information providing method executed by an information providing device, the method comprising:
a situation detection step of detecting the current situation of a moving object or a passenger of the moving object;
a calling step of calling a first contact based on the situation detected in the situation detecting step;
providing information for providing a second contact with call information generated based on the voice of the call between the passenger and the first contact due to the call, or access information for accessing the call information; step and
An information provision method characterized by including. to the computer,
a situation detection step of detecting the current situation of a moving object or a passenger of the moving object;
a calling step of calling a first contact based on the situation detected in the situation detecting step;
providing information for providing a second contact with call information generated based on the voice of the call between the passenger and the first contact due to the call, or access information for accessing the call information; step and
A program characterized by executing. to the computer,
a situation detection step of detecting the current situation of a moving object or a passenger of the moving object;
a calling step of calling a first contact based on the situation detected in the situation detecting step;
providing information for providing a second contact with call information generated based on the voice of the call between the passenger and the first contact due to the call, or access information for accessing the call information; step and
A recording medium that records a program for executing.

Images