JP4912803B2 - Media conversion message system - Google Patents

Description

The present invention relates to an exchange for connecting a telephone or videophone line to a mobile terminal such as a cellular phone, and a mail server for transmitting mail, and in particular, converts voice or video data of a telephone or videophone to mail. By transmitting or converting a text message of a mail into a mail with speech synthesis data and transmitting the message, message distribution and reception suitable for the situation of both the sender and the receiver are performed.

In addition to voice communication, a mobile terminal such as a cellular phone can transmit and receive text messages by e-mail and images such as still images and moving images taken with an attached digital camera. It is also possible to send a mail with a digital video or audio file attached thereto. There is also a mobile terminal that has a voice synthesizing function in a mobile terminal, and has a mail reading function that reads a text sentence of a mail body into voice by the voice synthesizing function.

There are the following documents related to a mobile terminal having a mail reading function.
JP 2005-250710 A JP 2001-339424 A Japanese Patent Laid-Open No. 11-17806 JP 2005-18194

When a caller cannot communicate due to reasons such as out-of-service, power-off, or a call even though he / she wants to convey a voice message, the caller can use a method of registering a message message in the answering service. However, even if the other party's mobile phone can make a call, there is no means for actively notifying that the message message is registered in the answering service. Therefore, the other party does not always immediately notice the presence of the message message, and an important message is not transmitted quickly.

In a mobile terminal having a read-out function, a user who has confirmed receipt of a mail needs to operate a key to select a mail and execute the read-out function. Therefore, even when it is desired to convey a message in text, when the other party is walking or working, the incoming message cannot be immediately confirmed. In addition, the time until confirmation of the message may be further increased because the other party is away from the mobile phone or because the mobile phone is in silent mode and does not notice the incoming call. As described above, even if the sender of the message makes a urgent message and sends it to the other party, the confirmation of the message is delayed depending on the situation placed on the receiver side.

The present invention provides a mechanism that enables a message to be confirmed as soon as possible by delivering the message to the nearest (terminal) of the partner even when the partner cannot confirm the message immediately. Furthermore, an object of the present invention is to deliver an appropriate message in consideration of the intention on the sender side such as an emergency request and the situation on the receiver side.

A mail transmitting unit or mail server according to the present invention is configured to determine an attribute of a mail requested to be transmitted from a mobile terminal, convert a mail that meets a predetermined condition into a mail with speech synthesis data, and transmit the mail to a transmission partner. have.
The mail server requested to send the mail determines whether the attribute of the mail, the attribute of the other party, and the situation are in a predetermined state. If it is determined that the condition is satisfied, a text-to-speech data file is created by synthesizing the text of the mail requested to be transmitted, and transmitted along with the mail.

In addition, the exchange according to the present invention converts the audio or video (TV phone) signal transmitted from the caller's terminal into an audio data file or video data file when the receiver's terminal is out of service area or talking. In addition, it has a configuration in which it is attached to a mail addressed to the recipient's terminal and transmitted.

A mobile terminal such as a cellular phone has a reproduction condition table that defines a method for processing a voice synthesis data file or an audio / video data file attached to an email.
A mobile phone that has received a mail with an attached voice synthesis data file or audio / video data file compares the conditions specified in the playback condition table with the attributes of the received mail, the status of the receiving terminal, etc. To determine how to process the recorded files. If the file attached to the reproduction condition table is set to immediately reproduce, the cellular phone cancels the manner mode and reproduces the attached voice synthesis data file or audio / video data file.
In another embodiment of the present invention, the created voice synthesis data file or voice / video data file is stored in a server in the network, and the user of the mobile phone that has received the mail can access the file described in the mail. To obtain audio or video data.

When sending a mail to the other party, by converting the text mail to a mail with speech synthesis data and sending it, it is possible to realize a receiving operation suitable for the situation of both the sender and the receiver. Therefore, even in a scene where the hand cannot be released for reasons such as walking, the message can be confirmed via voice.
Further, by storing the received voice message in the mobile device or storing the voice message in the server, the message can be confirmed any number of times without any trouble.
Further, in the present invention, a voice call or a video phone can be converted into a message using voice compression encoded data or video compression encoded data, and a message suitable for the situation of both the sender and the receiver can be transmitted and received. In the event of a disaster, it is possible to collect information using a mobile phone and simultaneously notify disaster information.

FIG. 1 is a diagram showing an outline of an embodiment of the present invention, which includes a mail transmission function part (a) and a call mail function part (b). The mail transmission function unit (a) is configured to attach a voice synthesis data file generated by voice synthesizing the text of the mail body to the mail. In addition, the call mail function unit (b) responds to a voice call or videophone request via the telephone communication network when the other party's mobile phone cannot receive or does not respond to the call. The video signal is digitized and compressed to generate an audio data file or video data file, which is automatically attached to a mail addressed to the other party's mobile phone and transmitted.

In the mail transmission function part (a), when the user of the mobile phone 111 creates a mail, an instruction whether to attach a voice synthesis data file to the mail, the level of urgency of the mail, the level of confidentiality, etc. Set attributes. The mail server unit of the communication control unit 300 that has received the mail from the mobile phone 111 determines whether to convert the mail into a mail with a voice synthesis data file based on the attribute information. When it is not converted into a mail with a voice synthesis data file, the received mail is transferred to the mobile phone 114 of the other party as it is. When the attribute set in the received mail corresponds to the attribute to which the voice synthesis data file is attached, the mail server unit synthesizes the text of the mail body by the voice synthesis means 112 to generate a voice synthesis data file, To the mobile phone 114 of the other party. At this time, a sentence notifying that a speech synthesis data file is attached may be added to the end of the mail. The mobile phone 114 has a reproduction condition table 115 in which information for determining a method for processing a received mail with a voice synthesis data file is set. The mobile phone 114 collates the received mail attribute and the status of the own device with the data stored in the reproduction condition table 115, and performs corresponding processing based on the collation result. For example, even if the cellular phone 114 is set to the manner mode, the manner mode is temporarily canceled and the attached voice synthesis data file is immediately reproduced, or the manner mode is canceled and the ring tone is sounded. Are selected from the operations.

In the call mail function part (b), whether or not the other party mobile phone 123 can be received by the telephone communication network that has received a voice call or videophone request from the mobile phone 121, or responds to the call within a predetermined time. It is determined whether or not. When the other party's mobile phone 123 can receive a call and responds to the call within a predetermined time, a normal telephone connection is made. When the mobile phone 123 is unable to receive a call or does not respond, the control unit of the telephone communication network compresses and encodes the audio signal or video signal transmitted from the mobile phone 121 to generate a file. When the transmission from the mobile phone 121 is completed, the control unit creates a mail to be transmitted to the mobile phone 123, attaches the generated audio data file or video data file, and passes it to the mail server unit. The mail server unit transfers the mail passed from the control unit of the telephone communication network to the mobile phone 123. The cellular phone 123 processes the received mail based on the conditions described in the reproduction condition table 126. The reproduction condition table 126 for the call mail function may be shared with the reproduction condition table 115 for the mail transmission function, or may be configured separately.

[Mail transmission function part]
FIG. 2A shows a mail transmission function unit, which is a flow in which the user of the mobile phone 111 creates a mail and transmits it to the counterpart mobile phone 114.
In step 200, the user starts to create a message. In step 201, the user determines whether the message to be created is a voice call / videophone message or an email. In the case of a message by voice call / TV phone, the process proceeds to the processing routine (b) described later.
If the user decides to send a mail in step 201, the process proceeds to step 210 to create a mail. In this step, the user sets attributes such as an instruction on whether or not to attach a speech synthesis data file to the created mail, the level of urgency of the mail, and the level of confidentiality. The created mail is transmitted to the control unit 300 in the network 100 (FIG. 1) in step 211, and the process ends in step 230.

FIG. 5 (a) shows an example of an input screen displayed on the display unit of the mobile phone when creating a mail in step 210. The input screen 500 displays a destination column 501 for inputting a destination, a title column 502 for inputting a mail title, and a text column 505 for inputting a body. In this embodiment, it is possible to specify the urgency level of the mail, and a field 503 for specifying the urgency level is displayed on the mail creation screen. In FIG. 5 (a), the urgent level column is a pull-down menu, and when the corresponding column is selected with the cursor, “high” and “medium” as selectable urgent levels are displayed in a pull-down menu. The user selects and specifies the target item from the pull-down menu items. In the example shown in FIG. 5 (a), the attribute (transmission condition) that can be specified for the mail to be transmitted is only the urgency level, but a plurality of attributes can be set. FIG. 5 (b) shows two attributes, urgency and sensitivity. These specifications are described in the text such as “speech synthesis data file attachment”, “high urgency”, “low sensitivity”, etc., and the mail text sentence is analyzed on the server side and the receiving side to specify the attribute. It is also possible to adopt a configuration to determine.

The user who has finished inputting the necessary items transmits the created mail. The transmitted mail is transferred to the control unit 300 provided in the network 100 (FIG. 1). FIG. 3 shows the function of the communication control unit 300, and FIG. 4 shows the processing flow. In each figure, (a) is a part belonging to the mail transmission function (a) in FIG. 1, and (b) is a part belonging to the call mail function (b) in FIG.

1 is received by the message receiving unit 301 of the communication control unit 300. The receiving unit 301 includes a mail receiving unit 310 that receives mail and an audio / video receiving unit 320 that receives audio and video signals. A mail transmitted from the mobile phone is received by the mail receiving unit 310 and passed to the mail analyzing unit 311.
The mail analysis unit 311 extracts control information, text data of the body, attached file, and the like from the received mail. The extracted control information is analyzed, and attributes such as the sender's mail address, the destination mail address, and the urgency level are acquired. Next, it is determined whether to convert the mail from the acquired attribute information into a mail with a speech synthesis data file.

In the configuration shown in FIG. 1, whether or not to attach a speech synthesis data file to a mail is determined every time a user creates a mail, and attribute information is added to the mail and transmitted to the communication control unit 300. . However, the conditions for attaching the voice synthesis data file to the mail are set in the condition table 113 in the communication control unit 300 in advance by a combination of attributes such as the mail destination, the mail transmission time, and the urgency level, and received. It is also possible to compare the mail attributes with the conditions set in the condition table 113 and attach a speech synthesis data file to the mail when the received mail attributes match the conditions set in the condition table 113 It is.

The text analysis unit 312 analyzes the text of the mail body extracted from the received mail, determines the language described in the mail body, for example, Japanese or English, and determines the speech synthesis means to be activated. It also analyzes the form of text and collects information for high-quality speech synthesis.
Based on the analysis result of the text analysis unit 312, the speech synthesis unit 313 generates a speech synthesis data file from the text. The mail generation unit 314 attaches the voice synthesis data file generated by the voice synthesis unit 313 to the received mail. If necessary, a comment notifying that a speech synthesis data file is attached is added to the end of the mail. The mail transmission unit 315 transmits the mail generated by the mail generation unit 314 to the destination mail address.

FIG. 4 is a processing flow of the communication control unit 300.
Step 400: The message receiving unit 301 receives a message via the network.
Step 401: Determine the type of received message. When the received message is an audio signal or a video signal, the process proceeds to step 420, and a call mail function (b) flow to be described later is executed. When the received message is mail, the process proceeds to step 410, and the flow of the mail transmission function (a) is executed.

Step 410: The text analysis unit 312 analyzes the mail received by the mail reception unit 310, and extracts control information, text data of the main body, attached file, and the like. Further, the control information is analyzed, and attribute information such as a sender's mail address, a destination mail address, and an urgency level is acquired.
Step 411: Analyzing the acquired attribute information, it is determined whether or not it is a mail to which a speech synthesis data file is attached. If it is determined that it is not necessary to attach, the process proceeds to step 414, and if it is determined to be attached, the process proceeds to step 412.
Step 412: The text analysis unit 312 analyzes the text data of the mail body, determines the language of the mail, for example, Japanese or English, and collects information for performing speech synthesis. Based on the analysis result of the text analysis unit 312, the speech synthesis unit 313 generates a speech synthesis data file from the text data of the mail.
Step 413: The mail generation unit 314 attaches the voice synthesis data file generated by the voice synthesis unit 313 to the mail. In addition, a comment for notifying that the voice synthesis data file is attached to the mail is added.
Step 414: The mail generated by the mail generation unit 314 (the mail received when it is determined in step 411 that the speech synthesis data file is not attached) is transferred to the destination mail address.
Step 415: End processing is performed.

FIG. 6 is a diagram showing a processing flow of the mobile phone 114 that has received the mail with the voice synthesis data file attached. The cellular phone 114 has a reproduction condition table 115 that defines a method for processing a speech synthesis data file attached to the received mail. FIG. 7 shows an example of the playback condition table 115. In the example shown in FIG. 7, the mail attributes (transmission conditions) are two levels of urgency and confidentiality, and are set by the mail sender using the display of FIG. 5 at the time of transmission. The “sender ID” 701 and “playback condition” 704 in the playback condition table 115 are set by the user of the mobile phone 114 using a function menu (such as an icon or a drop-down list) provided by the mail application of the mobile phone. It is also possible to configure the settings on the server setting screen and download the set data.

FIG. 8 shows an example of a function menu for setting the playback condition table. Reference numeral 800 denotes a menu screen provided by the mail application or server of the mobile phone. An item 802 is a column for inputting a telephone number and / or a mail address that is an ID on the transmission side, and is set in the “transmission side ID” column 701 of the reproduction condition table 115 (FIG. 7). An item 803 is a column for selecting a received mail processing method to be executed when the conditions are matched, and is set in “Reception side terminal operation” 710 of the reproduction condition table 115. In addition, a selection field corresponding to the playback condition field of the playback condition table 115, such as a time zone specification field 804, a position specification field 805, and a terminal mode specification field 806, is displayed. When the setting key 804 is operated, data set by the user is stored in the reproduction condition table 115. Correction is possible with the return key.

A “sender ID” 701 in the reproduction condition table 115 shown in FIG. 7 designates the sender's mail address or telephone number. 702 is an example in which a mail address and a telephone number are specified, but it can also be specified by a domain name (sending mail server name). “All” 703 defines a playback condition to be applied to mails of mail addresses not individually specified. If "All" is not set in the playback condition table, emails with email addresses not individually specified are treated the same as regular emails.
“Reproduction condition” 704 determines the attribute of the received mail and the state of the mobile phone. “Operation of receiving terminal” 710 is a method of handling mail whose “sender ID” and “reproduction condition” match. It prescribes. The items specified in FIG. 7 are as follows.

Step 711: The outgoing address of the received mail is “a@b.com”, or the ID (phone number) is “09011112333”, the urgency level set for the mail is “high”, and the incoming mobile phone is When the current position is “Area 001”, the current time is “between 9 o'clock and 15 o'clock”, if the mobile phone is set to manner mode, the manner mode is temporarily canceled and the attached voice synthesis data file is deleted. Play immediately from the voice playback means. “Position” is a place where the location of home or office is associated with the area code of the base station, and the code of the base station where the mobile phone is located is the code “ Compared to “Area 001”. As the “position”, a place within a specific latitude and longitude may be set. In a mobile phone equipped with a GPS function, the position information of the measured position is compared with the latitude and longitude set in the “position” column.
Step 712: The outgoing address of the received mail is “a@b.com”, or the ID (phone number) is “09011112333”, the urgency level set for the mail is “high”, and the sensitivity is “high” "When the location of the incoming mobile phone is other than" Area 001 ", the mobile phone temporarily cancels the manner mode, notifies the incoming mail by sounding the ringtone, and displays a pop-up screen for selecting an operation ( Fig. 9) is displayed. When the user instructs playback of the voice, the attached voice synthesis data file is played back by the voice playback means. In this setting, the current time and the state of the terminal are not considered. FIG. 9 is an example of a pop-up screen informing the arrival of mail. The display unit 950 of the mobile phone displays a portion 952 for notifying that an urgent message (mail) has arrived, and mail processing method selection requests 953 and 954. The user operates a cursor key or the like to select and instruct a target item.
Step 713: The outgoing address of the received mail is “a@b.com”, or the ID (telephone number) is “09011112333”, and when the headset is connected to the incoming mobile phone, the attached voice The user is notified that the composite data file is to be reproduced, and the sound of the file is reproduced after the user confirms the reproduction. In this setting, information on “urgency”, “confidence”, “position”, and “time” is not taken into consideration.
Step 714: When the outgoing address of the received mail is “a@b.com” or the ID (phone number) is other than “09011112333” and the urgency level of the mail is “other than low”, the mobile phone is vibrated. Notification is made and an operation selection pop-up screen (Fig. 9) is displayed. Process mail based on the action selected by the user.

The processing flow of FIG. 6 is as follows.
Step 600: When the mail application of the mobile phone detects that the received mail is a mail with a voice synthesis data file attached, the flow starts.
Step 601: The mail application extracts the sender mail address or ID from the received mail control information.
Step 602: In step 602, it is checked whether or not the mail address or ID extracted in step 601 is registered in the “sender ID” column 701 of the reproduction condition table. If registered, the process proceeds to step 603. If not registered, the process proceeds to step 604.
Step 603: If the email address or ID registered in the “Sender ID” column 701 in the inspection of Step 602 matches the email address or ID of the sender of the received email, the email address or ID is registered. The “reproduction condition” 704 set in a certain stage is compared with the attribute of the received mail and the status of the mobile phone. As a result of the comparison, if there is a stage where both match, the process proceeds to step 607. If there is no matching stage, the process proceeds to step 604.
Step 604: It is determined whether or not “All” is set in the “Sender ID” column 701 of the reproduction condition table. “All” is a setting for all e-mail addresses not individually registered. Therefore, the mail address or ID of the sender of the mail received in the determination of step 602 is not individually registered, or the mail address or ID corresponding to the corresponding mail address or ID is determined in step 603 Even if it is determined that the file does not exist, if “All” is set, the reproduction condition set in the “All” stage is inspected. If “All” is set, the process proceeds to step 605. If “All” is not set, the process proceeds to step 606.
Step 605: The reproduction condition set in the “All” column is compared with the attribute of the received mail and the status of the mobile phone. As a result of the comparison, if both match, the process proceeds to step 607. If they do not match, the process proceeds to step 606.
Step 606: Since there is no setting corresponding to the received mail in the reproduction condition table, it is notified that the mail has been transmitted according to the setting of the mobile phone (silent mode / ringing of ringtone). In response to the notification, the user opens the mail or reproduces the attached file.
Step 607: The operation specified in the “operation on the receiving terminal” column 710 corresponding to the stage determined to match in step 603 or step 605 is identified.
Step 608: Perform the action identified in step 607. When a user operation is required, a process such as displaying a pop-up menu is performed, and the user operation is waited for.
Step 609: An operation instructed by the user operating a key or the like is executed.
Step 610: Exit the mail application.

In the configuration shown in FIG. 6 and FIG. 7, the playback condition table 115 provided in the mobile phone is received according to the situation such as the sender of the received mail, the level of urgency, the current time, and the current position. It has a configuration for setting a processing method for a mail with an attached audio file. With this configuration, it is possible to specify different operations for different positions or different times even in the same urgency level or the same sensitivity sent from the same sender in the playback condition table 115. It becomes. Therefore, even if the same mail is received at the workplace, it can only be set to vibrate when it is received at the workplace, and when it is received at home, the voice synthesis data file can be forcibly played back. It becomes possible to select and set the processing method.
In the conventional mail system, although there is a need to transmit an urgent message, there is a case where the message is not transmitted because the recipient does not notice the incoming mail. However, in the configuration of the present invention, a mail with a high urgent level is set to play the attached voice file immediately, and the attached voice synthesis file is automatically generated from the mail body and played immediately after the mail is received. And a reliable message can be transmitted.

[Call mail function section]
FIG. 1B shows a call mail function unit. The telephone communication network that has received a voice call or videophone request from the mobile phone 121 determines whether or not the other party's mobile phone 123 can receive a call. If the incoming call is possible, the mobile phone 123 is called and a normal telephone connection is made. When the mobile phone 123 cannot receive a call due to reasons such as out of service area, power off, or during a call, the control unit (switching office) of the telephone communication network compresses and encodes an audio signal or video signal transmitted from the mobile phone 121. An audio or video data file is generated by performing compression encoding according to 124. Next, the control unit creates an email notifying that the data file recording the voice call or videophone transmitted from the mobile phone 121 is attached, and attaches the generated voice data file or video data file, Pass to the mail transfer function (mail server). The mail server transfers the mail to the other party's mobile phone 123. If the other party's mobile phone 123 cannot receive the mail due to use outside the service area, etc., the state of the other party's mobile phone 123 is monitored and the mail is transferred after waiting for the incoming call to be received. The cellular phone 123 processes the received mail based on the conditions described in the reproduction condition table 126.

FIG. 2B is a flow in which the user of the mobile phone 121 executes a voice or video call to the counterpart mobile phone 123. In this example, when starting a voice or video call, if the other party's mobile phone is unable to receive the call due to out-of-service, etc., specify that an audio / video file be generated and sent to the other party's mobile phone by e-mail Can do. For example, the telephone directory shown in FIG. 11 has a column for designating an emergency call, but this can be realized by providing a column for designating conversion to an audio / video file. Further, without providing a column for designating conversion to an audio / video file, conversion to an audio / video file may be automatically performed when an emergency call is designated. In the figure, the name portion is operated for normal outgoing calls, and the emergency button portion is operated for emergency outgoing calls, thereby instructing the control unit of the mobile phone that the call is an emergency outgoing call. Moreover, the level of urgency, the level of confidentiality, etc. are set with the same structure. Dial the other party's phone number with instructions for converting to an audio / video file, urgency level, and sensitivity level. With this dial, a special number 1xxx is added to the head of the telephone number (dial number) corresponding to the combination of the above settings. The communication control unit 300 that has received the call request analyzes the user setting from the special number 1xxx and performs the process instructed by the user.

In step 200 of FIG. 2, the user starts creating a message, and determines whether the message to be created in step 201 is a voice call / videophone message or a mail. When the user decides to send the mail, the process proceeds to step 210 to create the mail. If a voice call or videophone message is selected in step 201, the process proceeds to the processing routine (b).
Step 220: A call is requested by directly inputting attributes such as conversion to an audio file, level of urgency, level of sensitivity, etc. using the telephone directory shown in FIG. 11 or together with a telephone number.
Step 221: The communication control unit investigates whether or not the mobile phone having the telephone number for which the call is requested can respond. When the other party's mobile phone answers the call, a call between the users is started. If the other party's mobile phone is unable to answer due to reasons such as being out of service, or if the other party does not answer the call within the specified time, the user's voice or videophone video is converted into an audio / video file and Notify the caller that it will be sent to Start recording of user utterance or TV video.
Step 230: When a normal call is made, call termination processing is performed. If you cannot make a call with the other party and an audio / video file is generated, the mail address of the other party's mobile phone is obtained from the user or dialed phone number, and the call cannot be made. Create an email notifying you that you want to send it after converting it to a file, and send it with the created audio / video file attached.

The configuration and processing flow of the call mail function unit (b) of the communication control unit 300 shown in FIGS. 3 and 4 are as follows.
A voice call or videophone request by the user of the mobile phone 121 of FIG. 1 is received by the voice / video receiver 320 of the message receiver 301 of the communication controller 300. The reception status confirmation unit 321 analyzes the special number “1xxx” added to the head of the telephone number, and determines whether or not the audio signal or the video signal is filed, and the mail attribute such as the urgency level. . The audio / video recording unit 322 records an audio signal or a video signal, and the audio / video compression unit 323 encodes and compresses it in a predetermined format. The mail generation unit 314 creates a mail file informing that the voice call or the videophone call cannot be executed, a data file in which the voice or video transmitted by the caller is recorded, and attached to the mail. Further, the mail generation unit 314 searches a database storing the telephone number and the mail address by the other party's telephone number dialed by the caller, and extracts the other party's mail address. The mail transmission unit 315 transmits the mail generated by the mail generation unit 314 to the partner mail address searched by the mail generation unit 314.

FIG. 4 is a processing flow of the communication control unit 300.
Step 400: The message receiving unit 301 receives a message via the network.
Step 401: Determine the type of received message. If the received message is a mail, the process proceeds to step 410, and the flow of the mail transmission function (a) described above is executed. When the received message is an audio signal or a video signal, the process proceeds to step 420, and the flow of the call mail function (b) is executed.
Step 420: The reception status confirmation unit 321 determines whether the other party's mobile phone can receive a call or responds to the call within a predetermined time. If the other party's mobile phone is unable to receive a call due to reasons such as out of service area or does not answer the call, the process proceeds to step 423. When the other party's mobile phone answers the call, the process proceeds to step 421.
Step 421: Connect to the other party's mobile phone, notify the attributes such as the level of urgency and the level of confidentiality set by the caller, and start the call.
Step 422: The connection is terminated when the call ends.
Step 423: When the other party's mobile phone cannot answer the call or does not answer, the communication control unit 300 informs the caller that the voice or video is recorded / recorded and attached to the mail and transmitted, and the recording or recording is performed. To start.
Step 424: Compress or encode the recorded or recorded signal to generate a data file.
Step 425: The mail address of the other party is acquired from the telephone number of the other party dialed by the caller.
Step 426: Based on the attributes and transmission conditions set by the caller, the caller's information and the mail automatically generate a mail describing that the file generated from the caller's voice or video is attached. The audio or video data file generated in step 424 is attached.
Step 427: The mail generated in Step 426 is transferred to the mail address of the other party acquired in Step 425.
Step 428: Notifying the caller that the mail transfer has been completed, and terminating the connection.

The mobile phone (123 in FIG. 1) that has received the mail attached with the filed audio data or video data has the items set in the playback condition table 126 of the mobile phone, the sender address of the received mail, Compare the attribute such as the urgency level and the information such as the mobile phone position, and determine the handling of the received mail and the attached audio data or video data. The playback condition table 126 has the same configuration and function as the playback condition table 115 shown in FIG. Therefore, in the configuration in which the reproduction condition table for the mail transmission function and the reproduction condition table for the call mail function are separately provided, the reproduction condition tables for both functions can be combined into one table. The processing flow executed by the mobile phone is the same as the processing flow shown in FIG. 6, but it is possible to change the method of handling audio data and video data in the “reception side terminal operation” of the playback condition table 126. It is. For example, audio data is played unconditionally, but video data is played when the user instructs playback. Further, the reproduction condition table 126 is set using the user interface shown in FIG.

FIGS. 10-1 to 10-3 show modified examples of the mail transmission function unit. The configuration shown in FIGS. 1 to 4 is a configuration in which the mail transmission function unit (a) and the call mail function unit (b) are uniformly processed by the communication control unit 300, but the mail server has a mail transmission function. In addition, a configuration in which the exchange has a call mail function is also possible. The modification shown in FIGS. 10-1 to 10-3 has a configuration in which a mail server has a mail transmission function. However, it is possible to apply the configuration of these modified examples to a configuration in which the communication control unit 300 processes the call mail function in a unified manner.

The modification example shown in FIG. 10-1 (a) is a configuration in which a condition table 1004 is stored in the mail server 1002 that stores conditions for converting a mail requested to be transmitted into a mail with a speech synthesis data file and transmitting the mail. . The condition table 1004 is provided corresponding to the caller, and stores conditions for attaching the speech synthesis data file to the mail sent by the caller. The user accesses the server through the mobile phone and sets and changes the contents of the table assigned to the user. In the condition table 1004, 0 (zero) or more combinations of attributes such as a mail destination, a time when the mail is transmitted, an urgency level, and a title are set.
FIG. 10-1 (b) shows an operation flow of the modification.
Step 1051: The control unit 1003 of the mail server 1002 receives the mail transmitted from the mobile phone 1001.
Step 1052: It is determined whether or not a combination that matches the attribute of the mail exists in the combination of attributes set in the area of the condition table 1004 assigned to the mobile phone 1001.
Step 1053: When there is no matching combination, the mail server 1002 immediately transmits the mail to the destination mobile phone 1006 without changing the mail.
Step 1054: When there is a combination of attributes set in the area of the condition table 1004 that matches the attribute of the mail, the control unit 1003 uses the speech synthesis means 1005 to convert the text of the mail body into speech. Convert to generate a speech synthesis data file.
Step 1055: The generated voice synthesis data file is attached to the e-mail, and is transmitted to the destination mobile phone 1006 in Step 1056.
In this modification, the conditions for attaching the speech synthesis data file are registered in advance in the server. Therefore, it is not necessary for the user to instruct to attach a speech synthesis data file every time a mail is created, and it is possible to concentrate on the creation of the mail. When the number of attribute combinations set in the table is 0 (zero), this function is not used.

The modified example shown in FIG. 10-2 is a method for storing voice-synthesized data (speech-synthesizing data file) inside the server and accessing a voice-synthesizing data file stored in the server to mail, In this configuration, the address of the speech synthesis data file is added and transmitted to the other party.
FIG. 10-2 (a) is an example in which a storage unit for a speech synthesis data file is provided in the mail server 1012. FIG. When the control unit 1013 determines that it is necessary to attach a voice synthesis data file to the mail transmitted from the mobile phone 1011, the voice synthesis data file is generated from the body of the mail using the voice synthesis unit 1014, and the file storage unit 1015 To remember. Next, the control unit 1013 describes a method for accessing the voice synthesis data file stored in the file storage unit 1015 in the mail, and transmits the mail to the destination mobile phone 1017. The user of the cellular phone 1017 that has received this mail accesses and reproduces the speech synthesis data file stored in the file storage unit 1015 according to the access method described in the mail.

FIG. 10-2 (b) stores the speech synthesis data file generated by the control unit 1023 in the web server 1025 on the Internet, and describes the URL of the web server 1025 storing the speech synthesis data file in the mail. The mobile phone 1028 is configured to transmit. The user of the cellular phone 1028 that has received the mail clicks the URL in the mail and requests the web server 1025 to reproduce the speech synthesis data file. The web server 1025 reproduces the voice synthesis data file 1026 by the streaming transmission means 1027 and transmits it to the mobile phone 1028. Since this embodiment employs a configuration in which the voice synthesis data file is stored in the web server 1025, the mail recipient can listen to the voice message from a terminal other than the mobile phone. In addition, the receiving side can stream and download the audio file, and the receiver can acquire the audio message at an arbitrary timing.

In the modification shown in FIGS. 10-2 (a) and (b), the voice synthesis data file is stored in the mail server 1012 or the web server 1025, and the voice synthesis data file is reproduced by a request from the mail recipient. Or it is the structure which transmits to a mobile telephone. However, a configuration is also possible in which the mail server 1012 or the web server 1025 is provided with read-out means, and the text text of the mail is read out according to a request from the recipient. In addition, when converting the text of received text mail to speech synthesis, some variations have been added to the speech synthesis processing of the server so that it can be played with other speech patterns (different voice, intonation, dialect, etc.). It is possible to have it. In this case, the user requests the server to perform speech synthesis processing using the web access means. As a result, it is possible to confirm a voice message based on a voice pattern reflecting the preference and intention of the receiver as well as the sender. Recipients can also listen to a voice message converted to their local dialect.

In another form, the server may analyze the content of the text mail, attach a file such as an image / video / music that matches the content of the mail, and send it to the other party. Also in this case, it is possible to store a content file such as an attached image / video / music as a web page inside the server and notify the location address of the content file by text mail. With this configuration, by preparing a large amount of content data in the server, it is possible to acquire access history and statistical data from users, and to grasp popular content.

It can be used as a present such as a greeting mail, in which the sender can arbitrarily set conditions for converting a text mail into a mail with a speech synthesis data file attached. In addition, disaster information emails from various locations are aggregated on the server on the center side, the disaster information is converted into emails with voice synthesis on the center side, and sent to the terminals in the disaster area. By reproducing, it is possible to realize a disaster information collection / transmission system using a mobile packet network. Note that this speaker can be composed of, for example, a communication module that can access a mobile network and a module that reproduces an attached file.

The modification shown in FIG. 10-3 is an example in which the present invention is applied to a broadcast mail that simultaneously transmits a single mail to a plurality of other parties. The mail server 1032 has an address list 1033 for storing a plurality of mail addresses for broadcasting the mail. Mail is transmitted from the mail sender terminal 1031 to the address for broadcast mail. The mail server 1032 that has received the mail determines whether or not a speech synthesis data file should be attached to the mail from the attributes of the received mail. If it is determined that it is not necessary to attach a speech synthesis data file, the received mail is broadcast to the mail addresses described in the address list 1033. When attaching a voice synthesis data file, the text of the main body is extracted from the received mail, and voice synthesis is performed by voice synthesis means 1035 to generate a voice synthesis data file. In the example of FIG. 10-3, the generated speech synthesis data file is stored in the storage device 1036, and a method for accessing the file is described in the broadcast mail, and the receiving terminals 1038-1,. Broadcast to -N.
With the same configuration, it is possible to simultaneously send a mail attached with a speech synthesis data file to a plurality of other parties. With this configuration, for example, an email that conveys an urgent message is broadcast, and each recipient's mobile phone forcibly plays a voice synthesis data file, so that the urgent message can be reliably transmitted to multiple parties. It becomes.

12A to 12C show modified examples of the call mail function unit. The configuration shown in FIGS. 1 to 4 is a configuration in which the mail transmission function unit (a) and the call mail function unit (b) are uniformly processed by the communication control unit 300, but the mail transmission function is performed by the mail server. It is also possible to realize a call mail function by an exchange. The modification shown in FIGS. 12-1 to 12-3 is a configuration in which the call mail function is realized by an exchange, but can also be applied to a configuration in which the communication control unit realizes the mail transmission function in a unified manner.

In the modification shown in FIG. 12-1 (a), when the mobile phone 1212 called from the mobile phone 1210 cannot respond for reasons such as out of service, or when the mobile phone 1212 does not respond to the call within a predetermined time, Data for deciding whether to convert a voice call or a videophone call into mail and send it to the other party is stored in the condition table 1213 of the exchange 1211. FIG. 12-1 (b) is an operation flow of the modification.
Step 1250: The mobile phone 1210 calls the mobile phone 1212.
Step 1251: The exchange 1211 determines whether or not the mobile phone 1212 can respond to a call from the mobile phone 1210. In addition, it is determined whether or not the mobile phone 1212 has been off-hooked within a predetermined time and started a call. When the mobile phone 1212 goes off-hook, the process proceeds to step 1252 to start a call.
Step 1253: When the mobile phone 1212 cannot make a call due to reasons such as out of service, or when the mobile phone 1212 does not go off-hook within a predetermined time, the exchange 1211 checks a term corresponding to the mobile phone 1210 in the condition table 1213, and the mobile phone 1212 is registered. If it is registered or registered, it is determined whether or not the attribute such as the urgency level of the call matches the registered condition.
Step 1254: When the condition is not met in the determination of Step 1253, the exchange 1211 notifies the mobile phone 1210 that the other party does not respond and ends the processing.
Step 1255: When it is determined in step 1253 that the condition is met, the exchange 1211 inquires of the user of the mobile phone 1210 whether or not voice or video is converted into mail and transmitted to the other party.
Step 1256: When it is instructed that the user does not wish to send the inquiry after converting it into mail, the process proceeds to Step 1260 and the connection with the mobile phone 1212 is terminated. When it is instructed to convert to mail and send, the process proceeds to step 1257.
Step 1257: The exchange 1211 records the audio signal or video signal transmitted from the mobile phone 1210 by the recording means 1214 and compresses and encodes it by the encoding / compression means 1215 to generate an audio / video file.
Step 1258: The mail generation means 1216 creates a mail describing that the voice or video from the mobile phone 1210 is attached to the mail and sends it, and attaches the voice / video file generated in step 1257. Further, the mail generation means 1216 searches for the mail address of the mobile phone 1212 from the phone number of the mobile phone 1212 that the mobile phone 1210 has called.
Step 1259: The mail generation means 1216 instructs the mail server 1217 to transmit the mail generated in Step 1258 to the mail address of the mobile phone 1212. The process proceeds to Step 1260 and the process is terminated.
With the above configuration, the user automatically attaches voice or video when the mobile phone 1212 does not respond to the call by setting the telephone number and conditions of the other party to operate the call mail function in the condition table 1213 in advance. It is possible to start the process of creating a mail.

In the modification shown in FIG. 12-2 (a), an audio / video file obtained by encoding and compressing audio data or video data from a calling mobile phone is stored in a file device of a mail server, and access for accessing the file is performed. It is the structure which describes in the mail and transmits to the other party's mobile phone. When the user of the mobile phone 1220 makes an emergency call using, for example, the telephone directory shown in FIG. 11, a special number 1xxx is added to the head of the other party's telephone number and dialed. The exchange 1221 determines whether or not the other party's mobile phone 1222 can receive a call, and calls it if possible. When the mobile phone 1222 responds to the call and goes off-hook, a normal call (TV call) is performed. When the mobile phone 1222 cannot receive a call or does not respond within a predetermined time, the exchange 1221 that determines that the call is urgent from the special number 1xxx added to the head of the dial signal is The mobile phone 1220 is notified that the audio file or video file is attached to the mail and transmitted to the telephone 1222. In response to this notification, the user transmits audio or video. The recording unit 1223 records the audio signal or the video signal transmitted by the user, forms a file with the encoding / compression unit 1224, and stores the file in the file device 1227.

The mail generation means 1225 creates a mail describing that the audio or TV video transmitted from the mobile phone 1220 has been converted into an audio file or video file and stored, and a method for accessing the file, and a user management database is created. Search and obtain the mail address of the other party from the phone number of the mobile phone 1222. The mail server transmits the mail generated by the mail generation means 1225 to the mail address.
The mobile phone 1222 that has received the mail accesses the mail server 1226 according to the method for accessing the audio file or the video file described in the mail, and acquires and reproduces the file. Alternatively, the mail server 1226 reproduces the accessed file and transmits the reproduced audio or the reproduced video to the mobile phone 1222.

FIG. 12-2 (b) is a configuration in which an audio / video file is stored in a web server, and the URL is described in an email and transmitted to the other party's mobile phone. In FIG. 12-2 (a), the audio / video file generated by the encoding / compression means 1224 is stored in the file device 1227 of the mail server, and the mail describing how to access the file to the mobile phone 1222 of the other party. In the configuration shown in FIG. 12-2 (b), the audio / video file generated by the encoding / compression means 1234 is stored in the Internet web server 1238, and the other party's The mobile phone 1232 is configured to transmit an email describing the URL. The mobile phone 1232 that has received the mail clicks the URL of the mail displayed by the mail software, and accesses the URL by the mail software itself or by starting up the browser software. The accessed web server 1238 downloads the audio / video file to the mobile phone 1232 or plays the audio / video file and transmits the playback audio or playback video to the mobile phone 1232.

As shown in Fig. 12-2 (a) or Fig. 12-2 (b), by storing the audio file or video file inside the server, the receiver acquires the audio message or video message at any timing. be able to. Also, the device for acquiring voice messages and video messages is not limited to a mobile phone, and can be accessed from a personal computer or the like. In addition to a configuration in which an audio file or video file is downloaded to the recipient side and then played back, a configuration in which the server plays back the audio file or video file and then streams and transmits the played audio or video file is possible.
In addition, in the configuration shown in FIG. 12-2 (a) and FIG. 12-2 (b), it is a configuration in which the caller decides for each outgoing whether or not to generate a mail when the call could not be made, As shown in FIG. 12-1, it is also possible to provide a condition table in the exchange and determine based on the conditions set in the condition table.

The modification shown in FIG. 12-3 is an application of the present invention to a system for simultaneously transmitting information using a normal telephone or a videophone. In this embodiment, a telephone number for simultaneous transmission is set. When the sender dials this telephone number, the exchange 1241 activates the simultaneous transmission means. The recording unit 1243 records the audio signal or the video signal transmitted from the terminal 1240, and compresses and encodes it by the encoding / compression unit 1244 to generate an audio file or a video file. The mail generation means 1245 creates a mail for simultaneous transmission according to a preset format and attaches the audio / video file. The mail generation means 1245 is provided with an address list 1246 for storing a list of mail addresses of the other party to be simultaneously transmitted. The address list 1246 is provided for the terminal, and the corresponding address list is determined from the telephone number of the caller (the telephone number of the mobile phone 1240 in Fig. 12-3) acquired by the exchange 1241, and the generated address list Will be sent to the email addresses listed in the address list.

As another form of simultaneous transmission, a file storage device 1248 is provided in the mail server or web server, the audio file or video file generated by the encoding / compression means 1244 is stored in the file storage device 1248, A configuration for describing the access method or URL of the stored file is also possible.
The simultaneous transmission configuration enables the sender to contact multiple parties without any key operation even when key operations are difficult, such as while walking. It becomes possible to confirm communication at hand reliably.

The present invention attaches a voice file generated from a highly urgent e-mail or a call request to the other party and sends it to the other party, or writes information for accessing the generated voice file to the other party and sends it to the other party It is. However, when the destination mobile phone is out of service area or powered off, it is impossible to send mail. When such a mobile phone returns to the service area or is turned on and can be received, it cannot know that there was an e-mail addressed to it unless the user voluntarily inquires about the e-mail. There is a problem that mail with high urgency does not reach the destination. As a method for solving this problem, there is a method of retransmitting mail immediately when a destination mobile phone becomes available, which has a function of periodically retransmitting mail that could not be sent to the mail server.

FIG. 13 is an example of an operation flow of a mail server having a function of resending mail that the other party could not receive. The mail server includes a mail storage unit that stores a mail addressed to the mobile phone requested to be transmitted, and the mails requested to be transmitted are sequentially stored in the storage unit.
The operation flow of the mail server including mail resend processing is as follows.

Step 1301: The transmission control unit of the mail server checks the mail storage unit and checks whether or not a mail addressed to the mobile phone is stored.
Step 1302: When there is no mail stored in the mail storage unit, the process returns to Step 1301 to wait for a new mail transmission request. When mail is stored in the mail storage unit, the process proceeds to step 1303.
Step 1303: When mails are stored in the mail storage unit, the transmission control unit extracts mails one by one according to a predetermined rule. For example, the mail that has been waiting for transmission for the longest time is selected and taken out.
Step 1304: A telephone number is acquired from the destination address of the mail that has been taken out, and an inquiry is made to the switching center as to whether or not the mobile phone to which the mail is to be sent exists. Step 1305: If the mobile phone destined for the exchange makes the transmission possible, the process proceeds to Step 1306. If the transmission is impossible, the process proceeds to Step 1308.
Step 1306: The mail server requests the exchange to send the mail. The exchange transmits the mail from the base station as the transmission source to the corresponding mobile phone.
Step 1307: When the transmission of the mail is completed, the process returns to Step 1301 to process the next mail. When a notice that mail transmission has not been completed for some reason is received from the exchange, the process proceeds to step 1308.
Step 1308: The mail that could not be sent is stored again in the mail storage unit, and the process returns to Step 1301. By this process, the mail is selected by the control unit and waits for the transmission process to be performed again.

Mail that has not been transmitted by the above flow periodically repeats storage and transmission processing in the storage unit until transmission is successful, so that important mail can be reliably transmitted to the destination.

The mail transmission function of the present invention has a configuration in which when a mail is transmitted to the other party, the text mail is converted into a mail with a voice synthesis file and transmitted. With this configuration, it is possible to realize a reception operation suitable for the situation of both the sender and the receiver. In addition, even when you are walking or when you can't take your hands off, you can check the message via voice, save the voice message once received in the mobile device, or store the voice message on the server at any time. You can check the message as many times as you like. Furthermore, at the time of a disaster, information collection using a mobile phone and simultaneous notification of the disaster information can be performed.

The call mail function of the present invention converts voice or TV video into an audio / video file even when it is not possible to make a direct call due to out-of-service or busy, etc. It has a configuration that is attached to an email for distribution. With this configuration, it is possible to realize a reception operation suitable for the situation of both the sender and the receiver. Further, even when the recipient cannot be delivered immediately due to reasons such as being out of service or during a call, the email is delivered as soon as it is detected by the email retry function that the recipient can be received. In addition, since the receiver is informed that the mail has arrived by a ring tone or the like, there is no problem that the receiver does not notice the presence of the message and the message transmission is delayed unlike a normal answering machine message.
The mail reception confirmation notification function returns a notification that the mail has been delivered to the other party or that the mail has been opened. With this function, it is possible to confirm that the message has surely arrived at the other party.
The receiver can also confirm the message any number of times without any hassle by saving the received audio file or video file in the mobile phone or storing the audio file or video file in the server.

In addition, by integrating the mail sending function and the call mail function, the text mail is converted into a mail with a voice synthesis file attached and sent to the other party, and the voice / TV video call is attached to the voice / video file. It becomes the structure which is converted into the received mail and sent to the other party. With this configuration, it is possible to handle emergency communication or simultaneous communication by mail and emergency communication or simultaneous communication by voice or video in a unified manner. In addition, a reliable message can be transmitted by using a retry function to resend later when the other party cannot receive the mail, a forced reproduction function of the attached file, or a mail reply / open notification function.

Conceptual diagram of mail transmission function and call mail function according to Embodiment 1 The figure which shows the preparation procedure of the message of Example 1. Diagram of the control unit of the mail transmission function and the call mail function of the first embodiment Processing flow diagram of control unit of mail transmission function and call mail function of embodiment 1 User interface diagram of mail transmission function of embodiment 1 Flow chart of message reception processing in mail transmission function and call mail function of embodiment 1 The figure of the reproduction condition table of Example 1 Illustration of playback condition table setting screen User interface diagram when receiving mail Diagram of the mail transmission function according to the second embodiment Diagram of the mail transmission function according to the third embodiment Diagram of mail transmission function according to embodiment 4 User interface diagram of call mail function Diagram of call mail function according to embodiment 5 Diagram of call mail function according to embodiment 6 Diagram of call mail function according to embodiment 7 The figure which shows the processing flow of the mail server used for this invention.

Claims (8)

A media conversion message system having a plurality of mobile terminals and a communication control unit,
The mobile terminal has attribute setting means for the caller to set attributes,
The communication control unit creates a voice or video file from a voice or video call signal when it detects that the other party cannot respond to the call or does not answer the call and the attribute is an attribute for creating a file. Encoding means;
Mail sending means for obtaining a mail address from a telephone number of a call destination, creating a mail, attaching a file created by the encoding means, adding an attribute set by the attribute setting means and sending it to the mail address Have
The mobile terminal further receives mail received by the mail transmitting means, mail receiving means;
A reproduction condition table for storing conditions for reproducing the file;
A comparison means for comparing the attribute added to the received mail with the condition stored in the reproduction condition table;
The media conversion message system which has a reproducing means to reproduce | regenerate the said file attached to the said mail based on the comparison result of the said comparison means. A media conversion message system having a plurality of mobile terminals and a communication control unit,
The mobile terminal has attribute setting means for a caller to set an attribute of a call,
The communication control unit creates a voice or video file from a voice or video call signal when it detects that the other party cannot respond to the call or does not answer the call and the attribute is an attribute for creating a file. Encoding means;
Storage means for storing the file created by the encoding means;
A mail address is acquired from the telephone number of the call destination, a mail having information for accessing the file stored in the storage means is created, an attribute set by the attribute setting means is added, and the mail address is transmitted. Have email sending means,
The mobile terminal further receives mail received by the mail transmitting means, mail receiving means;
A playback condition table for storing conditions for acquiring the file;
Comparing means for comparing the attribute added to the received mail with the condition stored in the reproduction condition table;
A media conversion message system comprising access means for accessing the file based on a comparison result of the comparison means. The media conversion message system according to claim 1 or 2,
The media conversion message system according to claim 1, wherein the condition stored in the reproduction condition table to be compared with the attribute of the received mail includes at least caller information. The media conversion message system according to claim 1,
The media conversion message system characterized in that the playback means has a function of canceling the manner mode of the mobile terminal that has received the mail and playing the file. The media conversion message system according to claim 2,
The media conversion message system, wherein the storage means transmits a signal for reproducing the accessed file to the mobile terminal that has received the mail . The media conversion message system according to claim 1 or 2,
A media conversion message system comprising a condition table for storing information for determining whether or not the encoding means creates a file. The media conversion message system according to claim 1 or 2,
The media conversion message system characterized in that the condition set in the reproduction condition table includes time and / or position information, and is compared with the time when the mail is received and / or the position information of the apparatus which received the mail. The media conversion message system according to claim 1 or 2,
The media conversion message system characterized in that the communication control unit has an address list for storing an e-mail address for simultaneously transmitting e-mails, and simultaneously transmits the e-mail with the file attached to e-mail addresses stored in the address list. .

Images