JP4530016B2 - Information communication system and data communication method thereof - Google Patents

Description

  The present invention relates to an information communication system and a data communication method thereof. The information communication system according to the present invention relates to a communication system that uses, for example, an information communication device as a terminal device, exchanges data between the terminal devices, and communicates information generated according to pictogram analysis. Further, the data communication method of the information communication system according to the present invention relates to a data communication method reflecting the result of pictograph analysis between the information communication systems.

  Currently, mobile phones are not only making voice calls, but are becoming increasingly multifunctional. As an example of multifunctionalization, a mobile phone has an image communication function and a display function, and also has an e-mail function for transmitting and receiving character information. Furthermore, with regard to image communication, telephones having a function of displaying a moving image including a still image are also appearing in mobile phones. Further, for example, when a personal computer (hereinafter referred to as a PC) is used as the information terminal device, some PCs have a voice function for reading a sent electronic mail or text.

  In general, when an e-mail is used to convey a sender's emotions to a communication partner such as a close friend, pictograms are often created by combining single-character symbols and communication is performed by inserting them into text. This pictograph is an effective description for communication, but the expression content is limited. In addition, there are problems such as not knowing what pictograms mean for those who are not familiar with e-mail.

In order to effectively convey the intention of the writer to the reader, for example, a face mark input device of Patent Document 1 has been proposed. The face mark input device includes face image input means, facial expression determination means, face image conversion means, sentence input means, and sentence layout means. Further, the face mark input device may include a sentence input unit, a sentence analysis unit, a facial expression determination unit, a face image input unit, a face image conversion unit, a face image holding unit, and a sentence arrangement unit.
Japanese Patent Laid-Open No. 10-149433

  By the way, the face mark input device described above generates an expression that matches a word included in the supplied text. For example, “Sad”, “Angry”, “Angry” for the sentence “When you have a sad thing, if the world is bad, do n’t get angry.” There is a possibility that an unintended image may be generated due to ambiguity as to whether or not attention is paid to “no”. In order to eliminate this ambiguity, it is conceivable to put a designated range in advance as a confirmed area in order to confirm a word in a sentence to be imaged. Such an operation is complicated for creating a sentence. Further, the layout work for inserting the generated image into the created text is also troublesome for the user.

  In view of such a problem, the present invention is capable of expressing not only a facial expression that accurately reflects the intention of text creation but also a facial expression image with higher communication ability even if created in the same way as normal text creation. An object is to provide a communication system and a data communication method thereof.

  In order to solve the above-described problems, the present invention performs input / output of information, digitizes this information and transmits / receives the information, and performs application processing on the data output from the terminal device. And an information communication system that performs information communication between the terminal devices via the server device. The server device stores a text data file in which text is digitized by the terminal device. In response to this, the text data file is checked to see if the supplied data includes a pictograph that has a meaning by combining a single character or symbol. Data storage means for storing the data to be stored, and data read from the data storage means in accordance with the intention indicated by the analysis result. And a signal generation function block that adjusts and provides the timing of signals obtained by processing the data, and the terminal device receives the text data file from the server device, expands the text data file, and generates the text data. And a control function block for expressing the supplied signal in response to the display.

  In order to solve the above-mentioned problem, the present invention relates to a first information terminal device that transmits text data created by a text creation process, and the text data from the first information terminal device is related to the text data. In a data communication method in an information communication system using a server device to which the attached data is attached and a second information terminal device that is a communication partner of the first information terminal device, one character is added to text data in the server device. The first step of analyzing the meaning of the pictogram by checking whether it includes a pictograph that has a meaning by combining and symbols, and reading out basic data different from the text data stored in advance by the server device according to the intention indicated by the analysis result And a second step of attaching and outputting a file containing basic data to a text data file.

  According to the information communication system of the present invention, the pictogram analysis function block of the server device checks the presence or absence of pictograms in the electronic mail, analyzes the pictograms, and generates an analysis result according to the meaning of the pictograms as a signal generation function. On the other hand, the data read from the data storage means is supplied to the signal generation function block, and the signal generation function block performs signal processing according to the analysis result to generate a different type of signal from the text data file. The signal generated together with the text data file is also supplied to the partner terminal device. The counterpart terminal device receives the text data file via the server device, expands the file, and generates and provides a signal in accordance with the display of the text data in the control function block. Although the device has created a text data file in the same way as it has been created so far, it accurately reflects the intention of the pictogram on the signal on the terminal device on the other end of the communication, and outputs the output timing of the obtained signal. It can be adjusted and output to accurately provide the feelings of the communication partner.

  According to the data communication method in the information communication system of the present invention, the first information terminal device performs the same input processing as before, and the pictograms included in the text data supplied from the first information terminal device are stored in the server. Detecting by the device, analyzing its meaning, outputting the attached file including the basic data of the server device, and outputting the signal from the basic data attached according to the output destination and the function of the second information terminal device And the second information terminal device can make the second information terminal device perform expressions that are easier to understand and empathize compared to the case where text with pictograms is displayed.

Embodiments of an information communication system according to the present invention will now be described in detail with reference to the accompanying drawings. Referring to FIG. 1, in the embodiment of the information communication system according to the present invention, the pictogram analysis function unit 104a of the server device 104 checks the presence or absence of pictograms in the e-mail supplied, analyzes the pictograms, and interprets the meaning of the pictograms. The analysis result according to the signal is supplied to the signal generation function unit 104b, while the data read from the storage 104c is supplied to the signal generation function unit 104b, and the signal generation function unit 104b performs signal processing according to the analysis result. Then, a signal of a different type from that of the text data file is generated, and the signal generated together with the text data file is also supplied to the partner terminal device. In the partner terminal device 102b via the server device 104, the text data file is received, the file is expanded and the expression control function unit 102f expresses and provides a signal in accordance with the display of the text data. Even though the terminal device 102a on the sending side has created a text data file in the same way as it has been created so far, it can be obtained by accurately reflecting the intention of the pictogram in the signal on the terminal device 102b on the communication partner side. By adjusting the output timing of the received signal, it is possible to accurately provide the emotion of the sender and enhance the communication ability.

  In this embodiment, the information communication system of the present invention is applied to an electronic mail communication system 100. The illustration and description of parts not directly related to the present invention are omitted. In the following description, the signal is indicated by the reference number of the connecting line in which it appears.

  In principle, the mobile phone 10 shown in FIG. 3 includes a receiving unit 12, a pictogram analyzing unit 14, a basic data storing unit 16, a signal generating unit 18, and a signal generating unit 20. The receiving unit 12 includes a circuit that receives radio waves corresponding to, for example, IMT (International Mobile Telecommunications) -2000. It goes without saying that the mobile phone 10 also has a transmission unit (not shown). The received radio wave is power amplified to obtain a signal passing through a predetermined frequency band. This signal is multiplied by a predetermined frequency and down-converted to an intermediate frequency. This down-converted signal is amplified and then demodulated to become a baseband signal. For example, a baseband signal is converted into an analog signal, and, for example, a rake reception process is performed, and signals of a plurality of propagation paths are individually correlated and subjected to maximum ratio synthesis to obtain a stable signal. After that, the signal obtained in this way is decoded through a channel codec, and is stored in a buffer memory, for example, according to the type by decoding voice data, text data or the like. In this embodiment, a text data file and an attached file are stored in a memory (not shown). The receiving unit 12 supplies file data 12a including the obtained text data file to the pictogram analyzing unit 14.

  The pictograph analysis unit 14 has a function of examining whether or not a pictograph is inserted in the file data 12a including the supplied text data file, and analyzing the meaning of the pictograph when the pictograph is included. In order to provide this function, the pictograph analysis unit 14 includes a lookup table as described later. As text data, alphanumeric characters, hiragana, katakana, kanji, graphic symbols, special characters, and the like are used. Emoji is commonly used to express the creator's feelings at the end of a sentence.

  Currently, pictograms include (^ _ ^; (; _; (^ _ ^) v (^ o ^) m (_ _) m (? _?) (^ O ^) / ~ (ToT) (@_ @) There are emoticons such as (-_-) (* _ *) (> _ <).

  The pictograph analysis unit 14 usually examines file data 12a including a text data file for each amount of words and phrases, and determines whether or not the examined data has meaning as words and sentences. The pictograph analysis unit 14 makes this determination with the pictograph presence / absence determination function unit 140. The pictograph analysis unit 14 determines that the examined data does not form a meaning, and determines that the data is a pictograph. If the data is meaningful, the pictograph analysis unit 14 determines that the data is not a pictograph.

  In response to the determination that the pictogram analyzing unit 14 includes a pictogram, the emoticon is determined from the order of the characters appearing from the left side in one line in the case of the emoticon as described above. There is a pictograph semantic analysis function unit 142. In addition, some pictograms include actions and situations. Furthermore, some pictograms are expressed more complicatedly by arranging characters not only on one line but also on a plurality of lines. The pictograph meaning analysis function unit 142 has a look-up table (not shown) in which the patterns and meanings used for pictographs and the relationship between the control information corresponding to the meanings are tabulated in advance. The pictographic meaning analysis function unit 142 outputs not only the semantic analysis of pictographs but also a control signal 14a including, for example, a word extraction result of vowels and selection of basic data to be used to the signal generation unit 18.

  The pictograph semantic analysis function unit 142 also has a function of recognizing a delicate emotion that is difficult to express in words using an icon on a mobile phone and generating control information corresponding to this recognition.

  Note that this means that even if a so-called icon-attached e-mail is transmitted, it is replaced with pictographs possessed by each carrier via a relaying server and is not accurately transmitted to the other party. Therefore, in order to maintain this function, the server may be provided with a function for accurately converting pictographs between different carriers in association with each other.

  In this way, the pictograph analysis unit 14 outputs the control information of the analysis result to the signal generation unit 18 as the control signal 14a. Further, the text data 14b is input to, for example, a buffer memory (not shown) so that it can be used as it is.

  The pictograph analysis unit 14 also includes a file structure analysis function unit 144 that separates the text data file and the attached file according to the structure of the file in which the attached file is added to the supplied data. The separated attached file 14c is supplied to the signal generation unit 18.

  The basic data storage unit 16 is a nonvolatile memory. The basic data storage unit 16 includes image data, music data, sound data, personal characteristic data possessed by the data sender (provider), operation data for the image represented by the image data, status data for the image, and advertisement. Data for use are included.

  Among these, in the case of a mobile phone, image data, audio data, and advertisement data correspond to basic data as data to be followed by changes. On the other hand, the feature data, operation data, and situation data are incidental information and are classified as secondary data.

The basic data storage unit 16 is supplied with a selection signal 16a for basic data to be used from the signal generator 18. The basic data storage unit 16 outputs corresponding data 16b to the signal generation unit 18 in response to the selection signal 16a. The data 16b is at least one of basic data and secondary data. The data 16b may be a combination of basic data and secondary data. However, when only the secondary data is supplied, the basic data storage unit 16 is provided on the condition that the basic data has already been transmitted before the supply.

  Further, the basic data storage unit 16 may store data in each memory for each type of data, and may output the data 16b from each of the memories simultaneously to the signal generation unit 18. In this case, the signal generator 18 is supplied with a plurality of types of data.

  The feature data, operation data, and status data may be supplied from the mobile phone on the transmission side. The transmitting-side mobile phone may also supply basic image data. In this case, the mobile phone supplies image data, feature data, operation data, and situation data as an attachment file 14c attached to the text data file.

  The signal generation unit 18 has a function of generating a signal from the data 16b supplied from the basic data storage unit 16 in accordance with the control signal 14a (and attached file 14c). As will be described in detail later, various types of signals are generated corresponding to the supplied data 16b. The attached file 14c is supplied when it exists in the structure analysis result.

  The signal generation unit 18 includes an animation image creation function unit 180 corresponding to the image data, a D / A conversion function unit 182 that converts it into an analog signal corresponding to the music data, and a synthesized voice that generates synthesized speech corresponding to the audio data A creation function unit 184 and an advertisement image creation function unit 186 are included. In addition, the signal generation unit 18 may include a composite image creation unit 188. The composite image creation unit 188 has a function of synthesizing the image signals created by the animation image creation function unit 180 and the advertisement image creation function unit 186 by adjusting the display area and display timing. The signal generation unit 18 outputs the generated signal 18a to the signal expression unit 20.

  The animation image creation function unit 180 is supplied not only with image data as described above but also with feature data, operation data, and situation data. As a result, it is possible to display an image to be generated by reflecting personal characteristics, to give an action to the image, and to display an image by reflecting the situation.

  The signal expression unit 20 is a display unit 20a or a speaker 20b included in the mobile phone 10. The display unit 20a displays the image signal 18a generated by the signal generation unit 18 and the text data 14b in the set screen area. This division into areas is processed by a display controller (not shown). The image is displayed in synchronization with the displayed text. The speaker unit 20b performs sound generation at delicate timing by adjusting the timing of the sound signal (music, voice, etc.) generated by the signal generation unit 18 and supplying it.

  As a result, image, music, voice and advertisement information can be accurately reproduced from the mobile phone 10 corresponding to the pictograms included in the created e-mail (text data), and even for those who do not know pictograms. Can convey a certain nuance.

  Next, a procedure for reproducing and displaying the received electronic mail in the mobile phone 10 will be described (see FIG. 4). First, an e-mail is received (step S10). The received e-mail is temporarily stored in a buffer memory (not shown). The pictograms are analyzed for all the stored data 12a (subroutine SUB1). All of the analysis results are supplied to the signal generator 18 as the control signal 14a. Although the text data 14 b is not shown in the flowchart of FIG. 4, the pictogram analysis unit 14 supplies the text data 14 b to the signal expression unit 20.

  The signal generator 18 performs signal generation processing (subroutine SUB2). The signal generation unit 18 reads the basic data 16b selected from the basic data storage unit 16 in accordance with the control signal 14a, processes the basic data 16b, and generates a signal. The signal generation is performed so that it can be displayed in synchronization with the display of the text data 14b, and signal synthesis processing is also performed according to whether or not advertisements are included (step S12). In the signal synthesis, signals of the same kind are synthesized, but in the case of different kinds of signals, the obtained signals are output. For example, the synchronization may be performed in accordance with the movement of the cursor displayed on the display screen.

  In the signal expression unit 20, the supplied signal is expressed (step S12). When the signal supplied in synchronization with the text data 14b is an image signal, the signal is displayed on the display unit 20a, and when the signal is an audio signal, the sound is generated from the speaker unit 20b.

  Next, it is determined whether or not all reading has been completed (step S14). If the reading of the sentence has not been completed yet (NO), the process returns to the signal generation process again and the above-described procedure is repeated. If all the reading is completed (YES), the process proceeds to the end and the reproduction display of the e-mail is ended.

  Next, a pictographic analysis processing procedure (subroutine SUB1) will be described with reference to FIG. First, it is determined whether or not the captured data 12a includes a pictograph (substep SS100: pictograph presence / absence determination function unit 140). If a pictograph is included (YES), the process proceeds to selection of basic data corresponding to the pictograph (substep SS102). If no pictogram is included (NO), the process proceeds to, for example, vowel extraction processing based on the text data 12a (sub-step SS104).

  For emoticons, in the case of emoticons, look for the trend pattern from the nuances of the text, find the symbol “(” in more detail, and look for the combination of the data that preceded the symbol “(” and the subsequent data ( Sub-step SS102) Trend patterns are, for example, “fun”, “cold sweat”, “sad”, “embarrassed”, “sorry”, “not sure”, “sleepy”, “anger”, “greeting”, “Goodbye”, “Pain”, “Run away”, “Support”, “Normal”, “Lay down”, “Famous character” (not shown), “Cat”, “Inu”, “Pig”, “Living”, “Emoji” etc. (see FIG. 6) Each group such as “fun” is associated with emoticons and meanings representing cheers and expressions, stored in a lookup table, and corresponding to each meaning. The number of the selected data to be assigned Stored in the click-up table. Selecting an emoticon meaning analysis function unit 142 corresponding number in.

  When extracting vowels (sub step SS104), the pictogram meaning analyzing unit 142 extracts vowels when reading a sentence from text data. Then, a selection data number corresponding to the extracted vowel is selected (substep SS106). These selected numbers are the control signal 14a. The control signal 14a has, for example, a flag that also indicates the type of data to be handled. Data types include images, music, audio and advertising.

  Next, it is determined whether or not the analysis is finished (substep SS108). When the analysis is incomplete (NO), the process returns to the determination of whether or not it is a pictogram (go to substep SS100). When the analysis is completed for all the supplied data 12a (YES), the process proceeds to batch transmission processing (to sub-step SS110).

  The pictograph analysis unit 14 collectively transmits the control signal 14a generated corresponding to the supplied text data 12a to the signal generation unit 18 (sub step SS110). After this processing, the process proceeds to return and the subroutine SUB1 is terminated.

  Although not shown in FIG. 5, an attached file may be attached to the file supplied from the transmission source. In the pictograph analysis unit 14, the file structure analysis function unit 144 may check for the presence of an attached file. When there is an attached file, the attached file 14c is separated and provided to the signal generation unit 18.

  Next, a signal generation procedure will be described with reference to FIG. First, the pictograph analysis unit 14 temporarily stores the control signal 14a (and attached file 14c) in a buffer memory (not shown) (substep SS200). Thereafter, the temporarily stored control signal 14a is read out step by step to determine whether it is the control information number of the pictograph (sub-step SS202). In the case of a pictograph (YES), the read number is supplied to the basic data storage unit 16 as a selection signal 16a. Further, even when it is not a pictograph (NO), the read number is supplied to the basic data storage unit 16 as the selection signal 16a.

  The basic data storage unit 16 sends basic data 16b corresponding to pictograms and vowels from the flag and the selected number to the signal generation unit 18 (substeps SS204 and SS206).

  The signal generator 18 receives the basic data 16b of the signal to be handled and performs signal processing according to the basic data 16b (substep SS208: pictogram correspondence). In sub-step SS208, the generated signal is also interpolated to obtain a smooth signal. Then, expression continuation processing is performed (substep SS210). In the case of image display, for example, an image of an expression that can be temporarily stopped or emphasized is displayed as if paused. In the case of music / voice, the data supplied for a certain period is continuously played. On the other hand, the signal generator 18 receives the basic data 16b of the signal to be handled and performs signal processing according to the basic data 16b (substep SS212: vowel correspondence). In sub-step SS212, a signal corresponding to the generated vowel is interpolated to obtain a smooth and uncomfortable signal.

  Here, the signal generation unit 18 generates at least one of an image signal, music sound, sound, advertisement signal, and the like. The interpolation process is not limited to the method described above.

  Next, the presence / absence of advertisement is determined (substep SS214). If there is no advertisement (NO), the process proceeds to return and the subroutine SUB2 is terminated. If there is an advertisement (YES), the process proceeds to signal synthesis (to subroutine SUB3). A synthesized signal is generated, and the process proceeds to return to end the subroutine SUB2.

  In the case where the composition of advertisements described later relates to temporal composition, although not shown, it is preferable to perform the advertisement determination process and the signal composition process before the pictogram determination process (sub-step SS202).

  Next, signal synthesis will be briefly described with reference to FIG. The two signals are temporarily stored in the respective storage areas (substep SS300). Next, the signals are synthesized so as to maintain the synchronization relationship of the read signals (substep SS302). When the signal to be handled is the same type of signal, spatial synthesis, that is, synthesizing an advertisement on a part of the screen and generating a new image signal, and temporal synthesis, that is, reproducing text (e-mail) In some cases, a new image signal is generated by inserting into the time domain. In addition, the signal to be handled may be a different type of signal.

  Examples of different types of signals include image signals and audio signals. In this case, it is not a spatial synthesis, but a temporal synthesis, and the synthesis is performed so that the respective signal effects are exhibited while keeping the timing to be synchronized well.

  Next, the synthesized signal is output to the signal generating unit 20 (substep SS304). Thereafter, the process proceeds to return, and the subroutine SUB3 is terminated.

  By operating in this way, the mobile phone 10 not only displays a text data file, but also generates a signal corresponding to a pictogram (or emoticon) included in the file, and the timing of the expression of this signal is Since the adjustment is performed, expressions that reliably reflect the emotions of the sender can be added, and communication skills can be enhanced.

  Note that the representation of the image does not always have to be a moving image, and a normal still image may be displayed, and a corresponding moving image may be displayed when a pictograph is recognized.

  Some more specific examples are given below. Here, in the embodiment in which the present invention is applied to the mobile phone 10, common portions are denoted by the same reference numerals, and description thereof is omitted.

<Specific example 1>
The mobile phone 10 in FIG. 9 includes a receiving unit 12, a pictogram analyzing unit 14, a basic data storing unit 16, a signal generating unit 18, and a display unit 20a. The signal generation unit 18 includes an animation image creation function unit 180. For example, in the electronic mail playback mode, the mobile phone 10 performs the presence / absence and analysis of the pictogram in the pictogram analysis unit 14 according to the movement of the cursor with respect to the data 12a from the reception unit 12, and the control signal 14a obtained is a signal generation unit Supply to 18. The pictograph analysis unit 14 includes a pictograph presence / absence determination function unit 140 and a pictograph meaning analysis function unit 142. The signal generation unit 18 transmits the selection signal 16a indicating the selection number to the basic data storage unit 16 as the data to be read is an image. The basic data storage unit 16 supplies data 16b corresponding to the selection signal 16a from the image memory (not shown) to the signal generation unit 18.

  In the signal generation unit 18, the animation image creation function unit 180 creates the basic still image data for the moving image based on the supplied data 16b, and interpolates between the generated still images. In the interpolation processing, smooth image signals 18a are respectively generated from image data supplied with pictograms and vowels. Until the emoticon enters data 12a, the mouth in the face changes corresponding to the vowel, and if there is an emoji “(^ o ^)”, the image is changed to a laughing image. The display unit 20a displays text in the text display area 200 and displays an image in the image display area 202.

  The sender can display the image as an image together with the text data in accordance with the movement of the cursor, for example, without being conscious of the pictogram on the receiving side, despite the same e-mail creation as before. Thereby, a sender's emotion can be understood in an easy-to-understand manner.

<Specific example 2>
The mobile phone 10 of FIG. 10 has a music playback function added to the configuration of FIG. The pictograph analysis unit 14 not only analyzes the pictograph, but also controls information so that one sentence after the detected pictograph flows through the text display area 200 or changes the music over the period during which the cursor moves. Is added to the control signal 14a. The signal generation unit 18 includes an animation image creation function unit 180 and a D / A conversion function unit 182. The basic data storage unit 16 includes an image memory 160 and a music memory 162. The signal expression unit 20 includes a display unit 20a and a speaker unit 20b.

  Here, the above-mentioned one sentence indicates after the reading of the previous sentence to the reading of the main sentence. The music memory 162 of the basic data storage unit 16 supplies the data 16b to the signal generation unit 18 with this display period as a data read enable period.

  The D / A conversion function unit 182 of the signal generation unit 18 converts the supplied data 16b into an analog signal and outputs the analog signal to the signal expression unit 20 as a signal 18a. The signal 18a is an image signal and a reproduced analog signal (music). In the image display area 202 of the display unit 20a, for example, a moving image of a character image is displayed, and the mouth of this image can be seen to move based on the data 12a.

  When a pictograph is detected, the character image is changed and moved in the same manner as in the previous embodiment. At the same time, the music memory 162 of the basic data storage unit 16 supplies data 16b related to the music corresponding to the pictogram to the signal generation unit 18 over the period of one sentence written after the detection in accordance with the detection of the pictogram. The D / A conversion function unit 182 converts the supplied data 16b into an analog signal and outputs it to the speaker unit 20b. Thus, for example, during normal text display, a bird's twitter is output, but different music is output during the above-described period according to the detection of the pictograph.

  Therefore, the e-mail creator's emotion can be estimated without being conscious of pictograms, etc., and the music can also be changed to make it easier to convey the creator's emotion to the recipient. Become.

<Specific example 3>
A cellular phone 10 in FIG. 11 has a synthesized speech generation function added to the configuration in FIG. The pictograph analysis unit 14 not only simply analyzes pictographs, but also performs sentence syntax analysis as text analysis, while one sentence after the detected pictograph flows through the text display area 200 or over the period during which the cursor moves. Control information is added to the control signal 14a so that the synthesized speech is changed and played. The signal generation unit 18 includes an animation image creation function unit 180 and a synthesized speech creation function unit 184. The basic data storage unit 16 includes an image memory 160 and an audio memory 164. The signal expression unit 20 includes a display unit 20a and a speaker unit 20b. The above-described period is the same as in the second specific example.

  The voice memory 164 stores basic data necessary for creating a synthesized sound. The basic data is data according to the method. The first method is a voice waveform uttered by a person or data accumulated by waveform coding, and is used by being connected. The second method analyzes a speech waveform, accumulates parameterized data, and uses them by connecting them. In the third method, a character string or phoneme symbol string is stored as data, and speech is generated based on phonetic and linguistic synthesis rules. In the present embodiment, the speech memory 164 stores phoneme data of consonants and vowels.

  The synthesized speech creation function unit 184 is a function unit that performs text-to-speech synthesis and performs character-to-speech conversion. The synthesized speech creation function unit 184 generates LSP (Line Spectrum Pair) parameters and pitch patterns from the phonetic rules and prosodic rules using the data 16b from the speech memory 164 as speech synthesis control parameters from the results of text analysis, The speech data generated based on the above and LSP parameters are input to the digital filter, and speech synthesis is performed. The generated sound is D / A converted and output to the speaker unit 20b.

  In this way, the text data file supplied from the e-mail creator is converted into speech and output. As a result, the displayed character image is operated as if the text is being read out, and when a pictograph is detected, a voice corresponding to the detected pictograph is output. This voice is a key signal that increases the pitch of the control signal 14a and data that outputs a voice "Ya-ta" when a happy pictogram such as "v (^_^) v" is detected. And is supplied to the signal generation unit 18.

  Compared with the previous embodiment, it is advantageous for the visually impaired because the text is converted into speech and read out. And, without being conscious of pictograms and the like, it is possible to convey the feelings of the e-mail creator to the other party, and the communication ability can be enhanced.

  In these three specific examples, the e-mail creator has a feature that the e-mail creator can create the e-mail in the same procedure as the conventional e-mail creation without considering the configuration of the recipient.

<Specific Example 4>
In the mobile phone 10 of FIG. 12, a file structure analysis function unit 144 is added to the pictogram analysis unit 14 of FIG. That is, the pictograph analysis unit 14 not only analyzes the presence / absence and analysis of pictographs (the pictograph presence / absence determination function unit 140, the pictograph analysis function unit 142), but also analyzes the structure of the supplied text data file (e-mail), It has a function (file structure analysis function unit 144) for checking presence / absence of an attached file and data contents.

  When an attached file exists in the file structure analysis function unit 144, the file structure analysis function unit 144 separates the text data file and the attachment file 14c and supplies them to the signal generation unit 18. The signal generation unit 18 supplies the attached file 14c to the basic data storage unit 16 via the data 16a and stores it. Although not shown, the attached file 14c may be directly supplied to and stored in the basic data storage unit 16 and read out from the basic data storage unit 16. Here, the attached file 14c is model data for image display, and includes data corresponding to pictograms used in electronic mail.

  The mobile phone 10 displays the image based on the supplied data while synchronizing with the display of the text data 14b to be displayed without having the basic data of the display image in advance. Can recognize the e-mail creator. If the supplied model data uses a character or caricature that deforms the person himself, it can also give the receiver a feeling that they are interacting with the person who created the mail in a pseudo manner, thus improving the communication ability. .

<Specific example 5>
In the mobile phone 10 of FIG. 13, a file structure analysis function unit 144 is added to the pictogram analysis unit 14 of FIG. 9, and a personal characteristic memory 166 is arranged in the basic data storage unit 16. The file structure analysis function unit 144 determines the presence / absence of the attached file 14c and the content of the attached file as in the case of the specific example 4, and separates it from the text data file. The attached file 14c includes image model data and data indicating individual characteristics. The personal characteristic data is data in which an operation that gives a special change to a standard image is described, and is a habit or characteristic operation of a telegraph mail creator. The attached file 16c is separately supplied to the image memory 160 and the personal characteristic memory 166 of the basic data storage unit 16 via the signal generation unit 18.

  When the image is actually generated, the basic data storage unit 16 reads the image data and the personal characteristic data from the image memory 160 and the personal characteristic memory 166 to the signal generation unit 18, respectively. The animation image creation function unit 180 creates the supplied image data, reflects the personal characteristic data corresponding to the pictogram included in the text data in the image, and changes the image to represent the individual (substep SS204). ~ Compatible with SS210).

  If there is a description that opens larger than the mouth size generally defined as personal characteristic data, the animation image creation function section 180 opens the mouth of the character image corresponding to the pictogram “(^ o ^)”. Change the behavior so that you open and laugh. Thereby, the communication in the reproduction | regeneration of an electronic mail can be improved, and it can be made easy to carry in an emotion compared with a mere communication.

<Specific Example 6>
In the specific example 5, the application relating to the image data and the personal characteristic data has been described, but in this embodiment, the case where the image data and the description data are supplied as the attached file 14c will be described. As shown in FIG. 14, the basic data storage unit 16 is provided with an image memory 160 and an explanation memory 168.

  Here, the explanation data is, for example, operation data explaining the image, situation data indicating the surrounding situation, and the like.

  When the image is a product, it is not simply displayed when it is played back on the mobile phone 10, but an image is created in consideration of the explanation data. An image is displayed in synchronization with the position of the text to be displayed, and a specific product, a pointed item of the product, etc. can be accurately transmitted as indicated by a pointer, for example. By providing supplementary images corresponding to pictograms in this way, it is possible to contribute to grasping the contents to be communicated to the communication partner, and to contribute to easy understanding and deepening of understanding.

<Specific example 7>
In the mobile phone 10 shown in FIG. 15, the pictograph analysis unit 14 is provided with a pictograph presence / absence function unit 140, a pictograph analysis function unit 142, and a file structure analysis function unit 144, respectively. The basic data storage unit 16 includes an image memory 160 and an advertisement memory 170. The signal generation unit 18 includes an animation image creation function unit 180, an advertisement image creation function unit 186, and a composite image creation function unit 188.

  In this embodiment, an advertisement memory 170, an advertisement image creation function unit 186, and a composite image creation function unit 188 are newly provided. As the attached file 14c, image data and advertisement data are supplied. The advertising data is, for example, corporate advertisement data displayed on the background of image data that is model data. Further, the advertisement is not limited to spatial composition as in the background, but can be provided by temporal composition such as insertion at the beginning and the end of the e-mail reproduction.

  The attached file 14c is stored separately from the text data file in each of the memories 160 and 166 of the basic data storage unit 16 via the signal generation unit 18. Thereafter, data 16b (image data and advertisement data) is supplied to the signal generation unit 18 at the time of image creation. In the signal generation unit 18, the animation image creation function unit 180 creates a character image signal 180a based on the image data, and the advertisement image creation function unit 186 creates an advertisement image signal 186a based on the advertisement data.

  The synthesized image creation function unit 188 synthesizes the supplied character image signal 180a and the advertisement image signal 186a with either spatial synthesis or temporal synthesis. This image composition may be controlled according to the control signal 14a. The composite image creation function unit 188 outputs an output signal 18a as a composite image signal to the display unit 20a. The display unit 20a displays the composite image in the image display area 202. When spatial composition is performed, the advertisement image is made to look natural when the character image changes.

  By displaying an image including an advertisement in synchronization with the text display, it is possible to accurately convey the content to be communicated, and display an advertisement and receive a communication cost discount service. In this embodiment, an advertisement image is used as the background. However, the present invention is not limited to this image, and may be an image created by the explanation data as described above. By synthesizing the images, it is possible to provide easily understandable contents that the e-mail creator wants to convey.

  The change corresponding to the pictogram may be changed not only for the model data image but also for the background image so that the emotion of the e-mail creator can be well understood. For the model data image, model data arbitrarily created on the e-mail receiving side may be used instead of the attached file to be transmitted.

  Specific examples are not limited to those described above, and seven examples may be combined.

  By the way, if pictograms are registered in advance in a lookup table to be defined, an image corresponding to a new pictogram can be provided. Although the pictograph is inserted at the end of the sentence in the above-described embodiment, it may be inserted into the sentence according to the emotion of the e-mail creator.

  Although the mobile phone 10 has been described with respect to the configuration on the receiving side, the mobile phone 10 may have an e-mail creation function. It goes without saying that the e-mail creation function can create not only text but also image model data, personal characteristic data, explanation data, and advertisement data. Further, an e-mail created by a completely different personal computer or the like may be taken into the mobile phone 10 and sent to the other party at a convenient time.

  Next, the electronic mail communication system 100 will be described (see FIG. 1). The electronic mail communication system 100 includes an information terminal device 102 and a server device 104. The information terminal device 102 is connected to the server device 104 via, for example, an IP (Internet Protocol) network. The information terminal device 102 includes mobile phones 102a and 102b, personal computers (hereinafter referred to as PCs) 102c and 102d, and the like. The PC 102c has a browser function unit 102e. In addition, the cellular phone 102b and the PC 102c include expression control function units 102f and 102g, respectively. The PC preferably has a browser function and an expression control function. In the cellular phone, it is desirable to arrange an expression control unit on the receiving side.

  The browser function unit 102e has a client software function for browsing WWW (World-Wide Web). The expression control function units 102f and 102g have a function of controlling the data supplied as the attached file to be expressed in synchronization with the text display. In order to cause this expression, for example, the attached file includes a control key (control code) for notifying the expression timing. The control key is inserted by the server device 104.

  The cellular phones 102a and 102f communicate with the base stations 108a and 108b in the communication area via radio. The base stations 108a and 108b are connected to the IP network 110 via lines. The PCs 102c and 102g are also connected to the IP network 110 via lines.

The server device 104 uses an ASP ( Application Service Provider ) server. The server device 104 is connected to the IP network 110 via the line 110a. As shown in FIG. 2, the server device 104 includes a pictogram analysis function unit 104a, a signal generation function unit 104b, a storage 104c, and a customer information management function unit 104d.

  Individual functional units will be described. The pictograph analysis function unit 104a includes a pictograph presence / absence determination function unit 30, a pictograph meaning analysis function unit 32, and a file structure analysis function unit. The description of each function is the same as that of the mobile phone 10 described above. The description of the function is omitted to avoid repeated description. The pictograph analysis function unit 104a inputs the supplied e-mail data 110a, analyzes the pictograph in the e-mail, and outputs a control signal 36b indicating the analysis result to the signal generation function unit 104b together with the text data 36a. In addition, the pictogram analysis function unit 104a converts the attachment file 38 separated from the text data file according to the presence / absence and contents of the attachment file into the email data 110a obtained by the file structure analysis function unit 34, and the signal generation function unit 104b and storage. Supply to 104c. The attached file 38 includes model data such as image data, music data, personal characteristic data, explanation data (operation / situation), and advertisement data.

  The signal generation function unit 104b includes an animation image creation attachment function unit 40, a music data attachment function unit 42, a synthesized voice attachment function unit 44, an advertisement data attachment function unit 46, and an image composition attachment function unit 48. Although not shown, the signal generation function unit 104b inserts a control key into the attached file 38, for example, in response to detection of a pictograph in the text data 36a. This control key is used as a synchronization timing signal when the information terminal device 102 generates a signal. In the attached file 38, for example, data corresponding to a vowel included in the text data is arranged along a time series in which the text data is read, and a control code is arranged according to the detected pictogram. In addition, in the attached file 38, for simplification, a control code may be inserted into the corresponding location of the pictogram using the mouth pack data so as to open and close the mouth shape instead of the data corresponding to the vowel. .

  The signal generation function unit 104b reads and processes the attached file 38 supplied from the pictogram analysis function unit 104a as the basic data or the file data 38 stored in the storage 104c in advance, along with the text data file. The attached file is attached and output to the information terminal device 102 of the communication partner. Individual signal generation and attachment are described below.

  The animation image creation / attachment function unit 40 generates and interpolates a moving image signal according to the control signal 36b based on the model data for the image, and particularly shows an image corresponding to the meaning of the analysis corresponding to the pictogram. Generate a signal. The generated image data is converted into a predetermined attached file format and output to the communication partner.

  The music data attachment function unit 42 changes the music data to match the meaning of the analysis corresponding to the pictogram according to the control signal 36b. This music data is converted into a predetermined attached file format and output to the communication partner.

  The synthesized voice attachment function unit 44 generates synthesized voice data corresponding to the reading of the text in accordance with the control signal 36b, and inserts the synthesized voice data that matches the meaning of the analysis particularly corresponding to the pictogram. In this case, the synthesized voice data may be changed in pitch, for example, over a predetermined period. The generated synthesized voice data is converted into a predetermined attached file format and output to the communication partner.

The advertisement data attachment function unit 46 generates advertisement data as, for example, image data in response to the control signal 36b. The generated advertisement data is converted into a predetermined attached file format and output to the communication partner.
The advertisement data attachment function unit 46 may be selected and specified from a menu indicating how advertisement data is provided in advance. The menu includes, for example, spatial position designation and temporal insertion position designation. The advertisement data attachment function unit 46 performs processing according to this designation.

  The image composition attachment function unit 48 combines the image data supplied from the animation image creation attachment function unit 40 and the advertisement data attachment function unit 46, respectively. The composition designation is performed by designating advertisement data or designation before composition of both image data. The generated composite image data is converted into a predetermined attached file format and output to the communication partner.

  The storage 104c includes image data, music data, advertisement data, personal characteristic data owned by each user, and explanation data (operation / situation) possessed in advance as the server device 104. Further, the storage 104c may store the attached file supplied by the e-mail sender for each area according to the content. In addition, if such attached file data is registered so that it can be used by general users, the types of data to be handled can be dramatically increased.

  The advertisement data is collected in the storage 104c after collecting the advertising fee from the company / organization or the like that provides the data. For example, a rank based on a fee structure may be provided in the advertisement data, and the company may be charged for the advertisement price corresponding to this rank. As will be described later, for the user who uses the advertisement data based on this, the charge associated with the use of the server device 104 is reduced. The electronic mail with the attached file subjected to signal processing in this way is sent to the information terminal apparatus 102 of the communication partner via the line 110a.

  The customer information management function unit 104d includes a user registration management unit 50, a usage time management unit 52, an advertisement usage time management unit 54, and a billing calculation management unit 56. The user registration management unit 50 is a management unit that registers use of a user who uses the function of the server device 104 and performs recognition processing for a registered user.

  The usage time management unit 52 manages the time from when the e-mail data is received to the time when the signal is generated and output to the communication partner as the usage time. The advertisement use time management unit 54 counts how many times the advertisement data in which rank is used, or the number of times of use. The charge calculation management unit 56 is a management unit that calculates the charge for each user by converting the usage fee according to the usage time of the server device 104 and the number of times the advertisement data is used with respect to time. The advertisement usage time management unit 54 may manage charging based on the usage time itself.

  The customer information management function unit 104d supplies the individual information of the four management units 50 to 56 described above to the storage 104c as database parameters. The storage 104c stores the supplied parameters in a database.

  By constructing in this way and creating an e-mail as before without imposing a burden on the information terminal device 102 side, the e-mail can be output by reflecting information such as images and sounds in text data. Know the creator's emotions sensuously and receive more accurate explanations, and improve communication skills.

  Next, operations in the electronic mail communication system 100 in FIG. The information terminal device 102 includes a destination address and a mail text (text data) with pictographs, and transmits an attached file to the server device 104 as an electronic mail. The attached file is, for example, image data as model data.

  First, when the information terminal device 102 of the communication partner is the mobile phone 10 described above, the server device 104 collects text data, image data, and motion data for the image data collectively to the information terminal device 102 via the IP network 110. provide. Thereby, an e-mail can be read while displaying an image with a facial expression in the image display area. Even without this image display function, the contents can be confirmed as a normal electronic mail.

  Secondly, the server device 104 informs the information terminal device 102 of the communication partner that an e-mail has arrived at the address on the server device 104 with “name and title of destination”. Server device 104 can read an e-mail displaying an image with a facial expression automatically generated by access from information terminal device 102 of a communication partner.

  Third, the server device 104 automatically creates a moving image based on the model data. The moving image includes an image in which the expression is changed corresponding to the pictogram. The server device 104 transmits an electronic mail having the moving image data as an attached file to the information terminal device 102 of the communication partner. If the information terminal device 102 is a device capable of displaying a moving image, the information terminal device 102 can simultaneously display text and images. Further, when the incoming e-mail and its address are informed as in the second case, anyone can see the information on the accessed information terminal device 102.

  Note that the server device 104 may also send an e-mail created for the communication partner to the information terminal device 102 of the original e-mail creator as a transmission confirmation mail.

  If the information terminal device 102 on the e-mail creator side has a browser function, the user accesses the server device 104 via the information terminal device 102 and logs in. For new users, user registration is performed. Upon login, the server device 104 performs user authentication for the information terminal device 102. User authentication is performed depending on whether or not the registered user name and password match. The user creates an email on the server device 104 via the input device of the information terminal device 102, and selects a character that is model data. The e-mail address is also entered.

  The server device 104 searches e-mail text data, for example, as in the third usage mode described above, and checks for the presence of pictograms. The mouth shape or the like is changed so that the selected character is used for the text data, and image data corresponding to the expression or action corresponding to the pictogram is generated from the detection result of the pictogram. The server device 104 adds the generated image data as an attached file and sends it to the information terminal device 102 of the communication partner. Needless to say, the first and second modes of use described above can also be performed.

  In this case as well, the server device 104 may send an e-mail created for the communication partner to the information terminal device 102 of the original e-mail creator as a transmission confirmation mail.

  Further, the server device 104 receives an e-mail with a pictogram, automatically creates an e-mail corresponding to the pictogram according to one of the first and second forms, and sends it to the information terminal device 102 on the e-mail creator side. Send back. The e-mail is text with pictograms and motion data or text with pictograms and moving picture image data corresponding to pictograms. Thereafter, the information terminal device 102 transmits the information to the information terminal device 102 of the communication partner. Therefore, the user can manage the contents to be transmitted and the other party himself. Further, the server device 104 sets the e-mail destination as its own address and sends it back to the transmission source information terminal device 102, and the transmission source information terminal device 102 actually sends it to the communication partner information terminal device 102. In this procedure, since the address of the e-mail destination does not appear on the server device 104, the confidentiality of the information can be maintained.

  The attached file may be sent with the advertisement data described above. When opening an e-mail and reading the e-mail, there is a method of displaying a (spatial) synthesized advertisement on the background of the image data (movie character) having an expression, and before displaying the image data having an expression. In addition, there is a method of displaying an advertisement by (temporal) synthesis at least one of display termination. The advertisement data uses character data and video (image) data. When the advertisement is used, the administrator of the server device 104 can also provide a service that takes the burden of the usage fee with the advertising fee. If the user can receive this service, the use burden can be reduced, which is advantageous.

  The model data includes, for example, a method of creating a face based on image data taken from several pictures and photos, a method of creating data using dedicated software, and a method of providing a character for a fee. The data of the attached file is not limited to image data, and may be audio data, music data, or the like.

  By configuring as described above, semantic analysis of pictograms is performed according to the presence or absence of pictograms, image signals and audio signals corresponding to pictograms are generated and data required for generation is selected, and e-mails containing pictograms are attached. By sending it as a file and reflecting the sentiment of the sender (creator) of the e-mail, the communication distance with the communication partner is sensibly closer than when reading simple text data communication. As a result, communication skills can be improved. The meaning can be accurately provided to those who do not know the emoji.

  It can also be done by voice expression, which is effective for visually impaired people.

  Such communication ability can be similarly improved in the signal generation method, the e-mail communication system, and the data communication method.

  As described above, according to the information communication apparatus of the present invention, the text data supplied by processing the data read from the data storage means by the signal generation means according to the meaning analyzed by the pictogram analysis means, and supplying the text data At the same time, it outputs a signal that is generated by adjusting the timing, provides a signal corresponding to the correct pictogram according to the display of the text data, and reflects the emotion of the communication partner to read the text data communication simply Compared to the case, the communication distance with the communication partner can be made close sensuously, and as a result, the communication ability can be enhanced.

  Further, according to the information generation method in the information communication apparatus of the present invention, the supplied digital data is examined to include pictograms, the meaning of the pictographs present is analyzed, and the processing according to the analysis result is performed on the data. Therefore, it is possible to accurately reflect the intention of the pictogram in the signal, adjust the output timing of the obtained signal and output it, and accurately provide the emotion of the communication partner, compared to reading simple text data communication The communication distance with the communication partner can be reduced sensuously, and as a result, the communication ability can be enhanced.

  And according to the information communication system, the timing of the signal obtained by processing the data in the signal generation function block of the server device according to the analysis result from the pictogram analysis function block is adjusted, and the other terminal device In this terminal device, the terminal device on the transmission side receives the text data file, expands the file, and provides a signal that is expressed in accordance with the display of the text data in the control function block. Despite creating a text data file in the same way as we have created so far, accurately reflect the intention of the pictogram on the signal to the terminal device on the other end of the communication, and adjust the output timing of the obtained signal. It can output and accurately provide the feelings of the communication partner and enhance communication skills.

  Furthermore, the data communication method in the information communication system of the present invention performs the same input processing as before in the first information terminal device, and the pictogram included in the text data supplied from the first information terminal device is sent to the server device. Output the attached file containing the basic data of the server device, and generate a signal from the attached basic data according to the output destination and the function of the second information terminal device Then, since the second information terminal device can make the second information terminal device perform expressions that are easier to understand and empathize than when displaying text with pictograms, the communication ability in data communication can be further improved. Can do.

It is a figure which shows the structure of the electronic mail communication system to which the information communication system of this invention is applied. It is a functional block diagram which shows the schematic structure in the server apparatus of FIG. It is a block diagram which shows the principle structure used for the electronic mail display contained in the receiving side of the mobile telephone applied to the electronic mail communication system of FIG. It is a flowchart which shows the procedure which reproduces and displays the received electronic mail with the mobile phone of FIG. It is a flowchart which shows the process sequence of the pictograph analysis in the reproduction | regeneration display of FIG. FIG. 5 is a diagram for explaining a specific relationship between emoticon patterns and meanings in the pictogram solution of FIG. 4. 6 is a flowchart showing a signal generation processing procedure in the reproduction display of FIG. 4. It is a flowchart which shows the procedure of the synthetic | combination process in the signal generation of FIG. It is a block diagram which shows the structure of the specific example 1 of the reception email reproduction | regeneration display based on the principle of FIG. FIG. 6 is a block diagram showing a configuration of a specific example 2 of the received e-mail reproduction display based on the principle of FIG. 3. It is a block diagram which shows the structure of the specific example 3 of the reception email reproduction | regeneration display based on the principle of FIG. It is a block diagram which shows the structure of the specific example 4 of the received email reproduction | regeneration display based on the principle of FIG. It is a block diagram which shows the structure of the specific example 5 of the received electronic mail reproduction | regeneration display based on the principle of FIG. It is a block diagram which shows the structure of the specific example 6 of the received electronic mail reproduction | regeneration display based on the principle of FIG. It is a block diagram which shows the structure of the specific example 7 of the received electronic mail reproduction | regeneration display based on the principle of FIG.

Explanation of symbols

10 Mobile phone
12 Receiver
14 Emoji Analysis Department
16 Basic data storage
18 Signal generator
20 Signal generator
140 Pictogram presence / absence judgment function
142 Emoji Analysis Function
144 File structure analysis function
180 Anime image creation function
182 D / A conversion function
184 Synthetic voice creation function
186 Advertising image creation function
188 Composite image creation function

Claims (9)

A terminal device for inputting / outputting information, digitizing and transmitting / receiving the information, and a server device for performing application processing on the data output from the terminal device and supplying the data to a partner terminal device In an information communication system for performing information communication between the terminal devices via the server device,
The server device receives a text data file in which text is digitized by the terminal device, and the text data file is included in data supplied with meaningful pictograms by combining one character or symbol. And an emoji analysis function block for analyzing the meaning of the emoji,
Data storage means for storing image model data;
And a signal generation function block for generating a motion data against the model data read out from said data storage means in accordance with the meaning of the analyzed pictogram,
The pictograph analysis function block analyzes the text data for each word or phrase, determines whether the data analyzed in the analysis forms a meaning, and regards the analyzed data as a pictograph according to the determination false The analyzed data is regarded as data other than pictograms depending on the truth of the judgment,
The terminal device receives the text data file from the server device, expands the text data file, and generates a moving image based on the motion data supplied with the model data supplied together with the text data file. An information communication system comprising an expression control functional block . 2. The information communication system according to claim 1, wherein the signal generation functional block performs vowel extraction processing on a portion other than a pictogram of the text data to generate the motion data . 3. 3. The system according to claim 1, wherein the signal generation function block generates an attached file including the motion data and the model data to be displayed according to the meaning of the analyzed pictogram, and the attached file An information communication system comprising an image attachment function block for attaching an image to a text data file . 4. The information communication system according to claim 1, wherein the model data or the motion data is supplied from the terminal device . A first information terminal device that transmits text data created by a sentence creation process; a server device that attaches data related to the text data to the text data from the first information terminal device; and first information In a data communication method in an information communication system using a second information terminal device that is a communication partner of a terminal device, the method includes:
It said examining comprises or pictograms means a combination of one of the characters and symbols in the text data in the server device occurs, the first step of analyzing the pictogram meaning in pictograph analysis function block for analyzing the meaning of該絵characters,
Generates motion data signal generating function block for generating motion data for the read model data from the data storage means for storing model data of the image depending on the meaning of the analyzed pictograph, the motion to the text data file data attach, only contains a second step of outputting to the accompanying text data file,
In the second information terminal device, the attached text data file is received from the server device, the attached text data file is expanded, and the motion data supplied with the model data supplied together with the text data file is supplied. A third step of generating and displaying a moving image based on the motion data supplied with the model data in an expression control function block that generates a moving image based on
In the first step, the text data is analyzed for each word or phrase, it is determined whether the data analyzed in the analysis forms a meaning, and the analyzed data is regarded as a pictograph according to the determination false, A data communication method in an information communication system, wherein the analyzed data is regarded as data other than pictograms according to the truth of the judgment . 6. The data communication method according to claim 5 , wherein the second step performs vowel extraction processing for portions other than pictograms of the text data to generate the motion data . The method according to claim 5 or 6 , wherein the second step generates an attached file including the motion data and the model data to be displayed according to the meaning of the analyzed pictogram, A data communication method in an information communication system, wherein the data communication file is attached to the text data file . 8. The information communication system according to claim 5 , wherein the model data or the motion data is supplied from a first information terminal device . 9. The method according to claim 6, 7 or 8 , wherein the first step is a fourth step of determining the presence or absence of the pictogram by a pictogram presence / absence determination function block for determining whether or not the pictogram is included in the text data. When,
A fifth step of analyzing the meaning of the pictogram if the pictogram is present in the pictogram semantic analysis function block that analyzes the meaning of the pictogram upon detection of the pictogram ;
The presence / absence of a file attached to the file based on the text data is checked, and when the text data and the attached file exist, the text data and the attached file are separated and attached. And a sixth step of outputting the file to the signal generation function block .

Images