JP3694698B2 - Music data generation system, music data generation server device - Google Patents

Description

BACKGROUND OF THE INVENTION
The present invention relates to a system for generating music from text, for example, and more specifically to a system that can easily generate self-made music using a terminal device.
[0001]
[Prior art]
Currently, services such as greeting cards are provided that can send e-mails with messages attached to animated images and music. In this system, a plurality of greeting cards are registered in advance on the server device side, and a message can be added by allowing a user to select a desired one from among them.
[0002]
[Problems to be solved by the invention]
However, since such a system selects and uses images, music, etc. from a limited number of cards registered on the server device side, the user's originality is given to the card to be transmitted. I can't. It is also possible for the user to create music independently and send the created music with a message. However, in order to make music in this way, musical expertise is required. In addition, for example, a device for inputting the music information is a mobile phone or a personal computer. In this case, it takes a lot of time for the input.
[0003]
On the other hand, as a service that allows a user to easily create original music, a service that allows text input from a mobile phone and generates music from the text is also currently provided.
[0004]
This system generates music from names and favorite words. How about syllable beats and syllable links (crossing sounds) in thousands of Japanese words with a clear image? It is a summary of how it is used, and music is generated based on the close relationship between these syllables and the meaning of words. For example, it has a hard image such as “Go, Giga, Gyu, Ko, Chi, Ka, Kyo, Cha, Pa, Che, Ki, Ba” and “Fu, Nu, Ne, Words such as “Ju, Chu, Nya, Nyu, Nyo, Wa, Gu” have a soft image. Also, looking at each syllable, the syllable “ki” is suitable for conveying an image such as “clear, active, bright, resistance, flashy, narrow”. , Safe, excellent, pale, happy, thin ” Then, it captures the characteristics of the image that each syllable and the sound has, and generates music that matches that image.
[0005]
However, in such a system, music is generated from so-called short “words” such as names and favorite words, so it is highly likely that the user will select similar words. Since there is little information to change, music is likely to be common. Therefore, pursuing the user's originality by such a method is not perfect.
[0006]
Therefore, the present invention has been made paying attention to the above problems, and an object of the present invention is to provide a system capable of generating original music by expanding the range of originality.
[0007]
[Means for Solving the Problems]
That is, the present invention solves the above-described problem, and a transmission source portable terminal device including an input receiving unit that receives an input of a mail address of a portable terminal device that is a transmission destination of the sentence and the sentence, and the transmission of the sentence and the sentence. In a music data generation system comprising a music data generation server device that receives a mail address of a mobile terminal device that is a destination and a mobile terminal device that is a transmission destination of the text, the music data generation server device receives the reception Analyzing means for analyzing the composition of the sentence and the number of characters of the sentence constituent element based on the analysis result by the analyzing means, and generating music data by applying a melody template prepared in advance corresponding to the counted number In addition, the number of characters in the text component is displayed in a melody template prepared in advance corresponding to the count. If not respond decomposes the number of characters, the music data producing means for producing music data by applying a template corresponding to the count number that has been degraded, the destination mobile terminal device music data this generated Media data generation means for converting to a file format that can be output by the mobile station, and the music data generated by the media data generation means is transmitted to the mobile terminal device of the transmission source, and the generation is performed as a result of listening to music based on the music data. A transmission means for transmitting the music data to an e-mail address of the mobile terminal device that is the transmission destination when an instruction input indicating that the received music is acceptable is provided, and the music data is provided to the mobile terminal device of the transmission destination is obtained by the provided output means to output the music based on the data.
[0008]
Further, in such an invention, the media data generating means , when generating the media data, receives a mail from the mobile terminal device serving as the transmission destination, thereby allowing the music data to be output in a format that can be output by the mobile terminal device of the transmission destination. that converts.
[0009]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the present embodiment, portable information terminals 1 and 3 such as mobile phones are used as terminal devices, and music data generation server device 2 is used as a server device. When generating music data, the portable information terminal 1 accepts input of text of a message to be transmitted to the other party, and transmits it to the music data generation server device 2 via the network 4. On the music data generation server device 2 side that has received this text and the other party's e-mail address, the message is subjected to morphological analysis, and music data including melody and chord is generated based on the morphological analysis. And send data to the other party's e-mail address. And the portable information terminal 3 which received this is comprised so that the music and a message may be synchronized and output. Hereinafter, this embodiment will be described in detail.
[0010]
As shown in the block diagram of FIG. 2, the portable information terminals 1 and 3 include an input receiving unit 10 that receives a message input of a sentence composed of a plurality of phrases, and a music data generation server device 2 via a network 4 such as the Internet. Transmitting means 11 for receiving and transmitting data between them, receiving means 13, storage means 12 for storing messages with music generated by the music data generation server device 2, and output means 14 for outputting the stored messages with music And comprising. In addition, the portable information terminals 1 and 2 have other means for performing functions unique to the portable information terminal, such as means for functioning as a normal telephone.
[0011]
The input receiving means 10 for receiving a message input includes operation keys provided in the portable information terminals 1 and 3 and an application for allowing the message to be input. Normally, the operation keys are constituted by a numeric keypad or the like provided on the portable information terminals 1 and 3, but text information may be created from speech using speech recognition technology.
[0012]
The transmission means 11 transmits a message to the music data generation server device 2 via the network 4 such as the Internet. The receiving unit 13 receives a message with music transmitted from the music data generation server device 2.
[0013]
The storage unit 12 stores information necessary for operating the portable information terminals 1 and 3, and music data received from the music data generation server device 2 in addition to an operation execution program for causing the mobile phone to function. And data related to messages.
[0014]
The output unit 14 includes a display output unit such as a display and a voice output unit such as a speaker. The output unit 14 displays and outputs a message transmitted from the music data generation server apparatus 2 and also outputs the music data as audio. Audio is output by the output means. This display output and audio output incorporate a program that outputs in synchronization with each other, and for example, the display form is changed so as to sequentially change the color of the displayed message in accordance with the progress of music.
[0015]
On the other hand, the music data generation server device 2 automatically generates music data based on the received message. The reception unit 20, the analysis unit 21, the meaning determination unit 22, the melody / key determination unit 23, and the note string generation unit. 24, music data generation means 25, media data generation means 26, and transmission means 27.
[0016]
The receiving unit 20 receives data from the portable information terminal 1 via the network 4 and receives text data constituting a message from the portable information terminal 1 and an e-mail address that is a destination for transmitting the message.
[0017]
The analysis means 21 performs a morphological analysis on the message transmitted from the portable information terminal 1. For example, as shown in FIG. 5, the information input by the portable information terminal 1 “is always indebted. If the information contains the word “”, it is hiragana converted and decomposed into “always”, “Osewa”, “has become”, “.”, Etc. Note that this morphological analysis is not limited to the method of decomposing by hiragana conversion, but the method of decomposing “always”, “care for”, “becoming”, “.” By split writing, "Osewa", "ninatteorimasu", "."
[0018]
The meaning judging means 22 judges whether or not a predetermined character string is included in the sentence constituent elements analyzed by the analyzing means 21, and the sentence has a bright meaning as a whole or a sad meaning. Determine if you have one. In this meaning determination, a character string of a positive element, for example, “happy, happy, easy, fun, good, bright, good, light, south, white, top”, etc. is registered in advance. In addition, for example, “sad, sadness, dislike, darkness, evil, bitterness, thought, north, black, and lower” are registered as negative element character strings. Then, the number of positive element character strings and negative element character strings included in the constituent elements of the sentence subjected to morphological analysis is counted.
[0019]
Then, the melody / key determination means 23 compares the number of character strings of the positive elements with the number of character strings of the negative elements, and first determines the melody of the major or minor key. Specifically, if there are many or the same number of character strings of positive elements, the generated music is determined to be major. Conversely, if the number of negative element character strings is larger, the music to be generated is determined to be minor. As for the key of which sound is the main sound, the simple version uses the main sound as the main sound (C), but the normal version uses a method that separately defines the melody generated by C major or c minor (for example, the beginning of a sentence). The main sound is determined by taking mode 7 with the S-JIS code of the character.
[0020]
On the other hand, the note string generating means 24 counts the number of characters of the sentence component subjected to morphological analysis, and generates a note string by applying a melody template prepared in advance corresponding to the counted number. Specifically, first, a plurality of C major templates composed of one sound, two sounds, three sounds, four sounds, and five sounds are prepared. Then, for a character component subjected to morphological analysis, a 1-byte character is counted as “1” in 1 byte, a 2-byte character is counted as “2” in 2 bytes, and an arbitrary number of sounds corresponding to this count number is counted. Apply the template. If the count number of the character component subjected to the morphological analysis exceeds “5”, there is no template to be applied to this, so the count number of the character component is decomposed into an arbitrary count number. Apply the template corresponding to the number of counts. Thus, for example, when the count number “is now” shown in FIG. 5 is “8”, for example, “4” “2” “2” so that the total is “8”. ”As the template corresponding to each count number. Thereby, a note string corresponding to the length of the sentence can be generated.
[0021]
Then, the note string generated by the note string generating unit in this way is generated by the music data generating unit 25 into music corresponding to the message. As shown in FIG. 3, the music data generation means 25 includes a melody (main melody) data generation means 250, an accompaniment data generation means 251, and an accompaniment data addition means 252.
[0022]
The melody data generation means 250 combines the note strings generated by the note string generation means 24 and converts the note string into the melody and key determined by the melody / key determination means 23. When this music is configured as a major, it is normally configured as C major, and when it is configured as a minor, it is configured as c minor with the B, E, and B sounds of the C major lowered by a semitone. . Then, after these processes are performed, the length, repetition, end form, and the like are adjusted so that these melodies become musical as a whole, and this data is passed to the accompaniment data generation means 251.
[0023]
The accompaniment data generation means 251 generates a chord suitable for the progress of the melody based on the generated melody. This chord generation first lists all the chord progressions allowed according to the triad progression for a given melody. This chord progression follows a group of rules called “prohibitions” in harmony, that is, a rule group such as “good to do”, “must do this” or “do not do this”. Takes all the first and second inversion types into consideration, and for the genus chords, the seventh chord and the nine chords are generated up to the inversion type. Then, the chord progression is evaluated according to a preset evaluation table for all the chords generated in this manner, and the chord having the highest evaluation is extracted.
[0024]
The accompaniment data adding means 252 assigns the chord extracted in this way to the melody. In this assignment work, processing such as assigning chords to melody note strings in accordance with the tempo of the melody is performed.
[0025]
The music data generated in this way is integrated with the message by the media data generating means 26 and converted into data that can be transmitted. The generated music data file is converted into, for example, a SMAF MA2 or CMIDI 2.0 format so that the file format can be output by the portable information terminal 3 on the message receiving side. In this file conversion operation, if the output format on the receiving side is not known, for example, an inquiry mail about the model is sent from the music data generation server device 2 to the portable information terminal 3 on the receiving side, and this reply is returned. It may be converted into a format corresponding to the model by receiving it.
[0026]
The transmission unit 27 transmits the music data and the message generated in this way to the portable information terminal 3 that is the reception destination via the network 4.
[0027]
Next, the flow of the music data system 100 configured as described above will be described with reference to FIG.
[0028]
First, when receiving provision of a message transmission service with a melody, the user launches a predetermined application and displays a screen as shown in FIG. 6, and according to this screen, the user inputs a message and the portable information that is the transmission destination of the message. Enter the e-mail address of the terminal. When the portable information terminal 1 accepts the message (step S1), when the message transmission key displayed on the screen is pressed (step S2), information on the message and the destination e-mail address is generated as music data. It transmits to the server apparatus 2 (step S3).
[0029]
Next, on the music data generation server device 2 side receiving this information (step S10), the text information of the message is extracted from the received information (step S11), and this information is subjected to morphological analysis (step S12). . Based on the result of the morphological analysis, first, the number of positive character strings and negative character strings registered in advance in the sentence component is counted (step S13). Then, if there are more positive character strings or the same number based on the count number of the character strings, an output indicating that major music is generated is performed. On the other hand, if there are more negative character strings, an output indicating that minor music is generated is performed (step S14).
[0030]
Then, after determining this melody, this time, the number of characters of the character component subjected to morphological analysis is counted. The number of characters is counted, for example, by counting the number of characters of the character component that has been converted to hiragana (step S15). If the number exceeds the number of sounds of the template prepared in advance, the number of characters is counted as the template. Decompose into any number of characters that apply to the number of notes. Then, a template corresponding to the number of characters counted in this way is applied (step S16), and a conversion process of the melody is performed based on the melody determined in step S14 (step S17). If the melody determined in step S14 is in major key, no conversion process is performed, and if the melody determined in that step is in minor key, the B sound of the note string composed of C major, The E and A sounds are processed so as to be reduced by a chromatic scale. For other tones, C major or c minor is transposed by translation. Finally, in order to correct the melody thus generated to a musical melody as a whole, correction work such as length, repetition and end form is performed (step S18).
[0031]
Next, the melody thus generated is coded. For this reason, the melody is transferred to the accompaniment data adding means 251, where a chord corresponding to the melody is generated (step S19), and the chord is added to the melody (step S20).
[0032]
Finally, a message is added to the generated music to generate media data, and necessary format conversion processing is performed (step S21). The generated media data is transmitted to the message creator based on the confirmation request from the message creator (step S22, step S4), and output from the portable information terminal 1 for viewing. (Step S5). Then, when it is instructed that the generated music should be “good” or “remade” as a result of viewing (step S6), the viewing result is transmitted to the melody generation server device 2. (Step S7) When the result of viewing / listening is a result of “re-creating” (Step S23: NG), the process returns to Step S16 to regenerate a melody. On the other hand, if the result of viewing is “good” (step S23: YES), the generated media data is transmitted to the e-mail address of the creator's partner (step S24) and received. On the portable information terminal 3 side (step S30), information on the music data and the message is stored (step S31), and the music and the message are synchronized and output based on the output instruction (step S32). (Step S33).
[0033]
As described above, in the above embodiment, the mobile terminal device that is the transmission source accepts input of the text and the mail address of the mobile terminal device that is the transmission destination of the text, and the configuration of the accepted text is the music data generation server device side. The number of characters in the sentence component is counted, and music data is generated by applying a melody template prepared in advance corresponding to the counted number. The number of characters in the sentence component corresponds to the counted number. If the template does not correspond to the melody template prepared in advance, the number of characters is decomposed, the music data is generated by applying the template corresponding to the decomposed count number, and the generated music data is sent to the destination. After converting to a file format that can be output by the mobile terminal device, it is transmitted to the mobile terminal device of the transmission source, and the music data As a result of listening to music based on the above, if an instruction indicating that the generated music is acceptable is input, the music data is transmitted to the e-mail address of the mobile terminal device as the transmission destination. Even when music is attached to a message and transmitted like a card, the message can be given originality.
[0034]
In addition, when media data is generated, music data is converted into a format that can be output by the mobile terminal device of the transmission destination by receiving mail from the mobile terminal device of the transmission destination. The device can reliably output music based on the music data.
[0035]
In addition, this invention is not limited to the said embodiment, It can implement in a various aspect.
[0036]
For example, in the above embodiment, music data composed of melody and chord is generated, but music composed only of melody may be generated.
[0037]
In the above embodiment, the message and the music data are transmitted to the third-party portable information terminal 3. However, the present invention is not limited to this, and the generated music data is transmitted to itself. Also good. In this case, for example, if a sentence is input as lyrics, music data corresponding to the length of the lyrics can be generated on the music data generation server device 2 side, so that music with lyrics can be generated. In this case as well, if the music and text are output in synchronization, the music can be used as karaoke.
[0038]
In the above embodiment, when the result of viewing matches with NG, the template fitting operation is performed again. However, a message prompting the user to re-enter the text is performed, and the new message is used. The melody generation may be performed again.
[0039]
【The invention's effect】
In the present invention receives an input of mail address of the mobile terminal device which is the destination of the sentence and the sentence in the source of the portable terminal apparatus, sentence structure analyzes the structure of the received sentence music data generation server-side Count the number of characters in the element, apply the melody template prepared in advance corresponding to the number of counts to generate music data, and the number of characters in the sentence component corresponds to the number of characters in the melody prepared in advance If it does not correspond to the template, the number of characters is decomposed, the music data is generated by applying the template corresponding to the decomposed count number, and the generated music data can be output by the portable terminal device of the transmission destination After converting to a new file format, send it to the mobile terminal device that sent it, Since the music data is transmitted to the e-mail address of the mobile terminal device as the transmission destination when an instruction is input indicating that the generated music is acceptable, the original data is created from a meaningful sentence created independently. Music can be generated.
[Brief description of the drawings]
FIG. 1 is an overview diagram of a music data generation system according to the present embodiment. FIG. 2 is a functional block diagram according to the embodiment. FIG. 3 is a detailed functional block diagram of music data generation means according to the embodiment. FIG. 5 is a diagram showing morphological analysis in the same form. FIG. 6 is a display example of a portable information terminal in the same form.
DESCRIPTION OF SYMBOLS 1, 3 ... Portable information terminal 2 ... Music data generation server apparatus 4 ... Network 10 ... Input reception means 14 ... Output means 21 ... Analysis means 25 ... Music data generation means 251 ... Accompaniment data generation means 252 ... Accompaniment data addition means

Claims (4)

Receiving the e-mail address of the source mobile terminal device provided with the input receiving means for accepting the input of the e-mail address of the e-mail address of the mobile terminal device that is the text and the text destination, and the e-mail address of the mobile terminal device that is the destination of the text and text In a music data generation system comprising a music data generation server device and a portable terminal device to which the text is transmitted,
In the music data generation server device, the analyzing means for analyzing the composition of the received sentence, and the number of characters of the sentence constituent element are counted based on the analysis result by the analyzing means, and a melody prepared in advance corresponding to the counted number If the template is applied to generate music data, and the number of characters in the sentence component does not correspond to the melody template prepared in advance corresponding to the count, the number of characters is decomposed and the decomposed count Music data generating means for generating music data by applying a template corresponding to the number, media data generating means for converting the generated music data into a file format that can be output by the portable terminal device of the transmission destination, and the media The music data generated by the data generation means is transmitted to the mobile terminal device that is the transmission source. The music data based on the music listening result, when the instruction input may be the generated music is made, and transmitting means for transmitting the music data to the mail address of the mobile terminal device serving as the transmission destination Provided,
A music data generation system, characterized in that an output means for outputting music based on the music data is provided in the transmission destination portable terminal device. 2. The music data according to claim 1, wherein the media data generating means converts the music data into a format that can be output by the portable terminal device of the transmission destination by receiving an email from the portable terminal device of the transmission destination. Generation system. A music data generation server device that generates music data based on text received by a mobile terminal device, and receives text input on the mobile terminal device side and a mail address of the mobile terminal device to which the text is transmitted The receiving means, the analyzing means for analyzing the composition of the received sentence, the number of characters of the sentence constituent element is counted based on the analysis result by the analyzing means, and a melody template prepared in advance corresponding to the counted number is obtained. When music data is generated by fitting, the number of characters in the sentence component does not correspond to the melody template prepared in advance corresponding to the count number, the number of characters is decomposed, and the corresponding count number is resolved. A music data generation means for generating music data by applying a template, and the generated music data Media data generating means for converting to a file format that can be output by the mobile terminal device of the transmission destination, music data generated by the media data generating means is transmitted to the mobile terminal device of the transmission source, and music based on the music data As a result of the audition, the transmission means for transmitting the music data to the e-mail address of the mobile terminal device as the transmission destination when an instruction input indicating that the generated music is acceptable is provided. A music data generation server device. 4. The music data according to claim 3, wherein the media data generating means converts the music data into a format that can be output by the destination mobile terminal device by receiving an email from the destination mobile terminal device. Generation server device.

Images