JP2019008336A - Musical performance apparatus, musical performance program, and musical performance pattern data generation method - Google Patents

Abstract

To provide a musical performance apparatus capable of extracting musical elements from an acoustic signal of a desired musical piece and reproducing a musical performance pattern on the basis of the extracted musical elements.SOLUTION: A musical performance apparatus 10 includes a plurality of operators. The musical performance apparatus 10 extracts a plurality of acoustic waveforms of predetermined music elements from an acoustic signal according to an algorithm for extracting the acoustic waveforms of the predetermined musical elements included in the acoustic signal. The musical performance apparatus 10 assigns the extracted acoustic waveforms to each of the plurality of operators. The musical performance apparatus 10 selects one operator, which is under operation, out of the plurality of operators and generates musical performance pattern data representing the musical performance pattern by using the acoustic waveform assigned to the selected operator.SELECTED DRAWING: Figure 6

Description

  The present invention extracts a plurality of types of music elements included in an acoustic signal (acoustic waveform data) of music and generates waveform data representing each music element, and uses the generated waveform data. It is related with the performance apparatus and performance program which can be performed. The present invention also relates to a method for generating performance pattern data.

  2. Description of the Related Art Conventionally, a performance device having an automatic accompaniment function is known as described in Patent Document 1 below, for example. This performance device stores a plurality of types of accompaniment style data sets in advance. Each accompaniment style includes an “intro” section used as an accompaniment for the introductory part of the music, a “main” section used as an accompaniment for the middle part of the music, an “ending” section used as an accompaniment at the end of the music, etc. It is composed of a plurality of sections corresponding to each scene of the music. The data of each section represents a short phrase (performance pattern) of a musical accompaniment part (for example, an ensemble such as a percussion instrument part, a bass part, or a piano (chord) part). The data of each section is so-called MIDI data. That is, the data of each section does not represent the acoustic waveform of the performance sound, but is data corresponding to the musical score of each accompaniment part, and is converted into an acoustic waveform signal by synthesizing musical sounds by a tone generator circuit.

  The operation panel of the performance device is provided with a plurality of switches for selecting a section to be played. Section data is assigned to each of these switches. When the performer selects a section to perform using the switch and inputs a chord (chord) using the keyboard device, the controller of the performance device adds the selected section data and the input chord. Based on this, the tone generator circuit is controlled to cause the tone generator circuit to generate performance pattern data representing the performance pattern. The data of each section of each accompaniment style is not prepared for each chord type and its root note, but when the chord type is “M (major)” and the root note is “C” Only the data of is prepared. When other chord types and root sounds are designated, the pitches of the data constituting sounds are often changed (shifted) as appropriate. That is, when the chord input by the performer using the keyboard device is “CM”, the data of the currently selected section is supplied to the tone generator circuit as it is. On the other hand, when the chord input by the performer is different from “CM”, the control unit of the performance device corrects the data of the currently selected section. For example, when the chord input by the performer is “Cm (minor)”, the key pitch is “E” in the constituent sound data (note number) constituting the data of the currently selected section. The data of the constituent sound that represents a certain thing is changed to data that represents “E「 ”.

JP 2011-137881 A JP2012-203216A

  The data of each section of the accompaniment style of the performance device described in Patent Document 1 is MIDI data, and only the data corresponding to “CM” needs to be stored as described above. It's small. However, the accompaniment performance pattern to be reproduced is generated by the tone generator circuit in accordance with the MIDI data, and may seem unattractive compared to the live performance or the recorded data.

  Therefore, for example, as described in Patent Document 2, a performance device is also known in which the data of each section of each accompaniment style is composed of waveform data representing an acoustic waveform. In this performance device, the waveform data of each section of each accompaniment style is created and stored in advance by the device manufacturer, and the user cannot create and add them according to his / her preference. . Further, waveform data of a plurality of music elements including accompaniment styles are produced and stored, and the user cannot freely select waveform data that is to be used supplementarily when performing. Accordingly, variations of performance patterns that are used supplementarily while playing a melody or the like are limited to preset ones.

  The present invention has been made in order to address the above-described problems, and an object of the present invention is to provide a performance device capable of reproducing a performance pattern of a plurality of music elements representing a performance such as a live performance, from an acoustic signal of a desired music piece. An object of the present invention is to provide a performance device capable of extracting music elements and reproducing a performance pattern based on the extracted music elements. In addition, in the description of each constituent element of the present invention below, in order to facilitate understanding of the present invention, reference numerals of corresponding portions of the embodiment are described in parentheses, but each constituent element of the present invention is The present invention should not be construed as being limited to the configurations of the corresponding portions indicated by the reference numerals of the embodiments.

  In order to achieve the above object, the present invention is characterized by a plurality of operators (11) and an acoustic signal acquisition means (S12) for acquiring an acoustic signal representing an acoustic waveform of a performance sound emitted by playing a musical piece. And a music element extraction means (S14) for extracting the acoustic waveforms of the predetermined music elements from the acoustic signal according to an algorithm for extracting the acoustic waveforms of the predetermined music elements included in the acoustic signal, and the extraction And assigning means (S15) for assigning the plurality of acoustic waveforms to the plurality of operators, and selecting one of the plurality of operators being operated, and assigning the selected operator to the selected operator Performance pattern data generating means (S100 to S117, S200 to S204) for generating performance pattern data representing a performance pattern using an acoustic waveform, It lies in the fact that with the.

  In this case, the performance device may include an operator that is different from the plurality of operators and sets whether or not to generate the performance pattern data.

  Further, in this case, the performance pattern data generation means selects a last operated operator from the plurality of operators, and represents a performance pattern using an acoustic waveform assigned to the selected operator. It is preferable to generate performance pattern data.

  In this case, the music element may be a performance pattern of a rhythm part of the music or a performance pattern of a bridge portion of the music.

  According to the performance device configured as described above, a music element can be extracted from a desired musical piece, and performance pattern data can be generated based on the acoustic waveform of the extracted music element. In other words, the acoustic waveform of the music element is not stored in advance in the performance device, but the acoustic waveform of the music element is extracted from the desired musical composition. That is, the performance pattern data is not generated by the tone generator circuit based on the MIDI data, but is generated based on the acoustic waveforms of some music elements of the original music. Therefore, according to the performance device of the present invention, an attractive performance pattern such as a live performance can be reproduced.

  The present invention is not limited to implementation as a performance device, but can also be implemented as a computer program (performance program) applied to a computer included in the performance device or a performance pattern data generation method applied to the performance device.

It is the schematic showing the outline of the performance apparatus which concerns on one Embodiment of this invention. It is the enlarged view to which the music element switch of FIG. 1 was expanded. It is a block diagram which shows the structure of the performance apparatus of FIG. It is a flowchart which shows an audio music element data set production | generation program. It is a conceptual diagram which shows the correspondence of the acoustic waveform data showing performance of the accompaniment part of an original music, reference | standard waveform data, and the extracted accompaniment waveform data. It is a conceptual diagram which shows the correspondence of each waveform data and operation element. It is a flowchart which shows the first half part of a performance pattern data generation program. It is a flowchart which shows the second half part of a performance pattern data generation program. It is a flowchart which shows a performance pattern data supply program.

  A performance device 10 according to an embodiment of the present invention will be described. As will be described below, the performance device 10 takes in acoustic waveform data (for example, a digital audio signal in wav format) representing an acoustic waveform of a musical performance sound, and from the acoustic waveform data, a plurality of accompaniment waveform data, a plurality of pieces of accompaniment waveform data, Rhythm waveform data and a plurality of bridge waveform data are extracted, and an audio music element data set composed of the extracted waveform data is generated. Hereinafter, the music used to generate the audio music element data set is referred to as an original music. The accompaniment waveform data is extracted from performance patterns extracted from accompaniment parts (eg, ensemble of drum part, bass part, and piano (chord) part) excluding the main melody part (eg, vocal part and melody part) of the original music Represents the acoustic waveform. The accompaniment waveform data, like the MIDI accompaniment style data, usually represents a performance of several measures, and is generated by being selected for each scene (section) such as the introduction portion, the intermediate portion, and the end portion of the original song. . The rhythm waveform data represents an acoustic waveform of a performance pattern extracted from the rhythm part (drum part) of the original music. The rhythm waveform data is configured for each section (for example, two bars) of the original music. Further, the bridge waveform data represents an acoustic waveform of the performance of the bridge (rust) portion including a characteristic melody line in the traveling direction of the original music. Note that the performance device 10 can store audio music element data sets of a plurality of music pieces. The performer selects one audio music element data set that matches the music to be played, and selects the waveform data of the desired music element from the selected audio music element data set as the music performance progresses. A performance pattern based on the waveform data can be reproduced by selecting using the operation element. For example, the performer designates a desired accompaniment, rhythm, and bridge (rust) performance pattern by actually playing a melody part with the right hand and selecting an operator with the left hand. Thereby, the performance pattern of the desired music previously extracted and stored can be used as an accompaniment or an auxiliary performance for the performance of the melody part.

  The performance apparatus 10 also includes a plurality of accompaniment style data sets (hereinafter referred to as MIDI accompaniment style data sets) composed of MIDI data, as in the conventional performance apparatus. The performer can also select one MIDI accompaniment style data set and perform using the selected MIDI accompaniment style data set.

  As shown in FIGS. 1 to 3, the performance device 10 includes an input operator 11, a computer unit 12, a display 13, a storage device 14, an external interface circuit 15, a tone generator circuit 16, and a sound system 17. Are connected via a bus BUS.

  The input operator 11 includes a switch corresponding to an on / off operation, a volume or rotary encoder corresponding to a rotation operation, a volume or linear encoder corresponding to a slide operation, a mouse, a touch panel, and the like. Further, the input operator 11 also includes a keyboard device KY used when playing music. These operators are operated by a player's hand to set various parameters, and are used when playing music. The input operator 11 may include, for example, an electronic organ foot keyboard. When the performer operates the input operator 11, operation information indicating the operation content is supplied to the computer unit 12 described later via the bus BUS.

  For example, as shown in FIG. 2, the input operator 11 includes a music element switch PS. The music element switch PS includes a section selection switch SS. The section selection switch SS includes an intro switch IS, a main switch MS1, a main switch MS2, a main switch MS3, a fill-in switch FS, and an ending switch ES. These switches are used to select a desired section when reproducing the accompaniment style (MIDI and waveform data). Therefore, two or more of the intro switch IS, the main switch MS1, the main switch MS2, the main switch MS3, the fill-in switch FS, and the ending switch ES are not set to the ON state at the same time, and only one switch is set. Set to the on state.

  The music element switch PS includes a rhythm switch RS and a bridge switch BS. The rhythm switch RS is used when performing using the rhythm waveform data. The bridge switch BS is used when performing using the bridge waveform data. One of the section selection switches SS, the rhythm switch RS, and the bridge switch BS can be set to the ON state at the same time. That is, the performer can reproduce and play the accompaniment waveform data, rhythm waveform data, and bridge waveform data alone, or can reproduce and perform them in combination.

  The performance device 10 has a plurality of operation modes, and the input operator 11 is used when switching between these operation modes. The operation mode includes an audio music element data set generation mode for generating an audio music element data set based on the acoustic waveform data of an existing music piece, and audio music played using an audio music element data set that has been generated and stored in advance. Element playing mode is included.

  The computer unit 12 includes a CPU 12a, a ROM 12b, and a RAM 12c connected to the bus BUS. The CPU 12a reads out and executes an audio music element data set generation program, an audio music element performance program, etc., which will be described later in detail, from the ROM 12b. In the ROM 12b, in addition to an audio music element data set generation program (including first to third algorithms described later), an audio music element performance program, and other programs, initial setting parameters and an image displayed on the display unit 13 are stored. Graphic data and character data for generating display data to be represented are stored. The RAM 12c temporarily stores various data including music data when executing various programs.

  The display 13 is configured by a liquid crystal display (LCD). The computer unit 12 generates display data representing contents to be displayed using graphic data, character data, and the like, and supplies the display data to the display unit 13. The display device 13 displays an image based on the display data supplied from the computer unit 12. For example, the name of the currently selected audio music element data set is displayed.

  The storage device 14 includes a large-capacity nonvolatile recording medium such as an HDD, a CD, and a DVD, and a drive unit corresponding to each recording medium. The storage device 14 stores a plurality of acoustic waveform data representing the acoustic waveforms of a plurality of music pieces. The acoustic waveform data is composed of a plurality of sample values obtained by sampling a music piece at a predetermined sampling period (for example, 1/444100 seconds), and each sample value is recorded in order at consecutive addresses in the storage device 14. Title information representing the title of the music, data size information representing the capacity of the acoustic waveform data, and the like are also included in the acoustic waveform data. The acoustic waveform data may be stored in the storage device 14 in advance, or may be acquired from an external device via the external interface circuit 15 described later.

  The external interface circuit 15 includes a connection terminal that allows the performance apparatus 10 to be connected to an external device such as another electronic musical instrument or a personal computer. The performance device 10 can also be connected to a communication network such as a LAN (Local Area Network) or the Internet via the external interface circuit 15.

  Connected to the tone generator circuit 16 is a waveform memory WM that stores timbre waveform data representing the acoustic waveforms of a plurality of instrument sounds such as piano, organ, violin, trumpet and the like. The tone generator circuit 16 reads the timbre waveform data designated by the CPU 12 a from the waveform memory WM, generates musical waveform data of musical sound based on the note information of the MIDI data supplied from the CPU 12 a, and supplies it to the sound system 17. For example, when performing using the MIDI accompaniment style data set, the tone generator circuit 16 generates performance pattern data representing the acoustic waveform of the performance pattern corresponding to each section and supplies the performance pattern data to the sound system 17. The performance device 10 is configured to be able to store the performance pattern data generated by the sound source circuit 16 in the storage device 14. Note that an effector circuit for adding various effects such as a chorus effect and a reverberation effect to the performance sound is also included in the tone generator circuit 16.

  The sound system 17 includes a melody part in which the tone generator circuit 16 sequentially synthesizes musical sounds based on MIDI performance data generated by the performer using the input operation element 11 (keyboard device KY) for performance operation. Performance sound data is also provided. As will be described later in detail, the performance pattern data generated based on the audio music element data set is also supplied to the sound system 17 from the CPU 12a. The sound system 17 superimposes and adds the performance sound data and performance pattern data, and converts the analog sound signal into a D / A converter, an amplifier that amplifies the converted analog audio signal, and the amplified analog audio signal as an acoustic signal. A pair of left and right speakers that convert sound into sound and emit sound are provided. Note that all or part of the functions of the tone generator circuit 16 and the sound system 17 may be realized by a program executed by the CPU 12a, instead of dedicated hardware.

  Next, a procedure for generating an audio music element data set will be described. When the performer sets the operation mode of the performance device 10 to the audio music element data set generation mode using the input operator 11, the CPU 12a reads the audio music element data set generation program shown in FIG. 4 from the ROM 12b and executes it. To do. In step S10, the CPU 12a starts an audio music element data set generation process. Next, CPU12a displays the title of the music memorize | stored in the memory | storage device 14 on the display 13 in step S11. The performer uses the input operator 11 to select a desired piece of music (in this embodiment, “Song01”). In step S12, the CPU 12a reads acoustic waveform data representing the acoustic waveform of the selected music piece from the storage device 14 (for example, an audio CD).

  The performance device 10 applies a first algorithm, a second algorithm, and a third algorithm to the read acoustic waveform data, respectively, so that a plurality of accompaniment waveform data, rhythm waveform data, Bridge waveform data can be generated. The performance device 10 is configured to be able to select an algorithm to be applied to the read acoustic waveform data from among the first algorithm, the second algorithm, and the third algorithm. That is, the CPU 12a causes the player to select an algorithm to be applied to the read acoustic waveform data in step S13. For example, the CPU 12a displays icons (not shown) corresponding to the first algorithm, the second algorithm, and the third algorithm on the display unit 13, respectively. The performer uses the input operator 11 to select one or more of the first algorithm, the second algorithm, and the third algorithm, and instructs the start of generation of the audio music element data set.

  Next, in step S14, the CPU 12a applies the selected algorithm or algorithms to the read acoustic waveform data. As a result, among the plurality of accompaniment waveform data, the plurality of rhythm waveform data, and the plurality of bridge waveform data, waveform data corresponding to the selected algorithm is generated, and the generated waveform data is assigned to the input operator 11. .

  The first algorithm is a technique for extracting acoustic waveform data representing an accompaniment performance pattern from audio music data, and is realized, for example, by using an algorithm described in Japanese Patent Application Laid-Open No. 2014-029425. That is, the CPU 12a first causes the tone generator circuit 16 to generate performance pattern data representing each performance pattern using each MIDI accompaniment style data set, and stores it in the storage device 14 as reference waveform data (reference data of the present invention). The reference waveform data is generated for each accompaniment section. Further, reference waveform data of each chord (that is, all root sounds and chord types) is generated for one accompaniment section. That is, the reference waveform data is a phrase of a predetermined length (for example, two bars) generated by specifying one chord in a state where one MIDI accompaniment style data set is selected and one accompaniment section is selected. Represents the acoustic waveform. The name of the reference waveform data is set to a name obtained by concatenating the name of each MIDI accompaniment style data set, a section name, and a chord name with “_”. For example, as shown in FIG. 5, the name of the reference waveform data is set to “StyleM1_Intro_Am”.

  Next, the CPU 12a applies a known algorithm (for example, Japanese Patent Laid-Open No. 11-38980) to the acoustic waveform data of the original song, and generates the acoustic waveform data of the accompaniment part by excluding the vocal part and the melody part from the original song. To do. Next, the CPU 12a divides the generated acoustic waveform data of the accompaniment part into a plurality of sections t1, t2,. Next, the CPU 12a detects the reference waveform data having the highest similarity for each section by comparing the acoustic waveform data of each section obtained by the division and each reference waveform data. Then, the acoustic waveform data of the section corresponding to the section of the detected reference waveform data is cut out (extracted) from the acoustic waveform data of the original music, and the section name of the detected reference waveform data is extracted from the extracted acoustic waveform data. In addition, the accompaniment waveform data is stored in association with the chord name. For example, as shown in FIG. 5, the title including the title of the original music, the section name and the chord name of the detected reference waveform data is set as the name of the accompaniment waveform data, and the accompaniment waveform data is stored in the storage device 14. To do. In the example shown in FIG. 5, the title of the original song is “Song01”. The section name of the reference waveform data most similar to the acoustic waveform data in the section t1 is “Intro”, and the code name is “Am”. Therefore, in this case, the CPU 12a sets the name of the acoustic waveform data in the section t1 to “Song01_Intro_Am.wav” and stores it in the storage device 14 as accompaniment waveform data. That is, the name of each accompaniment waveform data is set to a name obtained by connecting the title of the music, the section name of the detected reference waveform data, and the chord name via “_”. According to this, the section and chord of the accompaniment waveform data can be identified by the name of the accompaniment waveform data. For other sections, the names of the accompaniment waveform data are set according to the same rules as those of the section t1, and the accompaniment waveform data is stored in the storage device 14. In the present embodiment, the reference waveform data represents a performance pattern for two measures. Accordingly, accompaniment waveform data similar to the performance pattern also represents a performance pattern for two measures.

  The second algorithm is described in, for example, “K. Miyamoto et al.,“ Separation of harmonic and non-harmonic sounds based on anisotropy in spectroscopy ”, Proc. Of ASJ Spring 90, et al. Includes similar algorithms. That is, the CPU 12a first calculates a spectrogram of the original music using the read acoustic waveform data. In general, the energy of percussion instrument performance sounds (single notes) tends to be widely distributed in the frequency axis direction and in a narrow range in the time axis direction in the spectrogram. On the other hand, the energy of a performance sound (single tone) of a piano, guitar, etc. tends to be distributed at intervals in the frequency axis direction and in a wide range in the time axis direction. Focusing on the characteristics of the performance sound of each instrument as described above, the rhythm part of the original song and other performance parts are separated. That is, the CPU 12a generates acoustic waveform data representing the performance of only the original rhythm part based on the calculated spectrogram. Then, the CPU 12a divides the acoustic waveform data representing the performance of only the generated rhythm part into a plurality of sections. In the present embodiment, in order to simplify the description, the length of these sections is the same as the length of the accompaniment waveform data (that is, the length of two bars in the present embodiment).

  Next, the CPU 12a selects 12 pieces of acoustic waveform data having a low degree of similarity among the plurality of pieces of acoustic waveform data formed by division. Then, the names of the 12 selected acoustic waveform data are listed in order from the acoustic waveform data located at the beginning of the music to the acoustic waveform data located at the end, “Song01_Rhythm1.wav”, “Song01_Rhythm2.wav”, ..., set to "Song01_Rhythm12.wav" and stored in the storage device 14 as rhythm waveform data.

  The third algorithm includes, for example, an algorithm similar to the algorithm described in Japanese Patent Application Laid-Open No. 2004-233965. That is, the CPU 12a divides the read acoustic waveform data into a plurality of sections, and calculates a chroma vector for each section. Then, the degree of similarity between the chroma vectors in each section is calculated, and sections that repeatedly appear are extracted as bridge sections based on the calculated similarity. In this embodiment, 12 bridge sections are extracted. For example, 12 bridge sections are extracted in descending order of the number of appearances. In the present embodiment, in order to simplify the description, the length of each bridge section is the same as the length of the accompaniment waveform data (that is, the length of two bars in the present embodiment). Next, the CPU 12a names the extracted acoustic waveform data of the 12 bridge sections in the order of “Song01_Bridge1.wav” and “Song01_Bridge2” in order from the bridge section on the head side to the bridge section on the end side of the original music. .Wav ”,...,“ Song01_Bridge12.wav ”and stored in the storage device 14 as bridge waveform data.

  Next, in step S15, the CPU 12a assigns the generated accompaniment waveform data, rhythm waveform data, and bridge waveform data to a predetermined input operator 11 as shown in FIG. For example, the keyboard device KY used for assigning each accompaniment waveform data to the switch including the same name as the section name of each stored accompaniment waveform data and for specifying a chord among the section selection switches SS is configured. Assigned to one key or a combination of keys (hereinafter simply referred to as accompaniment waveform data). That is, the CPU 12a generates a table representing the correspondence relationship between the accompaniment waveform data and each switch and key, and stores it in the storage device 14. When performing by using the accompaniment waveform data, the performer uses one or a plurality of keys belonging to a predetermined first key range (for example, “C2” to “B2”) of the keyboard device KY. input.

  As shown in FIG. 6, for example, “Song01_Intro_Am.wav” is assigned to the intro switch IS. In this example, only one accompaniment waveform data is assigned to the intro switch IS. In this case, “Song01_Intro_Am.wav” is assigned to all codes. In other words, when the intro switch IS is turned on and any chord is input during performance using the audio music element data set, “Song01_Intro_Am.wav” is performance pattern data representing a performance pattern. Is set to be selected as data for generating

  As shown in FIG. 6, for example, “Song01_Main1_FM.wav” is assigned to the main switch MS1. In this example, there are a plurality of accompaniment waveform data whose section name is “Main1” and whose chord name is different from “FM”. These accompaniment waveform data are also assigned to the main switch MS1. When a plurality of accompaniment waveform data is assigned to the same switch as described above, each accompaniment waveform data is first assigned to the same code as the chord name included in the name of each accompaniment waveform data. For example, “Song01_Main1_FM.wav” is assigned to “FM”. Furthermore, accompaniment waveform data with a name including a chord name that is closest to the chord is assigned to a code different from the code of any accompaniment waveform data. For example, when “Fm” is not assigned to any accompaniment waveform data, “Song01_Main1_FM.wav” is also assigned to “Fm”. In this case, when performing using the audio music element data set, when the main switch MS1 is set to the on state and “FM” or “Fm” is input as a chord, “Song01_Main_FM.wav” is a performance pattern. Is set to be selected as data for generating performance pattern data representing

  Further, the CPU 12a assigns each rhythm waveform data to the rhythm switch RS, and also belongs to a predetermined second key range (for example, “C3” to “B3”) among a plurality of keys constituting the keyboard device KY. Assign them so that they do not overlap each other. That is, the CPU 12a generates a table representing the correspondence between each rhythm waveform data and the combination of the rhythm switch RS and the key and stores it in the storage device 14. When performing by using the rhythm waveform data, the performer presses one key belonging to a predetermined second key range (for example, “C3” to “B3”) of the keyboard device KY to input the rhythm waveform data. Select. As shown in FIG. 6, when performing using the audio music element data set, for example, when the rhythm switch RS is set to the on state and “C3” of the keyboard device KY is pressed, “Song01_Rhythm1. “wav” is set to be selected as data for generating performance pattern data representing a performance pattern.

  Further, the CPU 12a assigns each bridge waveform data to the bridge switch BS and assigns the keys to the keys belonging to a predetermined third key range (for example, “C4” to “B4”) of the keyboard device KY so as not to overlap each other. That is, the CPU 12a generates a table representing the correspondence between each bridge waveform data and the combination of the bridge switch BS and the key and stores the table in the storage device 14. As shown in FIG. 6, when performing using the audio music element data set, for example, when the bridge switch BS is set to the on state and “C4” of the keyboard device KY is pressed, “Song01_Bridge1. “wav” is set to be selected as data for generating performance pattern data representing a performance pattern.

  Note that one waveform data among the plurality of generated accompaniment waveform data, a plurality of rhythm waveform data, and a plurality of bridge waveform data represents the acoustic waveform of the music element of the present invention. Also, one switch of the music element switches PS to which one waveform data among the plurality of generated accompaniment waveform data, a plurality of rhythm waveform data, and a plurality of bridge waveform data is assigned, and one or An operator group composed of a plurality of keys corresponds to the operator group of the present invention.

  The name of the audio music element data set composed of the plurality of accompaniment waveform data, the plurality of rhythm waveform data, and the plurality of bridge waveform data generated as described above is referred to as “Song01”, which is the title of the tune of the generation source. In association, it is set to “Song01_Component”. That is, the name of the audio music element data set is set to a name in which the title of the music and “Component” are combined with “_”.

  Returning to the description of FIG. After generating the audio music element data set as described above, the CPU 12a ends the audio music element data set generation process in step S16.

  Next, a procedure for generating performance pattern data representing performance patterns such as accompaniment style, rhythm, and bridge using the audio music element data set and supplying the performance pattern data to the sound system 17 will be described. When the performer sets the operation mode of the performance device 10 to the audio music element performance mode using the input operator 11, the CPU 12a reads the audio music element performance program from the ROM 12b and executes it. The audio style performance program includes a performance pattern data generation program shown in FIGS. 7A and 7B and a performance pattern data supply program shown in FIG.

  First, the performance pattern data generation program will be described. In step S100, the CPU 12a starts a performance pattern data generation process. Next, the CPU 12a executes an initialization process in step S101. For example, a predetermined value (for example, “0”) is written in an area (for example, first to fourth areas described later) of the RAM 12b used in this program.

  Next, in step S102, the CPU 12a displays the names of the audio music element data sets stored in the storage device 14 on the display unit 13 in a list format. Prior to the performance operation, the performer selects one audio music element data set (for example, “Song01_Component”) using the input operator 11. Next, in step S103, the CPU 12a detects whether any one of the section selection switches SS is set to an on state. When all the switches are in the off state, the CPU 12a determines “No” and advances the process to step S109. On the other hand, when any one of the section selection switches SS is in an on state, the CPU 12a presses at least one of the keys belonging to the first key range in step S104. Detect whether or not. If no key is pressed, the CPU 12a determines “No” and advances the process to step S109. On the other hand, if at least one of the keys is depressed, the CPU 12a detects the pitch of the currently depressed key and detects the currently input chord in step S105.

  Next, in step S106, the CPU 12a stores, in the predetermined first area of the RAM 12b, the accompaniment waveform data assigned to the currently selected switch of the section selection switch SS and the detected chord. Read. Next, in step S107, the CPU 12a determines whether or not the code of the read accompaniment waveform data is the same as the detected code. If the code of the read accompaniment waveform data is the same as the detected code, the CPU 12a determines “Yes” and proceeds to step S109. On the other hand, if the code of the read accompaniment waveform data is different from the detected code, the CPU 12a determines “No”, and in step S108, the read accompaniment waveform data is changed to the detected code. Correct it.

  As described above, the accompaniment waveform data extracted by the first algorithm in FIG. 6 is read out by the same operation as the operation of designating the MIDI accompaniment style section and chord.

  For example, the intro switch IS is set to the on state and the “A” key and the “G #” key in the first key range are pressed (simple code designation method), or the “A” key and “C”. It is assumed that the “Am” code is input (designated) by pressing the key and the “E” key (normal code designating method). In this embodiment, as shown in FIG. 6, “Song01_Intro_Am.wav” is assigned to the intro switch IS and all codes. Therefore, “Song01_Intro_Am.wav” is read into the first area. In this example, since the input chord and the accompaniment waveform data chord are the same, the CPU 12a advances the process to step S109 while holding “Song01_Intro_Am.wav” in the first area. On the other hand, it is assumed that the intro switch IS is set to an on state and “AM” is input as a code. As described above, since “Song01_Intro_Am.wav” is assigned to all codes, “Song01_Intro_Am.wav” is also selected in this case. In this example, the input chord and the accompaniment waveform data code are different. Therefore, the CPU 12a applies a well-known algorithm (for example, JP2012-203219A) to “Song01_Intro_Am.wav”. That is, among the musical tones that make up “Song01_Intro_Am.wav”, the musical tones whose key pitch is “C” are separated, the separated musical tones are pitch-changed to “C #”, and then re-synthesized. In this way, the code of “Song01_Intro_Am.wav” is corrected to “AM”.

  Next, in step S109, the CPU 12a detects whether or not the rhythm switch RS is set to an on state. If the rhythm switch RS is in the off state, the CPU 12a determines “No” and proceeds to step S112. On the other hand, when the rhythm switch RS is in the on state, the CPU 12a detects whether or not at least one of the keys belonging to the second key range is pressed in step S110. If no key is pressed, the CPU 12a determines “No” and advances the process to step S113. On the other hand, when at least one of the keys is pressed, the CPU 12a finally presses the key among the keys that belong to the second key area and are currently pressed in step S111. The key pitch of the key that has been recorded is detected. Next, in step S112, the CPU 12a reads the rhythm waveform data assigned to the detected key pitch into a predetermined second area in the RAM 12b.

  Next, in step S113, the CPU 12a detects whether or not the bridge switch BS is set to an on state. If the bridge switch BS is in the off state, the CPU 12a determines “No” and proceeds to step S117. On the other hand, when the bridge switch BS is in the on state, the CPU 12a detects whether or not at least one of the keys belonging to the third key range is pressed in step S114. If no key is pressed, the CPU 12a determines “No” and advances the process to step S117. On the other hand, if at least one of the keys is pressed, the CPU 12a finally presses the key among the keys that belong to the third key area and are currently pressed in step S115. The key pitch of the key that has been recorded is detected. Next, in step S116, the CPU 12a reads the bridge waveform data assigned to the detected key pitch into a predetermined third area in the RAM 12b.

  Next, in step S117, the CPU 12a superimposes and adds the accompaniment waveform data, the rhythm waveform data, and the bridge waveform data stored in the first area, the second area, and the third area, respectively. Performance pattern data representing an acoustic waveform is generated and written in a predetermined fourth area of the RAM 12b. Thereafter, the CPU 12a repeatedly executes the process consisting of steps S103 to S117. The performance pattern data consists of a plurality of sample values. The plurality of sample values are stored in the fourth area in the order of reproduction (D / A conversion). That is, the performance pattern represented by the performance pattern data can be reproduced by reading each sample value in order from the head address to the tail address of the fourth storage area and supplying it to the sound system 17. Yes.

  Next, a performance pattern data supply program will be described. The CPU 12a executes a performance pattern data supply program in parallel with the performance pattern data generation program.

  In step S200, the CPU 12a starts a performance pattern data supply process. Next, the CPU 12a executes an initialization process in step S201. For example, a pointer value indicating one address of the fourth area and storing one sample value constituting the performance pattern data is set as the head address of the fourth area. Next, in step S202, the CPU 12a supplies the sound system 17 with the sample value stored at the address pointed to by the pointer. Next, in step S203, the CPU 12a advances the pointer by one. That is, the value of the pointer is set to the next address from the current address. However, if the current address is the end of the performance pattern data, the value of the pointer is set to the start address of the fourth area. Next, in step S204, the CPU 12a waits until the next sampling period arrives, and then proceeds to step S201. Thereby, the CPU 12a supplies one sample value to the sound system 17 every predetermined sampling period (in the present embodiment, 1/44100 seconds).

  Therefore, in the performance using the accompaniment waveform data of the audio music element data set, the performance pattern of the currently selected section is repeatedly performed. Further, for example, even when a switch of a section different from the currently selected section is set to the ON state during the performance of the section, the performance is continued without interruption. The performance of the current performance pattern is continued until the end of the current measure is reached, and then the performance is started from the beginning of the next section. That is, when the CPU 12a reaches the end of the current measure, it executes step S117. Further, when the switch of the next section is set to the on state, the performance may be continued from a position in the middle of the next section and corresponding to the performance progress position in the current section. When a new chord is input in the middle of a measure and when the end of the measure is reached, the chord is changed to the newly input chord and the performance is continued. When the end of the ending section corresponding to the ending switch ES is reached, the CPU 12a ends the performance using the audio music element data set and sets all the music element switches PS belonging to the music element switch PS to the OFF state. . Even when the performer selects to stop the performance using the input operator 11, the CPU 12a terminates the performance using the audio music element data set and turns on all the switches belonging to the music element switch PS. Set it to the off state.

  In the performance device 10 configured as described above, accompaniment waveform data, rhythm waveform data, and bridge waveform data are not stored in the performance device 10 in advance, but are extracted from acoustic waveform data of a desired music piece. The performance pattern data representing the performance patterns of accompaniment style, rhythm, and bridge is not generated by the tone generator circuit 16 based on the MIDI data, but based on waveform data cut out from the acoustic waveform data of the original music. Generated. Therefore, according to the performance device 10, an attractive performance pattern such as a live performance can be reproduced. In the performance device 10, the operator groups to which the accompaniment waveform data, rhythm waveform data, and bridge waveform data are assigned do not overlap each other. Therefore, according to the performance apparatus 10, each waveform data extracted from the acoustic waveform data of the existing music is selected (designated) alternatively or in real time, and the performance is performed using the selected (designated) waveform data. The pattern can be played back. That is, a performance pattern can be reproduced using only one of accompaniment waveform data, rhythm waveform data, and bridge waveform data, or a performance pattern in which two or all of them are superimposed can be reproduced. In addition, regarding the accompaniment waveform data, even if there is no accompaniment waveform data corresponding to the section and chord of the accompaniment style selected (designated) by the performer, the accompaniment waveform data of the same section is corrected to correct the accompaniment waveform data. The waveform data code can be corrected to the specified code (see S107 and S108). Therefore, the variation of a performance pattern can be increased compared with the past. In addition, existing music can be easily arranged. When superimposing acoustic waveforms respectively represented by two or all of the waveform data among the accompaniment waveform data, rhythm waveform data, and bridge waveform data, the performance of some instruments may overlap. In this case, the volume of the performance sound of some of the musical instruments may be reduced by applying a filter to any one of the superimposed data among the accompaniment waveform data, rhythm waveform data, and bridge waveform data.

  In addition, since an algorithm to be applied to acoustic waveform data can be selected, only necessary waveform data can be generated. For example, when bridge waveform data is unnecessary, only accompaniment waveform data and rhythm waveform data can be generated. According to this, it is possible to suppress wasteful consumption of the storage capacity of the storage device 14.

  Furthermore, in carrying out the present invention, the present invention is not limited to the above embodiment, and various modifications can be made without departing from the object of the present invention.

  In the above embodiment, three types of algorithms can be applied to the acoustic waveform data of music, but these algorithms are not limited to the above embodiment and may be other algorithms. For example, in the above embodiment, the accompaniment waveform data includes a drum part, but an algorithm for generating data that includes performances of performance parts other than the drum part among the accompaniment parts may be applied. . In the above embodiment, all performance parts are included in the bridge waveform data, but an algorithm for generating data that includes only vocal parts and melody parts may be applied. As described above, if the musical instrument types are configured so as not to overlap between waveform data used simultaneously (in parallel), the combination of waveform data used simultaneously can be freely changed. For example, the rhythm waveform data in the middle part of the original music can be combined with the accompaniment waveform data in the introduction part of the original music. According to this, the variation of a performance pattern increases dramatically.

  Moreover, in the said embodiment, although the audio music element data set was produced | generated using the whole original music, you may use a part of original music. In this case, it is preferable that the portion used for generating the audio music element data set can be selected from the acquired acoustic waveform data of the original music.

  Further, a known algorithm for changing the tempo without changing the pitch may be applied to each waveform data of the audio music element data set. Further, the original acoustic waveform data and audio acoustic waveform data set may be stored in a server connected to the CPU 12a via a network. Further, the server may execute a program for generating an audio music element data set, and the result may be used by the CPU 12a. In the above embodiment, the keyboard device KY is used to specify a code, but information representing a code received from an external device may be used.

BS ... Bridge switch, PS ... Music element switch, ES ... Ending switch, FS ... Fill-in switch, IS ... Intro switch, KY ... Keyboard device, MS1 ... Main switch, MS2 ... main switch, MS3 ... main switch, RS ... rhythm switch, SS ... section selection switch, WM ... waveform memory, 10 ... performance device, 11 ... input operator , 12 ... Computer unit, 13 ... Display, 14 ... Storage device, 15 ... External interface circuit, 16 ... Sound source circuit, 17 ... Sound system

Claims (6)

Multiple controls,
An acoustic signal acquisition means for acquiring an acoustic signal representing an acoustic waveform of a performance sound emitted by playing a song;
Music element extraction means for extracting the acoustic waveforms of the plurality of predetermined music elements from the acoustic signal according to an algorithm for extracting the acoustic waveforms of the predetermined music elements included in the acoustic signal;
Assigning means for assigning the extracted plurality of acoustic waveforms to the plurality of operators, respectively;
Performance pattern data generating means for selecting one operating element among the plurality of operators and generating performance pattern data representing a performance pattern using an acoustic waveform assigned to the selected operator; ,
A performance device equipped with. The performance device according to claim 1,
A performance device comprising an operation element that is different from the plurality of operation elements and sets whether or not to generate the performance pattern data. The performance device according to claim 1 or 2,
The performance pattern data generating means selects a last operated operator from the plurality of operators, and generates performance pattern data representing a performance pattern using an acoustic waveform assigned to the selected operator. A performance device. The performance device according to any one of claims 1 to 3,
The performance device, wherein the music element is a performance pattern of a rhythm part of the music or a performance pattern of a bridge part of the music. A computer program applied to a performance device having a plurality of operators, the computer included in the performance device,
An acoustic signal acquisition step of acquiring an acoustic signal;
A music element extraction step for extracting the acoustic waveforms of the plurality of predetermined music elements from the acoustic signal according to an algorithm for extracting the acoustic waveforms of the predetermined music elements included in the acoustic signal;
Assigning the extracted plurality of acoustic waveforms to the plurality of operators, respectively;
A performance pattern data generating step of selecting one operated operator from the plurality of operators and generating performance pattern data representing a performance pattern using an acoustic waveform assigned to the selected operator; ,
A computer program for executing a process including: A performance pattern data generation method applied to a performance device having a plurality of operators,
An acoustic signal acquisition step of acquiring an acoustic signal;
A music element extraction step for extracting the acoustic waveforms of the plurality of predetermined music elements from the acoustic signal according to an algorithm for extracting the acoustic waveforms of the predetermined music elements included in the acoustic signal;
Assigning the extracted plurality of acoustic waveforms to the plurality of operators, respectively;
A performance pattern data generating step of selecting one operated operator from the plurality of operators and generating performance pattern data representing a performance pattern using an acoustic waveform assigned to the selected operator; ,
A method for generating performance pattern data.

Images