JP2003521005A - Device for displaying music using a single or several linked workstations - Google Patents

Abstract

(57) Summary The music workstation system generates a display display of the music in response to the music data and one or both of the input variables and the selected operating mode. The system provides a means for providing song data (local storage (ROM, RAM, CD-ROM, hard disk, etc.) or another music workstation, master controller, computer, etc.) via a communication interface to an external device. , Memory, selection subsystem, controller and display subsystem. The system may also provide hierarchical editing and librarian functions to facilitate practice, teaching, performance, librarian, archiving and distribution functions.

Description

Detailed Description of the Invention

[0001]

[Related application]

This invention is a partial continuation of Application Serial No. 08 / 677,469, which is currently published as U.S. Patent No. 5,728,960, filed May 16, 1998. It is a divisional application of 09 / 039,952.

[0002]   Federal-sponsored research or development   Not applicable

[0003]

BACKGROUND OF THE INVENTION

This invention relates to the field of music. More particularly, the present invention relates to display systems for displaying songs in a batch or real-time environment and for processing and communicating user performances.

Scores are usually fixed keys and can only be used in the form written for a single (or fixed set) performer / instrument type. Fitting or modifying arrangements is complex and costly. Musicians in remote areas cannot practice together efficiently. A small group, each with only a few musicians, is limited to practicing with the few musicians it has.

Music players experience many inconveniences to deal with. One of these inconveniences concerns music display displays, traditionally the composition, distribution and use of sheet music. Another major issue relates to the inconvenience of scheduling and physical assembly of multiple musicians (including musical instrument players and vocalists) who combine musical performances to provide a musical ensemble or orchestra. For example, practice in a high school band requires that all students be able to practice in the same place at the same time (ie, the school music room). However, many students have other activities, which presents the drawback that it is incompatible with the band's practice and the practice is incomplete. In addition, when composing, musicians often come up with ideas when they are not physically together with another musician.

Musicians typically work on sheet music. When composing, they write notes on a piece of paper with several staves. The musician plays the song 1
When transposing from one key to another, the notes are also written on the staff. Scores for different instruments also need to be generated and written. All scores are then duplicated for distribution to other musicians and / or music stores.

When playing, it is necessary to find, manually distribute, manually place, and manually handle sheet music (eg, turn pages) for all parts played. Also, regardless of whether the playing musician is a solo or a member of an orchestra, there is an unmet need for quick access to a more comprehensive database of music for that musician. Also, musicians often play audience requested songs and require access to sheet music for the requested song. Currently, there are various combinations of edited songs, usually in popular song sheet music (“FAKE” Books) by category (eg rock, country, blues, big band, etc.). This is of limited help. Moreover, the use of paper sheet music is cumbersome and inconvenient. That is, pages are often corrupted or lost, and indexed access is poor and slow.

This method of composing and distributing music is unsuitable when the music is used by a band or orchestra that requires hundreds of copies. When a conductor wants to play the piece on a different key, or when a certain part of the music is edited to suit the conductor's taste, the song is rewritten and a new transposed copy is made into a band. Or it needs to be distributed to the orchestra. When the orchestra has a large number of members, this is a very costly, time consuming and tedious task.

In addition, if the song does not have a part for a particular instrument, the conductor needs to generate the required part from the original song. After generating the score for the required instrument, the part needs to be duplicated and distributed to the individual musicians. Again, this is a very costly and tedious task when the band has a large number of musicians requesting different parts. Therefore, there is a need for a more efficient way of transposing, editing and distributing music scores.

Over the past years, electronic input, storage and display of music has come a long way. Electronic bands and orchestras are built using computers and MIDI equipment. In order for an individual to transpose and compose music using a computer, a personal computer (for example, Apple Macintosh (R), DOS)
, And Windows (R) machines). It also automatically inputs music from direct performance (eg, directly from a keyboard, electronically through a MIDI converter (eg for stringed instruments, etc.), via pickups and microphones, and sequencers, tone generators, etc.) and digital data and There are also programs for generating music notation.

Musicians often play both pre-planned and ad hoc songs in a sequence of performances. Therefore, it is desirable to be able to access a large music database on demand. It is also desirable to allow communication and synchronization of music displays to multiple playing musicians playing together. Also, the playing musician inputs his or her musical performance into an individual music workstation, allows it to be stored, analyzed by an automated system, and / or has one or more other network connections ( It is desirable to have communication with individual music workstations (remote).

[0012]

SUMMARY OF THE INVENTION The present invention encompasses a music display system. In one embodiment, the system allows one or more users to select a song and play the selected song on each of a plurality of individual staves, the staves being independent. To capture each user's performance and communicate that individual performance data to the master workstation (which may be standalone or one of the networked individual workstations) The workstation combines a plurality of individual workstation performance data into a composite, combined performance data, and recommunicates the combined performance data to all individual workstations, where each individual workstation Is a combined performance (representing music performance input for all of the individual workstations in communication). Providing audio (and / or video and / or audio visual) output representative of the data. The time from when a user plays a piece of music to when the same user hears the audio representation of the combined data is shorter than a human detectable time interval. In the preferred embodiment, the plurality of individual workstations collectively provide a synchronized display representation of the display of the selected song and output individual performance data representing the user's musical performance corresponding to the display representation. I will provide a. Timing synchronization is provided to enable synchronization of the display representations of multiple individual workstations, and for the master workstation to synchronize multiple individual performance data to build combined performance data. In one embodiment, the master workstation produces a sync signal, which is communicated from the master workstation to all individual workstations. Other synchronization structures, such as embedding timing synchronization data in individual performance data, are equally acceptable.

In another embodiment of the invention, a music display system allows a user to select from one or a variety of songs, control the suitability of the selected song, and efficiently edit the edited version in a paperless environment. Allows to distribute. The system and process of the present invention also provide a means for receiving music from several sources. The user selects the desired song from the source. The desired song is displayed and / or stored in the system's memory for further processing by the system prior to display and / or distribution.

According to one aspect of the invention, each music workstation in the intelligent music communication architecture provides distributed music information for video or visual display of music in user-friendly notation, and / or Or, provide an audio display that can be selectively tracked and synchronized to a video display, and / or track and synchronize a displayed video display to a live performance, and so on.

In yet another embodiment, the system allows selection of a song, optionally any user-specified editing desired in the song, and in a further preferred embodiment, a parameter ( The music key on which the song is played, etc.)
A user input device that enables user selection of the. The user then directs the system to one or more display subsystems (CRT, L
The newly generated music score can be transmitted by an ED, LCD, etc.) or other system. In the preferred embodiment, these displays take the form of liquid crystal displays incorporated into music stand based systems, also referred to herein as display stations or workstations.

The present invention also relates to a music display and / or communication system, and more particularly to allowing a musician to view a score or other audiovisual or visual-only display of a musician. / It relates to a system that allows a user to play the musical composition with a favorite musical instrument selected by the user with a favorite key selected by the user.

According to one aspect of the present invention, there is provided one or more music workstations, which include video display means such as a display screen (CRT, LCD, LED, head-up display (HUD), etc.), In one embodiment, a computer-based system that stores a database of songs and music available to the musician / system user.

In accordance with yet another embodiment of the present invention, multiple music workstations are provided to allow each of the different or similar musical instruments to select different portions of the song to be played, and to create the same musical composition. By providing a music display or representation at the same key to all musicians playing the, it is possible to play that music together. In the preferred embodiment, the system responds to a specific input variable (such as that provided by a microphone or keyboard, or a voice recognition or input device such as a camera) to define the desired key to be played. It can be fixed to the key (and / or instrument type). In the preferred embodiment,
The user can select an auto-transpose mode in which all music is automatically transposed thereafter. This transposition takes place at the master workstation and may then be communicated to individual workstations. In one of the illustrated embodiments, music transposition is performed locally at a music workstation that provides local intelligence. Original songs, such as those selected from the storage database of the library of music, are then transposed according to transposition rules. Many options are available, various transposition rules and methods are well known and documented, and a keyboard with built-in functionality for transposing music and a computer that provides transposition and transcription of music. Used in many products such as software.

According to an alternative embodiment, the user connects to a remote database via wireless or wired communication, allowing the user to download the musical composition selected for playing to the local computer. The user music terminal or central computer may receive the transposed (derivative) version, or the unmodified (original song) version, which in turn may be needed for each instrument and / or key. Music may be displayed and / or transposed and transposed accordingly.

In another alternative embodiment, a user may schedule download of selected songs via a remote connection service, where the music user terminal allows storage and playback of all requested songs. A non-volatile storage memory may be included. Alternatively, a central server may be provided, where the music end terminals share a single central controller computer, or each shares a central server computer or is distributed to each other. Have their own computer that shares the type architecture.

Alternatively, a non-volatile storage structure, such as a CD-ROM, may contain a database of music from which to select for transposing in accordance with the present invention.

The present invention provides a music communication architecture and method that enables synchronization of music display displays to multiple display stations playing the same song. Bands and orchestras can be configured with multiple independent music workstation displays, whether at one site or remotely distributed. In one embodiment, the music display display provides one or more displays of songs, a performance by the user, and an output display for a combination of individual performance data for multiple individual workstations. In one embodiment, the master workstation is responsive to individual performance data from a plurality of individual performance data, synchronizes individual performance data from a plurality of individual workstations, and is combined into a composite. Means are provided for providing display output (audio and / or video) including virtual performance.

A further object of the invention is the performance of the performer, such as the parameter signal obtained via the microphone and / or the camera, of the performance or execution of the artist during the performance as compared to the stored and displayed music. It is to be able to compare parameters. This comparison includes a critique of the pitch, timing, volume and tempo of the music (such as through audio recognition), as well as the physical movement of the artist (such as proper finger placement) through visual recognition. In a preferred embodiment, the music workstation system provides performers and / or conductors with
It provides display performance feedback that indicates the quality of the performance as compared to the stored or displayed music, eg, any errors, where it occurred.

It is a further object of the invention to transpose any music displayed, such as on different keys, or to include different musical instruments and voices that are different or additional to what sheet music originally displayed. System).

A further object of the present invention is to provide an automated mode of intelligent operation of a music workstation and responsiveness to multiple forms of user input.

These and other aspects and contributions of the present invention will be discussed with reference to the accompanying drawings and the following specification.

[0027]

Detailed Description of the Preferred Embodiments

The present invention is capable of many different forms of embodiment, and the particular embodiment thereof shown in the drawings and described in detail herein is for the purpose of this disclosure to be considered illustrative of the principles of the invention. , With the understanding that it is not intended to limit the invention to the particular embodiments illustrated.

In accordance with the teachings of the present invention, systems and methods for music display and communication are provided. Multiple sources such as pre-stored score images, energized microphones, direct input from musical instruments or direct vocal performance, scanning of existing printed score images (optical code recognition), camera, video, etc. Music can be input to the present invention from any one or more of the following. These inputs by this system are used for selective storage, compositing, communication and display of the music system of this invention. The system can automatically generate additional material or allow the user to modify, communicate, display and / or play songs.

Changes may be made to the rhythm, basic keys, individual notes, chords, etc. Bulk storage of music information stored in digital notation format and / or any video format can be broadcast (analog or digital) to a local music workstation or a master controller that can also be a local workstation. The master controller may be a stand-alone unit, or it may act as a server and its own stand-alone unit, or simply as a server for a plurality of other stand-alone units. However, in a minimal configuration, only a single music user station is needed.

In one of the preferred embodiments, the workstation is provided as a music stand, where the display display is a liquid crystal display (LCD). This LCD
May provide monochrome, grayscale or high quality color displays depending on design and cost constraints and desires. Other display types can also be used. Touch screen input may provide simplified and adaptive user input selection. Optional built-in metronome functionality may be provided for display audio and / or video. Also, a subsystem may optionally be provided to enable music to be audibly played at the workstation through a speaker or headphone jack or other output.

From linear analog-to-digital (eg A / D) conversion to processed data conversion to encoded digital music data such as MIDI, it is known in the art to convert a user analog audio input into a digital format. Is well known in. Examples of MIDI include voice / non-pickup instruments through a microphone to a MIDI converter, or direct guitar or other string instrument input, or a microphone converted to a MIDI input, or keyboard MIDI input. Such input systems are commercially available from many companies for many types of interfaces at many interface levels. Similarly, numerous A / D converter subsystems are commercially available at chip and board solution levels (Analog Devices and Mattrox Systems).
stems), etc.).

According to one aspect of the invention, the multidimensional music transfer system of the invention also includes
Allows the user to select one or more songs from a larger database from multiple songs. This database may be stored locally within the workstation, on the site, or stored remotely (cable, wire, telephone line, wireless (eg, radio frequency)) and transmitted to the user. The user may also optionally edit the score of the selected song (such as changing keys and / or any sounds and / or timings, etc.) to suit his or her preference. The score (whether changed (derivative) or not (
Original song)) then LCD or C in the music stand of the band or orchestra
It can be sent to one or more displays such as RT. Thus, the present invention communicates, displays, and optionally transposes, edits, inputs, comparative tests-educates, conducts, and distributes music to one display or multiple displays. To provide an efficient paperless solution for Each display provides the same or different unique customized display of the appropriate musical notation for each selection, automatically in response to system setup, for each predetermined parameter, and / or for user input. Can have This score can also be printed if a hard copy is desired.

As illustrated in FIG. 1, music is stored as a music library (120) in digital format, such as on a large hard drive or CD ROM jukebox. The music library (120) is the processor subsystem (115)
Be combined with. Coupling can be wireless or shielded cable, fiber optic conductor,
It may be a cable connection, such as through a switched connection (such as over a telephone line), or it may be local or remote. The processor (115) has local storage capacity (eg, semiconductor memory, disk storage, etc.) for holding a digitized version of a song transmitted thereto from the library (120) on demand. The music library may be local or remote in close proximity to the rest of the system.

In the wireless embodiment, the music library (120) is coupled to a communication subsystem (such as a radio frequency transmitter) (125), which communicates through the transmitter's antenna (104) to the remote music library (120). To Processors (115)
Send the requested song content to. The receiver antenna (102) receives the transmitted signal and the receiver communicates it to the processor (115). This example
Allows the music library (120) to be located remotely and at a great distance from the requesting site. The communication subsystem (125) may be a transceiver for two-way wireless communication, or may be simple (such as when a request is communicated to the music library subsystem (120) in other ways, such as over a wire connection). It may be a transmitter for directional wireless communication.

As illustrated in FIG. 1A, a system controller in the form of a music stand (105C) with a liquid crystal display is used by an operator (eg, performer, conductor, etc.) to select one or more songs. To be done. FIG. 1A illustrates two types of music workstation music stands. Workstation music stand (105C)
Provides certain optional features for a more full-featured music stand, including speakers (140) with both wireless and wired communication capabilities as illustrated, and as illustrated, an externally isolated configuration. Processor with memory as element (115)
Indicates. The music stand (105P) indicates that the processor and memory are integrated into the music stand itself, and also has both a wireless (antenna (101)) and a wired connection (port (107)) for enabling network communication. Show. Alternatively,
The conductor music stand (105C) may have all or some of the features integrated into the music stand (105C). Depending on the capabilities for which the music workstation music stand is used, some or all features may be provided to the music stand to minimize cost or optimize diversity. For example, in one situation, only the teacher or conductor needs a full-featured, high-powered music workstation. In this case, the performer or student does not have a full-featured workstation, but a reduced version of the workstation music stand. In the preferred embodiment, a user input device (110) (touch screen, microphone, keyboard, switch, voice recognition system, video recognition system, etc.) is wired (cable or fiber optic link, etc.) to the workstation music stand (105C). ) Or wirelessly (such as an RF or infrared link) to the processor, or directly to the processor, where it is incorporated into the system controller as a workstation (105P). The user can select the original song from the touch screen of the liquid crystal display (135).
The processor is responsive to the request by the user's local workstation memory (1
Respond by storing the song in 15).

Using the touch-sensitive LCD (135), the user can generate derivative music. The touch-sensitive LCD allows the user to enter the music key on which the original song is played, edit any desired sound, and select the instrument and part that plays the song. The songs as originally composed and the derived or modified songs are played to the user through the speaker (140), optionally allowing him or she to see the score simultaneously on the display visual display (
You may listen (for example, to see how the changes sound). Once the score is specified (eg selected, edited, etc.) to the user's (eg conductor's) preferences, then the appropriate part (eg per instrument) of the score is associated with each of the band members. Can be sent for display (optional storage and) to individual music workstation music stands.

In the preferred embodiment, each music stand has an input device (110) that allows the user of the music stand to select which instrument uses that music stand. (As mentioned above, this input device may take the form of a touch-sensitive screen or some buttons or switches or voice or audio recognition, etc.) In the preferred embodiment, individual music workstation music stands (105).
Directly to receive (and optionally convert locally) and display the specified music score for each instrument type (user type) that uses (and is associated with) its music stand. And / or can be programmed remotely. For example, a music stand user (or conductor) enters the selection saxophone into the user input device (110) of the workstation music stand (105C), and the workstation music stand (105C) receives only the music score for the saxophone. (See FIG. 3). The music scores for all selected parts may then be independently broadcast to all connected workstation staves, where each individual workstation stadium uniquely identifies only that part. To receive. Alternatively, each workstation music stand may be individually addressed to separately receive broadcasts of its own respective selected part. Additionally, a music stand user can program user input to select a music part of a selected song (eg, a saxophone's chief position) and receive only the music score specified for that position. This same procedure can be followed for other instruments in the band or orchestra. Alternatively, a single song may be broadcast to all workstations, where each workstation has local intelligence (processing and storage), and each work for each selected instrument for each workstation. Allows local translation for display at the station.

For wireless communication, each music workstation music stand (105) receives (or receives) radio frequency information from (and to) a master workstation (such as for a conductor). Receiver (or transceiver when two-way communication is desired) and antenna (101, 103). The music stand also has a display (such as an LCD (135)) for displaying the music score specified for the music stand.

Referring to FIG. 1B, the music workstation music stand may be the same or may be divided into a conductor music stand and a music stand for musicians. Music stand for conductor (10
5CON) may have more functions and controls than the music stand for a player (105PER). The performer music stand (105PER) may only have the ability to receive and display music scores, while the conductor music stand (105CON) selects a music score and changes the key of the song, It also has the ability to perform other tasks that are permitted or required to be performed only by the conductor.

In one embodiment, the RF antenna for the music stand (105) may be incorporated into the music stand itself. Alternatively, instead of using RF, the music stand of the performer may be linked to the main (eg conductor's) music stand using infrared, fiber optic cable, shielded cable, or other data transmission technology. . As mentioned above, the communication link may be bidirectional, thereby facilitating requests and responses to prompt feedback of performance parameters, or whether any workstation may be a master or a slave. Well or may be used in combination.

FIG. 2A illustrates the overall operation of the music communication workstation. It starts by starting the system (200). The system then gives a menu (2
01) Allow the user to select a list of available songs. The user then selects (210) one or more songs. When the user selects one from a locally stored menu, it retrieves the information directly. Alternatively, if it is not stored locally, the system may connect to a remote storage site (eg, by dialing or through a database or network) to request and select the selected song. To receive.

Any desired changes to the song may be selected in the next logical block (215). When there is a change (such as to a key, or edit a sound, or select a display shape or instrument), that change is blocked (255)
To (285).

When no changes are desired, the music score for the selected song is broadcast, transmitted, or otherwise sent to the workstation music stand (220). It is stored internally on the local workstation music stand. The score is then displayed on the workstation display (eg LCD
Or CRT) or displayed on a video projection system (225)
. The display can be an integrated stand-alone workstation or personal computer (Macintosh, DOS or Windows (R)
) PC, etc.) may be part of a group of interconnected components.

Next, the display mode is selected (230). This allows selection of the active display mode, rather than just selecting resolution or color. The two main choices in the preferred embodiment are the manual mode (250) and the automatic mode (240). There are many sub-modes or options for automatic mode selection (240) that allow, for example, a performer or user to perform a performance without having to worry about selecting a portion of the displayed music or turning pages. There is an operation mode to be set. In the automatic performance mode shown on the LCD (135P), the selected music piece, the display representing the user's audio performance, and the deviation signal or the deviation data representing the analysis of the performance, preferably simultaneously in near real time. Display is provided.

FIG. 2B illustrates a manual mode (250), which provides a user manual selection of features (252). Even in manual mode, there are many functions that the user can select, such as flipping pages of the display by hitting a button or touch screen. Another function is to return to the page or scroll forward or backward. For the visually impaired, another feature can increase the font size of the music display.

Therefore, there are many functions that can be selected by the manual that can be provided. The manual mode may allow the selection of automated functions, but it is distinguished from the automatic mode, where the control is partially predetermined without the assistance of the user. Manual mode (2
At 50) the user selects any and all features provided, some of which can be automated. The selected function is then processed (25
6).

Next, any ongoing requests are processed (257). These requirements may include any overlapping automated functionality (otherwise consistent with any other selected functionality).

Referring to FIG. 2C, the operation of the automatic mode “A mode” (240) is illustrated. First, the desired automatic mode user selection is detected, and the automatic progress mode (242
), Training mode (244), play mode (246), or any one of a number of other modes (248) as described in more detail below. For example, the automatic repeat mode may be selected by specifying start and stop points and the number of times the "looped" portion (or portions) of the displayed song is repeated. Marching band mode (automatic progression based on metronome function, conductor control, etc.), automatic song mode, and much more can be realized. The order of automatic progression, training or performance mode selection is arbitrary and the user may alternatively decide from a menu where all are shown simultaneously as options.

The display may progress the music by page options or by user selection of one of many options (eg scrolling, tablature, video graphic tutorial display, etc.).

Referring to FIG. 2D, the automatic mode 1 for the automatic advance operation (242) of FIG. 2C.
In this example, the user has selected the automatic progression performance mode. In this mode "A mode 1" (271), the system tracks the score's user performance of the song (272). A performance refers to the actual performance by the individual person (or people) reading the music score on which the performance is based. Whether the score is in tablature format, staves and clef and notation, or some other format, the system will generate the appropriate signal to allow comparison of the user's performance to the music score. To do.

Based on the comparison, a decision is made according to the selection criteria programmed into the system, such as the speed at which the piece is played, the time indicator, the tempo, the rhythm, and the progress of the music on the available display. , Display progresses (274 and 278). In some cases, the music is for example D.I. S. You may move backward by a coder. The display on the display enables a smooth, unobstructed performance or singing by tracking the performance. The user may be provided with the ability to override this automatic progression, for example for exercises where it is desirable to continue returning across sections. In this case, the user override option (276) is allowed to change the automatic operation. Upon discontinuation of user override, the system may shut down and automatically return to the normal auto-advance mode, or it may be programmed to handle the other auto-modes (270) of FIG. 2C.

Referring to FIG. 2E, the automatic mode “A mode 2” of FIG. 2C corresponding to the training mode.
“(244)” is illustrated. In this mode, the system tracks individual user performances for song scores (280), primarily for the purpose of allowing critical analysis and comparison of performances to scores (282). This analysis defines deviations from the selected music score, indicates errors or deviations from the desired performance goals (eg, note timing match, note duration, note pitch, etc.), and these errors ( Display (284) such as by audio or video means. The predetermined performance goals provide a knowledge base for expert system based analysis.

The system can then generate a graded score indicating the error (286),
It can also be presented in a number of formats such as histograms, error frequencies, error intervals, etc. The identification of when the error occurs (eg, only when going from slow to fast, or from fast to slow), absolute position in the score, etc. are also tracked and reported. Other expert system rules may be given by the music teacher, which give the parameters needed to model expert system reasoning, and how to correct problems via display text, graphics, audio, etc. Give guidance and suggestions to.

Comparison of performance to score in training mode is performed by the performer's obedience to parameters such as tempo, rhythm, filter, parameters, pitch, tonality, and other features adaptable or modifiable by the performer. Is performed for the purpose of detecting. This parametric information is available and published in many forms. Thus, by providing a core set of this parameter, the system can be in training auto mode.

As illustrated in FIG. 2F, the automatic mode 3 “A mode 3” is the performance mode (24
6). In this mode, the operation is the same as the automatic mode 1 (automatic progression mode) except that user override is not permitted. Its main purpose is to accompany the performer during the entire performance of the score as automatic page turning. Tracking "page-turning" for a performance is independent of the performer's actual performance input (eg, microphone), such as an embedded metronome clock, central control (eg, conductor or special user input), or It may be based on any criteria. In addition, performance characteristics may be tracked, calculated and reported, as well as educational and training modes. Training feedback may be provided in real time or optionally after the completion of the performance to assist the performer as well as the training mode. Alternatively, in contrast to an actual page-turning display, scores may be provided in a moving score mode (eg vertically, horizontally, or otherwise) or in a linear display.

FIG. 2G illustrates the operation of automatic mode 4 (“A mode 4”), which provides for processing of other automatic functions selected by the system. These modes may include a conductor mode, a karaoke mode, etc.

In Conductor mode, a conductor can control the communication of signals to his or her performer (such as "volume up" or "tempo up" or "staccato"). The icon may be provided so that the conductor supplements his hand and body movements by simply touching the touch screen (or other input mechanism), allowing for more effective communication with the performer. Alternatively, as illustrated in FIGS. 9 and 10, in a more advantageous system version, the conductor's movements are first learned by the monitoring system based on user-defined and assignment of meanings to movements and the expert Give a knowledge database.

This system provides tracking of the movement input, for example in FIG. 10 the input via the conductor's (1015) video camera (1005) to the background (eg blue screen) (1010) is video processed. Processed by the unit (1020) or as shown in FIG.
935) or sensor (944) or sensor clothing (940) or head or eye movement tracking sensor (930) (to analyze movement, virtual reality, flight simulation, avionics equipment (such as jet and space flight) and sports) Inputs for the required movements are given via () such as those used by athletes)). The input of this movement is analyzed using an expert knowledge database and an automatic display (video and / or audio) is generated to provide local visual and / or audio enhancement on the local display (music score display as an in-screen screen). Of the conductor's body language is provided to allow audio and video enhancement of the conductor's body language. That is, a "quiet" body language signal directed to a particular part of the orchestra is automatically interpreted so that the system only outputs a message to each display of that particular part (e.g.
Along with the "quiet" sound, such as a large face with your fingers in front of it to make a quiet sound. Conductor mode offers many benefits to playing and communication.

For all these automatic modes (eg A-modes 1, 2, 3, 4), in real time on either or both of the performer's workstation and the second (eg teacher's) workstation, Alternatively, training feedback may be given after the performance.

There are many advantages to electronic music, communication and display. Expert systems help many of the functions performed in composition and performance, in addition to those discussed here,
There is the ability for expert system based artificial intelligence type assistance.
For example, in the Auto Composition mode, when it is necessary to change words to match the time signature, equivalent terms may be selected from many sources, such as thesaurus, dictionaries, synonyms, encyclopedias, etc., for assistance. . New works may be created by re-expressing phrases from poems selected and indexed by content or subject.
Accompaniment of the drum and rhythm parts may be suggested well, and also harmony, melody line to accompany the chord, chord progression to accompany the melody,
Harmonies to accompany the melody, and suggested instrument groupings to support a particular sound, rhythm, style, tone quality, etc. may be suggested.

The expert system may be built by commercially available technology,
It is based on a component hardware system with supporting software, as well as Intel's X86 and Pentium® processor technology, Motorola's Power PC and 68XXX processor-based technology, DEC PDP-11 technology, Sun Workstation, etc. , Commercially available software packages running on commercial personal and business computers such as Macintosh, Windows, and DOS machines from Apple Computer, Inc. DSP on custom microcomputer or chip
The base system architecture may be configured, and ASIC, custom or semi-custom logic may be configured.

The system may be designed to take advantage of expert system design knowledge. A database of rules and facts is provided and accumulated by the system in self-learning mode over time. The expert system itself
Find the user, monitor the performance and apply rules to give the user a skill level, mistakes,
It has the necessary logic to provide feedback and reporting, such as an autoplay display, which starts with a base definition set of rules, commands and a specific knowledge database for music.

The shape of the music score communication can be easily shaped to suit the requirements. One example is MID
I (Musical Instrument Digital Interface Standard), which is the bandwidth of the storage device used, is widely available commercially,
It has advantages such as being standardized. However, signal processing, text, icon-based, object-based, and various other forms of storage, user interface, and processing are also applicable for more specific application of the product.

FIG. 3 illustrates one example of an LCD display used to display input controls and information from a processor and memory. In the preferred embodiment, the LCD is a touch-sensitive screen that can change the function associated with each button displayed, and also moves the displayed buttons around the screen, depending on the function activated. The music score may be edited by the conductor, for example by touching an individual note and then providing him with some notes to replace the touched note. The lower part of the screen displays the instruments from which the conductor can choose which instrument will play the song. After touching the buttons on this screen, some sub-screens may come up,
Each of them has its own individual touch sensitive areas and the functionality activated by those areas. Alternatively, in addition to or instead of the touch screen, the system may provide input via a separate key switch, voice recognition, etc.

For example, when the conductor touches the send key on the main screen, he is provided with a screen showing all the instruments he has selected for the work and the button labeled “All”. It He may send to each individual music stand, or to the entire orchestra by pressing the "All" area.

The music library can be included (“stored”) in non-volatile storage, either locally or at a remote central site that includes an entire (or subset) database of all possible music. , In real time when playing, or in advance, downloaded to local storage on request).

Alternatively, the music library may be provided on a storage medium that is easily transported and available locally on the site by the display system. Thus, for storing and containing a large data library of songs, for example, disk drives, cartridges, flash RAM cards, plug-in memory modules, or C
It is possible to use a D-ROM or a plurality of CD-ROMs in a CD-ROM changer. This is a more expensive means than sharing a central library,
Each music group requires you to get a library of all possible songs they may want, which is speed, flexibility, no communication with another remote source, and a whole new mass marketing area (CD or digital). Audio tape (D
(For AT) etc.). Another way to use this technique is to maintain a history of music used by a remote music library or a local music library. This can be done for a number of reasons, including assessing copyright fees, establishing a history of music performances and requests for future use in determining performance itineraries, and so forth. Alternatively, a hybrid of locally stored libraries and centrally shared libraries may be used to optimize cost, speed and flexibility benefits.

In accordance with another aspect of the invention, each display workstation may also provide the ability to convert the played song into annotated songs, with appropriate musical notation (eg, staff, tablature, MIDI, etc.), Generate notes, time signatures, keys, instruments, or user types.

The display workstation may be implemented as a completely self-contained workstation, where each workstation has its own processing subsystem and any communication interface (such as wireless or cable) for network use. ) And an input / output interface including one or more of a user input keypad, speaker, microphone, joystick, push button, etc. Each stand-alone workstation may then work with a local database or may be coupled to a shared music database as illustrated in FIG.

The stand-alone workstation (105) is coupled to a shared database interface (405) and may also be coupled remotely (eg, via a telephone line) to a remote shared music database, or a local shared or dedicated music database. It may be bound to (410). The shared music database (410) may be primarily storage means (eg, hard disk or CD-ROM, etc.) or may include a processing subsystem (420) for local intelligence. In one embodiment, the stand-alone music workstation includes a shared music database (410) and interface (405), a non-volatile local storage medium for the shared database (410), and a local processing subsystem (420). Can work standalone. In an alternative embodiment of this stand-alone device, a shared database interface is included in a stand-alone workstation (but not a shared music database or processing subsystem) and a storage database (410) remote from the stand-alone device. Gives the ability to communicate with.

In any of these embodiments, an alternative additional embodiment is that each stand-alone workstation is a master stand-alone or a master or workstation in a set of workstations that includes a plurality of stand-alone workstations. It provides the ability to function as slave workstations, one designated as the master (parent device) and the other designated as slaves (child devices). Slave workstations in this configuration receive a communication of songs to be displayed from the master workstation, thereby allowing a shared music database to be communicated among all the workstations that are part of the group. .
It should be appreciated that the shared music database function can be distributed in many different ways among workstations, or can be separate from and independent of the workstations. This choice is just one of the designs,
The illustrations herein should not be taken in a limiting manner.

In one embodiment, the master workstation has full control over the slave workstations. Everything that appears on the master workstation also appears on the slave workstations. It is also possible for the user to mask certain parts of the master workstation's display before it is displayed on the slave workstations. In this manner, the conductor using the master workstation can send only the information required by the orchestra members to the slave workstations.

In an alternative embodiment, the slave workstation communicates performance parameters or deviation signals to the master workstation for error analysis feedback.

According to another aspect of the invention, in the means provided herein, a plurality of individual workstations are coupled together in a network configuration to provide networked communication of music playing data, Each music workstation provides capture of performance data for user performance and communication of that performance data to a master or conductor workstation, with the master workstation synchronizing the performance data of multiple individual workstations. And then combined to produce a composite virtual performance data output, which is re-communicated to all individual workstations in near real time so that each workstation receives the composite virtual performance data and Is a union that includes all of the user performances An audio output (and / or visual display) of the combined virtual performance data can be provided. Although this networking may be used with other features and embodiments of the invention, including communication of music to displays and analysis and data communication of other music performance data, as well as interpersonal communication between musicians, the network connection of the invention. The disclosed embodiment allows multiple, remotely located individual workstations to combine all their performances at their respective workstations with their own individual performances by enabling synchronized virtual performances. It enables you to play physically separately with the benefit of hearing the results in near real time.

In accordance with another aspect of the present invention, means are provided for allowing a user of a music workstation to achieve song pitch, tempo and other transitions. In the preferred embodiment, the lead voice or instrument can audibly indicate keys via microphone input or another type of input stimulus. The workstation analyzes the user input, determines the key, pitch and tempo for the song partially played by the user, adjusts and transforms the song, and at that new user's desired key, pitch, tempo, etc. It can be displayed for use at the workstation only, or for communication for use at one or more other workstations. In a networked version, this user input may be transposed by one or more workstations by being communicated to other workstations, or communicated to a master workstation, The master workstation may transpose and rebroadcast the transposed song.

Alternatively, the user can enter pitch, tempo and keys via user input (eg, keypad, joystick, push buttons, voice recognition, playing a musical instrument, etc.) and the system performs the conversion, Show the modified song for the user (
And / or print and / or play audibly). In addition, one song is 1
Written for one instrument, and when different or additional instrument versions are desired for simultaneous playing, the user can indicate other instruments via user input and the system will Generate a suitable display. The workstation also uses the audio of the converted song to convert and provide individual additional instruments or voices, or to listen to a mix of additional and original versions. Output may be given.

Referring to FIG. 5, a music communication system is illustrated, which includes a plurality of workstations (500), each of which includes a display (510) and a keypad (
522), joystick (524), push buttons (525 and 526),
Includes microphone (527) and user input such as a speaker (528). The workstation also includes communication interface means such as a wireless interface including an antenna (531), or alternatively or additionally a wired or cabled communication interface (540). Each workstation further includes a local microcomputer subsystem (550) that provides local intelligence and management of functions within the workstation.

In the networked embodiment, a number of physically separate locations, each having one or more individual workstations, are used to communicate performance data from individual workstations and And the display of the combined virtual performance data at each workstation by the individual workstations,
Provides virtual performance. In this case, the communication interface utilizes a slightly different structure such as telephone modem (analog modem), cable modem, ISDN between locations, etc.

Various types of communication interfaces are well known and commercially available. Currently they are available for purchase at the chip, board or system level. In fact, many single chip microcomputers include wired or wireless communication interface capabilities.

The workstation further includes optional instrument inputs (562) and instrument outputs (564) that allow the instrument to be directly coupled to the workstation via the instrument interface (570). Therefore, the keyboard through appropriate input,
An electric guitar or microphone input through the interface (570) allows direct input of an instrument or voice to the workstation for direct input independent of the microphone (527).

The instrument output allows for the combination of directly supplied or workstation modified instrument input signals for output to an appropriate well-known address or amplification and display system or a separate analysis system. To do. The workstation is coupled via wire or wireless communication to a processor subsystem (580) that includes a processor, non-volatile memory, read / write memory, and an interface to a non-volatile storage medium (582).

The processor subsystem (580) includes a suitable communication interface, such as a communication interface (540) for a wired interface (532) or a wireless interface that includes an antenna (533). The processor subsystem is coupled to a non-volatile storage medium (582) containing application programs, conversion programs, and shared music library interface application programs or actual shared music libraries and access programs, among others.

As described above, the processor subsystem (580) and the non-volatile storage device (
582) The music library may be built directly on one of the master music workstations (500), where the other workstations are slaves, which may include a processor subsystem and non-volatile storage, or It may be a lower cost dummy slave terminal. As illustrated in FIG. 6, in addition to providing the basic workstation subsystem (200), the first master workstation (300) provides a processor subsystem (280) and a non-volatile storage system (285). Including as part of it provides a complete stand-alone music communication system, which can act as a master or master / slave. This master workstation (300) may also function as a stand-alone or one or more including one or more masters (300) and / or one or more non-master workstations (105). May be connected to another workstation.

Multiple connected workstations can operate as stand-alone workstations with their local intelligence for displaying downloaded or permanently retained songs. Also, they are master /
Interact with each other in a slave's linked environment, where one of the master workstations (300) asserts that it is in the master state, and all other interconnected workstations, workstations (105) or master /
Slave workstation (300) operates in slave mode, which is independently coupled to a designated master. In addition, masters can communicate with each other for a master / master network configuration.

Alternatively, a plurality of connected workstations can operate together in a networked virtual playing mode or in a networked communication mode. A dedicated stand-alone or distributed master workstation architecture can provide coordination and combination and synchronization of multiple, individual performance data outputs into a combined virtual performance data output.

With reference to FIG. 7, an alternative embodiment of the present invention is provided wherein one or more workstations (105) include at least a display of musical notation. These workstations have master music communication controllers (41
5), the master music communication controller indicates the requested song, conversion, and display request for various ones of the associated workstations, M
Different user inputs (providing an input interface for IDI state streams, computer data links (RS232, modem data links, etc.), etc.
411) is provided.

In an alternative embodiment, the master music communication controller 415 provides additional functionality including a virtual playing mode, where the input interface (MIDI stream, computer data link, etc.) is music data for display, Conversion information,
The display request, one or more of the user's individual performance data, and the workstation are responsive to a master music communication controller to combine those individual performance data with the combined virtual performance. Receive data.

The workstation (105) accesses the music database storage means (420) that provides data for the requested song via the master controller (415). The master controller (415) communicates the requested music and user interface communication to the music communication system displayed on either the dedicated display (416) or the workstation (105) represented by the master controller (415). Show both. Music database (42
0) is local or on a data link (eg phone line, RF, etc.)
You may go through. In one embodiment, the motion sensor subsystem (422).
Monitors the target person's movements and responds according to predetermined motion interpretation characteristic parameters, such as for the conductor.

In a preferred embodiment, the user input means (411) comprises a keyswitch device such as a touch membrane keypad or a capacitance touch surface. Alternatively, in one of the preferred embodiments, user input is provided via touch screen technology. Touch screen technology enables the display of user interactive icons and descriptive text, including text and graphics, which allows unlimited customization of user input structures according to task requirements. Thus, the order of contact for a particular switch or touch screen may be associated with commonly used icons from the task being done with the words to give ultimate clarity. User error is virtually eliminated with the help of automatic entry error detection of defined fields, mandatory fields, etc.

Alternatively, the microphone input (527) provides coupling of user speech to the processor subsystem (580) using any of several commercially available and well-known speech recognition algorithms. it can. These algorithms, alone or as an adjunct to a touch screen or other haptic input mechanism, provide voice recognition input control.

The luxury version embodiment is provided with an output (421) that allows for the coupling of an external display, such as a color monitor, projection unit or other display display system, including one or more audio, visual and audiovisual. .

Further, the workstation display display output can provide an audio output display of the workstation-generated music performance in response to song data, user performances, combined virtual performance data, or external sources. In addition, visual or audiovisual displays can be provided to provide information feedback to the user as well as to and from individual workstations and / or from and to the master controller or conductor workstations.

According to another aspect of the invention, means are provided for moving the printed (displayed) musical notation in synchronism with the live performance from the displayed musical notation.

Musical notation, in a comprehensive sense, is in the form of text that supplements or replaces or partially replaces instructions, as well as chord tables, lyrics and chords (characters), tablature,
Staves, notes, sharps, flats and clefs, including written instructions, in any video, graphic, audio, audiovisual or other display form or alternative form of presentation such as a combination of the types of displays mentioned above. Used to refer to any method of communicating musical performance instructions, including but not limited to general musical notation, having.

The difficulty in playing music using some written notation (written on paper or displayed on a display device such as a screen) is that “page turning” is performed while playing music smoothly. Timing (or communicating the change to a third party, such as by touching a key or button). This is especially true when the user is marching and both hands are open at the same time.

According to one aspect of the present invention, means are provided for accepting input from one or more sources to initiate "page turning". Input types include traditional touch input devices (such as key switches or capacitive touchpads), motion sensing gears,
This includes automatic input when operating in the automatic mode operation mode. The motion sensing gear may be for a body part of the performer, such as a head tilt sensor or an optical eye movement sensor.

A further type of input that can initiate “page turning” includes a voice or sound recognizer built into the microcontroller system. This device has the ability to use (with very high precision) pattern recognition specific to the sound or user's voice and the spoken words. Of course, in the preferred embodiment, any type of user-actuated device, such as a foot or hand switch or head movement device or a sound or voice recognition system, selectively controls the override of the normal progression of musical performance. forgiven.

Overrides may advance or backtrack through the score independently of the normal reading of the score. The automatic mode, which is a play mode, blocks the user's override to allow performance in accordance with proper material timing, and is responsive to song data timing or, in optional embodiments, the performer. To respond to. It moves the score automatically as it is written, preferably with metronome time indications and indications of the appropriate place in the score where the performer should be at a particular time for that instrument. Indicates. This is particularly valuable in the conductor mode of networked communications where the conductor couples to one or more music workstations.

The user's performance can be compared to the score and feedback can be given to the performer regarding the quality of the performer's performance.

In the performance monitor mode, a user (
Or a remote teacher or conductor) can indicate the speed at which the user feels that the performer should perform at that speed. A microphone input to the music workstation samples the user's actual performance and uses a chart showing the relative synchronization of the performer's actual performance to the conductor's desired performance (to the user or teacher / conductor). Allows you to provide a mapping.

In an alternative automatic progression mode, the display of songs is synchronized with the player's actual performance. Therefore, rather than merely visually indicating to the teacher / conductor or the user how the performer's relative performance was to the written and displayed music,
By using the comparative performer according to the written music synchronization information, the display speed of the actual music can be adjusted so as to match the performer's speed.

With proper sound buffing, the conductor can monitor and control multiple instruments simultaneously, as long as the output sound patterns of each instrument are communicated directly to their respective workstations. .. The output of each of the workstations can then be coupled to the conductor's master workstation for further analysis and processing.

The oboe workstation may have a built-in slide boom with an ultralight microphone so that it can receive sound input from the oboe.
Electronic musical instruments such as guitars, keyboards and other electrical analog signal sources can be plugged directly into the appropriately buffered and filtered line inputs. Signal inputs can also be accommodated by a MIDI interface subsystem that allows both the use of data in workstation-to-workstation communication and the use of MIDI outputs at stations where the data is entered.

For one aspect of networked virtual performance and output display display, MIDI input and output are utilized on each of the individual workstations and on the master controller workstation to capture user performance and to the master workstation. Conversion into individual performance data including time synchronization information that enables communication becomes possible. The master workstation synchronizes and combines the individual performance data to produce combined virtual performance data. This data is then communicated to individual workstations. Individual workstations use their MIDI output interface to provide a display representation (eg, audio output) of the combined virtual performance data. Further, even if the virtual playing mode is not selected, providing a workstation with MIDI interface inputs and outputs, there are many other users who would benefit, as described elsewhere herein. In addition, various analog-to-digital converter input devices,
Other types of user performance-user performance data input devices and transducers are available, including audio signal capture, and are commercially available as is well known.

By combining the actions of the conductor and play modes, the workstation can be modified to provide training and performance comparisons to actual music.

Some music is only available in annotated form, where there is no existing signal indicating proper signal synchronization. Thus, controller subsystems (such as (580)) provide real-time conversion and syntax analysis of musical notation in conjunction with an accurate clock metronome, as well as location in sheet music (or other forms of musical notation). Relative timing of performance to (indicator
) (Such as color or other highlights or bold or emphasis).

Existing forms of music notation can be converted manually or scanning sheet music, using various elements of music (using optical character recognition), constants and variables and protocols. Recognizing syntax points and details in the form of notation, including integrating with artificial intelligence expert systems to notate, highlight and emphasize notation by synchronized metronoming of time signatures to music, etc. Can be converted automatically.
Any of a variety of other means of converting music can be used, such as direct input of a music performance signal that is processed through software that converts the input into a musical notation. Such software is available from ARS NOVA, Wildcat Canyon Software, Mark of the Unicorn, Inc., and Passport Designs.
ort Designs, Inc.) and the like.

Now that the musical notation is in a computer-usable form, it communicates, displays, composes, modifies and transposes music (keys and summons for the type of instrument or voice) via well known techniques. (Voice etc.) is an easy process.

Further, when the user input is converted into the user performance data for the workstation, the individual performance data of the user can also be used in the computer, and if the performance is appropriately converted into the performance data, Contains the appropriate sync data for the master controller performance sync signal. Therefore, both musical notations are in a computer-usable form (which facilitates display, modification and analysis / comparison), and user performance is in a computer-usable form (digital individual performance data), so that intelligent operation is possible. And providing analysis and utilization of both music information and user performance information to provide the user with various automation modes and features.

Implementations include a microprocessor, non-volatile storage memory, read / write memory and all required additional peripheral circuitry (a single chip including ASIC or CPU, DSP, A / D and other peripheral support circuitry). It is also possible in custom designs, including those available in microcomputer chipsets). These single or multiple chip solutions can be used to create specialized systems that implement the complete music workstation performance criteria and support very low cost, high capacity music workstation solutions.

Note the process of communication in standard notation while simultaneously allowing the interaction and communication of music media signals containing simple analog, digitized (analog-to-digital converted) individual performance data (representing the user's performance). However, strict adherence to that process and the fact that it can optionally include timing / synchronization data introduces a new form of communication.

The multi-CD ROM changer houses indexed storage of hundreds of thousands to millions of songs, enabling full standalone operation of user music workstations. Alternatively, an optional internal or external modem may be provided to allow intercommunication with a remote central music database management system that allows both communication for standalone operation and download (and disconnect). be able to. Thus, the workstation can remain online and retrieve music as needed, or can request that it be given a single or multiple songs of a musical composition. The song is then downloaded from the central database manager. The user workstation then disconnects from the music database management system and then stores all desired music locally in a (preferably non-volatile) storage device for standalone operation. The storage device can be a semiconductor, magnetic, optical or any other medium.

The use of virtual reality technology, including motion sensors and body gloves, allows a variety of other things to be monitored (as shown in FIG. 9). For example, as shown in FIG. 10, a camera associated with analysis logic, such as expert software, can monitor roll model behavior for motion and compare performer behavior. All hand, finger, arm, leg, eye, head, body and mouth movements can be monitored, and constructive and critical feedback accumulated and analyzed for performer training or performance or conductor communication And give feedback to the user or teacher.

Input of monitored motion data is provided to the user workstation to enable or allow for precise technical training such as finger position, violin or neck angle of the string to the neck of the guitar. The virtual link device such as the virtual reality glove and the head movement detecting device can be used to enable a virtual performance of music by the performer. Users can play songs with their own personalization, practically without any instruments.

For example, one guitar part may be displayed in a notation form, and actually played according to the timing of the user's finger movement (actual fret position or timing information only). To add further realism, using a full-scale guitar, keyboard, flute or other musical instrument and in combination with virtual effects, music playing and personalization (pe
rsonalization) can be given. Thus, for entertainment purposes, the user can play the violin part and play as part of the symphony orchestra.
If you play out of time, you will hear your instrument playing out of sync with the other orchestras.

There are many ways to implement a system of conductor motion interpretation. As illustrated in FIGS. 9 and 10, some use a body motion detection device common in virtual reality, sports medicine, etc., as described above, to identify certain motion patterns or signals associated with certain motion patterns. Identify parameters, display display, audio,
Start a video or audiovisual to give an indication of the conductor's movements and related. Alternatively, the command may be provided by a video camera or other video source (eg, a VCR) and use other techniques such as having the conductor interpret his actions and assign them unique meanings. It is possible to create lexicons of human actions and corresponding meanings.

For example, quickly moving the hand downwards from top to bottom indicates, in one aspect, “decreasing the volume”. When doing so and pointing at a particular section, the conductor indicates that only that orchestra section should be quiet. In this aspect, the camera input for movement, glove sensing for movement, or any other technique (such as audio, ultrasound, etc.) is used to track the movement as specified signal parameters or conductor input devices provide. The parameter signal of the meaning of the operating parameter may be able to have an associated meaning or index. For example, in the case of a virtual reality globe, its input would be (PC or MA
It will be the glove's signal output, as interpreted by the associated software in the processor (such as C (R)). Alternatively, for example, for video camera input,
It may be pattern recognition or analog signal comparison to determine the presence of certain signal patterns that indicate to the system to initiate automatic communication of the conductor presentation. By doing so, the conductor can quickly convey what he means, concentrate it on a particular instrument group and do so. There is no need to focus or focus on them for a long time to make sure they have received the signal of the conductor. Alternatively, you can focus on listening to see if they received the conductor's message.

FIG. 8 illustrates an alternative embodiment of the invention. In this example, the workstation is a remote unit (801-80) used by a member of the marching band.
3). Each of the remote units (801-803) comprises a receiver (810-812) that receives the songs transmitted to them. Remote unit controller (8
20-822) controls the operation of the remote units (801-803). The song is
It is displayed on the display (830-832) of the remote unit. The display can be an LCD multi-line display, which provides low cost, low power usage and high visibility / readability and has an auto-advancing mode. The display is
Automatically scroll the contents of the display screen as the music is played.

Each remote unit (801-803) can be mounted on the instrument or in place on the staff. The remote unit antennas (840-842) may be separate from or incorporated within the remote unit or staff.

The music is transmitted to the remote units (801-803) using the portable main unit (850). The portable main unit (850) is a portable main unit (850
), A music database storage medium (805) containing data of music to be played by the band, and a remote unit (801).
-803) and a transmitter (804) for transmission. The main unit may be in the form of a suitcase or briefcase sized article. The main unit may be built in a wagon that is driven near the band or provided as a self-contained small portable unit. According to this example, the band is
You can play a virtually unlimited number of songs without the problem of carrying them around in the form of paper. Band members are also freed from the problem of changing songs or changing pages while marching. In the play mode, the score automatically scrolls the screen display (830-832), as described in the example above. Further, a keyboard and / or a microphone is attached to the portable main unit, and the display (830-832) or the unit (801-803) is used.
) And the associated speaker to allow the conductor to send a message to the remote unit. This allows the conductor to send commands to the band (taking a path or playing at different volumes or speeds). With two-way communication and user performance feedback, the conductor can also monitor for errors.

FIG. 9 illustrates a conductor, back or other person with sensor gloves (935) on each hand and a head and eye movement monitor (930). This figure also shows the conductor wearing the full body sensor equipment (940). Either the example or the combined example can be used to map body movements. With only the glove (935) or body sensor (944), the movement of the glove or sensor can be captured by the video system, as shown in FIG.

Another method of capturing movement relies on a special sensor (944) located on the performer's joint, such as via a sensor bodysuit (940). Once the movement is photographed or analyzed, a data set is created that interprets the movement in Cartesian coordinates. These coordinates give the spatial location of each of those markers. This information is then organized and put into an animation package.

FIG. 10 shows a video camera (1005) and a standing conductor (1015) (or performance being tracked, with or without a blue screen (1010) behind it). (Playing musicians that are virtually linked). The video camera (1005) receives the video signal from the video processing system (
1020). It uses signal processing to provide signal pattern recognition capabilities. The blue color of the screen is filtered out by signal processing such as Ultimatte processing.

In one embodiment, the conductor is wearing the sensor-equipped bodysuit (940) and gloves (935) of FIG. In another embodiment, the conductor wears only the sensor equipped glove (935) of FIG. In yet another embodiment, conductor movements are picked up by the video camera (1005) and processed without a sensor suit.

Seeing the conductor's rapid hand movements, specific range of hand movements, face and head movements,
Simple things like focusing on arm movements as well as body language are all programmable into the cognitive knowledge base. Some of the techniques for perfect mapping of body movements that exist in making today's video games include Video Sy, October 1995.
Stems magazine, Volume 21, No. 11, page 42 and NEXT Generation magazine, October 1995, pages 49-54, both of which are incorporated herein by reference.

In any case, now that the system has knowledge of movement recognition, the system interprets and utilizes them to convey presentation information to members of the ensemble or orchestra or studio, or to analyze the movements of the performer, or , Can enable virtual playing. One example would be a large screen or multi-large screen television for the viewing of members of a group of viewers. Alternatively, each music stand can be provided with a picture-in-picture display of the conductor's special movement in the area of the display that is not currently showing music. The music stand is
This embodiment may have the intelligence to compare the played music with the played music, so that this embodiment may have been played or for some time (eg, at least 10 seconds in either direction; Other criteria may be used to set the desired performance environment characteristics) to allow the display of messages in portions of the music display area that are not played.

Voice recognition and response to conductor annotations can supplement the system.
The system may record the message, interpret to whom the conductor directed the message, and either audibly convey it or translate it into a text or iconic representation as part of the audiovisual representation of the system.

Referring to FIG. 11A, an alternative embodiment of the automatic mode “A mode” of FIG. 2C is illustrated. The process shown for automatic mode 240 in FIG. 11A includes the process steps of automatic progression A mode 1, training A mode 2, playing mode A mode 3, which are A modes 1, 2, and 3 shown in FIG. 2C. Is equivalent to
However, as shown in FIG. 11A, in step 1148, it is determined whether or not the conductor automatic mode is selected, and if it is determined as “yes”, step 11
At 49, automatic mode 4 is entered. If "no" is determined, then the logic proceeds to networked virtual performance mode A mode 5, as determined in decision logic step 1150. In response to the selection of the virtual performance mode connected to the network, the A mode 5 (1151) is executed. If network connection mode A mode 5 is not selected, processing proceeds to decision logic step 1152 to determine if synchronization of display to performance (mode A6) has been selected. If so, the process proceeds to step 1153 to provide the A mode 6 function. Step 1154 for automatic mode processing
Ends with. It should be noted that since the automatic modes are cumulatively selectable, networked virtual performances may include other A modes 1, 2, 3, 4, 5 and 6 or other A modes that may be provided. It is possible to include any or all of the automatic modes. It should also be noted that, as shown in more detail in FIG. 13, the track of the user's performance to the display of the song (step 272 of FIG. 2D) requires the logic required for A-mode 6 (synchronization of the display to the performance). Is to give the first part of.

Referring to FIG. 11B, there is shown an alternative overall operation of the music communication system, which replaces that shown in FIG. 2A, showing additional automatic modes, including network virtual playing mode A5. FIG. 11B shows an alternative control logic structure for network selection, where decision logic proceeds in a manner similar to FIG. 2A. Calculation is step 1
Beginning at 100, the mode is selected at step 1110. If the song is selected at 1120, and the decision logic 1120 determines that the song is selected, the process proceeds to step 113.
Go to 0 and select the mode. If no song is selected, the process returns to the song selection step 1110. Once the song is selected, step 1130 as shown.
A mode is selected at, and the decision logic of the selection mode 1140 determines whether the selected mode is (1), (2) or (3) below. That is, (1) display mode, in which case processing proceeds to step 220 of FIG. 2A, (2) song change mode, in which case processing proceeds as from step 215 of FIG. 2A towards the yes branch, or (3 ) A selection mode for determining that a networked virtual playing mode has been selected, in this case the process proceeds to networked mode automatic mode 5, ie step 1150, as shown in more detail in FIG.
Is.

Referring to FIG. 12, the networked virtual playing process flow, step 1150 of FIG. 11B, is shown in more detail. In step 1150, the automatic mode of networked virtual performance was selected. This automatic mode 5 is handled by proceeding to verify song selection. At step 1220, the user's performance is captured (eg, with a microphone or via MIDI) and converted into individual workstation performance data. This data is then broadcast by each of the plurality of individual music stands to a designated master controller.
In step 1230, the controller receives the individual performance data of the plurality of users and combines them to generate a combined and combined performance data representing the plurality of individual performance data. This combined performance data is then broadcast to all of the individual music workstations. At step 1240, each of the plurality of individual music workstations provides an output (eg, audio) in response to the combined performance data representing a combination of the plurality of user audio performances of the music synchronized with the display display of the music. . Timing synchronization data is provided to synchronize the individual performance data of multiple individual music workstations to each other and to the display display of the selected song, allowing audio playback and set-up at the individual workstations in near real time. It facilitates synchronization for matching purposes and provides apparent real-time feedback of each user's performance in combination with all other individual users playing on each individual workstation. At step 1250, an analysis is made as to whether the song is over. If so, the process is completed in step 1260, and the automatic mode 5 ends. Otherwise, if the process is not over, it means the song is not over, and the process proceeds to step 1220, as shown.
Return to.

Referring to FIG. 13, automatic mode 6 corresponding to synchronizing the actual display of the display to the user's performance, resynchronizing the display of the music to make up for the actual performer's timing and any errors or differences. Is shown. The automatic mode 6 is similar to the A mode 1 without overriding, but is not similar to the A mode 3 which automatically advances independently of the performance of the user. In step 1153, automatic mode 6 is entered.
At step 1310, similar to step 272 of FIG. 2D, the user's performance is tracked and stored for comparison to the music display display for the timing of where the performance should be. At step 1320, the tracked performance is compared to the score to generate offset performance data for the performer. In step 1330,
The error is used to resynchronize the display display of the music to match the actual user's real-time performance timing with respect to the display display and the user's performance start synchronization with the music display on the display. At step 1340, an analysis is made as to whether the process is complete (eg, is the song over?). If so, A-mode 6 ends at process step 1350, and the automatic mode of processing can be terminated or another automatic mode can be checked. The process may begin for another selected automatic mode.

Referring to FIG. 14, a communication architecture and system according to the present invention is shown. There are a plurality of individual music workstations 1410, each of which responds to a user playing the music input (1411). Music inputs are processed by individual music workstations 1410 and provide a combined performance data output 1412 for communication to control system 1450. The control system may be a master controller or a master workstation that is coupled to receive and process individual workstation performance data for a plurality of individual workstations. A communication interface 1413, such as a modem, can provide coupling and communication between individual workstations 1410 and master controller 1450. In one embodiment, the modem 1413 is coupled to the corresponding modem 1455 via the public network. Corresponding modems couple to the master workstation for two-way communication between individual workstations and the master workstation. Alternatively, some kind of cable, hard-wired or wireless communication interface may be provided, which will work to the same extent in accordance with the invention. The master controller 1450 is responsive to individual performance data outputs from a plurality of individual workstations and provides a combined and synchronized virtual performance data output 1451. The output is coupled to a plurality of individual workstations via a communication network. Each of the workstations provides an output (eg, audio) 1415 representing the combined performance data for display to the user. Audio and / or visual display output 1452 may also be provided at the master workstation.

Referring to FIG. 15, a data flow and communication architecture for one embodiment of the present invention is shown. A music communication system is provided having a plurality of physically distinct, remotely located locations, each having one or more individual music workstations. Each individual music workstation provides a communication output of individual performance data of the user performance of the displayed song on that individual workstation. As shown, master controller 1505 is coupled to communication infrastructure 1510 at a first location. Multiple individual music workstations 1
511, 1512, 1513 and 1514 are coupled to the communications infrastructure 1510 at location 1 shown in Performance Group 1. Similarly, location 2, performance group 2, provides individual workstations 1521 and 1522 that are coupled to communication infrastructure 1510, and location 3, performance group 3 provides individual music that is coupled to communication infrastructure 1510. Workstations 1531, 1532 and 1533 are provided. A plurality of individual workstations 1511, 1514, 1421-1522 and 1531-1533 each provide individual performance data and a number of separate time samples of performance data (eg, time, segments of data). The performance data, which may include synchronization information therein, is communicated to the controller or master workstation 1505 via the communication infrastructure 1510. The resulting output (eg, voice) from the individual workstations is resynchronized and combined performance data of a plurality of individual performance data that are resynchronized for each of the time segments of the output.

Referring to FIG. 16, a data word structure for one embodiment of the present invention is shown. The data structure for each user performance data can not only give the start of a word, cyclic redundancy code (CRC) word, performer's ID (unique address of each workstation) (unique ID, Control information, including instrument type indications), and headers containing other control information for other operating modes as well as virtual performance, payload data representing actual performance data and timing synchronization data. It is illustrated as including. Similar to the present invention, any other data word structure providing header information including control information, payload information including performance data, and some timing synchronization mechanism, whether or not part of the user performance data word. Works well on.

FIG. 17 is in the form of a block diagram illustrating a network interface subsystem and a music data processor subsystem for one embodiment of the present invention, which is compatible with architectures such as those described in FIGS. 1-15. 1 shows an example of a networked system. FIG. 17 shows a single individual workstation 171
0, but a networked system (similar to the plurality of individual workstations 1410 in FIG. 14) typically includes a plurality of individual workstations 1.
Including 710. Individual workstation 1710 provides communication with master workstation 1790 (similar to the communication architecture with master workstation 1450 in FIG. 14). Musical performance by user (1712) is coupled to input interface 1715, which provides musical performance data to music data processor 1720. The processor may be a MIDI based processor, which provides the processed music performance data output to the network communication interface 1730. The interface outputs individual music performance data 1731 for coupling to the master workstation 1790 via the communications infrastructure.

The master workstation 1790 is a plurality of individual workstations 17
The individual musical performance data 1731 from 10 is processed to provide an output 1791 of the combined virtual performance data. Both the individual musical performance data and the combined virtual performance data include separate time-segmented data samples. The combined virtual performance data is synchronized within each sample time to provide a synchronized combination of individual musical performances for that time segment.

The network interface subsystem 1735 responds to the combined virtual performance data by providing a synchronized virtual performance data output to the music data processor 172.
5 (for example, MIDI). The processor provides sound output of combined virtual performance data corresponding to the synchronized combination of individual music performance data from a plurality of individual workstations 1710. In addition, individual workstations 1710 provide data analysis and display processing 1740. This provides, among other things, an output to a display means 1745, such as an audiovisual or video display or an audio output, in response to the combined virtual performance data. It should be noted that in the preferred embodiment, a number of individual network workstations 1710 are synchronized (eg, in response to a sync signal from master workstation 1790) such that a plurality of individual workstations are individually synchronized. It is to start display of music at the same time for synchronization of user performance. In one embodiment, the output of individual performance data (such as via a MIDI music processor) includes timing synchronization information. The master workstation uses this information to synchronize all of the musical performances that represent the individual musical performance data and play them together substantially in a combined and synchronized performance. The combined virtual performance data representing the synchronized virtual performances is then sent back (eg, broadcast) to the individual workstations and via the network communication interface 1735 the music data processor 1 of the individual workstations.
Combined back into 725 to provide the corresponding audio and / or visual output. If the master workstation is for conductor or teacher, not only network virtual performance mode but also conductor mode or teacher mode is available. In fact, all of the automatic modes can be selectively combined, such as by providing overlapping functionality via software.

Referring to FIG. 18, the individual network connection workstations NWS ₁ , NWS
A timing diagram of individual performance data and synchronized virtual performance data for signals output from WS ₂ , NWS _N and master workstation MWS is shown. As shown, the master workstation MWS provides a sync signal to initiate synchronization of all workstations (NWS) coupled to the system. In the preferred embodiment, the individual workstations (NWS) initiate the display of the song in sync with the sync signal from the master workstation (as the master workstation does). In response, each individual workstation can display the song and the workstation user can play the song. Individual workstations (NWS) provide individual performance data in response to user performances. As shown, workstation N
WS ₁ provides performance data A and B at each time, while individual workstation NWS ₂ provides performance data C and D at each time, and independent workstation NWS _N provides individual performance data at each time. Performance data signal E
And F are given. During the first time segment, individual performance data A, C and E are output from individual workstations 1, 2 and N, respectively. However, as shown in FIG. 18, the relative timing of the output of individual performance data (and its reception by the master workstation) is offset from each other. The master workstation resynchronizes the individual performance data A, C, E within each time segment, recombines, reconstructs, and provides synchronized A, C, and E outputs to provide synchronized composition. Give the combined virtual performance data. It should be noted that the synchronized virtual performance data A, C, E including both the individual performance data and the corresponding response-synchronized virtual performance data is the first time segment T1.
It happens within. The maximum time delay T _D is the time from the user's performance output of the corresponding individual performance data to the time when the same individual workstation receives the synchronous virtual performance data corresponding to the individual performance data and gives it as an audio output. Represents the worst case time acceptable for the user to endure. Similarly, during timeslot 2, each of the individual workstations is slightly offset from each other to provide the individual performance data B, D and F,
The master workstation is a combination of synchronized virtual performance data B, D, F.
give. It is sent back to the individual workstations to produce the audio output.

The present invention finds application in many different environments and embodiments. For example, live practice can be done from multiple locations while one or more musicians edit the score, communicate the changes in real time, and replay them. It is possible for the orchestra to be in one place and the singer to be in another. Make music,
Editing and synchronizing to movie scores can also be advantageously facilitated by the present invention. For example, in a movie, many elements change dynamically, requiring resynchronization. For example, a scene can grow or shrink and the soundtrack must be adjusted. Scores made for a movie must be rewritten to include the edited movie. Generally, composers make scores at home or in the studio. The score is sent to the movie studio. However, movie studios may edit scenes that use music, for example, a three second reduction in the scene. The edited scene is returned to the composer so that the composer can shorten the music. This process is slow, inefficient and hinders the manufacturing process. By using the present invention, this can be done in real time from a remote location. The virtual playing mode and other modes of music communication of the system can be advantageously used for this application.

This system provides the infrastructure for the music internet. This is applicable to interactive editing of music. It can provide a special one-to-one mode for teaching and performance evaluation. It can facilitate adapting the display of music to the performer's performance, or it can align the display with the metronome and force the user's performance to be synchronized with the metronome timing. Music can be easily composed, edited, transposed, etc. from any of multiple individual workstations or on a single standalone workstation. Many individual music workstations (IMW) (Individual Music)
The Work Station) is capable of communicating with each other both data and audio such as voice and / or music and / or supplementary data such as video, audio, data files, control signals, applets and the like. Bands can be practiced at home without the inconvenience of either practicing alone or having to physically meet together in a large group. A singer may have one, two, or even all of them physically located far from each other (eg, LA, NY, etc.), but with other instruments or You can form groups with other singers.

A large number of musical instruments can be played at one place. There are many options as to how the IMW can be assigned. For example, (1) I for each place
MW (individual music workstation), (2) IMW for each instrument type, (3
) One IMW for each performer (eg instrument, vocal). (1) IM
There are also numerous options for network connection communication between Ws and / or between the IMW and the master workstation. The modes can be selectively mixed, tied and combined, such as (1) fully automatic mode enable mode, (2) virtual playing mode, full audiovisual, (3) audio link only mode. Complex music sound analysis algorithms applied to user input to detect features such as simple analog-to-digital (A / D) (eg, instrument type, pitch tone, voicing, weakening, amplitude, vocal symbols, etc.) There are many options for signal processing modes that can generate individual performance data. Selected song data (corresponding to data displayed on IMW receiving performance input for analysis) (eg, to (3) between "(1)" and "(2)", There are also a huge number / parameters of performance analysis algorithms that can be selected, which utilize the sound features generated by the sound analysis of the user's performance. In addition, many types of data include (1) IMW, (2) IMW and master workstation and (3
) Communication is possible between the IMW and an external communication interface. Examples of that type of data include performance data, video data, processed / analyzed performance data, audio signals, data files, and the like.

Referring to FIG. 19, the memory workspace structure of both individual and master workstations in virtual playing mode is shown. Each of the individual workstations will have live performance data, individual performance data (Individual
Performance Data) IPDXXX music data buffering is provided, and incoming virtual performance data (Combined Virtual Performance Data) CPDXX
Give more memory of X. This buffering is done in the read-write memory in each IMW. Similarly, a data structure for a memory buffer of a master workstation is shown, a separate one for each of a plurality of individual workstations WS ₁ -WS _N , providing storage for each associated respective performance data IPD AN. Indicates the buffer storage location of the. In one embodiment, the IMW is provided with multiple frame buffers that allow multiple time segments of IPD and CPD to be stored in a buffer structure, which buffers both input store and output retrieve operations. Can be supported. Other data structures and buffer operations are compatible with this invention. The structure of the data word can be modified or adapted within its existing structure to allow the transfer of supplemental data transferred from the IMW or the master workstation, or between the IMW or between the IMW and the master workstation. make it easier. By utilizing the illustrated or other compatible data buffer structure, the timing and synchronization (with the type stored in the frame buffer) is not only for communication workstations but also for operations within the IMW. Asynchronous communication becomes easy. Frame buffering allows individual workstations and master workstations to either dump the resulting output to a buffer or receive asynchronously buffered input individual performance data relative to other operations of their respective workstations. . The IMW can facilitate operation in one mode or in multiple modes at the same time.

From the above, it will be appreciated that numerous variations and modifications can be made without departing from the spirit and scope of the invention. It is to be understood that no limitation to the particular devices illustrated herein is intended or should be inferred. Of course, the appended claims are intended to cover all such modifications as fall within the scope of the claims.

[Brief description of drawings]

FIG. 1A is a diagram showing a music display system according to the present invention.

FIG. 1B is a diagram showing a music display system according to the present invention.

FIG. 2A shows a flowchart of a process according to the present invention.

FIG. 2B shows a flow chart of a process according to the present invention.

FIG. 2C shows a flow chart of a process according to the present invention.

FIG. 2D shows a flow chart of the process according to the present invention.

FIG. 2E shows a flow chart of a process according to the present invention.

FIG. 2F shows a flow chart of a process according to the present invention.

FIG. 2G shows a flow chart of a process according to the present invention.

FIG. 3 illustrates one embodiment of a display for a music display workstation and input device according to the present invention.

FIG. 4 illustrates an embodiment of a shared music database and stand-alone workstation according to the present invention.

FIG. 5 is a diagram showing a music communication system according to the present invention.

FIG. 6 illustrates a master workstation and a slave workstation according to the present invention.

FIG. 7 illustrates an alternative embodiment of the invention using one or more workstations coupled to a master controller and music database.

FIG. 8 is a diagram illustrating a marching band environment according to the present invention.

FIG. 9 illustrates a person equipped with a sensor bodysuit according to one aspect of the invention.

FIG. 10 illustrates a motion and pattern recognition system according to one aspect of the invention.

FIG. 11A illustrates a flow chart for an alternative embodiment of the operation of the automatic mode “A mode” 240 of FIG. 2A, which is an alternative to that illustrated in FIG. 2C.

11B is a diagram illustrating a process flow for an alternative overall operation of FIG. 2A of a music communication workstation according to the present invention, wherein steps 200-250 of FIG. 2A are further illustrated in FIG. It is redefined to show the overall operation including the specific networked mode A mode 5 as described above.

FIG. 12 illustrates a process flow for the networked virtual playing mode 1150 of FIG. 11B.

FIG. 13 illustrates a process flow for automatic mode 6 corresponding to process step 1153 of FIG. 11A regarding synchronizing display to performance and resynchronizing display of music to account for performer error. It is a figure.

FIG. 14 is a diagram illustrating a communication architecture according to the present invention, wherein each individual music stand 1410 receives a music input 1411 and provides a performance data output 1412 coupled to and in communication with a master workstation. , The master workstation produces an output of virtual performance data 1451 in response to the composite of the plurality of individual performance data signals, the virtual performance data 1451 being re-communicated to all of the plurality of individual workstations 1410. Gives an audio output in response.

FIG. 15 is a plurality of physically separate remote locations, such as teacher / master conductor / server locations, and each of a plurality of locations providing communication of performance data to users of individual workstations at each of those locations. FIG. 6 is a diagram illustrating an example of a dataflow communication architecture for a populated location where timing information is used by a master workstation to reconstruct and combine all individual performance data into a composite virtual performance data output, Responsive to a plurality of individual workstations that provide audio output.

FIG. 16 is a diagram illustrating a data word structure compatible with one of the embodiments of the present invention.

FIG. 17 illustrates a block diagram for a workstation (generally shown in FIGS. 5-7) that further includes a network interface and a MIDI performance data processor.

FIG. 18 is the architecture illustrated in FIGS. 14 and 15 and FIG.
FIG. 3 is a diagram showing a timing diagram showing the synchronization timing of the data structure exemplified in FIG. 1, and also showing the combined synchronized virtual performance data and a plurality of individual performance data.

FIG. 19 is a diagram showing an example of a memory workspace structure for an individual workstation and a master workstation in a virtual performance mode according to the present invention.

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) G10H 1/20 G10H 1/20

Claims (44)

[Claims] 1. A music display system comprising individual workstations, each workstation comprising: (a) a memory for selectively storing song data representing a selected song; and (b) Means for generating a display display in response to each music data, (c) Means for determining the selected display form, (d) Stored music data in response to the selected display form Responsive to the data processing means for selectively processing and generating a corresponding particular display presentation, and (e) displaying at least a video display of the song in the selected presentation. , At least one display subsystem. 2. A system for use by multiple users in providing multiple display representations of a selected song, the system comprising: a plurality of individual workstations and a plurality of selected workstations for the selected song. Means for displaying the presentation on the local visual display display of the. 3. A system for use by multiple users in providing multiple display representations of a selected song, the system comprising a plurality of individual workstations, each of the individual workstations comprising: , Further comprising a communication interface providing communication of music data representative of the selected music to each individual workstation, the system further for displaying the presentation on a plurality of local visual display displays for the selected music. The system of claim 1, including the means of: 4. The system of claim 2, further comprising means for displaying the presentation on a plurality of local visual display displays for the selected song. 5. The system of claim 2, further comprising an input device responsive to a user playing the displayed song to provide an output of user playing data. 6. The system comprises at least one of the individual workstations.
6. The system of claim 5, which provides a display indication of the differences between the displayed song data and the user performance data. 7. The system of claim 4, wherein the means for synchronizing is responsive to at least one of music data, timing data, and timing signals embedded within external timing signals. 8. An input device responsive to a user's performance of a displayed song to provide output of user performance data, and a plurality of output devices in response to user performance data output from each of a plurality of individual workstations. 4. The system of claim 3, further comprising: combining means for synchronizing and combining user performance data from the individual workstations of to generate composite virtual performance data. 9. A modified sub-system further comprising: an editing subsystem for modifying at least one characteristic of pitch, key, tempo, instrument type, notation and composition of music data to create modified music data. The system of claim 3, wherein the music data is communicated to at least one of the individual workstations that provides a local video display in response to the modified music data. 10. The system of claim 9, wherein the modified song data is distributed to a plurality of individual workstations, each of which provides a local video display in response to the modified song data. 11. The system of claim 9, wherein the editing subsystem is part of at least one of the individual workstations. 12. The system of claim 9, wherein the modification is restricted to permit modification of only some of the features. 13. The system of claim 9, wherein feature changes are limited to a defined permission level. 14. The system of claim 10, wherein there are multiple editing subsystems and feature changes are programmably restricted to a defined permission level for each of the editing subsystems. 15. A plurality of individual workstations are associated with each defined subset of individual workstations, each of the editing subsystems being associated with and associated with at least one of the defined subsets. Communicating each modified song data to a defined subset of individual workstations, each of the workstations providing a respective local display indication in response to the respective modified song data. 10. The system according to 10. 16. The system of claim 15, wherein at least one of the editing subsystems is a parent device that communicates its respective modified song data to all of the plurality of individual workstations. 17. The modified song data from the parent device takes precedence over all modified song data from all others of the editing subsystem for display on an individual workstation. Item 16. The system according to Item 16. 18. The system of claim 3, wherein communication between individual workstations is bidirectional. 19. The system of claim 9, wherein the change is responsive to user input. 20. The system of claim 19, wherein the user input is at least one of voice stimuli, digital data, switches, touch input devices, motion sensors, motion capture data and language recognition. 21. A plurality of editing subsystems are present, and a plurality of individual workstations are associated with each defined subset of individual workstations, each of the editing subsystems being of a defined subset. Each of the editing subsystems associated with a selected one of them communicates its respective modified song data to each of the associated and selected subsets of the individual workstations defined, The system of claim 9, wherein each of the stations provides a respective local display indication in response to the respective modified song data. 22. Modified song data from the parent device is for display by all individual workstations to any and all other modified song data from all others of the editing subsystem. 22. The system of claim 21, wherein the system is prioritized. 23. At least one of the editing subsystems is of a subgroup that communicates each modified song data to each associated and selected one of the defined subsets of individual workstations. 22. The system of claim 21, which is a parent device. 24. The system of claim 22, wherein there are multiple subgroup parent devices. 25. The system of claim 23, wherein at least one of the editing subsystems is a parent device that communicates its respective modified song data to all of the plurality of individual workstations. 26. The modified song data from the parent device takes precedence over all modified song data from all others of the editing subsystem for display by individual workstations. 25. The system according to item 25. 27. The parent device is for use by at least one of a conductor, a band leader, a teacher, a librarian and a composer, each of the plurality of sub-groups of the parent device being a section leader, 26. The system of claim 25, for use by at least one of a band reader, teacher and librarian. 28. The music data further comprises type data, wherein at least one of the individual workstations is programmed to selectively receive the communicated music data in response to the type data. The system described in. 29. The system of claim 28, wherein there are a plurality of individual workstations, each being programmed to selectively receive the communicated song data in response to respective type data. . 30. At least one of the individual workstations is responsive to at least one of pre-programming, switch, audio input, direct line input, MIDI data, user programming and remote program control to a particular type. 29. The system of claim 28, which is programmed to respond. 31. The song data further comprises type data, wherein the song data is broadcast to a plurality of individual workstations, each of the workstations including the song data to customize the video display display according to the respective type data. The system of claim 3, wherein the system provides a local video display display in response to processing the song data for local conversion. 32. The system of claim 3, further comprising a conductor workstation for providing controlled and addressable song data communication to at least one of each of the plurality of individual workstations. 33. The communication is selectably addressable to a defined subgroup within a plurality of individual workstations that provide band-based communication, the communication being sub-addressed to each of the respective bands. 33. The system of claim 32, mapped to and from each of the groups. 34. Individual workstations are operable in a user-selected automatic mode, which includes automatic progression mode, training mode, playing mode, automatic repeat mode, conductor mode, marching band mode, automatic mode. The system of claim 1, comprising at least one of a composition mode, a self-learning mode, and a user activated display page turning mode. 35. The system of claim 3, wherein one of the individual workstations is a master workstation that communicates with the rest of the individual workstations. 36. The system of claim 1, wherein the processing includes at least one of display format, transposition, and communication to an external music display system. 37. Each of the plurality of individual workstations is provided with means for independently capturing the music performance of each user, and means for producing each individual performance data and responding to the performance data. Means for synchronizing and combining individual performance data from a plurality of individual workstations to generate a combination performance data, and for communicating said combination performance data to a plurality of individual workstations At least one of the individual workstations is responsive to the combined performance data to provide a local display representative of the combined music performance to all of the plurality of individual workstations in communication. The system of claim 3, wherein: 38. The system of claim 5, wherein each of the plurality of individual workstations provides an output of individual musical performance data representative of a musical performance by the user corresponding to a display display. 39. Synchronizing means for generating a synchronizing signal for starting playing, wherein the selected song is played over a period of time and communicated in discrete time segments, each of the time segments being The system of claim 3, wherein the system is synchronized in response to the output of the sync signal and the individual performance data. 40. Means for storing user performance data simultaneously with corresponding display on display in response to a performance by the user; means for comparing the user performance data with respective associated music data; 6. The system of claim 5, further comprising means for changing the display of the display to reflect the results of the simultaneous playing of the data. 41. Associating means for associating types with individual workstations and control means for broadcasting display data for a number of different graphical display representations, corresponding to a number of different types. In addition, each individual workstation further includes a distinguishing means for distinguishing between a number of different graphical displays, and in response to the associating means and the distinguishing means, a particular one of the types representing the corresponding respective type. The system of claim 3, wherein the system is selected. 42. The display display is one of visual and audiovisual, and the system comprises a secondary video data source representing the secondary video image and a picture-in-picture in a sub-portion of the display display. Video controller means for displaying a secondary video image.
The system according to 1. 43. The system of claim 41, wherein the display representation is one of audio, visual and audiovisual. 44. The method of claim 3, further comprising means responsive to communicated performance data from at least two of the plurality of individual workstations to provide a combined output of composite virtual performance data. system.