CN100428664C - Method for triggering and inserting synchronous message of data stream - Google Patents

Abstract

The synchronous message triggering method of the data stream processes the data frame and the command frame of the data stream, reads the data of the data frame when judging that one frame in the data stream is the data frame after reading the data stream, and obtains a command identification code of the command frame when judging that the frame in the data stream is the command frame so as to execute a program corresponding to the command identification code. In addition, the method for inserting the synchronization message into the data stream of the present invention is to play a data, insert a command frame at a proper time point, separate a data frame from the data before inserting the command frame, and finally combine the data frame and the command frame to generate a data stream including the data frame and the command frame.

Description

Synchronization message trigger of data stream and method of inserting synchronization message

technical field

The invention relates to a method for triggering and inserting synchronous messages of data streams, in particular to a method for synchronously executing related messages during data stream processing, and a method for arranging the synchronous messages in data streams.

Background technique

In the application of sound-producing products, it is often required to achieve synchronization between sound and other actions. For example, when a toy robot speaks, it often needs its limbs and facial features to cooperate to make some actions at the same time. Most of these products are composed of a microprocessor (uP) plus some peripheral devices. Through the ingenious arrangement of its program, the microprocessor, on the one hand, synthesizes the sound signal and outputs it to the speaker; on the other hand, it controls the voltage potential of its specific output pin at an appropriate time. If the output pin is externally connected to a light-emitting diode (LED), it can control the LED on and off; if the output pin is connected to a motor, it can control the activation or deactivation of the motor.

However, how to change the voltage of the output pin at an 'appropriate time' in accordance with the progress of the sound is a complicated task. With currently known techniques, the programmer must first measure the time difference between when the sound starts to play and when the action starts to activate. Then use a timer (Timer), fill in a conversion value representing the time difference, and start timing at the same time as the sound is played. When the timer overflows (meaning that the timing is over), an interrupt program is executed to change the potential of the output pin.

Although the above method can reach the purpose of synchronization of microprocessor (uP) instructions and sounds, it still has the following disadvantages:

1. It takes a lot of time: every action that needs to be synchronized must measure the time and repeatedly adjust the value of the timer. Such a try-and-error approach is neither direct nor efficient.

2. It is not enough to cope with complex applications: when the program design becomes more and more complex, uP is likely to handle multiple tasks at the same time, which may make the playback rate of the sound slightly slower, but the time set by the timer in advance is still will not slow down so that the motion is still out of sync with the sound. In addition, if the sound playback rate is allowed to be changed arbitrarily by the user, the same problem will also occur.

Contents of the invention

The object of the present invention is to propose a new operation method according to the above-mentioned known technology, cooperate with special data structure and processing skills, more efficiently arrange synchronous actions in the data stream, and simultaneously make sound playback and action generation The time point can be fully controlled, and there will be no problem of out-of-sync movement and sound.

In order to achieve the above object, the synchronous message triggering method of the data stream of the present invention is to distinguish a data frame and a command frame in a data stream, and when reading the data stream, if it is judged that the data stream When a frame (frame) in the data stream is the data frame, read the data of the data frame, and if it is judged that the frame in the data stream is the command frame, obtain a command identification code of the command frame to execute the command frame A program corresponding to the command ID.

Simultaneously, the method for inserting a synchronous message into a data stream of the present invention is to convert the data into a digital data stream by playing a data mode, so that it includes a data frame composed of data frame information and digital data, and selects a A command frame is inserted into the data frame at an appropriate time point, and finally the data frame and the command frame are combined to generate a data stream including the data frame and the command frame. Wherein, the data frame is one of a complete data frame and an incomplete data frame.

In this way, the data stream includes data frames and command frames at the same time. When the microprocessor reads the data stream, it can perform corresponding processing according to the data stream and the attributes of each frame. When data is used, the data is read directly, and when it is determined to be a command, a program can be executed according to the command to generate corresponding synchronous actions, thereby achieving the purpose of the present invention.

In the synchronous message triggering method of the data stream of the present invention, the data stream is a digital data stream. The data frame includes a data frame message and a voice data. The data frame information includes a frame identification bit and a sound data length data, and the frame identification bit is used to determine that the frame is the data frame. The command frame includes-command frame information including the command identification code. The command frame message also includes a frame identification bit, and the frame identification bit is used to determine that the frame is the command frame.

In the method for inserting synchronous information into a data stream of the present invention, the data is a whole piece of audio data. The data frame includes a data frame message and a segment of audio data. The data frame information includes a frame identification bit and a sound data length data, and the frame identification bit is used to determine that the frame is the data frame. The command frame includes a command frame message. The command frame message includes a frame identification bit and a command identification code, and the frame identification bit is used to determine that the frame is the command frame. The data stream is a digital data stream. The playback mode presents the data on a screen in the form of sound waves. The method of inserting the command frame is to click on the sound wave, and add the command frame at the corresponding appropriate time point. The data frame is divided into a complete data frame and an incomplete data frame.

Description of drawings

The present invention will be understood more deeply by the following detailed description with reference to the accompanying drawings:

FIG. 1(A) is a schematic diagram of inserting commands into voice data according to a preferred embodiment of the present invention.

Figure 1(B) is the data flow corresponding to Figure 1.

Fig. 2 shows various frames of the preferred embodiment of the present invention.

Fig. 3 is a processing flowchart of a preferred embodiment of the present invention.

Detailed ways

Please refer to Fig. 1(A), in terms of operation, the present invention proposes the concept of closely combining the trigger information of the synchronous action with the sound data, and changes the one-dimensional time relationship between the sound and the synchronous action into a two-dimensional image. , and allow the user to design the activation time of the synchronous action in the two-dimensional image.

First, with the aid of a personal computer (PC) program tool, the waveform of the sound, that is, the sound wave 22 is displayed on the screen 21, and the user can listen to the sound waveform repeatedly through the sound effect device of the PC. Secondly, according to the concept of closely combining the trigger information of the synchronous action with the sound data, after listening to the sound, the user can directly insert the trigger information of multiple synchronous actions into the appropriate position of the sound waveform with the assistance of the PC program tool , for example insert command 00 at time T1, insert command 01 at time T2, and insert command 02 at time T3. Finally, the original sound data and the newly inserted synchronous trigger message are generated by the PC program tool in the data structure mode proposed by the present invention to generate the data stream of the present invention, which can be stored as a new file, and its corresponding data stream is shown in Figure 1(B) shown. In Figure 1(B), there are four data frames, each of which may contain multiple complete data frames and an incomplete data frame (usually the last one).

Please refer to FIG. 2 , the data structure proposed by the present invention divides data into three encoding types. All sound data combined with the inserted synchronous activation messages are composed of these three encoding types. The three types are respectively a complete data frame 31 (complete data frame), an incomplete data frame 32 (incomplete data frame) and a command frame 33 (command frame). In each frame, there are two fixed-position bits used to identify the type of the frame. The various frames are detailed below:

i) Complete data frame 31: the content of this frame is mainly sound data of a certain length (for example, 256 sampling points). In addition, at a fixed position in the entire frame (usually at the forefront), there are some bits that record the special information of the frame, including a two-bit frame type identification code, called 'frame information'.

ii) Incomplete data frame 32: the content of this frame is non-fixed audio data less than the sound length of the complete data frame and the frame's 'frame information'. The 'frame information' of the incomplete data frame must have some more bits than the 'frame information' of the complete data frame to record the length of the audio data in the frame.

iii) Command frame 33: the content of this frame may only contain 'command frame information', but may be a combination of 'command frame information' and audio data. The command identification code is contained in the command frame message of the command frame to indicate different commands. Different commands represent different synchronous action trigger messages and correspond to different microprocessor programs.

In addition, in the frame generation mode, the user can insert multiple command flags into the sound waveform, and can freely adjust the position of each flag. The sound data and command data are recombined and encoded by the PC program tool to generate a new mixed data file. The combination logic is as follows:

i) Assume that the sound data length of a complete data frame is set at 256 sampling points. From the first sampling point of the sound to the 256th sampling point, if no command flag appears, the 256 sampling points can be compiled into a complete data frame, and the front of the frame is added A frame message of several bits, including a frame identification code of two bits. Next time, starting from the 257th sampling point, the coding will be carried out according to the same principle.

ii) Between the first sampling point and the 256th sampling point of the sound, if a command flag appears, compile an incomplete data frame from the first sampling point to the previous sampling point where the command flag is located , and add a few bits of data frame information at the front of the frame, which includes a two-bit frame identification code and an eight-bit sound data length. The command flag and the sampling points of its location are compiled into a command frame, and several bits of command frame information are added to the front of the frame, which includes a two-bit frame identification code. Next time, start from the next sampling point where the command flag is located, and code down according to the above principle.

See Figure 3. The flow process of the present invention processing data flow is as follows:

S1: First read the frame information in the data stream, and judge whether the frame belongs to a data frame or a command frame according to the data in the frame information. The data frame can be further divided into a complete data frame and an incomplete data frame.

S2: If it is a complete data frame, it means that the sound data in this frame is a complete 256 points, and all the data can be output. If it is an incomplete data frame, it means that the audio data in the frame is less than 256 points. At this time, the audio data length must be read from the data frame message, and the output audio data points are determined by the length. Finally, if it is judged from the frame message that it is neither a complete data frame nor an incomplete data frame, then the frame is a command frame, so the command identification code can be read from the command frame message in the command frame 33, and the corresponding program.

S3: If the command frame contains sound data, output the sound data. Of course, the sound data obtained from the complete data frame or the incomplete data frame is also output in this step.

S4: After judging that the sound data conversion is completed, or when there is no sound data in the command frame, the action of one frame is completed. At this time, you can go back to step S1 to read the next frame, and repeat the same steps until the entire data stream is processed. until complete.

To sum up, in the data stream of the present invention, at an appropriate point in time, a command flag representing an action can be inserted. During the reading process of the data stream, the microprocessor can process the frame according to the form of various frames. corresponding action. If a data frame is read, the sound data is output according to the data in the frame, and if a command frame is read, a corresponding program can be executed according to the command in the frame. The program can drive a light, or a voice, or a mechanical action. This application on the toy can make the action of the toy and the voice completely synchronized, and there will be no time gap between the action and the sound. In addition, the data frames of the present invention are divided into complete and incomplete data frames. In practice, only incomplete data frames can be used. In fact, complete data frames are a special case of incomplete data frames. Of course, the present invention can also be applied to other aspects besides the audio data stream, such as the video data stream. Similarly, some commands can be inserted to generate corresponding synchronous actions when the video is played.

Various changes may be made to the present invention by persons skilled in the art, but these changes shall be included within the scope of the appended claims.

Claims (7)

1. a data flow is inserted the method for synchronous message, comprises the following step:

Play data;

With this data conversion is a digital data stream, makes it comprise a Frame of being made up of Frame message and numerical data;

Select the reasonable time point, in this Frame, insert command frame; And

Make up this Frame and this command frame, to produce a data flow that comprises this Frame and this command frame, wherein this Frame be for complete data frame and non-complete data frame one of them.

2. data flow as claimed in claim 1 is inserted the method for synchronous message, it is characterized in that these data are one whole section voice data.

3. data flow as claimed in claim 1 is inserted the method for synchronous message, it is characterized in that this Frame comprises a Frame message and a fragment voice data.

4. data flow as claimed in claim 3 is inserted the method for synchronous message, it is characterized in that this Frame message comprises a frame identification position and a voice data length data, and this frame identification position is used and judged that this frame is this Frame.

5. data flow as claimed in claim 1 is inserted the method for synchronous message, it is characterized in that this command frame comprises a command frame message.

6. data flow as claimed in claim 5 is inserted the method for synchronous message, it is characterized in that, this command frame message comprises a frame identification position and an order identification code, and this frame identification position is to use to judge that this frame is this command frame.

7. data flow as claimed in claim 1 is inserted the method for synchronous message, it is characterized in that the mode of this broadcast is that the form of these data with a sound wave is presented on the screen.

Images