JP3343089B2 - Information recording system for recording image information and audio information on recording paper and information reproducing system for reproducing the information - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information recording system for recording image information and audio information on recording paper and an information reproducing system for reproducing the information.

[0002]

2. Description of the Related Art Conventionally, as a method of recording image information and audio information in association with each other, analog recording by video or the like has been used in the past. It also converts audio information into digital information, adds header information and the like to the information,
(Compact DiscRead Only Me
memory) is also used.

In video and the like, image signals and audio signals are sequentially recorded on a magnetic tape as analog signals. In a CD-ROM or the like, both an image signal and an audio signal are converted into digital signals, and then compression-encoded or the like, and header information such as an information type is added to each information and recorded. Therefore, a large amount of data can be recorded on a CD-ROM or the like.

On the other hand, a method for visualizing audio information and relating the visual information to image information has been provided. For example, JP-A-8
JP-A-125789 discloses a facsimile apparatus which converts short syllable voice data into a black and white bar code and outputs the converted bar code.

In the facsimile apparatus disclosed in the above publication, a plurality of voices and images can be recorded on one sheet of recording paper by placing a voice barcode near a character portion or a line drawing of a document to be transmitted.

[0006]

However, the above-mentioned conventional method has the following problems.

First, a method using a video tape, a CD-ROM, or the like as a recording medium is used. However, in this method, it is not possible to recognize what information is recorded on the recording medium unless a reproducing device is used. Further, in the case of analog recording, it is necessary to read sequentially using a reproducing apparatus, and it is not easy to take out arbitrary data. In addition, since the recording medium is a video tape, a CD-ROM, or the like, the versatility and the medium cost are inferior to the method using a recording paper as the recording medium.

On the other hand, in the method described in Japanese Patent Application Laid-Open No. 8-125789, the problem of the medium cost is solved because the recording paper is used as the recording medium.
The content of the recorded information can be recognized without using a reproducing device. However, this apparatus cannot handle recording of image data transmitted as video data such as a moving image or a still image, and furthermore, it is not possible to convert encoded sound into line drawing or character data. Since the association is performed at the arrangement position on the recording paper, there is a problem that the arrangement position of the audio code on the recording paper is restricted, and a long-time audio recording cannot be performed.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and a first object of the present invention is to provide an inexpensive and versatile recording paper with image information such as moving images and still images together with audio information. It can record well, and can easily associate image data and audio data, and
An object of the present invention is to provide an information recording system in which the outline of the recorded contents can be determined at a glance. A second object is to provide an information reproducing system capable of easily reproducing image data and audio data recorded on the recording paper.

[0010]

SUMMARY OF THE INVENTION In order to solve the above-mentioned problems, an information recording system according to the present invention captures image data of an arbitrary frame from a moving image together with time information of the image data. Means, image time information converting means for converting time information of the image data captured by the moving image data capturing means into visualization information,
First recording means for recording an image of the image data captured by the moving image data capturing means on a recording paper in a predetermined form together with time information of the image data visualized by the image time information converting means; Encoding, and audio data conversion means for converting to visualization information, audio time information conversion means for converting the time information of the audio data to visualization information,
A second recording unit for recording the visualization information of the audio visualized by the audio data conversion unit together with the time information of the audio data visualized by the audio time information conversion unit on a recording sheet in a predetermined form. And

According to this, the moving image data capturing means selectively captures image data of an arbitrary frame from the moving image, and the first recording means stores the image of the captured image data in the image time information converting means. Then, the image is recorded on a recording sheet together with the time information of the image visualized.

On the other hand, with respect to voice, voice data conversion means converts the voice signal into a digital signal, encodes it, compresses it, converts it into visualization information, and converts this into visualization information. It is recorded on recording paper together with the time information of the visualized audio data.

[0013] This makes it possible to efficiently record the image information of the moving image together with the audio information on inexpensive and versatile recording paper.

Further, by recording both the image data and the audio data together with the time information, the association between the image data and the audio data can be easily made, and the data arrangement position on the recording paper is not restricted.

In addition, in recording by such an information recording system, an image of an arbitrary frame of a moving image selected on recording paper is expressed as it is. And the outline of the contents of the recorded information can be determined at a glance.

In the above information recording system,
Still image data capturing means for capturing a still image is further provided, wherein the image time information converting means includes, when the still image data is captured by the still image data capturing means, time information of the captured still image data. May be converted into visible information (claim 2).

With this, when a still image is sent, the still image data capturing means captures the image data of the still image, thereby processing the same as the image data of the selected frame of the moving image. Image information of a still image can be recorded together with audio information. The time information of the still image referred to here is information for synchronizing with the audio data taken in at the same time. By using this information, you can display a still image at the desired timing of a certain explanation by audio,
The display timing of the sound and the still image can be matched very accurately.

In the above information recording system,
Character data capturing means for capturing character data such as text messages, and integrating the character data captured by the character data capturing means into image data captured by moving image data capturing means or still image data capturing means. The image data integrating means may be further provided as one image data.

As a result, a text message or the like can be added to the image data as needed and recorded as image information, so that the convenience and the functionality can be improved.

In the above information recording system,
It is preferable that the audio data conversion means performs the visualization by using a three-dimensional bitmap code using color data or a three-dimensional barcode using color data.

Even if audio data is encoded and compressed,
Since the data amount is large, when visualized with a barcode or the like, only short-time audio information can be recorded. In this way, a three-dimensional bitmap code using color data or a three-dimensional barcode using color data is used. By performing the visualization, audio information for a long time can be efficiently recorded.

When visualization is performed using a three-dimensional bitmap code using color data or a three-dimensional barcode using color data, a specific color scale is used as header information of the three-dimensional bitmap code or three-dimensional barcode. It is desirable to have a header information inserting means for inserting key data.

In the case where color data is used, if the color reproduction accuracy and gradation reproduction accuracy of a recording device used for recording and a reading device that reads the color data differ from device to device, a color data reading error occurs, and It cannot be reproduced. However, by inserting the color gradation data as the header information by the header information inserting means as described above, it is possible to avoid a reading error of the color data with the color gradation data at the time of reproduction. Data visualized by a map code or a three-dimensional bar code can be accurately reproduced.

Further, as described above, when visualization is performed using a three-dimensional bitmap code or a three-dimensional barcode, a skew guard information adding means for adding skew guard information to the three-dimensional bitmap code or the three-dimensional barcode is provided. It is more desirable (claim 6).

In order to accurately read a three-dimensional bitmap code or a three-dimensional barcode, it is necessary for the reading device to read the recording paper while keeping it completely vertical, but this is very difficult. Therefore, by adding such skew guard information, it becomes possible for the reading device to correct the oblique displacement with respect to the recording paper insertion direction, and the three-dimensional bit map code or the three-dimensional bar code is independent of the recording paper insertion direction. Playback without code reading errors is possible.

An information reproducing system according to the present invention comprises: an information reading means for reading information from recording paper recorded by using the above information recording system; and an identification means for identifying a type of the information read by the information reading means. And image display means for displaying an image based on the image data identified by the identification means, analysis means for devising the visualized information identified by the identification means, and audio data passing through the analysis means. From the audio output means for decoding and audible, and the time information of the image data and the time information of the audio data having passed through the analysis means, the synchronization of the image data and the audio data reproduced by the image display means and the audio output means, respectively. And a synchronous control means for controlling.

According to this, the information read out from the recording paper by the information readout means is identified by the identification means, and the analysis means decomposes the visualized information among the information. . Then, the image display means displays the image as a moving image, a still image, or a character image based on the image data, and the audio output means decodes the audio data, converts the audio data into audible data, and outputs the decoded data. The means controls the synchronous relationship between the reproduced image data and the audio data from the time information of the read image data and the time information of the audio data.

This makes it possible to reproduce and display the image information and the audio information recorded on the recording paper in a temporally related manner.

In the above information reproducing system,
When the analyzing means analyzes the audio data visualized as a three-dimensional bitmap code using color data or a three-dimensional bar code using color data, a specific color gradation data as header information is thresholded. It is desirable to obtain a value of the color data of the three-dimensional bitmap code or the three-dimensional barcode as information (claim 8).

Thus, when specific color gradation data is inserted as header information of a three-dimensional bitmap code or three-dimensional bar code on a recording sheet, the color gradation data is set as threshold information and three-dimensional The value of color data of a bitmap code or a three-dimensional barcode can be obtained, and reproduction without color data reading errors due to differences in color reproduction accuracy and gradation reproduction accuracy can be performed.

In the information reproducing system,
It is preferable that the information reading means performs skew correction using skew guard information when reading information visualized in a three-dimensional bitmap code or a three-dimensional barcode.

Thus, even if the recording paper is inserted obliquely into the reading device, the skew is corrected using the skew guard information, so that the three-dimensional bitmap code or the three-dimensional bar code can be used regardless of the recording paper insertion direction. Playback without code reading errors is possible.

[0033]

FIG. 1 is a block diagram showing a configuration of a recording apparatus to which an information recording system according to the present invention is applied. Here, the recording device is exemplified, but the configuration may be such that the recording device is mounted on a videophone device or a facsimile device.

In the recording apparatus, an image signal including image information of a moving image or a still image input from an image input unit 30 including a camera or the like is converted into an image A / D converter (A / D converter in the figure).
D) The signal is converted from an analog signal to a digital signal by 1 and transmitted to an image capturing control unit (moving image data capturing unit, still image data capturing unit) 5. The image capture controller 5 captures 30 frames of image data per second.

The image capture control unit 5 selects image data at a preset frame interval, and sends the image data of the selected frame to the image data integration unit 10. At the same time, the image capture control unit 5 determines the timing of frame selection by the image data time information control unit 4.
To send to.

The image data time information control section 4 fetches time information from the real-time clock 3 in synchronization with the frame selection timing sent from the image fetch control section 5 and converts the time information to image data time information described later. It is sent to the visualization conversion unit 9. At the same time, the image data time information control unit 4 assigns a relative frame number to the captured image data, and similarly sends the frame number to the image data time information visualization conversion unit 9. The image data time information control unit 4 and the image data time information visualization conversion unit 9 constitute an image time information conversion unit of the present invention.

Character information such as a character message input from a character input unit 31 such as a key input device such as a keyboard or a pen input device is converted by a character data conversion unit (character data capturing means) 6 into a form adapted to the display mode. Is converted to Here, conversion of handwritten characters to printed characters or conversion of characters to codes is selectively performed. The converted character data is sent to an image data integration unit (image data integration unit) 10.

An audio signal containing audio information is an audio A / D
After being converted from an analog signal to a digital signal by a converter (A / D in the figure) 2, the digital signal is sent to a voice encoding unit 8.

The voice coding unit 8 performs coding on the digitized voice data according to a predetermined compression coding rule, and sends the compressed and coded voice data to a voice data visualization conversion unit 12 described later. . Here, the audio data is compressed because the digitized audio signal has a large amount of information. If the data is directly converted into a code such as a bar code without compression, recording of the audio data for a long time cannot be expected. That's why. The compression coding rules include G.264. 711,
G. FIG. 722, G. 723.1, G. 728, G.R. 72
9, MPEG-AUDIO and the like. The audio encoding unit 8 and the audio data visualization conversion unit 12 constitute an audio data conversion unit of the present invention.

The audio encoding unit 8 encodes the audio data and notifies the audio data time information control unit 7 of the encoding timing.

The audio data time information control unit 7 fetches time information from the real-time clock or 3 in accordance with the encoding timing transmitted from the audio encoding unit 8,
The time information is sent to the audio data time information visualization conversion unit 11 described later. These audio data time information control units 7
The audio data time information visualization conversion unit 11 constitutes the audio time information conversion means of the present invention.

Further, in the above-mentioned audio encoding section 8, no audio data is encoded in a silent portion in order to delete unnecessary data.
Therefore, the valid voice data and the fetched time information are sent from the voice coding unit 8 and the voice data time information control unit 7 to the voice data visualization conversion unit 12 and the voice data time information visualization conversion unit 11, respectively. become.

The image data time information visualization conversion unit 9 converts the transmitted time information and frame number into a form of visualized data that can be printed on a recording sheet. An example of the conversion is a one-dimensional barcode shown in FIG. Since the amount of information included in the time information and the frame number is small, such a one-dimensional barcode is sufficient as a visualization code for displaying the information.

The audio data time information visualization conversion unit 11 converts the sent time information into a form of visualized data that can be printed on a recording paper, like the time information of the image data. As a conversion method, a one-dimensional barcode similar to that of the image data time information visualization conversion unit 9, a three-dimensional barcode described later, or a three-dimensional bitmap is used.

The image data integration unit 10 integrates the image data sent from the image data acquisition control unit 5 and the character data sent from the character data conversion unit 6 according to the type of image data integration. As the image data integration type, there are a case where character data is superimposed on image data, a case where image data and a region of character data are distinguished and displayed, and the like. The image data integrated by the image data integration unit 10 is sent to the image data conversion unit 13.

The image data conversion 13 converts image data necessary for printing. Image data conversion includes resolution conversion and color space conversion. If the resolution of the input image data is different from the resolution of the print area of the image, it is necessary to convert the resolution. Also,
The printing device that is the printing unit 33 uses a different color space depending on its specifications.

For example, when the image input unit 30 is an NTSC camera, the image signal taken from here is Y
This is a UV-based color space. In contrast, an inkjet color printing apparatus often uses a CMYK-based color space in the inkjet color printing apparatus.
Color space conversion from a YUV system to a CMYK system or the like is required depending on the printing device. The image data conversion unit 13 performs resolution conversion according to the resolution of the print area and color space conversion according to the color space used by the printing apparatus.

The audio data visualization converter 12 converts the encoded data sent from the audio encoder 8 into visualized data. As a visualization conversion method, a one-dimensional barcode similar to the image data time information visualization conversion unit 9 can be considered. However, although the audio data is encoded, the information amount is large. Therefore, the time length of the recorded sound is short in the one-dimensional barcode. Therefore, in order to record sound efficiently and for a long time, the audio data visualization conversion unit 12 performs conversion into a three-dimensional bitmap code as shown in FIG. The conversion to the three-dimensional bitmap code will be described later.

Image data time information visualization conversion section 9, image data conversion section 13, audio data time information visualization conversion section 1
1 and the respective data from the audio data visualization conversion unit 12 are input to the print screen control unit 14.

The print screen controller (first recording means, second recording means) 14 arranges each data in accordance with the recording format and creates print data.

FIGS. 3 and 5 show an example of a recording format. In the recording format of FIG. 3, color gradation data as shown in FIG. 7 is arranged at the beginning of the print data as header information. This indicates threshold information of a three-dimensional bitmap code described later. Printing unit 33
Or a color document reading apparatus provided in a reproducing apparatus for reproducing recording paper on which information is recorded by the recording apparatus (a recording paper reading unit 15 in the reproducing apparatus of FIG. 2 described later). Since the color reproduction accuracy and the gradation reproduction accuracy in each of the above-described methods differ from one device to another, the accuracy error is corrected using the color gradation data.

In the recording format of FIG. 3, skew guard information is arranged around a three-dimensional bitmap code of audio data and audio data time information. The audio data time information referred to here is for deleting the recording of the audio silence time. When a silence code is detected, for example, the silence time (the number of clocks of the real-time clock 3) is counted, and the actual silence time is counted. The recording density is improved by recording the count value instead of recording the code (see FIG. 4).

The skew guard information is, for example, a black frame having a constant thickness. In general, it is difficult for a reading device that reads a printed document to read the printed document while keeping the document vertically, and a deviation occurs in an oblique direction. If a shift occurs, the bitmap cannot be correctly decoded. Therefore, in order to prevent a bitmap reading error, the skew guard is printed together with the three-dimensional bitmap at the time of printing, and the deviation is corrected on the reading device side using the skew guard.

On the other hand, the recording format shown in FIG. 5 is different from the recording format shown in FIG. 3 in that an area in which image data can be displayed by a three-dimensional bitmap code is provided.

In the above description, only audio data is converted into a three-dimensional bitmap code. However, similar coding can be applied to image data. For example, the image data of the frame selected by the image capture control unit 5 is not coded image data, that is, the image data of the frame that is printed as an image in the image area by the above-described procedure. By encoding the difference data from the selected frame and the like and expressing it in a three-dimensional bitmap code expression, it becomes possible to record full frame image data.

The print screen control unit 14 includes a visualization code (visualization data) for image data time information, a visualization code (visualization data) for image data and audio data time information, a visualization code (visualization data) for audio data, and Print data is created based on the color gradation data and the skew guard, and output to the printing unit 33 described above.

Hereinafter, the three-dimensional bitmap code will be described. FIG. 8 shows an example of a three-dimensional bitmap code. Here, color data is used as data used for the bitmap. In FIGS. 3 to 8, RG is used as a color space.
An example is shown in the case where the B system is used.

In one dot of the bit map, R: 8 gradations,
When G: 8 gradations and B: 4 gradations are assigned, 8 dots are assigned to one dot.
× 8 × 4 = 256 gradations can be expressed. That is. One dot data can be represented by one dot. The header information at this time is shown in FIG.

For example, if the printing device of the printing unit 33 and the reading device of the reproducing device can guarantee 100 dpi, the amount of information that can be recorded in a 1-inch square area is 10 Kbytes.

As the sound encoding method, G. When using 729,
G. FIG. In 729, it is encoded at 12 kbit / s.
The amount of encoded information is 1.5 Kbytes per second. Therefore, data for about 6 seconds can be recorded in the 1-inch square area. Also, 5.6 kb is used for the sound encoding method.
G / it / s. With 723.1, it is possible to record about 14 seconds of data. The effective area of A4 paper is 6 inches in width (about 215 cm) and 10 inches in height (about 26 c
m), and when recording is performed on the entire surface of this area, 729 for 6.7 minutes. In 723.1, data can be recorded for 14.3 minutes.

Next, a description will be given of a configuration of a reproducing apparatus to which the information reproducing system of the present invention is applied, in which the recording apparatus reproduces a recording sheet on which image information and audio information are recorded. Here, the playback device is exemplified, but a configuration in which the playback device is mounted on a videophone device or a facsimile device having a display function may be used.

FIG. 2 is a block diagram of the reproducing apparatus.
In the reproducing apparatus, each data recorded on the recording paper, that is, a visualization code of image data time information, image data,
The visualization code of the audio data time information, the visualization code of the audio data, the color gradation data, and the skew guard are read by the recording paper reading unit 15 and sent to the code data correction unit 16.

The code data correction section 16 identifies skew guard information from the transmitted data, and according to the skew guard information, the recording paper reading section 1.
The deviation of the read recording paper with respect to the read head No. 5 is corrected. After the correction, the read data is sent to the data identification unit (identification means) 17. The recording paper reading section 15 and the code data correcting section 16 constitute the information reading means of the present invention.

The data identification section I7 uses the color format data of the header information according to the recording format described above,
Visualization code of image data time information (hereinafter, image data time information code), image data, visualization code of audio data of three-dimensional bitmap code (hereinafter, audio data code), and audio data time information of three-dimensional bitmap code (Hereinafter, audio data time information code) is identified.

The image data time information code is sent to the image data time information code analyzing section (analyzing means) 18, the image data is sent to the image data output control section 23, and the audio data time information code is sent to the audio data time information code analyzing section ( The audio data code is sent to an audio data code analysis unit (analysis unit) 20, and the color gradation data is sent to both the audio data time information code analysis unit 19 and the audio data code analysis unit 20.

The image data time information code analyzing section 18 decodes the bar code as shown in FIG. 6 to obtain the time information and the frame number of the image data. The obtained time information and frame number are stored in a synchronization control unit 21 described later.
Sent to Similarly, the audio data time information code is decoded by the audio data time information code analysis unit 19, and then the time information of the audio data is sent to the synchronization control unit (synchronization control unit) 21.

On the other hand, in the audio data code analysis unit 20,
The coded audio data is decoded based on the transmitted color gradation data and the audio data code converted into the three-dimensional bitmap code.

First, a gradation threshold value of each color component used in the three-dimensional bitmap code is obtained from the color gradation data. This is because, as described above, since the color reproduction accuracy of the printing device on the recording device side and the color reproduction accuracy of the reading device on the reproduction device side are different, an accurate code can be obtained without the gradation threshold value of the printed color. This is because they cannot be decoded. Therefore, first, a threshold value of each color is obtained from the color gradation data, and a color value of the three-dimensional bitmap code is obtained according to the threshold value. The encoded audio data obtained by this is sent to the audio decoding unit 22.

In the audio decoding section 22, the audio encoded data is transmitted to the G.264. 729, decoded by MPEG-AUDIO or the like, and sent to the audio data output control unit 24.

The synchronization control unit 21 adjusts the output timing of the image data and the audio data based on the respective time information sent from the image data time information code analysis unit 18 and the audio data time information code analysis unit 19. Do. By performing this adjustment, the display unit 34 such as a liquid crystal display is
Can be output from the sound output unit 35 such as a speaker.

The image data output control unit 23 outputs image data in accordance with the synchronization control signal from the synchronization control unit 21. The image data is converted from a digital signal to an analog signal by the image D / A converter 25. After that, it is supplied to the display unit 34 and output. When there is no instruction to output image data, the image data output control unit 23 repeatedly outputs the currently output image data to output a full frame image signal.

The audio data output control section 24 outputs audio data in accordance with the synchronization control signal from the synchronization control section 21, and the audio data is converted from a digital signal to an analog signal by the audio D / A converter 26. After that, it is supplied to the sound output unit 35 and output. When there is no instruction to output audio data, the audio data output control unit 24 outputs data in a silent state.

As described above, in the above-described recording apparatus, an image is extracted from image information such as a moving image or a still image together with the time information of the image, and the time information of the captured image data is used as visualization information. Performs conversion and records the image data together with the visualized time information on a recording paper in a predetermined form, while for audio, converts the audio signal into digital data, encodes and compresses it, and converts the data into visualization information. Then, conversion for visualizing the time information of the audio signal is performed, and the visualized audio data and time information are recorded on a recording sheet in a predetermined form.

As a result, it is possible to realize a recording apparatus that efficiently encodes image information and audio information while associating the image data and the audio data with each other, and records the encoded information on recording paper.
Further, since character data can be taken in as image data and integrated with the image data, character information such as a character message can be recorded together. Further, since the data is visualized by a three-dimensional bitmap code using color data, a large amount of information such as audio data and image data is efficiently coded, and visualized and printed. be able to. Similar effects can be obtained by visualizing data using a three-dimensional barcode using color data other than the three-dimensional bitmap code described above.

On the other hand, the reproducing apparatus identifies and reads various data from the information recorded on the recording paper, displays the read image data as a moving image, a still image, or a character image, and reads the read image data. The visualized audio data is decoded, converted to audible data and output, and the synchronization relationship between the reproduced image data and the audio data is determined based on the time information of the read image data and the time information of the audio data. Control.

As a result, a reproducing apparatus for reproducing and displaying the image information and the audio information recorded on the recording paper in a time-related manner is realized. Also, here, specific color gradation data is inserted into the recording format as header information of a three-dimensional bitmap code or three-dimensional barcode, and the color gradation data is used as threshold information to form a three-dimensional bitmap code. Alternatively, since the configuration is such that the value of the color data of the three-dimensional barcode is obtained, recording and reproduction without color data reading errors due to differences in color reproduction accuracy and gradation reproduction accuracy can be performed. In addition, when skew guard information is added to a three-dimensional bitmap code or a three-dimensional barcode, and the three-dimensional bitmap code or the three-dimensional barcode is read, the data is oblique to the reading device. In addition, since the oblique correction is performed using the skew guard information, it is possible to perform reproduction without reading errors of the three-dimensional bitmap code or the three-dimensional barcode regardless of the recording paper insertion direction.

[0077]

As described above, the information recording system according to the first aspect of the present invention comprises a moving image data capturing unit that captures image data of an arbitrary frame from a moving image together with time information of the image data. Image time information converting means for converting the time information of the image data captured by the moving image data capturing means into visualization information; and image time information converting means for converting the image of the image data captured by the moving image data capturing means. First recording means for recording on a recording sheet in a predetermined form together with the time information of the image data visualized in step 1, audio data converting means for encoding the audio signal and converting it into visualization information, and time information of the audio data Audio time information conversion means for converting the audio visualization information into visualization information, and audio time information conversion means With visualization time information of audio data is configured to include a second recording means for recording on a recording sheet in a predetermined form.

As a result, the image information of the moving image can be efficiently recorded together with the audio information on an inexpensive and versatile recording sheet, and the image data and the audio data can be easily associated with each other. In addition, there is an effect that an information recording system can be provided in which the outline of the recorded content can be determined at a glance.

The information recording system according to a second aspect of the present invention is the information recording system according to the first aspect, further comprising a still image data capturing unit for capturing a still image, wherein the image time information converting unit is a still image data capturing unit. When the compressed still image data is captured, the time information of the captured still image data is converted into visible information, so when a still image is sent, the image information of the still image is It can also be recorded together with audio information, and also has the effect of being compatible with still image information.

According to a third aspect of the present invention, in the information recording system according to the first or second aspect, the character data capturing means for capturing character data such as a character message and the character data capturing means. Image data integrating means for integrating the character data as image data with the image data captured by the moving image data capturing means or the still image data capturing means to form one image data. Since a text message or the like can be added to the image data as needed and recorded as image information, there is an effect that convenience and functionality can be further improved.

According to a fourth aspect of the present invention, in the information recording system according to the first, second or third aspect, the audio data conversion means uses a three-dimensional bitmap code using color data or color data. This is a configuration in which visualization is performed by using the three-dimensional barcode, which also has the effect of making it possible to efficiently record audio information for a long time.

According to a fifth aspect of the present invention, in the information recording system according to the fourth aspect, a three-dimensional bitmap code using color data or a three-dimensional bitmap code using color data is used.
It is configured to include a header information insertion unit for inserting specific color gradation data as header information of a three-dimensional barcode, thereby making it possible to avoid a reading error of color data at the time of reproduction. In addition, the data visualized by the three-dimensional barcode can be accurately reproduced.

According to a sixth aspect of the present invention, in the information recording system according to the fourth aspect, the skew guard information for adding skew guard information to a three-dimensional bit map code or a three-dimensional bar code using color data. With this configuration, the reading device can correct the oblique displacement with respect to the recording paper insertion direction, and can read a three-dimensional bitmap code or a three-dimensional bar code regardless of the recording paper insertion direction. An effect of enabling reproduction without error is also provided.

According to a seventh aspect of the present invention, there is provided an information reproducing system for reading information from a recording sheet recorded by using the information reproducing system according to the first aspect. Means, identification means for identifying the type of information read by the information reading means, image display means for displaying an image based on the image data identified by the identification means, and identification means identified by the identification means. Analysis means for solving the visualization of each visualized information, audio output means for decoding and audible audio data passed through the analysis means, and image display from the time information of the image data and the time information of the audio data passed through the analysis means And a synchronization control means for controlling synchronization between the image data and the sound data reproduced by the means and the sound output means.

As a result, it is possible to provide an information reproducing system capable of reproducing and displaying the image information and the audio information recorded on the recording paper in a time-related manner.

In the information reproducing system according to the present invention, the analyzing means is visualized as a three-dimensional bitmap code or a three-dimensional bar code using color data. When analyzing audio data, specific three-dimensional bitmap codes or three-dimensional bitmap codes are used as threshold information using specific color gradation data as header information.
In this configuration, the value of the color data of the dimensional barcode is obtained.

Thus, when specific color gradation data is inserted as header information of a three-dimensional bitmap code or three-dimensional bar code on recording paper, the color gradation data is used as threshold information and the three-dimensional The value of the color data of the bitmap code or the three-dimensional barcode can be obtained, and the effect of reading without the error of reading the color data due to the difference in the color reproduction accuracy and the gradation reproduction accuracy can be obtained.

According to a ninth aspect of the present invention, in the information reproducing system according to the ninth aspect, the information reading means visualizes the information as a three-dimensional bitmap code or a three-dimensional barcode using the color data. When reading the read information, the oblique correction is performed using the skew guard information.

As a result, even when the data is skewed with respect to the reading device, the skew is corrected using the skew guard information. This also has the effect of enabling reproduction without code reading errors.

[Brief description of the drawings]

FIG. 1 illustrates one embodiment of the present invention, and is a block diagram illustrating a configuration of a recording apparatus.

FIG. 2 illustrates one embodiment of the present invention, and is a block diagram illustrating a configuration of a playback device.

FIG. 3 is an explanatory diagram illustrating an example of a recording format.

FIG. 4 is an explanatory diagram showing a display example of audio data visualized in a three-dimensional bitmap code.

FIG. 5 is an explanatory diagram showing another example of a recording format.

FIG. 6 is an explanatory diagram showing a display example of visible data obtained by visualizing time information of image data.

FIG. 7 is an explanatory diagram showing a display example of header information of color gradation data.

FIG. 8 is an explanatory diagram showing a display example of a three-dimensional bitmap code.

[Explanation of symbols]

4 Image data time information control section (image time information conversion means) 5 Image capture control section (moving image data capture means,
Still image data capturing unit) 6 Character data conversion unit (character data capturing unit) 7 Audio data time information control unit (Audio time information conversion unit) 8 Audio encoding unit (Audio data conversion unit) 9 Image data time information visualization conversion unit (Image time information conversion means) 10 Image data integration section (Image data integration means) 11 Audio data time information visualization conversion section (Audio time information conversion means) 12 Audio data visualization conversion section (Audio data conversion means) 14 Print screen control section (First recording means, second recording means) 15 recording paper reading section (information reading means) 16 code data correction section (information reading means) 17 data identification section (identification means) 18 image data time information analysis section (analysis means) 19 audio data time information analysis section (analysis means) 20 audio data analysis section (analysis means) 21 synchronization control section ( Period control means) 22 audio decoding section (audio output means) 23 image data output control section (image display means) 24 audio data output control section (audio output means) 34 display section (image display means) 35 sound output section (audio) Output means)

──────────────────────────────────────────────────続 き Continued on the front page (58) Field surveyed (Int. Cl. ⁷ , DB name) H04N 5/76-5/956 G06K 17/00 G10L 13/00 H04N 1/00 G06F 3/16 340

Claims (9)

(57) [Claims] 1. A moving image data capturing means for capturing image data of an arbitrary frame from a moving image together with time information of the image data, and visualizing time information of the image data captured by the moving image data capturing means. An image time information converting means for converting the information into information, and an image of the image data captured by the moving image data capturing means is recorded in a predetermined form together with the time information of the image data visualized by the image time information converting means. First recording means for recording on paper, audio data conversion means for encoding an audio signal and converting it into visualization information, audio time information conversion means for converting time information of audio data into visualization information, The audio visualization information visualized by the conversion means is shared with the time information of the audio data visualized by the audio time information conversion means. Information recording system characterized by comprising a second recording means for recording on a recording sheet in a predetermined form. 2. A still image data capturing means for capturing a still image, wherein the image time information converting means captures the still image data by the still image data capturing means when the image data is captured by the still image data capturing means. 2. The information recording system according to claim 1, wherein time information of the obtained image data is converted into visible information. 3. A character data capturing means for capturing character data such as a character message, and the character data captured by the character data capturing means as image data, wherein the moving image data capturing means or the still image data capturing means captures the character data. 3. The information recording system according to claim 1, further comprising an image data integrating unit that integrates the captured image data into one image data. 4. The apparatus according to claim 1, wherein said audio data conversion means performs visualization by using a three-dimensional bitmap code using color data or a three-dimensional barcode using color data. Information recording system as described. 5. A header information inserting means for inserting specific color gradation data as header information of a three-dimensional bitmap code using color data or a three-dimensional barcode using color data. Item 4. The information recording system according to Item 4. 6. A skew guard information adding means for adding skew guard information to a three-dimensional bitmap code using color data or a three-dimensional bar code using color data. Information recording system. 7. An information reading means for reading information from a recording sheet recorded by using the information recording system according to claim 1, and a type of the information read by said information reading means. Identification means for identifying, image display means for displaying a moving image based on the image data identified by the identification means, and analysis means for dissolving the visualized information identified by the identification means, An audio output unit that decodes audio data that has passed through the analysis unit and makes the audio data audible, and reproduces the time information of the image data and the time information of the audio data that have passed through the analysis unit by the image display unit and the audio output unit An information reproducing system comprising: a synchronization control unit that controls synchronization between image data and audio data to be transmitted. 8. When analyzing the audio data visualized as a three-dimensional bitmap code using color data or a three-dimensional barcode using color data,
8. The information reproducing system according to claim 7, wherein the value of the color data of the three-dimensional bitmap code or the three-dimensional barcode is obtained by using specific color gradation data as header information as threshold information. 9. When reading information visualized in a three-dimensional bitmap code using color data or a three-dimensional barcode using color data, the information reading means performs skew correction using skew guard information. 9. The information reproducing system according to claim 7, wherein the information reproducing is performed.