JP2010010800A - Moving image recording and reproducing device - Google Patents

Abstract

A moving picture recording / reproducing apparatus capable of correcting a defective pixel in a reproducing apparatus without increasing a capacity capable of recording defective pixel position information.
A moving image recording / reproducing apparatus includes an imaging device and a reproducing device. The imaging device 2 includes an imaging unit 11, a compression unit 12 that compresses moving image data and metadata to generate compressed data, a defective pixel position recording unit 14 that detects a defective pixel position, and a defective pixel position. A position data conversion unit 15 for converting the data into a metadata format, and the compression unit records the data of the defective pixel position in the metadata of the moving image data. The reproduction apparatus 3 includes a decompression unit 22 that converts compressed data into moving image data and metadata, a defective pixel position detection unit 24 that detects defective pixel position data from the metadata, and based on the defective pixel position data. A correction data generation unit 25 that generates correction data and a correction unit 23 that corrects moving image data based on the correction data are provided.
[Selection] Figure 1

Description

  The present invention relates to a moving picture recording / reproducing apparatus that compresses and saves a moving picture, reads compressed data, and decompresses the corrected moving picture in a commercial moving picture recording / reproducing apparatus.

  As a conventional moving image recording / reproducing device, one having an imaging device and a reproducing device has been proposed (see, for example, Patent Document 1). FIG. 9 is a block diagram showing a configuration of the moving image recording / reproducing apparatus.

  This moving image imaging apparatus generates imaging data and compresses the imaging apparatus 101, a recording medium 102 that stores the compressed imaging data (compressed data), a playback apparatus 103 that decompresses the compressed data, and the imaging data. And a display unit 104 that displays the image. The imaging apparatus 101 includes an imaging unit 111 that converts received light into an electrical signal to generate imaging data, a compression unit 112 that compresses the imaging data, and a writing unit 113 that writes the compressed data to the recording medium 102. The recording medium 102 stores compressed data.

  The playback device 103 includes a reading unit 121, an expansion unit 122, a correction unit 123, a memory 124, a defective pixel position detection unit 125, and a correction data creation unit 126. The reading unit 121 reads compressed data from the recording medium 102. The decompressing unit 122 decompresses the compressed data read by the reading unit 121 to restore the imaging data. The memory 124 stores defective pixel position information generated in the imaging unit 111. The defective pixel position detection unit 125 acquires defective pixel position information from the memory 124 and specifies the correction position of the defective pixel. The correction data creation unit 126 creates correction data from the correction position of the defective pixel. The correction unit 123 corrects the imaging data based on the correction data. The display unit 104 displays the corrected imaging data as a moving image.

As described above, the moving image capturing apparatus does not correct the defective pixel at the time of recording, and corrects the defective pixel by referring to the defective pixel position information stored in the memory at the time of reproduction.
2005-31746 gazette

  However, since the conventional moving image imaging device includes a memory for storing defective pixel position information in the playback device, when correcting compressed data captured by another imaging device, a plurality of images are stored in the memory. A capacity sufficient to record defective pixel position information about the apparatus is required. In addition, since the moving image imaging apparatus having the above-described configuration is configured to previously record the defective pixel position information of the imaging unit in a memory, when a moving image is captured by an unknown imaging apparatus, a moving image is recorded from the recording medium. When the image is reproduced, it is not possible to correct the defective pixel in the reproducing apparatus.

  In the present invention, in order to solve the above-described conventional problem, when reproducing data picked up by different image pickup devices, correction processing of defective pixels is performed in the reproduction device without increasing the capacity to record defective pixel position information. It is an object of the present invention to provide a moving image recording / reproducing apparatus capable of performing the above.

  An imaging apparatus according to the present invention includes a plurality of photoelectric conversion elements, an imaging unit that converts an optical image into moving image data, a compression unit that compresses the moving image data and metadata to generate compressed data, and And a writing unit for writing the compressed data to the recording medium. In order to solve the above-described problem, a defective pixel position recording unit that detects a defective pixel position of the imaging unit, and a position data conversion unit that converts data of the defective pixel position into a metadata format, the compression unit includes: The converted defective pixel position data is recorded in metadata of moving image data.

  Further, in order to solve the above problems, the playback device of the present invention reads a compressed data obtained by compressing moving image data and metadata from a recording medium, and converts the compressed data into moving image data and metadata. A defect pixel position detection unit that detects data of a defective pixel position indicating a position of a defective pixel in an imaging unit of an imaging device in which the moving image data is created from the metadata, and the defective pixel A correction data generation unit that generates correction data based on position data and a correction unit that corrects the moving image data based on the correction data are provided.

  In order to solve the above-described problem, a moving image recording / reproducing apparatus of the present invention includes the above-described imaging apparatus and the above-described reproducing apparatus.

  According to the present invention, by storing defective pixel position information on metadata recorded on a recording medium together with imaging data, it is possible to record defective pixel position information when reproducing data captured by different imaging devices. Therefore, it is possible to provide a moving image recording / reproducing apparatus capable of correcting a defective pixel in the reproducing apparatus without increasing the capacity of the moving image.

  The imaging apparatus of the present invention can take various modes based on the above configuration. That is, it is possible to employ a configuration having a memory for storing data of the detected defective pixel position.

  Further, the defective pixel position recording unit determines whether or not the data of the defective pixel position is stored in a memory, and when the data of the defective pixel position is stored, the defective pixel position is recorded in the compression unit. Can be recorded in the metadata of the moving image data.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(Embodiment)
FIG. 1 is a block diagram showing a configuration of a moving image recording / reproducing apparatus 1 according to an embodiment of the present invention. The moving image recording / reproducing apparatus 1 includes an imaging device 2 that generates compressed data, a recording medium 3 that stores the compressed data, a reproducing device 4 that expands and processes the compressed data, and the expanded moving image data as a moving image. And a display unit 5.

  The imaging device 2 includes an imaging unit 11, a compression unit 12, a writing unit 13, a defective pixel position recording unit 14, a position data conversion unit 15, and a memory 16. The imaging unit 11 includes a light receiving unit such as a CCD (CCD: Charge Coupled Device) camera unit, and converts an optical image of a subject into an electrical signal. The light receiving unit is composed of a plurality of pixels. Further, the imaging unit 11 performs analog signal processing, A / D conversion, and digital signal processing on the converted electric signal to generate moving image data. As will be described in detail later, the defective pixel position recording unit 14 detects whether there is a defective pixel in the light receiving unit of the imaging unit 11, generates defective pixel position information indicating the position of the defective pixel, and stores it in the memory 16. . The defective pixel position recording unit 14 takes out defective pixel position information from the memory 16 and transmits the defective pixel position information to the position data conversion unit 15, as will be described in detail later.

  The position data conversion unit 15 converts the defective pixel position information into a metadata format (for example, XML format) for recording in the metadata, and transmits the converted defective pixel position information to the compression unit 12. The compression unit 12 records the defective pixel position information from the position data conversion unit 15 in the user data area in the metadata. The compression unit 12 also compresses moving image data together with metadata to create compressed data. The writing unit 13 stores the compressed data in the recording medium 3. Examples of the recording medium 3 include a magnetic tape, a semiconductor memory, and an optical disk.

  The playback device 4 includes a reading unit 21, an expansion unit 22, a correction unit 23, a defective pixel position detection unit 24, and a correction data creation unit 25. The reading unit 21 reads the compressed data recorded on the recording medium 3 and transmits it to the decompression unit 22. The decompressing unit 22 decompresses the compressed data into moving image data and metadata. The decompression unit 22 transmits moving image data and metadata to the correction unit 23, and transmits the metadata to the defective pixel position detection unit 24.

  The defective pixel position detection unit 24 extracts defective pixel position information from the metadata and transmits the defective pixel position information to the correction data creation unit 25. Although the details will be described later, the correction data creation unit 25 generates correction data compared with the defective pixel position information and the moving image data one frame before or after, and transmits the correction data to the correction unit 23. The correction unit 23 corrects the moving image data with the correction data and transmits it to the display unit 5. The display unit 5 displays the corrected moving image data as a moving image.

  As described above, since the defective pixel position information is recorded in the metadata in the moving image data and stored in the recording medium, the defective pixel in the moving image data can be corrected even if the reproducing apparatus has no defective pixel position information. Can do.

  FIG. 2 is a diagram showing a recording format of defective pixel position information. The recording format has, for example, a defective pixel X coordinate 31 of 2 bytes, a defective pixel Y coordinate 32 of 2 bytes, and a defective pixel length 33 of 4 bytes. The defective pixel X coordinate 31 and the defective pixel Y coordinate 32 indicate position information of the defective pixel detected by the imaging unit 11. The defective pixel length 33 is the length of the continuous defective pixel starting from the defective pixel X coordinate 31 and the defective pixel Y coordinate 32 when defective pixels are continuously detected in the light receiving unit of the imaging unit 11. Show.

  FIG. 3 is a diagram showing a format of compressed data in the compression unit 12. As compressed data, captured moving image data is stored as one clip 41 in a recording medium for each clip. The clip 41 includes metadata 42, a video file 46, and an audio file 47. The captured moving image data is recorded in the video file 46, and the audio is recorded in the audio file 47. The metadata 42 includes structural data 43, detailed data 44, and user data 45. In the structure data 43, the name, ID, recording method, and the like of the captured moving image data are recorded. In the detailed data 44, an imaging date and time, an imaging location, and the like are recorded. The user data 45 is an area that can be freely used by the user, and is used as an area for recording defective pixel position information.

  Next, a method for correcting defective pixels will be described. FIG. 4 is a diagram showing a defective pixel correction target frame 52 and frames 51 and 53 before and after the defective pixel in the moving image data. In FIG. 4, the tree on the image moves from left to right as time passes. In this case, defective pixel correction data is created from the correction target frame 52 and the previous frame 51 or the rear frame 53.

  The coordinates of the defective pixel 54 in the correction target frame 52 are (X, Y). The correction data creation unit 25 in FIG. 1 predicts the motion of the subject to be displayed at the coordinates (X, Y) of the defective pixel in the correction target frame 52.

  Prediction of the motion of the subject applies inter-frame prediction used in MPEG. FIG. 5 is a diagram illustrating the previous frame 51 and the correction target frame 52. Each frame is divided into blocks of 8 × 8 pixels (area surrounded by thin lines). The correction data creation unit 25 searches for a similar block with reference to the previous frame 51 for the correction target block 61 including the defective pixel 54 in the correction target frame 52. When a similar reference block 62 is found, a motion vector indicating the motion of the defective pixel is obtained from the correction target block 61 and the relative position of the reference block 62.

  The motion vector (ΔX1, 0) is obtained by the correction data creation unit 25 referring to the previous frame 51 and the correction target frame 52. The correction data creation unit 25 identifies the coordinates (X−ΔX1, Y) of the reference pixel 55 using the coordinates (X, Y) of the defective pixel 54 and the motion vector. The correction data creation unit 25 creates correction data using the coordinates of the reference pixel 55 and the coordinates of the defective pixel 54. The correction unit 23 in FIG. 1 receives the correction data having the reference pixel coordinates from the correction data creation unit 25 and replaces the defective pixel 54 with the reference pixel 56. A defective pixel can be corrected by the above process.

  In the correction of defective pixels, the correction data is obtained by comparing the previous frame 51 and the correction target frame 52, but the reference pixel 56 is obtained by comparing the subsequent frame 53 and the correction target frame 52. You can also.

  Next, the operation of the moving image recording / playback apparatus 1 according to the present embodiment will be described. First, the operation at the time of defective pixel detection of the moving image recording / reproducing apparatus 1 will be described. FIG. 6 is a flowchart of the defective pixel detection operation of the light receiving unit in the imaging unit 11 shown in FIG. In the defective pixel detection operation, first, in step S101, the defective pixel position recording unit 14 determines whether or not the defective pixel of the imaging unit 11 exists. Whether or not there is a defective pixel is determined in a state where the electrical signal from the imaging unit 11 is analog signal processed and A / D converted.

  Whether or not there is a defective pixel is determined by first covering the lens of the image capturing unit 11 with a cover or the like to shield the light receiving unit of the image capturing unit 11 to make the moving image being captured black. In addition, by reducing the sampling frequency of the light receiving unit in the imaging unit 11 to about one tenth of the normal frequency, defective pixels existing on the light receiving unit can be viewed as white, for example, on a black moving image. The operator determines whether or not there is a point (defective pixel) having a certain level of illuminance on the moving image.

  When there is no defective pixel on the moving image, the operator can determine that there is no defective pixel, and ends the defective pixel detection operation. In step S101, when there is a defective pixel on the moving image, in step S102, the operator determines that the defective pixel exists, and then specifies the position of the defective pixel. The imaging unit 11 sequentially inspects each photoelectric conversion element of the light receiving unit along the scanning line, thereby specifying the position of the defective pixel based on the X coordinate and the Y coordinate of the light receiving unit as defective pixel position information. be able to. Next, as step S <b> 103, the defective pixel position recording unit 14 records defective pixel position information in the memory 16. Thus, the defective pixel detection operation in the imaging device 2 is completed.

  Next, the moving image recording operation of the moving image recording / reproducing apparatus 1 will be described. FIG. 7 is a flowchart of the operation of storing the captured compressed data in the recording medium 3 in the imaging device 2. First, in step S <b> 111, the imaging unit 11 converts light from the subject into moving image data, and transmits the moving image data to the compression unit 12. Next, as step S112, the defective pixel position recording unit 14 determines whether or not the defective pixel position information generated by the defective pixel detection operation exists in the memory 16.

  When defective pixel position information exists in the memory 16, the defective pixel position recording unit 14 transmits the defective pixel position information to the position data conversion unit 15. Next, as step S113, the position data conversion unit 15 converts the defective pixel position information into a metadata format (for example, an XML format). Next, as step S114, the position data conversion unit 15 records the defective pixel position information converted into the metadata format in the user data area in the metadata of the moving image data. Next, as step S115, the compression unit 12 compresses moving image data and metadata into compressed data.

  If there is no defective pixel position information in the memory 16 in step S112, the metadata and moving image data without the defective pixel position information are compressed into compressed data in step S115. Finally, in step S116, the writing unit 13 stores the compressed data in the recording medium 3. Thus, the operation of storing the compressed data in the recording device 3 in the imaging device 2 is completed.

  Next, the operation of reproducing moving images of the moving image recording / reproducing apparatus 1 will be described. FIG. 8 is a flowchart of an operation for displaying a moving image on the display unit 5 in the playback apparatus 4 shown in FIG. First, in step S <b> 121, the reading unit 21 reads compressed data from the recording medium 3 and transmits the compressed data to the decompressing unit 22. Next, in step S122, the decompression unit 22 decompresses the compressed data into moving image data and metadata, and transmits the moving image data to the correction unit 23 and the metadata to the defective pixel position detection unit 24. Next, as step S123, the defective pixel position detection unit 24 determines whether or not defective pixel position information exists in the metadata.

  When there is defective pixel position information in the metadata, in step S124, the correction data creation unit 25 creates correction data based on the defective pixel position information extracted by the defective pixel position detection unit 24, and the correction unit 23 Send to. In step S125, the correction unit 23 corrects defective pixels in the moving image data using the correction data. Next, as step S126, the correction unit 23 displays the corrected moving image data on the display unit 5 as a moving image.

  In step S123, when there is no defective pixel position information in the metadata, the correction unit 23 causes the display unit 5 to display the moving image data as a moving image in step S126. Thus, the operation for displaying the moving image on the display unit 5 in the playback device 4 is completed.

  As described above, the moving image recording / playback apparatus 1 according to the present embodiment acquires defective pixel position information by reading the metadata in the compressed data recorded on the recording medium 3 in the playback apparatus 4. Therefore, the playback device 4 does not require a memory. Further, even when the compressed data is stored in the recording medium 3 by the unknown imaging device 2, the reproducing device 4 can read out the defective pixel position information recorded in the metadata to perform defective pixel correction.

  The present invention makes it possible to acquire defective pixel position information by reading metadata in compressed data recorded on a recording medium in a reproducing apparatus, and therefore requires a defective pixel position information memory in the reproducing apparatus. And not. In addition, defective pixel correction can be performed even when compressed data is read from a recording medium recorded by an unknown recording apparatus. Therefore, it is useful as a moving image recording / reproducing apparatus that corrects defective pixels at high speed and appropriately after compressing and storing moving images, reading compressed data, and decompressing them in a commercial moving image capturing system.

The block diagram which shows the structure of the moving image recording / reproducing apparatus which concerns on embodiment of this invention The figure which shows the recording format of the defective pixel position information which concerns on embodiment of this invention The figure which shows the format of the compression data in the compression part which concerns on embodiment of this invention The figure which shows the correction object frame of the defective pixel in the moving image data which concerns on embodiment of this invention, and the frame before and behind it The figure which shows the front frame and correction object frame which concern on embodiment of this invention The flowchart about the defective pixel detection operation | movement of the light-receiving part in the imaging part of the moving image recording / reproducing apparatus which concerns on embodiment of this invention FIG. 7 is a flowchart of an operation of storing captured compressed data in a recording medium in the imaging apparatus of the moving image recording / reproducing apparatus according to the embodiment of the present invention. FIG. 7 is a flowchart of an operation for displaying a moving image on the display unit in the reproducing apparatus of the moving image recording / reproducing apparatus according to the embodiment of the present invention. The block diagram which shows the structure of the conventional moving image recording / reproducing apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Moving image recording / reproducing apparatus 2 Imaging apparatus 3 Recording medium 4 Reproducing apparatus 5 Display part 11 Imaging part 12 Compression part 13 Writing part 14 Defective pixel position recording part 15 Position data conversion part 16 Memory 21 Reading part 22 Expansion part 23 Correction part 24 Defective pixel position detection unit 25 Correction data creation unit 31 Defective pixel X coordinate 32 Defective pixel Y coordinate 33 Defective pixel length 41 Clip 42 Metadata 43 Structure data 44 Detailed data 45 User data 46 Video file 47 Audio file 51 Previous frame 52 Correction target Frame 53 Rear frame 54 Defective pixels 55 and 56 Reference pixel 61 Correction target block 62 Reference block

Claims (5)

An imaging unit having a plurality of photoelectric conversion elements and converting an optical image into moving image data;
A compression unit that compresses the moving image data and metadata to generate compressed data;
In an imaging apparatus comprising a writing unit that writes the compressed data to a recording medium,
A defective pixel position recording unit for detecting a defective pixel position of the imaging unit;
A position data conversion unit that converts the data of the defective pixel position into a metadata format;
The said compression part records the data of the said defective pixel position converted on the metadata of moving image data, The imaging device characterized by the above-mentioned.   The imaging apparatus according to claim 1, further comprising a memory that stores data of the detected defective pixel position.   The defective pixel position recording unit determines whether or not the data of the defective pixel position is stored in a memory, and when the data of the defective pixel position is stored, the data of the defective pixel position is stored in the compression unit. The image pickup apparatus according to claim 2, wherein: is recorded in metadata of the moving image data. A reading unit that reads compressed data obtained by compressing moving image data and metadata from a recording medium;
A decompression unit that converts the compressed data into moving image data and metadata;
A defective pixel position detection unit that detects data of a defective pixel position indicating a position of a defective pixel in an imaging unit of an imaging device in which the moving image data is created from the metadata;
A correction data creation unit for creating correction data based on the data of the defective pixel position;
A reproduction apparatus comprising: a correction unit that corrects the moving image data based on the correction data. The imaging device according to any one of claims 1 to 3,
A moving image recording / reproducing apparatus comprising the reproducing apparatus according to claim 4.

Images