KR100854724B1 - Encoded data transfer method and imaging device performing the method - Google Patents

Abstract

An encoded data transfer method and an imaging device that performs the method are disclosed. The image signal processor encodes image data corresponding to an electrical signal input from an image sensor to generate encoded image data, and outputs encoded image data sequentially input from the encoding unit to the receiving end for each frame. It may include a data output unit. Here, when the output encoded image data is abnormal data, a corresponding determination signal may be output to the receiving end by the data output unit. By the present invention, easy error detection of encoded video data is possible.

Encoding, image, JPEG, image sensor

Description

Method for transferring encoded data and image pickup device performing the method

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a simplified diagram of a configuration of a general imaging device.

2 is a diagram illustrating a general JPEG encoding process.

FIG. 3 is a diagram illustrating a signal form for outputting encoded data by a conventional image signal processor (ISP). FIG.

4 is a diagram schematically showing a configuration of an imaging device according to an embodiment of the present invention.

5 is a diagram schematically showing a configuration of a data output unit according to an embodiment of the present invention.

6 and 7 illustrate signal waveforms for encoded data output of an image signal processor in accordance with one embodiment of the present invention.

TECHNICAL FIELD The present invention relates to data encoding, and more particularly, to data encoding performed in an imaging device.

In recent years, small and thin image pickup devices are mounted in small and thin portable terminals such as mobile phones and PDAs (Personal Digital Assistants), whereby the portable terminals can function as image pickup devices. That is, the imaging device is provided not only in a mobile phone or a PDA but also in a portable terminal such as an MP3 player so that various devices can hold external images as electronic data. Therefore, in the case of a portable terminal having a communication function, not only the voice information but also the captured image information can be transmitted to a remote place.

Generally, solid-state imaging devices, such as a charge coupled device (CCD) type image sensor and a complementary metal-oxide semiconductor (CMOS) type image sensor, are used for such an imaging device.

FIG. 1 is a diagram schematically illustrating a configuration of a general image capturing apparatus, FIG. 2 is a diagram illustrating a general JPEG encoding process, and FIG. 3 is a conventional image signal processor (ISP) for outputting encoded data. It is a figure which shows the signal form.

As illustrated in FIG. 1, an image pickup device that converts an external image into electrical data and displays the same on the display unit 150 includes an image sensor 110, an image signal processor 120 (ISP), and a backend chip ( 130, a back-end chip, a baseband chip 140, and a display unit 150. In addition, the imaging device may further include a memory for storing the converted electrical data, an AD converter for converting an analog signal into a digital signal, and the like.

The image sensor 110 is a sensor having a Bayer pattern, and outputs an electric signal corresponding to the amount of light input through the lens for each unit pixel.

The image signal processor 120 converts an electrical signal (raw data) input from the image sensor 110 into a YUV value, and inputs the converted YUV value to the back end chip 130. The YUV method focuses on the fact that the human eye is more sensitive to brightness than color. The YUV method distinguishes colors into Y components of luminance and U and V components of chrominance. Since the Y component is sensitive to error, we code more bits than the color components U and V. A typical Y: U: V ratio is 4: 2: 2.

The image signal processor 120 sequentially stores the converted YUV values in the FIFO so that the back end chip 130 may receive the corresponding information.

The back end chip 130 converts the input YUV value into JPEG or BMP by using a predetermined encoding method and stores the same in the memory or decodes the displayed YUV value on the display unit 150. The back end chip 130 may also perform functions such as enlargement, reduction, and rotation of an image. Of course, as shown in FIG. 1, the baseband chip 140 may receive decoded data from the backend chip 130 and display the decoded data on the display unit 150.

The baseband chip 140 performs a function of controlling the overall operation of the imaging device. For example, when an imaging command is input from a user through a key input unit (not shown), the baseband chip 140 transmits an image generation command to the backend chip 130 so that the backend chip 130 receives an external image. It is also possible to generate encoded data corresponding to.

The display unit 150 displays decoded data provided by the control of the back end chip 130 or the baseband chip 140.

2 illustrates a general JPEG encoding process performed by the back end chip 130. Since the JPEG encoding process 200 is obvious to those skilled in the art, it will be briefly described.

As shown in FIG. 2, the input YUV values are divided into blocks of 8 × 8 pixel size, and a DCT (Discrete Cosine Transform) is performed on each block (210). The pixel value of each pixel input in the form of an 8-bit integer between -128 and 127 is converted into a value between -1024 and 1023 by the DCT.

Subsequently, the quantizer quantizes the DCT coefficient of each block with weights according to the effect on time (220). This table of weights is called a quantization table. The quantization table values take small values near DC, and large values at high frequencies, resulting in small loss of data near DC with a large amount of information, and high compression at high frequencies.

The final compressed data is then generated 230 by an entropy encoder, which is a lossless coder.

The data encoded through the above-described process is loaded into the memory. The back end chip 130 decodes the data loaded in the memory and displays the same on the display unit 150.

A signal waveform of a process of sequentially inputting data loaded in a memory for processing such as decoding is shown in FIG. 3. In general, the back end chip 130 is implemented to receive data in YUV / BAYER format, and uses the P_CLK, V_sync, H_sync, and DATA signals as an interface for receiving such data.

As shown in FIG. 3, the conventional backend chip 130 outputs the clock signal P_CLK in the entire process in transferring the encoded data to a subsequent component (eg, a decoding unit). Since ON is maintained in the ON state, the backend chip 130 must perform an operation for interfacing with each other even while invalid data (for example, data including 0x00) is input.

Therefore, the conventional imaging device has a problem that unnecessary power consumption is caused by the unnecessary operation of the back end chip 130.

In addition, the conventional imaging device outputs image data information in the form of YUV, BAYER, RGB in outputting image data information from the image signal processor to the back end chip. However, this includes information on all pixels, and as a result, too much image information is provided, which causes the backend chip to perform unnecessary operations and also causes unnecessary power consumption.

Accordingly, the present invention is to solve the above-described problem, and the encoded data transfer method and method for improving the processing efficiency and power consumption of the receiving end (for example, any one of the back-end chip, baseband chip, etc.) To provide an imaging device for performing the.

In addition, the present invention outputs the compressed data of one frame in the form of encoded data in providing the image data to the receiving end, the receiving end can suppress the power consumption due to the switching of the write enable signal of the memory The present invention provides an encoded data transfer method and an imaging device that performs the method.

In addition, the present invention provides an encoded data transfer method capable of using the conventional synchronization signal (ie, H_sync, V_sync) for error detection when the image signal processor outputs data to the receiving end for easy error detection of the image data and It is to provide an imaging device that performs the method.

In addition, the present invention provides an encoded data transfer method having an advantageous effect in terms of hardware design and control by using a general interface structure in the image signal processor to provide the encoded data to the receiving end, and to provide an image pickup apparatus that performs the method. It is for.

Other objects of the present invention will become more apparent through the preferred embodiments described below.

According to an aspect of the present invention to achieve the above object, there is provided an image signal processor and / or an imaging device including the image signal processor.

According to an embodiment of the present invention, an image signal processor of an imaging device includes: an encoding unit which encodes image data corresponding to an electrical signal input from an image sensor by a predetermined encoding method to generate encoded image data; And a data output unit configured to output encoded image data sequentially input from the encoding unit to each receiver for each frame. Here, when the output encoded image data is abnormal data, a corresponding determination signal may be output to the receiving end by the data output unit.

The data output unit may include a clock generator. The data output unit may control a clock signal to be output to the receiver only in a section in which valid data is transmitted among sections in which the encoded image data is output.

The data output unit may include: a transmission delay unit configured to output encoded image data input from the encoding unit to a receiving end in a predetermined size unit; A determination signal generator configured to output a determination signal in a high or low state according to a determination signal control command; And determining whether a corresponding determination signal is output by monitoring one or more of whether an encoded image data input to the transmission delay unit has an operation error during a DCT operation, or whether an overflow occurs in the transmission delay unit. It may include a transmission control unit for controlling the signal generator.

The determination signal generator may be either a vertical sync signal V_sync generator or a horizontal sync signal H_sync generator.

The transmission control unit controls the determination signal generator to cause a state transition point of the determination signal output by the determination signal generator when the calculation error or the overflow occurs, before the STOP MARKER output for the encoded image data is generated. When the operation error or the overflow does not occur, the state transition point of the determination signal output by the determination signal generator may be generated after the STOP MARKER output for the encoded image data.

The data output unit may include: a transmission delay unit configured to output encoded image data input from the encoding unit to a receiving end in a predetermined size unit; First and second determination signal generators respectively outputting a determination signal in a high or low state according to a determination signal control command; And outputting a corresponding determination signal by monitoring one or more of whether an encoded image data input to the transmission delay unit has an operation error during a DCT operation, or whether an overflow occurs in the transmission delay unit. It may include a transmission control unit for controlling the first and second determination signal generator.

One of the first and second determination signal generators may be a vertical synchronization signal (V_sync) generator, and the other of the first and second determination signal generators may be a horizontal synchronization signal (H_sync) generator.

The transmission control unit transfers a STOP MARKER output of the encoded image data to at least one state transition point of the first and second determination signals output by the first and second determination signal generators when the operation error or the overflow occurs. One or more of the first and second determination signal generators may be controlled to be generated at.

The transmission control unit may output the state transition points of the first and second determination signals output by the first and second determination signal generators when the operation error or the overflow does not occur after the STOP MARKER output for the encoded image data. The first and second determination signal generators may be controlled to be generated.

The transmission control unit may recognize whether all of the encoded image data for one frame are output by using header information and tail information of the encoded image data stored in the transmission delay unit.

The transmission control unit generates the H_sync generator and the H_sync generator so that they are generated when the state transition points of the first and second determination signals output by the H_sync generator and the H_sync generator do not coincide with each other when the operation error or the overflow occurs. Can be controlled. The transmission control unit may be configured to generate the H_sync generator and the controller at a time point at which state transition points of the first and second determination signals output by the H_sync generator and the H_sync generator coincide with each other when the operation error or the overflow does not occur. You can control the H_sync generator.

The predetermined encoding scheme may be at least one of a JPEG encoding scheme, a BMP encoding scheme, an MPEG encoding scheme, and a TV out scheme.

In an imaging device including an image sensor and an image signal processor according to another embodiment of the present invention, the image signal processor encodes and encodes image data corresponding to an electrical signal input from the image sensor by a predetermined encoding scheme. An encoding unit for generating image data; A transmission delay unit outputting the encoded image data input from the encoding unit to a receiver in units of a predetermined size; A decision signal generator for outputting a decision signal in a high or low state according to a decision signal control command; And whether the encoded image data input to the transmission delay unit has an operation error during a DCT operation, or whether an overflow occurs in the transmission delay unit and outputs a corresponding determination signal to the receiver. It may include a transmission control unit for controlling the determination signal generator so as to.

The image signal processor may include a clock generator. The transmission controller may control a clock signal to be output to the receiver only in a section in which valid data is transmitted among sections in which the encoded image data is output.

The determination signal generator may include at least one of a vertical sync signal V_sync generator and a horizontal sync signal H_sync generator.

The transmission controller may be configured to generate a state transition point of at least one of the first and second determination signals output by the V_sync generator and the H_sync generator when the operation error or the overflow occurs before the STOP MARKER output for the encoded image data. One or more of the V_sync generator and the H_sync generator may be controlled.

The transmission control unit may generate the state transition points of the first and second determination signals output by the H_sync generator and the H_sync generator after the STOP MARKER output for the encoded image data when the operation error or the overflow does not occur. The H_sync generator and the V_sync generator can be controlled.

Alternatively, the transmission controller may be configured to generate the H_sync generator and the controller at a time when state transition points of the first and second determination signals output by the H_sync generator and the H_sync generator do not coincide with each other when the operation error or the overflow occurs. You can control the H_sync generator. The transmission control unit may be configured to generate the H_sync generator and the controller at a time point at which state transition points of the first and second determination signals output by the H_sync generator and the H_sync generator coincide with each other when the operation error or the overflow does not occur. You can control the H_sync generator.

According to another aspect of the present invention for achieving the above object, there is provided an image signal processing method performed in an image signal processor and / or a recording medium on which a program for performing the method is recorded.

An image signal processing method performed in an image signal processor of an imaging device having an image sensor according to an exemplary embodiment of the present invention includes sequentially outputting encoded image data encoded by an encoding unit and sequentially input to a receiving end. ; Determining whether the encoded image data is abnormal data; And outputting a corresponding determination signal according to the determination result to the receiver. Here, the determination signal may be at least one of a vertical sync signal V_sync and a horizontal sync signal H_sync output to the receiver.

Whether the output of the encoded image data for one frame is completed may be determined using header information and tail information of the input encoded image data.

The encoded image data input from the encoding unit is an abnormal data when there is an operation error during the DCT operation or an overflow occurs in the transmission delay unit in which the input encoded image data is temporarily stored. You can judge.

If it is determined that the encoded image data is abnormal data, one or more of the vertical sync signal V_sync and the horizontal sync signal H_sync are controlled to have a state transition before output of the STOP MARKER corresponding to the encoded image data. Can be.

Alternatively, when it is determined that the encoded image data is abnormal data, the encoded image data may be controlled to be generated when the state transition points of the vertical synchronization signal V_sync and the horizontal synchronization signal H_sync do not coincide.

As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. The term and / or includes a combination of a plurality of related items or any item of a plurality of related items.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, and in describing the present invention with reference to the accompanying drawings, the same or corresponding elements are denoted by the same reference numerals regardless of the reference numerals, and duplicates thereof. The description will be omitted. In addition, in the following description of the embodiments of the present invention, only the processing operations of the image signal processor, which is the core of the present invention, will be described. However, the scope of the present invention is not limited thereto.

4 is a view schematically showing the configuration of an image pickup device according to an embodiment of the present invention, and FIG. 5 is a view schematically showing the configuration of a data output unit 430 according to an embodiment of the present invention. 7 is a diagram illustrating a signal waveform for the encoded data output of the image signal processor 400 according to an embodiment of the present invention.

As shown in FIG. 4, the imaging apparatus according to the present invention includes an image sensor 110, an image signal processor 400, and a back end chip 405. In addition, it will be apparent that the imaging apparatus may further include a display unit 150, a memory, a baseband chip 140, a key input unit, and the like, and thus description thereof will be omitted. In addition, the back end chip 405 illustrated in FIG. 4 is an example of a receiving end that receives an output signal from the image signal processor 400. The back end chip 405 outputs the image signal processor 400 using the technical spirit of the present disclosure. Obviously, the receiving end for receiving the image data is not limited to the back end chip 405.

The image signal processor 400 may include a preprocessor 410, an encoder 420, and a data output unit 430. Of course, the image signal processor 400 may further include a clock generator for internal operation.

The preprocessor 410 performs a preprocessing process for the processing of the JPEG encoder 420. The preprocessor 410 may receive raw data in the form of an electric signal from each image sensor 110 for each frame, process the raw data, and transmit the raw data to each encoder 420.

The preprocessing may include color space transformation, filtering, downsampling, and the like.

Color Space Transformation converts the RGB color model to a YUV (or YIQ) color model because it can reduce the amount of information without being aware of the difference in picture quality.

Filtering is a process of smoothing the image with a low pass filter to increase the compression ratio.

Color subsampling is the process of downsampling the chrominance signal components by using all Y values, using only some of the other values, and discarding others.

The encoder 420 compresses the raw data preprocessed by the method described above to generate encoded data. The encoder 420 compresses the input raw data according to a predetermined method, and the compression processing scheme may vary according to a design method, and the specific name of the encoder may also vary according to the compression processing scheme.

However, hereinafter, it is assumed that the most commonly used JPEG encoding scheme is used. Therefore, for convenience of explanation and understanding, hereinafter, it is assumed that the encoder 420 is a JPEG encoder that performs encoding according to the JPEG encoding scheme, and the data encoded by the encoder 420 is assumed to be JPEG encoded data. Explain. In addition, the same reference numerals (that is, 420) are applied to the JPEG encoder.

The JPEG encoder 420 is an input memory for temporarily storing processed raw data input from the preprocessor 410 in order to be divided into predetermined block units (for example, 8 x 8) for encoding processing. It may include.

In addition, the JPEG encoder 420 may further include an output memory for temporarily storing the JPEG encoded data before outputting the encoded data to the data output unit 430. The output memory can be, for example, a FIFO.

That is, the image signal processor 400 according to the present invention may further perform encoding of image data, unlike the conventional image signal processor 120. In addition, the JPEG encoder 420 (or output memory) may provide the transmission control unit 550 to FIG. 5 with status information on how much JPEG encoded data (or valid data) is filled in the output memory.

The data output unit 430 transfers the JPEG encoded data generated by the JPEG encoder 420 to the back end chip 405. As described above, the back end chip 405 is an example of the receiving end, and it is obvious that the receiving end for transmitting JPEG encoded data is not limited to the back end chip 405.

The data output unit 430 transmits the JPEG encoded data to the back end chip 405 in order to output the total data (i.e., the effective data among the JPEG encoded data) (i.e., the JPEG encoding constituting the actual image). Data) and / or invalid data) correspond to a predetermined line size. Invalid data (or dummy data) herein means data that is not mentioned as valid data in the JPEG standard or the like (that is, data that does not actually constitute an image), and as an example, 0x00 (see FIG. 3). It will be shown as shown as or as a separate data is not output (see lines 6 and 7).

For example, if the size at which the back end chip 405 recognizes that all JPEG encoded data for one frame has been input is 640 x 480, the data output unit 430 outputs as much as 640 of the line size. Until now, valid data and dummy data among the JPEG encoded data input from the JPEG encoder 420 are sequentially output.

In this case, the dummy data may be only data added formally until the data becomes 640 when the valid data output by the data output unit 430 does not become the data of the line size 640. This is because the backend chip 405 may not recognize when data smaller than the line size is output.

The above-described process will be performed sequentially and repeatedly by a predetermined time interval of 480 times the column size.

5 illustrates a detailed configuration of the data output unit 430.

Referring to FIG. 5, the data output unit 430 includes an AND gate 510, a first determination signal generator 520, a second determination signal generator 530, a transmission delay unit 540, and a transmission control unit. 550.

 The AND gate 510 outputs the clock signal P_CLK to the back end chip 405 only when signals are input to all inputs. In other words, the clock signal is input from a clock generator (not shown) included in the image signal processor 400, the clock control signal is input from the transmission control unit 550, and the clock control signal indicates the clock signal output. The signal is output to the back end chip 405. The clock control signal may be in the form of a high signal or a low signal, and may be recognized as a P_CLK enable or P_CLK disable signal, respectively.

The first determination signal generator 520 and the second determination signal generator 530 may include a first determination signal for determining whether JPEG encoded data currently input from the back end chip 405 is normal or abnormal. The second determination signal is output to the back end chip 405.

The first determination signal generator 520 and the second determination signal generator 530 are conventionally a V_sync generator and an H_sync generator for outputting a synchronization signal (a vertical synchronization signal V_sync and a horizontal synchronization signal H_sync) to a receiver. Can be. Accordingly, the determination signals output by each determination signal generator may be synchronization signals output through the V_sync output pin and the H_sync output pin. However, it may be recognized as a meaning different from that of the conventional V_sync and H_sync.

In other words, while maintaining the same interface structure, different applications of the signals output to the receiving end under the control of the transmission control unit 550 allow for easier error recognition for JPEG encoded data. When transmitting / receiving JPEG encoded data, this is performed by using information included in a header and / or a tail (ie, START MARKER (FFD8) and STOP MARKER (FFD9)) in a relationship between a transmitter and a receiver. Because the start and end of one frame can be recognized, input and output of V_sync and H_sync may be unnecessary.

In FIG. 5, it is assumed that the first determination signal is V_sync (vertical synchronization signal), and the second determination signal is H_sync (horizontal synchronization signal), and the following description will be made based on this, but it is obvious.

The transmission delay unit 540 outputs JPEG encoded data input from the JPEG encoder 420 to the back end chip 405 in units of a predetermined size. The transmission delay unit 540 may include a register for delaying and outputting the data input from the JPEG encoder 420 for a predetermined time (for example, 2 to 3 clocks) or may be a FIFO. For example, the data size unit input from the JPEG encoder 420 may be 32 bits, and the data size unit output to the backend chip 405 may be 8 bits.

6, a section in which JPEG encoded data from the transmission delay unit 540 is output to the back end chip 405 is a falling edge time from a falling edge time point of the first and second decision signals. It is shown to be until. However, according to a design method, whether the first determination signal and / or the second determination signal are in a low state or a high state may vary in a section in which JPEG encoded data is output. For example, when the determination signal is in a low state, a signal of 0 (zero) may be output, and in the high state, a signal of 1 may be output.

The transmission controller 550 outputs a P_CLK enable or P_CLK disable signal to the AND gate 510 according to whether data to be output to the current backend chip 405 is valid data or invalid data. Controls whether the clock signal is output.

The transmission control unit 550 monitors JPEG encoded data output from the JPEG encoder 420 and sequentially recorded in the transmission delay unit 540 to capture START MARKER (FFD8) and STOP MARKER (FFD9) to start JPEG encoding. Recognize information about and end. That is, through this, the JPEG encoder 420 may recognize whether all one frame is encoded. Here, the transmission control unit 550 may recognize that the JPEG encoded data for the new frame will be input by the input of the V_sync_I signal from the JPEG encoder 420. The method of detecting an input of a new frame may be varied by a method of detecting a rising edge or a falling edge of the V_sync signal.

In addition, when the transmission control unit 550 outputs JPEG encoded data for any one frame to the backend chip 405, whether the currently encoded JPEG encoded data is normally encoded data or not, the transmission delay unit 540. The control signal generation of the first determination signal generator 520 and the second determination signal generator 530 is controlled according to whether or not the controller performs a normal processing operation.

When the transmission control unit 550 recognizes abnormal JPEG encoded data, for example, when it detects that an error has occurred in a DCT operation that performs an addition / subtraction / multiplication operation by a predetermined number of bits, the transmission delay unit 540. ), There may be a case where an overflow occurs. When the overflow occurs in the transmission delay unit 540, when the size of the JPEG encoded data is abnormally large, when the operation clock of the JPEG encoder 420 is too large compared to the operation clock of the back end chip 405 ( That is, if too much data must be accumulated before data is output). Also, the transmission control unit 550 may recognize abnormally JPEG encoded data when the size of the JPEG encoded data is larger than the upper limit of the compressed data designated by the user.

As described above, when the transmission controller 550 recognizes that the JPEG encoded data currently output to the backend chip 405 is normal data, the state transition of the first decision signal and the second decision signal as shown in FIG. The first determination signal generator 520 and the second determination signal generator 530 are controlled so that the dot appears after the STOP MARKER. The state transition point is a point at which the determination signal is converted from the first state (either of the low state or the high state) to the second state (the other of the low state or the high state), and in the case of FIG. 6, after the STOP MARKER output. It can be seen from the point of view. That is, in case of normal JPEG encoded data, the transmission control unit 550 controls the first determination signal generator 520 and the second determination signal generator 530 so that the respective stop markers are output to the backend chip 405 after the STOP MARKER is output. The state transition point for the determination signal is displayed. The back end chip 405 may recognize that all normal JPEG encoded data (for one frame) has been input by recognizing the input of the STOP MARKER.

The point of time at which each state transition point appears under the control of the transmission control unit 550 may be the same point in time as illustrated in FIG. 6, but may be different after the STOP MARKER output. However, if JPEG encoded data corresponding to subsequent frames should be further output to the backend chip 405, each state transition point should be controlled to appear before the START MARKER output for subsequent frames.

In addition, as described above, the JPEG-encoded data currently output to the back-end chip 405 by the transmission control unit 550 is abnormal data (for example, an overflow occurs in the transmission delay unit 540, an error in the DCT operation). The first determination signal generator 520 and / or the second such that at least one of the state transition points of the first determination signal and the second determination signal appears before the STOP MARKER, as shown in FIG. The determination signal generator 530 is controlled. The back end chip 405 may recognize that abnormal JPEG encoded data (for one frame) is input by recognizing that the STOP MARKER has not been input at the time when the state transition of one or more determination signals is recognized. .

In FIG. 7, it can be seen that state transition points of the first determination signal and the second determination signal appear at an arbitrary time point before the output of the STOP MARKER. That is, in case of abnormal JPEG encoded data, the transmission control unit 550 controls the first determination signal generator 520 and / or the second determination signal generator 530 so that the STOP MARKER is output to the backend chip 405. State transition points for one or more determination signals are indicated.

As illustrated in FIG. 7, the time points at which the state transition points appear under the control of the transmission control unit 550 may be different points before the STOP MARKER output, or may be the same time points before the STOP MARKER output. In addition, there is one each before and after the STOP MARKER output time point (for example, the state transition point of the first judgment signal appears before the STOP MARKER output, and the state transition point of the second judgment signal is STOP MARKER). May appear after output). However, if JPEG encoded data corresponding to subsequent frames should be further output to the backend chip 405, each state transition point should be controlled to appear before the START MARKER output for subsequent frames.

So far, the method of outputting the determination signal has been described based on the case where both H_sync and V_sync are used. However, even if only one of H_sync and V_sync is used, the same or similar effect may be possible by determining whether the corresponding signal indicates a state transition point before or after the STOP MARKER. That is, if the state transition point of the specific synchronization signal used as the determination signal appears before the output of the STOP MARKER, the receiving end may recognize that the currently encoded JPEG encoded data is abnormal data. In this case, one synchronization signal that is not used as the determination signal may be used for the same purpose as in the prior art.

Until now, the image signal processor 400 has been described based only on the case of using the JPEG encoding scheme, but other encoding schemes such as BMP encoding scheme, MPEG (MPEG 1/2/4, MPEG-4 AVC) encoding scheme, TV out scheme, etc. Obviously, the same data transmission scheme can be used even if it supports it.

As described above, the present invention has an effect of improving processing efficiency and preventing power consumption of a receiving end (for example, any one of a backend chip, a baseband chip, and the like).

In addition, the present invention outputs the compressed data of one frame in the form of encoded data in providing the image data to the receiving end to suppress the power consumption due to the switching of the write enable signal of the memory by the receiving end. There is also an effect.

In addition, in the present invention, when the image signal processor outputs data to the receiving end, conventional synchronization signals (that is, H_sync and V_sync) can be used for error detection, so that error detection of image data can be easily performed.

In addition, the present invention has an advantageous effect in terms of hardware design and control by using a general interface structure in providing the encoded data to the receiving end of the image signal processor.

Although the above has been described with reference to a preferred embodiment of the present invention, those skilled in the art to which the present invention pertains without departing from the spirit and scope of the invention as set forth in the claims below It will be appreciated that modifications and variations can be made.

Claims (27)

In the image signal processor of the imaging device, An encoding unit for encoding the image data corresponding to the electrical signal input from the image sensor by using a predetermined encoding method to generate encoded image data; And A data output unit for outputting the encoded image data sequentially input from the encoding unit for each frame to the receiving end, And the corresponding determination signal is output to the receiving end by the data output unit when the encoded encoded image data is abnormal data. delete The method of claim 1, The data output unit includes a clock generator, and outputs a clock signal to the receiving end only in a section in which valid data constituting an actual image is transmitted among sections in which the encoded image data is output. Image signal processor. The method of claim 1, The data output unit, A transmission delay unit outputting the encoded image data input from the encoding unit to the receiving end in units of a predetermined size; A determination signal generator configured to output a determination signal in a high or low state according to a determination signal control command; And The determination signal is output so that a corresponding determination signal is output by monitoring at least one of whether an encoded image data input to the transmission delay unit has an operation error during a DCT operation, or whether an overflow occurs in the transmission delay unit. And a transmission control unit for controlling the generator. The method of claim 4, wherein And the determination signal generator is one of a vertical sync signal (V_sync) generator and a horizontal sync signal (H_sync) generator. The method of claim 4, wherein The transmission control unit controls the determination signal generator, A state transition point of the determination signal output by the determination signal generator when the operation error or the overflow occurs, occurs before the STOP MARKER output for the encoded image data, And a state transition point of the determination signal output by the determination signal generator when the operation error or the overflow does not occur after the STOP MARKER output for the encoded image data. The method of claim 1, The data output unit, A transmission delay unit outputting the encoded image data input from the encoding unit to the receiving end in units of a predetermined size; First and second determination signal generators respectively outputting a determination signal in a high or low state according to a determination signal control command; And The first image is output such that a corresponding determination signal is output by monitoring at least one of whether an encoded image data input to the transmission delay unit has an operation error during a DCT operation, or whether an overflow occurs in the transmission delay unit. And a transmission controller for controlling the second determination signal generator. The method of claim 7, wherein One of the first and second determination signal generators is a vertical synchronization signal (V_sync) generator, and the other of the first and second determination signal generators is a horizontal synchronization signal (H_sync) generator, characterized in that . The method of claim 7, wherein The transmission control unit before the output of the STOP MARKER for the encoded image data at least one state transition point of the first and second determination signal output by the first and second determination signal generator when the operation error or the overflow occurs And controlling at least one of the first and second decision signal generators to be generated. The method of claim 7, wherein The transmission control unit may output the state transition points of the first and second determination signals output by the first and second determination signal generators when the operation error or the overflow does not occur after the STOP MARKER output for the encoded image data. And controlling the first and second decision signal generators to be generated. The method of claim 7, The transmission control unit recognizes whether all of the encoded image data for one frame are output by using header information and tail information of the encoded image data stored in the transmission delay unit. Image signal processor. The method of claim 7, wherein The transmission controller may be configured to generate the first and second determination signals output by the first and second determination signal generators when the operation error or the overflow occurs, when the state transition points of the first and second determination signals do not coincide. 2 An image signal processor for controlling a decision signal generator. The method of claim 7, wherein The transmission controller is configured to generate the first and second determination signals when the state transition points of the first and second determination signals output by the first and second determination signal generators coincide with each other when the operation error or the overflow does not occur. 2 An image signal processor for controlling a decision signal generator. Claim 14 was abandoned when the registration fee was paid. The method of claim 1, The predetermined encoding scheme is at least one of a JPEG encoding scheme, a BMP encoding scheme, an MPEG encoding scheme, and a TV out scheme. An imaging device comprising an image sensor and an image signal processor, The image signal processor, An encoding unit for encoding the image data corresponding to the electrical signal input from the image sensor by using a predetermined encoding method to generate encoded image data; A transmission delay unit which outputs encoded image data input from the encoding unit to a receiver in units of a predetermined size; A decision signal generator for outputting a decision signal in a high or low state according to a decision signal control command; And The encoded image data input to the transmission delay unit monitors at least one of whether there is an operation error in the DCT operation process or whether an overflow occurs in the transmission delay unit so that a corresponding determination signal is output to the receiver. And a transmission control unit for controlling the determination signal generator. delete Claim 17 was abandoned upon payment of a registration fee. The method of claim 15, The image signal processor includes a clock generator, And the transmission controller outputs a clock signal to the receiver only in a section in which valid data constituting an actual image is transmitted among sections in which the encoded image data is output. The method of claim 15, And the determination signal generator comprises at least one of a vertical sync signal (V_sync) generator and a horizontal sync signal (H_sync) generator. Claim 19 was abandoned upon payment of a registration fee. The method of claim 18, The transmission controller may be configured to generate a state transition point of at least one of the first and second determination signals output by the V_sync generator and the H_sync generator when the operation error or the overflow occurs before the STOP MARKER output for the encoded image data. And at least one of a V_sync generator and the H_sync generator. Claim 20 was abandoned upon payment of a registration fee. The method of claim 18, The transmission control unit may generate the state transition points of the first and second determination signals output by the H_sync generator and the H_sync generator after the STOP MARKER output for the encoded image data when the operation error or the overflow does not occur. And controlling the H_sync generator and the V_sync generator. Claim 21 was abandoned upon payment of a registration fee. The transmission control unit generates the H_sync generator and the H_sync generator so that they are generated when the state transition points of the first and second determination signals output by the H_sync generator and the H_sync generator do not coincide with each other when the operation error or the overflow occurs. An imaging device, characterized in that for controlling. Claim 22 was abandoned upon payment of a registration fee. The method of claim 18, The transmission control unit may generate the H_sync generator and the H_sync generator so that they are generated when the state transition points of the first and second determination signals output by the H_sync generator and the H_sync generator coincide with each other when the operation error or the overflow does not occur. An imaging device, characterized in that for controlling. An image signal processing method performed in an image signal processor of an imaging device having an image sensor, Sequentially outputting encoded image data encoded by the encoding unit and sequentially input to the receiving end; Determining whether the encoded image data is abnormal data; And Outputting a corresponding determination signal according to the determination result to the receiving end; And the determination signal is at least one of a vertical sync signal (V_sync) and a horizontal sync signal (H_sync) output to the receiving end. Claim 24 was abandoned when the setup registration fee was paid. The method of claim 23, wherein Completion of output of the encoded image data for one frame is determined using the header (Header) information and the tail (Tail) information of the encoded image data input method. The method of claim 23, wherein The encoded image data input from the encoding unit is an abnormal data when there is an operation error during the DCT operation or an overflow occurs in the transmission delay unit in which the input encoded image data is temporarily stored. And determining the image signal processing method. The method of claim 25, If it is determined that the encoded image data is abnormal data, one or more of the vertical sync signal V_sync and the horizontal sync signal H_sync are controlled to have a state transition before output of the STOP MARKER corresponding to the encoded image data. Image signal processing method characterized in that the. The method of claim 25, If it is determined that the encoded image data is abnormal data, the image signal processing method is controlled to be generated when the state transition points of the vertical synchronization signal V_sync and the horizontal synchronization signal H_sync do not coincide. .

Images