CN1144446C - Digital camera adjustment system and adjustment device - Google Patents
Digital camera adjustment system and adjustment device Download PDFInfo
- Publication number
- CN1144446C CN1144446C CNB98119740XA CN98119740A CN1144446C CN 1144446 C CN1144446 C CN 1144446C CN B98119740X A CNB98119740X A CN B98119740XA CN 98119740 A CN98119740 A CN 98119740A CN 1144446 C CN1144446 C CN 1144446C
- Authority
- CN
- China
- Prior art keywords
- digital camera
- mentioned
- suitable gain
- adjustment
- white balance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000011156 evaluation Methods 0.000 claims abstract description 47
- 230000007613 environmental effect Effects 0.000 claims description 30
- 238000001514 detection method Methods 0.000 claims description 11
- 230000003287 optical effect Effects 0.000 claims description 9
- 238000006243 chemical reaction Methods 0.000 claims description 7
- 238000003384 imaging method Methods 0.000 claims description 6
- 230000001105 regulatory effect Effects 0.000 claims 17
- NUHSROFQTUXZQQ-UHFFFAOYSA-N isopentenyl diphosphate Chemical compound CC(=C)CCO[P@](O)(=O)OP(O)(O)=O NUHSROFQTUXZQQ-UHFFFAOYSA-N 0.000 abstract description 16
- 239000003086 colorant Substances 0.000 abstract description 5
- 230000006870 function Effects 0.000 description 15
- 230000002159 abnormal effect Effects 0.000 description 11
- 230000000875 corresponding effect Effects 0.000 description 11
- 238000000034 method Methods 0.000 description 11
- 238000012545 processing Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 6
- 230000006835 compression Effects 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 238000005286 illumination Methods 0.000 description 3
- 238000005070 sampling Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- WHXSMMKQMYFTQS-UHFFFAOYSA-N Lithium Chemical compound [Li] WHXSMMKQMYFTQS-UHFFFAOYSA-N 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000008033 biological extinction Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- OJIJEKBXJYRIBZ-UHFFFAOYSA-N cadmium nickel Chemical compound [Ni].[Cd] OJIJEKBXJYRIBZ-UHFFFAOYSA-N 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005401 electroluminescence Methods 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 229910052744 lithium Inorganic materials 0.000 description 1
- 229910052987 metal hydride Inorganic materials 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000001454 recorded image Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Landscapes
- Color Television Image Signal Generators (AREA)
- Processing Of Color Television Signals (AREA)
- Studio Devices (AREA)
Abstract
Description
技术领域technical field
本发明涉及数字式照相机调整系统及调整装置,具体地说,涉及设有自动白平衡(Auto White Balance,以下简记为AWB)机能的数字式照相机调整系统及调整装置。The present invention relates to a digital camera adjustment system and an adjustment device, in particular to a digital camera adjustment system and an adjustment device equipped with an automatic white balance (Auto White Balance, hereinafter abbreviated as AWB) function.
背景技术Background technique
以往,在数字式照相机中,为了获得高质量彩色图像,需要调整白平衡。若该白平衡崩溃的话,则当对白色被照体进行摄影时,其摄影图像会带上颜色,不仅如此,当对一般被照体进行摄影时,色再现性也差,难以得到高质量的再现图像。Conventionally, in digital cameras, in order to obtain high-quality color images, it was necessary to adjust the white balance. If the white balance breaks down, when shooting a white subject, the photographed image will be colored. Not only that, but when taking a picture of a general subject, the color reproducibility is also poor, and it is difficult to obtain a high-quality image. reproduce the image.
若光源色温变化,白平衡就变化,所以,每当拍摄白色(或无彩色)被照体时,必须将作为数字式照相机摄影信号输出的三原色信号R、G、B的输出比调整为1∶1∶1。这叫白平衡调整,这种调整一般通过调整设在各色信号的传送线路上的可变增益电路进行。If the color temperature of the light source changes, the white balance will change. Therefore, whenever a white (or achromatic) subject is photographed, the output ratio of the three primary color signals R, G, and B output as a photographic signal of a digital camera must be adjusted to 1: 1:1. This is called white balance adjustment, and this adjustment is generally carried out by adjusting the variable gain circuit arranged on the transmission line of each color signal.
发明内容Contents of the invention
但是,在以往的数字式照相机中,存在光源温度一变化就不能正确地再现白色的问题。However, in conventional digital cameras, there is a problem that white cannot be accurately reproduced when the temperature of the light source changes.
本发明就是鉴于上述先有技术所存在的问题而提出来的,其目的在于,提供用于调整即使光源色温变化也能正确地再现白色的数字式照相机的数字式照相机调整系统及调整装置。The present invention has been made in view of the above-mentioned problems of the prior art, and an object of the present invention is to provide a digital camera adjustment system and an adjustment device for adjusting a digital camera capable of accurately reproducing white even if the color temperature of a light source changes.
为了实现上述目的,本发明提出一种数字式照相机调整系统,由数In order to achieve the above object, the present invention proposes a digital camera adjustment system, which consists of digital
字式照相机和用于调整该数字式照相机的数字式照相机调整装置构成,上述数字式照相机设有将通过光学系统的被摄对象光变换成电信号、再将该电信号作为彩色图像信号输出的摄像元件,以及对上述彩色图像信号进行A/D变换、作为数字彩色图像信号输出的A/D变换器;其特征在于,上述数字式照相机还设有:A digital camera and a digital camera adjustment device for adjusting the digital camera are provided with a device for converting the subject light passing through an optical system into an electrical signal and outputting the electrical signal as a color image signal An imaging element, and an A/D converter for performing A/D conversion on the above-mentioned color image signal and outputting it as a digital color image signal; it is characterized in that the above-mentioned digital camera is also equipped with:
白检测范围设定装置,用于设定作为白平衡调整对象的色温范围;The white detection range setting device is used to set the color temperature range as the object of white balance adjustment;
AWB评价装置,对于上述数字彩色图像信号的各色成份(RGB),输出与上述各色成份的亮度数据相对应的AWB评价值;An AWB evaluation device, for each color component (RGB) of the above-mentioned digital color image signal, output an AWB evaluation value corresponding to the luminance data of the above-mentioned each color component;
AWB调整装置,用于调整上述数字彩色图像信号中至少二色增益;AWB adjustment device, used to adjust at least two color gains in the digital color image signal;
存储装置,用于存储若干种照明条件下的合适增益值;a storage device for storing suitable gain values under several lighting conditions;
AWB控制装置,参照上述存储在上述存储装置中的合适增益值,在上述白检测范围设定装置设定的色温范围内,计算与从上述AWB评价装置输出的AWB评价值对应的合适增益值,设定上述AWB调整装置的增益;The AWB control means calculates an appropriate gain value corresponding to the AWB evaluation value output from the AWB evaluation means within the color temperature range set by the white detection range setting means with reference to the appropriate gain value stored in the storage means, setting the gain of the above-mentioned AWB adjusting means;
写入装置,将从上述数字式照相机调整装置传送来的各照明条件下的合适增益写入上述存储装置中。The writing means writes the appropriate gain under each lighting condition sent from the digital camera adjusting means into the storage means.
上述数字式照相机调整装置设有:The above-mentioned digital camera adjusting device is provided with:
可在若干照明条件下照射光的照明装置;lighting fixtures capable of illuminating light under certain lighting conditions;
合适增益计算装置,累计在上述照明装置的各照明条件下的上述RGB的自动白平衡评价值,计算至少二色的合适增益,使得累计值之比成为在规定值内;an appropriate gain calculation device that accumulates the RGB automatic white balance evaluation values under each lighting condition of the above-mentioned lighting device, and calculates appropriate gains for at least two colors so that the ratio of the accumulated values falls within a predetermined value;
送信装置,用于将上述各照明条件下的合适增益送向上述数字式照相机。The sending device is used for sending the appropriate gain under each lighting condition to the above-mentioned digital camera.
根据本发明的数字式照相机调整系统,其特征还在于,上述照明装置切换光学特性不同的滤光片,使照明条件不同。The digital camera adjustment system according to the present invention is further characterized in that the illumination device switches filters with different optical characteristics to make illumination conditions different.
根据本发明的数字式照相机调整系统,其特征还在于,上述合适增益计算装置对各RGB计算AWB评价值的累计值∑R、∑G、∑B,将累计值之比∑R/∑G和∑B/∑G成为规定值内时的R、B增益设为合适增益。The digital camera adjustment system according to the present invention is further characterized in that the appropriate gain calculating means calculates integrated values ΣR, ΣG, and ΣB of the AWB evaluation values for each RGB, and calculates the ratio of the integrated values ΣR/ΣG and The R and B gains when ΣB/ΣG are within predetermined values are set as appropriate gains.
根据本发明的数字式照相机调整系统,其特征还在于,设有AE控制装置,用于设定AE机能的接通或断开。The digital camera adjustment system according to the present invention is further characterized in that it is provided with an AE control device for setting the AE function on or off.
根据本发明的数字式照相机调整系统,其特征还在于,设有AWB控制装置,用于设定AWB机能的接通或断开。The digital camera adjustment system according to the present invention is further characterized in that an AWB control device is provided for setting on or off of the AWB function.
根据本发明的数字式照相机调整系统,其特征还在于,上述合适增益计算装置对于计算合适增益的调整次数设定规定次数,当调整次数超过该规定次数还不能得到合适增益时,报知“数字式照相机或环境条件为异常”的信息。According to the digital camera adjustment system of the present invention, it is also characterized in that the above-mentioned appropriate gain calculating means sets a predetermined number of adjustment times for calculating the appropriate gain, and when the number of adjustments exceeds the specified number of times and the appropriate gain cannot be obtained, it will report "digital gain". camera or environmental conditions are abnormal" message.
根据本发明的数字式照相机调整系统,其特征还在于,上述合适增益计算装置对于计算合适增益的调整时间设定规定时间,当调整时间超过该规定时间还不能得到合适增益时,报知“数字式照相机或环境条件为异常”的信息。According to the digital camera adjustment system of the present invention, it is also characterized in that the above-mentioned appropriate gain calculation device sets a predetermined time for the adjustment time for calculating the appropriate gain, and when the adjustment time exceeds the specified time and the appropriate gain cannot be obtained, it will report "digital gain". camera or environmental conditions are abnormal" message.
为了实现上述目的,本发明还提出一种数字式照相机调整装置,用于调整数字式照相机,上述数字式照相机设有:In order to achieve the above object, the present invention also proposes a digital camera adjustment device for adjusting the digital camera, the above digital camera is provided with:
将通过光学系统的被摄对象光变换成电信号、再将该电信号作为彩色图像信号输出的摄像元件;An imaging element that converts the subject light passing through the optical system into an electrical signal, and then outputs the electrical signal as a color image signal;
对上述彩色图像信号进行A/D变换、作为数字彩色图像信号输出的A/D变换器;An A/D converter for performing A/D conversion on the above-mentioned color image signal and outputting it as a digital color image signal;
白检测范围设定装置,用于设定作为白平衡调整对象的色温范围;The white detection range setting device is used to set the color temperature range as the object of white balance adjustment;
自动白平衡评价装置,对于上述数字彩色图像信号的各色成份RGB,输出与上述各色成份的亮度数据相对应的自动白平衡评价值;An automatic white balance evaluation device, for each color component RGB of the above-mentioned digital color image signal, output an automatic white balance evaluation value corresponding to the brightness data of the above-mentioned various color components;
自动白平衡调整装置,用于调整上述数字彩色图像信号中至少二色增益;An automatic white balance adjustment device, used to adjust at least two color gains in the digital color image signal;
存储装置,用于存储若干种照明条件下的合适增益值;a storage device for storing suitable gain values under several lighting conditions;
自动白平衡控制装置,参照上述存储在上述存储装置中的合适增益值,在上述白检测范围设定装置设定的色温范围内,计算与从上述自动白平衡评价装置输出的自动白平衡评价值对应的合适增益值,设定上述自动白平衡调整装置的增益;The automatic white balance control device calculates the automatic white balance evaluation value output from the automatic white balance evaluation device within the color temperature range set by the white detection range setting device with reference to the appropriate gain value stored in the storage device. Set the gain of the above-mentioned automatic white balance adjustment device according to the appropriate gain value;
写入装置,将从上述数字式照相机调整装置传送来的各照明条件下的合适增益写入上述存储装置中;A writing device, for writing the appropriate gain under each lighting condition transmitted from the digital camera adjustment device into the storage device;
该数字式照相机调整装置特征在于,设有:The digital camera adjustment device is characterized in that it is provided with:
可在若干照明条件下照射光的照明装置;lighting fixtures capable of illuminating light under certain lighting conditions;
合适增益计算装置,累计在上述照明装置的各照明条件下的上述RGB的自动白平衡评价值,计算至少二色的合适增益,使得累计值之比成为在规定值内;an appropriate gain calculation device that accumulates the RGB automatic white balance evaluation values under each lighting condition of the above-mentioned lighting device, and calculates appropriate gains for at least two colors so that the ratio of the accumulated values falls within a predetermined value;
送信装置,将上述各照明条件下的合适增益送向上述数字式照相机,以便存储在上述数字照相机的存储装置中。The sending means sends the appropriate gain under each lighting condition to the digital camera so as to be stored in the storage device of the digital camera.
根据本发明的数字式照相机调整装置,其特征还在于,上述照明装置切换光学特性不同的滤光片,使照明条件不同。The digital camera adjusting device according to the present invention is further characterized in that the lighting device switches filters with different optical characteristics to make lighting conditions different.
根据本发明的数字式照相机调整装置,其特征还在于,上述合适增益计算装置对各RGB计算AWB评价值的累计值∑R、∑G、∑B,将累计值之比∑R/∑G和∑B/∑G成为规定值内时的R、B增益设为合适增益。The digital camera adjustment device according to the present invention is further characterized in that the appropriate gain calculating means calculates the integrated values ΣR, ΣG, and ΣB of the AWB evaluation values for each RGB, and calculates the ratio of the integrated values ΣR/ΣG and The R and B gains when ΣB/ΣG are within predetermined values are set as appropriate gains.
根据本发明的数字式照相机调整装置,其特征还在于,设有AE控制装置,用于设定AE机能的接通或断开。The digital camera adjusting device according to the present invention is further characterized in that it is provided with an AE control device for setting on or off of the AE function.
根据本发明的数字式照相机调整装置,其特征还在于,设有AWB控制装置,用于设定AWB机能的接通或断开。According to the digital camera adjustment device of the present invention, it is further characterized in that it is provided with an AWB control device for setting the AWB function on or off.
根据本发明的数字式照相机调整装置,其特征还在于,上述合适增益计算装置对于计算合适增益的调整次数设定规定次数,当调整次数超过该规定次数还不能得到合适增益时,报知“数字式照相机或环境条件为异常”的信息。According to the digital camera adjustment device of the present invention, it is also characterized in that the above-mentioned appropriate gain calculation means sets a predetermined number of adjustment times for calculating the appropriate gain. camera or environmental conditions are abnormal" message.
根据本发明的数字式照相机调整装置,其特征还在于,上述合适增益计算装置对于计算合适增益的调整时间设定规定时间,当调整时间超过该规定时间还不能得到合适增益时,报知“数字式照相机或环境条件为异常”的信息。According to the digital camera adjustment device of the present invention, it is also characterized in that the above-mentioned appropriate gain calculation means sets a predetermined time for the adjustment time for calculating the appropriate gain, and when the adjustment time exceeds the predetermined time and the appropriate gain cannot be obtained, it will report "Digital camera or environmental conditions are abnormal" message.
下面说明本发明的效果。Effects of the present invention will be described below.
按照本发明的数字式照相机调整系统及调整装置,能调整即使光源的色温有变化也能正确地再现白色的数字照相机。According to the digital camera adjustment system and adjustment device of the present invention, it is possible to adjust a digital camera capable of accurately reproducing white even if the color temperature of a light source varies.
按照本发明的数字式照相机调整系统及调整装置,能简单地变更照明条件。According to the digital camera adjustment system and adjustment device of the present invention, the lighting conditions can be easily changed.
按照本发明的数字式照相机调整系统及调整装置,能计算精度高的合适增益。According to the digital camera adjustment system and adjustment device of the present invention, it is possible to calculate an appropriate gain with high accuracy.
按照本发明的数字式照相机调整系统及调整装置,能在AWB调整时得到合适曝光。According to the digital camera adjustment system and adjustment device of the present invention, proper exposure can be obtained during AWB adjustment.
按照本发明的数字式照相机调整系统及调整装置,在AWB调整时,能防止白平衡状态变化,很容易进行白平衡调整。According to the digital camera adjustment system and adjustment device of the present invention, during AWB adjustment, the white balance state can be prevented from changing, and the white balance adjustment can be easily performed.
按照本发明的数字式照相机调整系统及调整装置,操作者很容易判断数字照相机或环境条件的异常。According to the digital camera adjustment system and adjustment device of the present invention, the operator can easily judge the abnormality of the digital camera or the environmental conditions.
附图说明Description of drawings
图1是本发明实施例涉及的数字式照相机的构成图;FIG. 1 is a block diagram of a digital camera according to an embodiment of the present invention;
图2表示图1的IPP的具体构成一例;Fig. 2 shows an example of the concrete constitution of the IPP of Fig. 1;
图3是本发明实施例涉及的数字式照相机调整装置的外观构成图;Fig. 3 is a diagram of the appearance and composition of a digital camera adjustment device according to an embodiment of the present invention;
图4是本发明实施例涉及的数字式照相机调整系统构成图;Fig. 4 is a configuration diagram of a digital camera adjustment system related to an embodiment of the present invention;
图5表示图3的计算机构成图;Fig. 5 represents the computer configuration diagram of Fig. 3;
图6表示AWB调整处理顺序的流程图;FIG. 6 shows a flow chart of the AWB adjustment processing sequence;
图7是“表示菜单”图;Fig. 7 is a "representation menu" diagram;
图8是“滤光片选择菜单”图。Figure 8 is a diagram of the "filter selection menu".
具体实施方式Detailed ways
下面参照附图,详细说明本发明涉及的数字式照相机调整系统及调整装置的合适实施例。A suitable embodiment of the digital camera adjustment system and the adjustment device according to the present invention will be described in detail below with reference to the accompanying drawings.
本实施例中涉及的数字式照相机设有AWB调整机能,其中央处理器(Central Processing Unit,以下简记为CPU)作为AWB控制装置根据从图像信息预处理部(Image Pre-Processor,以下简记为IPP)的AWB调整值·白提取设定电路(AWB评价装置)输出的AWB评价值,参照调整工序中已存入瞬间存储器(flash memory)中的各照明条件下的合适增益值,计算在设定的色温范围内对应的合适增益值,在IPP的白平衡调整部(AWB调整装置)设定上述算得的合适增益值,进行AWB控制。另外,数字式照相机调整装置根据各照明条件下从数字式照相机的IPP输出的AWB评价值,计算对应的合适增益。该合适增益被写入数字式照相机的瞬间存储器中。在本说明书中,所谓数字式照相机调整系统是指包含上述数字式照相机和数字式照相机调整装置的系统。The digital camera involved in this embodiment is equipped with an AWB adjustment function, and its central processing unit (Central Processing Unit, hereinafter referred to as CPU) is used as an AWB control device according to the image information preprocessing part (Image Pre-Processor, hereinafter referred to as The AWB adjustment value of IPP) and the AWB evaluation value output by the white extraction setting circuit (AWB evaluation device) are calculated by referring to the appropriate gain value under each lighting condition that has been stored in the flash memory in the adjustment process. The appropriate gain value corresponding to the set color temperature range is set in the white balance adjustment part (AWB adjustment device) of the IPP to set the appropriate gain value calculated above to perform AWB control. In addition, the digital camera adjustment device calculates a corresponding appropriate gain based on the AWB evaluation value output from the IPP of the digital camera under each lighting condition. The appropriate gain is written into the flash memory of the digital camera. In this specification, a digital camera adjustment system refers to a system including the above-mentioned digital camera and a digital camera adjustment device.
先就本实施例的数字式照相机进行说明。First, the digital camera of this embodiment will be described.
图1是本发明实施例涉及的数字式照相机构成图,在该图中,100表示数字式照相机,数字式照相机100由透镜101、包含自动调焦等的机械机构102、电荷藕合器件(Charge-Coupled Device,以下简记为CCD)103、相关双重取样(Correlate Dual Sampling,以下简记为CDS)电路104、可变增益放大器(AGC放大器)105、A/D变换器106、IPP 107、离散余弦变换器(Discrete CosineTransform,以下简记为DCT)108、编码器(Huffman Encoder/Decoder)109、存储卡控制器(Memory Card Controller,以下简记为MCC)110、RAM(内部存储器)111、PC卡接口112、CPU121、显示部122、操作部123、马达驱动器125、控制信号产生(SG)部126、闪光灯127、电池128、DC-DC转换器、瞬间存储器130构成。另外,通过pc卡接口112与可装离的pc卡150连接着。Fig. 1 is a diagram showing the structure of a digital camera according to an embodiment of the present invention. In the figure, 100 represents a digital camera. -Coupled Device, hereinafter abbreviated as CCD) 103, correlated double sampling (Correlate Dual Sampling, hereinafter abbreviated as CDS) circuit 104, variable gain amplifier (AGC amplifier) 105, A/D converter 106, IPP 107, discrete Cosine Transformer (Discrete Cosine Transform, hereinafter abbreviated as DCT) 108, Encoder (Huffman Encoder/Decoder) 109, Memory Card Controller (Memory Card Controller, hereinafter abbreviated as MCC) 110, RAM (internal memory) 111, PC Card interface 112 , CPU 121 , display unit 122 , operation unit 123 , motor driver 125 , control signal generator (SG) unit 126 , flash 127 , battery 128 , DC-DC converter, and flash memory 130 constitute. In addition, it is connected with the detachable pc card 150 through the pc card interface 112 .
透镜组件由透镜101、包含自动调焦(AF)·光圈·滤光部的机械机构102等构成,机械机构102的机械快门使两半帧同时曝光。CCD 103通过透镜组件将输入镜像变换成电信号(模拟图像数据)。CDS电路104是为了对CCD型摄像元件低杂音化的电路。The lens unit is composed of a lens 101, a mechanical mechanism 102 including an auto focus (AF), aperture, and filter, and the mechanical shutter of the mechanical mechanism 102 simultaneously exposes two fields. The CCD 103 converts the input image into an electrical signal (analog image data) through a lens assembly. The CDS circuit 104 is a circuit for reducing noise of a CCD-type imaging element.
另外,AGC放大器105对由CDS电路104作相关双重取样的信号电平进行补正。A/D变换器106将通过AGC放大器输入的来自CCD 103的模拟图像数据变换成数字图像数据。即,CCD 103的输出信号通过CDS电路104及AGC放大器105,再由A/D变换器106,以最合适取样频率(例如NTSC信号的副载波频率的整数倍)变换成数字信号。Also, the AGC amplifier 105 corrects the signal level of the correlated double-sampled signal by the CDS circuit 104 . The A/D converter 106 converts the analog image data input from the CCD 103 through the AGC amplifier into digital image data. That is, the output signal of the CCD 103 passes through the CDS circuit 104 and the AGC amplifier 105, and then is converted into a digital signal by the A/D converter 106 with the most suitable sampling frequency (such as an integer multiple of the subcarrier frequency of the NTSC signal).
另外,IPP 107、DCT 108、以及编码器109对由A/D变换器106输入的数字图像数据按色差(cb,cr)和亮度(Y)进行各种处理,补正及图像压缩/伸长的数据处理。所谓图像压缩/伸长数据处理是指进行例如JPEG标准的图像压缩/伸长一过程的正交变换以及JPEG标准的图像压缩/伸长一过程的赫夫曼符号化·复号化。In addition, the IPP 107, the DCT 108, and the encoder 109 perform various processes on the digital image data input from the A/D converter 106 in terms of color difference (cb, cr) and brightness (Y), correction, and image compression/extension. data processing. The so-called image compression/stretching data processing refers to performing, for example, the orthogonal transformation of the image compression/stretching process of the JPEG standard and the Huffman symbolization and complex numbering of the image compression/stretching process of the JPEG standard.
MCC 110是将被压缩处理的图像暂时存储,通过PC卡接口112往PC卡150记录,或从PC卡150读出。The MCC 110 temporarily stores the compressed image, records it to the PC card 150 through the PC card interface 112, or reads it out from the PC card 150.
CPU 121根据存储在ROM(没有图示)的程序将RAM(没有图示)作为作业区域使用,按照来自操作部123的指示,或者按照没有图示的遥控器等外部动作指示,控制上述数字式照相机内部的全部动作。具体地说,CPU 121控制照相动作、自动曝光(AE)动作、自动白平衡(AWB)调整动作、AF动作等。CPU 121根据来自数字式照相机调整装置200的计算机207的指令,可以设定AE机能、AWB机能、AF机能的通/断。The CPU 121 uses a RAM (not shown) as a work area according to a program stored in a ROM (not shown), and controls the above-mentioned digital digital system according to an instruction from the operation unit 123 or an external operation instruction such as a remote controller not shown. The whole action inside the camera. Specifically, the CPU 121 controls a photographing operation, an automatic exposure (AE) operation, an automatic white balance (AWB) adjustment operation, an AF operation, and the like. The CPU 121 can set ON/OFF of the AE function, the AWB function, and the AF function according to an instruction from the
另外,照相机电源是从电池128、例如镍镉、镍氢、锂电池等输入到DC-DC转换器129,供给该数字式照相机内部。In addition, camera power is input from a battery 128, such as a nickel-cadmium, nickel-metal hydride, or lithium battery, to the DC-DC converter 129, and supplied to the inside of the digital camera.
显示部122通过液晶显示、二极管发光、电致发光等实现,显示所摄影的数字图像数据、经伸长处理的记录图像数据,同时,在模式显示部将该数字式照相机状态等表示在画面上。操作部123设有用于从外部进行机能选择、摄影指示及其它各种设定的按钮。在瞬间存储器130中写入用于进行AWB调整的各照明条件下的合适增益值。The display unit 122 is realized by liquid crystal display, diode light emission, electroluminescence, etc., and displays the photographed digital image data and the recorded image data after elongation processing, and at the same time, the state of the digital camera, etc. . The operation unit 123 is provided with buttons for externally performing function selection, imaging instructions, and other various settings. Appropriate gain values under each lighting condition for performing AWB adjustment are written in the flash memory 130 .
上述数字式照相机100设有将摄像而得的图像数据记录在PC卡150上的记录模式、显示上述记录在PC卡150上的图像的显示模式、与数字式照像机调整装置200协同将调整数据写入瞬间存储器130中的记录·调整模式等。The above-mentioned
图2表示上述IPP 107具体构成一例,IPP 107设有将从A/D变换器106输入的数字图像数据分离成三原色R·G·B各色成份的色分离部1071、插入所分离的R·G·B各图像数据的信号插入部1072、调整R·G·B各图像数据黑色信号电平的熄灭脉冲电平(Redestal)调整部1073、调整R·B各图像数据白色电平的白平衡调整部1074、以由CPU 121设定的增益对R·G·B各图像数据进行补正的数字增益调整部1075、进行R·G·B各图像数据的r变换的灰度系数变换部1076、将R·G·B各图像数据分离为色差信号(cb,cr)和亮度信号(Y)的矩阵变换(matrix)部1077、以及根据色差信号(cb,cr)和亮度信号(Y)制作视频信号输出到显示部122的视频信号处理部1078。Fig. 2 shows an example of the specific structure of the above-mentioned IPP 107. The IPP 107 is provided with a
IPP 107还设有检测由熄灭脉冲电平调整部1073调整后的R·G·B各图像数据的亮度数据(Y)的Y运算部1079、仅让在Y运算部检测而得的亮度数据(Y)的所定频率成份通过的BPF 1080、将与通过BPF 1080的亮度数据(Y)对应的数字计数值作为AF评价值输出到CPU 121的AF评价值电路1081、将与经Y运算部1079检测而得的亮度数据(Y)对应的数字计数值作为AE评价值输出到CPU 121的AE评价值电路1082、检测经数字增益调整部1075进行增益调整后的R·G·B各图像数据的亮度数据(Y)的Y运算部1083、将与经Y运算部1083检测而得的亮度数据(Y)对应的数字计数值作为AWB评价值输出到CPU 121的AWB评价值电路1084、与CPU 121接口的CPU I/F 1085、以及与DCT 108接口的DCT I/F 1086等。The IPP 107 is also provided with a
上述白平衡调整部1074对于R·B各设有乘法器1074r、1074b,将CPU 121设定的R·B各增益数据分别与输入到各乘法器1074r、1074b的R·B图像数据进行乘法运算,调整图像数据的白平衡。并且、上述AWB评价值·白提取设定电路1084的亮度范围(白检测区域)由CPU 121设定。The above-mentioned white balance adjustment unit 1074 has multipliers 1074r and 1074b for each of R and B, and multiplies the R and B gain data set by the CPU 121 by the R and B image data input to the multipliers 1074r and 1074b respectively. , to adjust the white balance of the image data. Also, the luminance range (white detection area) of the above-mentioned AWB evaluation value/white
上述数字增益调整部1075对于R·G·B各设有乘法器1075r、1075g、1075b,将CPU 121设定的R·G·B各增益数据分别与输入到各乘法器1075r、1075g、1075b的图像数据进行乘法运算、调整R·G·B图像数据的信号电平。The above-mentioned digital
下面说明上述数字式照相机100中涉及AWB控制的动作。Next, the operation related to the AWB control in the above-mentioned
CPU 121在设定作为白平衡调整对象的色温范围(白检测区域)内参照存储在瞬间存储器130中的在各照明条件下的合适增益值计算与从IPP 107取入存储在RAM中的AWB评价值对应的合适增益。接着,CPU 121对于摄像取入的图像数据分别乘以适当增益在白平衡调整部1074的R和B乘法器1074r、1074b进行乘法运算,调整图像数据的信号电平,进行AWB控制。The CPU 121 calculates the appropriate gain value under each lighting condition stored in the flash memory 130 within the color temperature range (white detection area) set as the target of white balance adjustment, and imports the AWB evaluation stored in the RAM from the IPP 107. The appropriate buff corresponding to the value. Next, the CPU 121 multiplies the captured image data by an appropriate gain to perform multiplication in the R and B multipliers 1074r and 1074b of the white balance adjustment unit 1074, adjusts the signal level of the image data, and performs AWB control.
关于取入AWB评价值,有在通常摄影动作之前将AWB评价值存储在取入(预扫描)RAM中,摄影时根据该AWB评价值进行AWB控制的方法,以及在通常摄影动作中将AWB评价值存储在取入RAM中、当下次摄影时根据该已取入的AWB评价值进行AWB控制的方法,上述方法那一种都行。Regarding the acquisition of the AWB evaluation value, there is a method of storing the AWB evaluation value in the acquisition (pre-scan) RAM before the normal shooting operation, and performing AWB control based on the AWB evaluation value during shooting, and a method of storing the AWB evaluation value during the normal shooting operation. The value is stored in the RAM, and the AWB control is performed based on the imported AWB evaluation value at the next shooting, either of the above-mentioned methods is acceptable.
在白平衡调整部1074调整增益的虽然只有R·B,但是本发明并不局限于此,可以调整R·G·B中至少二种组合的增益。Although only R·B is used to adjust the gain in the white balance adjustment unit 1074, the present invention is not limited thereto, and the gains of at least two combinations of R·G·B can be adjusted.
图3表示本实施例涉及的数字式照相机调整装置200的外观构成图,图4是由数字式照相机100和数字式照相机调整装置200构成的数字式照相机调整系统300的方框构成图。FIG. 3 shows an external configuration diagram of a digital
图3和图4中表示的数字式照相机调整装置200设有:向数字式照相机100供给电源的数字式照相机供给用电源201,用于对数字式照相机供给用电源201进行通用接口母线(General-PurposeInterface Bus,以下简记为GPIB)控制的适配器202,显示用数字式照相机100所摄影的图像的监视器203,以向量显示在数字式照相机100扫描的彩色信号(RGB)的振幅和位相的向量显示器204,观察监视器203的影像信号用的波形监视器205,屏幕式灰色标度光源206,对数字式照相机100和上述检测器(向量显示器204,波形监视器205等)进行控制等的计算机207,计算机207的显示装置,表示调整菜单等的显示器208,装在计算机207本体中的GPIBI/F 209,固定数字式照相机100、进行数字式照相机供给用电源201、RS-232C,视频等信号连接的调整夹具本体210,进行滤光片(W4、C10、C4、W16等)切换的滤光片切换装置212,根据来自计算机207的指令控制滤光片切换装置212的滤光片切换的控制箱211。并且、用光源206和滤光片切换装置212构成照明装置。The digital camera adjusting device 200 shown in FIG. 3 and FIG. 4 is provided with: a digital camera supply power supply 201 for supplying power to the digital camera 100, and is used to connect a general-purpose interface bus to the digital camera supply power supply 201 (General- PurposeInterface Bus, hereinafter abbreviated as GPIB), the adapter 202 controlled by the digital camera 100, the monitor 203 displaying the image taken by the digital camera 100, and the vector displaying the amplitude and phase of the color signal (RGB) scanned by the digital camera 100 Display 204, waveform monitor 205 for observing the video signal of monitor 203, screen-type gray scale light source 206, computer for controlling digital camera 100 and the above detectors (vector display 204, waveform monitor 205, etc.) 207, the display device of the computer 207, the display 208 indicating the adjustment menu, etc., the GPIBI/F 209 installed in the computer 207 body, the fixed digital camera 100, the power supply 201 for digital camera supply, RS-232C, video and other signals The connected adjustment fixture body 210, the filter switching device 212 for switching filters (W4, C10, C4, W16, etc.), controls the filter switching of the filter switching device 212 according to the instructions from the computer 207 Box 211. Furthermore, an illumination device is constituted by the
图5表示上述计算机207的构成,其设有给予操作指示的输入部2071、控制计算机装置整体的CPU 2072、存储使上述2072动作的各种控制程序的ROM 2073、作为CPU 2072的工作区使用的RAM 2074。Fig. 5 shows the composition of above-mentioned
作为上述控制程序有例如用于将在各照明条件下的合适增益数据等的调整数据写入数字式照相机100的瞬间存储器130中的调整数据制作程序等。The control program includes, for example, an adjustment data creation program for writing adjustment data such as appropriate gain data under various lighting conditions into the flash memory 130 of the
下面参照图6所示流程图说明数字式照相机100和数字式照相机调整装置200协同实行的AWB调整处理顺序。Next, the procedure of the AWB adjustment process performed in cooperation by the
在该AWB调整中,将屏幕式灰色标度设置在光源206(5100K)上,通过在滤光片切换装置212切换不同特性滤光片(W4,C10,C4,W16等),改变光源206的照明条件,计算AWB调整数据。In this AWB adjustment, the screen-type gray scale is set on the light source 206 (5100K), and the
先如图5所示,将数字式照相机100装到数字式照相机调整装置200的夹具本体210上,接通数字式照相机100和数字式照相机调整装置200的电源,进行数字式照相机100和数字式照相机调整装置200的初期化处理(步骤S1,P1),图7中的“表示菜单”显示在显示器208(步骤S2)。另外,在数字式照相机100中设定调整·记录模式(步骤P2)。First, as shown in FIG. 5 , install the
接着,若在数字式照相机调整装置200从显示器208的“表示菜单”画面(参照图7)选择AWB调整(步骤S3),则显示图8所示“滤光片选择菜单”画面,从该选择画面选择滤光片(步骤S4)。计算机207的CPU 2072通过控制箱211将光源206的滤光片切换到所选择的滤光片(步骤S5)。Next, if AWB adjustment (step S3) is selected from the "display menu" screen (see FIG. 7) of the
随后,计算机207的CPU 2072通过RS 232C电缆向数字式照相机100的CPU 121发送表示开始AWB调整的指令(步骤P3)。并且,计数器K的值设定为初值“0”(步骤S7)。Subsequently, the
数字式照相机100的CPU 121接收到上述指令(步骤P3),就在将AF机能和AE机能设为接通、AWB机能设为断开状态下,在白平衡调整电路1074的乘法器1074r、1074b分别设定R、B增益初值,进行摄影(步骤P4)。The CPU 121 of the
摄影时,从IPP的AWB评价值电路1084向CPU 121分别输出设定亮度范围(白检测区域)内的R、G、B的AWB评价值,CPU121将这些R、G、B的AWB评价值送向数字式照相机调整装置200的计算机207(步骤P5)。When shooting, the AWB
计算机207的CPU 2072接收到R、G、B的AWB评价值,就分别计算R、G、B的的∑R、∑G、∑B(步骤S8)。接着,CPU2072计算∑R/∑G,∑B/∑G(步骤S9),将计数器K的值增加1(步骤S10)。The
随后,CPU 2072判断∑R/∑G和∑B/∑G是否处于规定值(1附近)内(步骤S11),当∑R/∑G和∑B/∑G处于规定值内场合,将这时的R、B增益作为AWB调整增益,送向数字式照相机的CPU 121(步骤S12)。数字式照相机100的CPU 121接收到该R和B的AWB调整增益,就存入瞬间存储器130中(步骤P6)。Subsequently, the
另一方面,在步骤S11中,当∑R/∑G和∑B/∑G不处于规定值内场合,则移到步骤S13,判断计数器K的值,即调整次数是否比规定次数N多,当K>N时,判断为数字式照相机或环境条件异常,将该信息表示在显示器208上,报知操作者(步骤S15)。On the other hand, in step S11, when ΣR/ΣG and ΣB/ΣG are not in the specified value, then move to step S13, judge the value of the counter K, that is, whether the number of times of adjustment is more than the specified number of times N, When K>N, it is judged that the digital camera or the environmental conditions are abnormal, and the information is displayed on the
而当K不大于N时,则移到步骤S14,变更R、B增益,使得∑R/∑G和∑B/∑G成为1附近,将计算而得的R、B增益以及应再次摄影的指示送向数字式照相机的CPU 2072(步骤S14)。数字式照相机100的CPU 121在白平衡调整电路1074的乘法器1074r、1074b设定算得的R、B增益,进行摄影(步骤P4),再次发送AWB评价值(步骤P5)。并且,计算机的CPU 2072在分别计算∑R、∑G、∑B之后(步骤S8),计算∑R/∑G、∑B/∑G(步骤S9),将计数器k的值增加1(步骤S10),以规定次数N为限,反复上述处理(步骤S14,P4,P5,S8,S9,S10,S11,S13),直到∑R/∑G和∑B/∑G成为上述规定值内。And when K is not greater than N, then move to step S14, change R, B gain, make ΣR/ΣG and ΣB/ΣG become close to 1, the calculated R, B gain and should be photographed again The instruction is sent to the
对于各滤光片W4,C10,C4,W16进行上述处理(步骤S4-S14,P3-P6),将各照明条件下的AWB调整增益存入瞬间存储器130中。The above processing (steps S4-S14, P3-P6) is performed on each filter W4, C10, C4, W16, and the AWB adjustment gain under each lighting condition is stored in the flash memory 130.
在上述处理中,当调整次数大于规定次数时,判断为数字式照相机或环境条件异常,并将该内容表示在显示器208上,报知操作者。但是也可以设定为当调整时间超过所定时间时判断为数字式照相机或环境条件异常。In the above processing, when the number of adjustments is greater than the predetermined number, it is determined that the digital camera or the environmental conditions are abnormal, and the content is displayed on the
如上所述,在本实施例的数字式照相机调整系统300中,数字式照相机的CCD 103将通过透镜组件101的被照体光变换成电信号,作为彩色图像信号输出,在A/D变换器106将该彩色图像信号作A/D变换,成为数字彩色图像信号输出,IPP 107输出与数字彩色图像信号的各色成分(RGB)的亮度数据相对应的AWB评价值,CPU 121参照存储在瞬间存储器130中的各照明条件下的合适增益值,在设定的色温范围内计算与从IPP 107输出的AWB评价值对应的合适增益值,在白平衡调整部1074设定上述算得的合适增益,进行AWB调整;另一方面,在本实施例的数字式照相机调整装置200中,滤光片切换装置212切换滤光片,使光源206的照明条件不同,根据各照明条件下从数字式照相机100的IPP 107输出的RGB的AWB评价值,计算至少二色的合适增益,将各照明条件下的合适增益向数字式照相机100发信,将上述合适增益写入数字式照相机100的瞬间存储器;因此,即使光源的色温变化,数字式照相机也能合适地再现白色。As mentioned above, in the digital camera adjustment system 300 of this embodiment, the CCD 103 of the digital camera converts the subject light passing through the lens assembly 101 into an electrical signal, and outputs it as a color image signal, and the A/D converter 106 performs A/D conversion on the color image signal to become a digital color image signal output, and the IPP 107 outputs the AWB evaluation value corresponding to the luminance data of each color component (RGB) of the digital color image signal, and the CPU 121 refers to the value stored in the flash memory For the appropriate gain value under each lighting condition in 130, calculate the appropriate gain value corresponding to the AWB evaluation value output from IPP 107 within the set color temperature range, set the above-mentioned calculated appropriate gain in the white balance adjustment part 1074, and perform AWB adjustment; on the other hand, in the digital camera adjustment device 200 of the present embodiment, the filter switching device 212 switches the filter to make the lighting conditions of the light source 206 different, and from the digital camera 100 according to each lighting condition The AWB evaluation value of RGB output by IPP 107 calculates the appropriate gains of at least two colors, sends a letter to the digital camera 100 with the appropriate gains under each lighting condition, and writes the above-mentioned appropriate gains into the flash memory of the digital camera 100; therefore, Even if the color temperature of the light source varies, digital cameras can properly reproduce white.
在本实施例中,滤光片切换装置212切换光学特性不同的滤光片,使光源206的照明条件不同,因此,能简单地变更照明条件。In this embodiment, the
在本实施例中,对各RGB计算AWB评价值的累计值∑R、∑G、∑B,将累计值之比∑R/∑G和∑B/∑G成为规定值内时的R、BIn this embodiment, the integrated values ΣR, ΣG, and ΣB of the AWB evaluation values are calculated for each RGB, and the ratios of the integrated values ΣR/ΣG and ΣB/ΣG are within predetermined values for R and B.
增益设为合适增益,因此,能得到精度高的合适增益。Since the gain is set as an appropriate gain, an appropriate gain with high accuracy can be obtained.
在本实施例中,AWB调整时,将数字式照相机100的AE机能设为接通,所以,AWB调整时能得到合适的曝光。In this embodiment, the AE function of the
在本实施例中,AWB调整时,将数字式照相机100的AWB机能设为断开,所以,AWB调整时能防止白平衡状态变化,能很容易进行白平衡调整。In this embodiment, the AWB function of the
在本实施例中,AWB调整时,对于计算合适增益的调整次数设定规定次数,当调整次数超过该规定次数还不能得到合适增益时,报知“数字式照相机或环境条件为异常”的信息,所以,操作者能很容易判断“数字式照相机或环境条件为异常”。In this embodiment, during AWB adjustment, a specified number of times is set for the number of adjustments to calculate the appropriate gain. When the number of adjustments exceeds the specified number of times and the appropriate gain cannot be obtained, the message "the digital camera or the environmental condition is abnormal" will be reported. , therefore, the operator can easily judge that "the digital camera or the environmental conditions are abnormal".
在本实施例中,AWB调整时,对于计算合适增益的调整时间设定规定时间,当调整时间超过该规定时间还不能得到合适增益时,报知“数字式照相机或环境条件为异常”的信息,所以,操作者能很容易判断“数字式照相机或环境条件为异常”。In this embodiment, during AWB adjustment, a specified time is set for the adjustment time for calculating the appropriate gain, and when the adjustment time exceeds the specified time and the appropriate gain cannot be obtained, the information of "the digital camera or the environmental condition is abnormal" will be reported. , therefore, the operator can easily judge that "the digital camera or the environmental conditions are abnormal".
Claims (34)
Applications Claiming Priority (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP267543/97 | 1997-09-30 | ||
JP267543/1997 | 1997-09-30 | ||
JP267545/1997 | 1997-09-30 | ||
JP26754397 | 1997-09-30 | ||
JP267545/97 | 1997-09-30 | ||
JP26754597 | 1997-09-30 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN1213926A CN1213926A (en) | 1999-04-14 |
CN1144446C true CN1144446C (en) | 2004-03-31 |
Family
ID=26547922
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CNB98119740XA Expired - Fee Related CN1144446C (en) | 1997-09-30 | 1998-09-29 | Digital camera adjustment system and adjustment device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN1144446C (en) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE60336247D1 (en) * | 2002-07-18 | 2011-04-14 | Sony Corp | IMAGE DATA PROCESSING, IMAGE PROCESSING DEVICE AND COMPUTER PROGRAM |
JP4422433B2 (en) * | 2003-05-28 | 2010-02-24 | オリンパス株式会社 | Electronic camera and method for adjusting signal gain of electronic camera |
KR100513342B1 (en) * | 2003-12-03 | 2005-09-07 | 삼성전기주식회사 | An apparatus for automatical digital white balance |
JP4477517B2 (en) * | 2005-02-08 | 2010-06-09 | オリンパスイメージング株式会社 | Color adjustment method and color adjustment apparatus |
CN101222572B (en) * | 2007-01-11 | 2011-12-07 | 昆山杰得微电子有限公司 | White balance processing equipment |
KR20100066855A (en) * | 2008-12-10 | 2010-06-18 | 삼성전자주식회사 | Imaging apparatus and imaging method |
JP6286944B2 (en) * | 2013-08-28 | 2018-03-07 | ソニー株式会社 | Information processing apparatus, imaging apparatus, information processing method, and program |
CN113542596B (en) * | 2021-06-29 | 2022-08-19 | 中国科学院长春光学精密机械与物理研究所 | Imaging control method of CCD imager |
-
1998
- 1998-09-29 CN CNB98119740XA patent/CN1144446C/en not_active Expired - Fee Related
Also Published As
Publication number | Publication date |
---|---|
CN1213926A (en) | 1999-04-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7852396B2 (en) | Image pick-up apparatus with exposure setting method | |
US20040212691A1 (en) | Automatic white balance adjusting method | |
CN1298158C (en) | Image pick-up device and image quality conection method | |
JP2003304546A (en) | Imaging apparatus, display control method, program, and recoding medium | |
CN1224239C (en) | Digital camera and color regulator | |
CN1956551A (en) | Image processing method, image processing program, image processing apparatus, imaging apparatus, imaging method, and imaging program | |
CN1925559A (en) | Device and method for processing images | |
CN101047773A (en) | Imaging apparatus, video signal processing circuit, video signal processing method and computer program product | |
CN1144446C (en) | Digital camera adjustment system and adjustment device | |
CN1867080A (en) | Image process apparatus and image pickup apparatus | |
CN1118181C (en) | Digital camera | |
CN1233177C (en) | Television camera and white balance correcting mehtod | |
CN1768535A (en) | Imaging device | |
US20100141791A1 (en) | Video camera | |
CN1161956C (en) | digital camera | |
JP2004129065A (en) | Digital camera | |
US8866925B2 (en) | Image sensor compensation | |
CN1134968C (en) | Digital camera regulating system and its regulating device | |
US8547447B2 (en) | Image sensor compensation | |
JP3820034B2 (en) | Digital camera adjustment system | |
CN1158841C (en) | Digital camera adjustment system and adjustment device | |
JP2003302570A (en) | Digital camera | |
JP2005109999A (en) | White balance adjustment method and camera | |
CN1764243A (en) | Image processing device, image recording device and image processing method | |
CN1138403C (en) | digital camera |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C06 | Publication | ||
PB01 | Publication | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20040331 Termination date: 20140929 |
|
EXPY | Termination of patent right or utility model |