CN102348069A - Method for acquiring high dynamic image with fixed frame rate from image sensor and apparatus thereof - Google Patents
Method for acquiring high dynamic image with fixed frame rate from image sensor and apparatus thereof Download PDFInfo
- Publication number
- CN102348069A CN102348069A CN2010102403704A CN201010240370A CN102348069A CN 102348069 A CN102348069 A CN 102348069A CN 2010102403704 A CN2010102403704 A CN 2010102403704A CN 201010240370 A CN201010240370 A CN 201010240370A CN 102348069 A CN102348069 A CN 102348069A
- Authority
- CN
- China
- Prior art keywords
- integration
- time
- row
- frame
- short
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 27
- 230000010354 integration Effects 0.000 claims description 471
- 238000006243 chemical reaction Methods 0.000 claims description 4
- 230000000750 progressive effect Effects 0.000 claims description 3
- 230000009467 reduction Effects 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 4
- 238000003491 array Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012797 qualification Methods 0.000 description 1
Images
Landscapes
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
A method for acquiring a high dynamic image with a fixed frame rate from an image sensor and an apparatus thereof, which belong to the image sensor field, are disclosed. The method comprises the following steps: distributing long integral time and short integral time for a light-sensitive pixel array; determining a long integral time row reset starting position of a current frame and a reading starting position, a short integral time row reset starting position and a reading starting position, a long integral time row reset starting position of a next frame according to long integral time T1 of the current frame, the short integral time T2 of the current frame, the long integral time T3 of the next frame and a maximum value M of the short integral time, and simultaneously determining, in one frame, a long integral time reading row of the current frame, a long integral time reset row, a short integral time reset row, a short integral time reading row, the long integral time reset row of the next frame; outputting an obtained integral-row integral signal. The light-sensitive pixel array performs an integral operation as a fixed frame length so as to achieve an effect of outputting the complete and correct image data with the fixed frame rate.
Description
Technical field
The invention belongs to field of image sensors, be specifically related in imageing sensor, obtain the fixedly method and the device of frame per second high-dynamics image.
Background technology
The method of obtaining the high-dynamics image frame at present is: all row to the photosensitive pixel array carry out time exposure within a certain period of time, obtain the time exposure signal of whole picture frame; And all row of photosensitive pixel array are carried out short time exposure, obtain short time exposure signals of whole picture frame; The short time exposure signal and the time exposure signal that obtain are synthesized.
For imageing sensor; Above-mentioned exposure is that the logical photosensitive pixel array is grown resets and read and reset the short time of integration and read out realization the time of integration; And the principle that realizes integration just is earlier all row of pel array to be resetted by particular order line by line within a certain period of time, uniformly-spaced by this reseting sequence particular row is read line by line after a period of time again; When obtaining high-dynamics image, the long time of integration of all row short time of integration consistent, all row is consistent in one of them picture frame.
Because whole time of integration, the realization of principle need reset to the photosensitive pixel array in a last counts; Read in next counts then; Like this; One frame image data is from resetting to complete reading the time that just needs two counts; For improving frame per second and realizing the time of integration of length less than a frame; Usually the method that adopts is in a line time, not only to read but also reset simultaneously; Make a counts in the time except accomplishing the reading and reset of current image frame, can also begin resetting of next picture frame.One of them picture frame time (frame length) comprises effective frame time (effectively frame length) and idle frame time (idle frame length); The delegation owing to only reset in the line time; Therefore when changing from small to big the time of integration; If its variable quantity is greater than the idle frame length in the current image frame; Then in order to guarantee that current image frame and all provisional capitals of next picture frame can reset fully; Need make the blanking time between back one picture frame and the current image frame valid data elongated; Thereby make frame length become big, the image frame per second diminishes.
Fig. 1 is a sequential chart of realizing the embodiment of high dynamic mode image output under the prior art condition: existing algorithm is following:
10 begin present frame photosensitive pixel array is resetted line by line according to the long integration 10 of the present frame count signal Line_counter that is expert at; Then before current frame data is read; The count signal Line_counter that for example goes is 1 o'clock; The long time of integration 10 of present frame and the long time of integration 100 of next frame are compared; For avoiding the present frame and long time of integration of the horizontal reset of back one frame to overlap; Guaranteeing that all effective provisional capitals are accomplished resets, and the frame length of present frame is adjusted into 1110 by 1020 of acquiescence; Like this can so that the present frame short time of integration of row and current frame length integration horizontal reset fully after, just begin resetting of next the frame length row time of integration, i.e. T1 and T3, T2 and T3 do not conflict; So-called conflict is meant that the above effective row address of two row need reset in the time in a certain count line simultaneously, and in addition, T1 is 10, and T2 is 2, and both are even number, also do not clash.
From row count signal Line_counter is that 1110 beginnings are read the long time of integration of the row view data of integration of present frame photosensitive pixel array successively; Be 5 according to the maximum short time of integration then; Can know from row count signal Line_counter to be that 1105 beginnings are read the picture signal of the short time of integration of the row of integration of present frame photosensitive pixel array successively; Therefore and be 2 the short time of integration of present frame, should be 1017 to begin that present frame photosensitive pixel array is lacked time of integration row and reset line by line from row count signal Line_counter.Make like this when row count signal line_counter is even number; Carry out resetting and reading of current frame length row time of integration view data; And row count signal line_counter is when being odd number, then carries out resetting and reading of the present frame short time of integration of row view data.At last, 100 begin a back frame photosensitive pixel array is resetted line by line according to the long integration 100 of the back one frame count signal Line_counter that is expert at.The capable viewdata signal of long and short integration that obtains is exported on request.
The count signal Line_counter that is expert at be 1106 o'clock long when the time of integration, row was read to the 2nd row of the integration of said present frame photosensitive pixel array: at the 7th row long time of integration of the row of this horizontal reset present frame photosensitive pixel array; And according to maximum short time of integration be 5; The count signal Line_counter that confirms to be expert at is 1105 the 0th row short time of integration of the row view data of reading the integration of present frame photosensitive pixel array, is the short time of integration that the 2 count signal Line_counter that confirm to be expert at are 1105 the 1st row short time of integration of the row that reset present frame photosensitive pixel array according to present frame simultaneously; The present frame long and short time of integration of the row that resets at of the back one frame length row time of integration is read and is just begun to reset after finishing, and just no longer sets forth at this.In addition; Above-mentioned the photosensitive pixel array is resetted in the process with read operation, have present frame to read the row address 0＜present frame short time of integration of reset line address 1＜current frame length the short time of integration and read row address 2＜current frame length reset line time of integration address 7 time of integration.
Frame length has become 1110 by 1020 in the prior art; Frame per second is slack-off; Can not satisfy NTSC (NatioNal TeleviSioN StaNdardS Committee; NTSC) or the fixing requirement of image frame per second that need satisfy of PAL (PhaSe AlterNatiNg LiNe, line-by-line inversion) when output system.In addition; If output high-dynamics image; Need at first in a frame time, to export the view data that is equivalent to general mode two frames; Wherein frame data are realized the long time of integration; It is time exposure; Another frame data are realized the short time of integration; If need to obtain the high-dynamics image frame data that the long and short time of integration, line data was alternately read; Long and short integration is capable need to be resetted in delegation in order to avoid; Need to guarantee that strange, the even property of the long and short time of integration in the same frame is identical, but can not guarantee to export the high-dynamics image data that realize any long and short time of integration like this.
Summary of the invention
The technical problem that the present invention will solve is:
1, the dynamic image that obtains of imageing sensor can't keep the fixedly problem of frame per second;
The problem that need limit strange, the even characteristic of the long and short integration in the same frame when 2, exporting high-dynamics image;
3, solve the fixedly problem of frame per second output of high-dynamics image.
For solving the problems of the technologies described above, the present invention proposes and in imageing sensor, obtain the fixedly method of frame per second high-dynamics image, said imageing sensor comprises the photosensitive pixel array that is arranged as row and column, this method comprises the steps:
A: the photosensitive pixel array is distributed the long time of integration and the short time of integration;
B: according to present frame long time of integration T1 long time of integration the horizontal reset original position begin present frame photosensitive pixel array is resetted line by line;
C: read original position from the current frame length row time of integration and begin successively the long time of integration of the row view data of integration of present frame photosensitive pixel array to be read; Then according to present frame short time of integration T2 with short time of integration maximum M confirm short time of integration of horizontal reset original position; Said short time of integration, maximum M was an odd number, short time of integration the horizontal reset original position begin present frame photosensitive pixel array is resetted line by line; Read original position according to the definite weak point of the short maximum M time of integration row time of integration, read original position from the weak point row time of integration then and begin successively the short time of integration of the row view data of integration of present frame photosensitive pixel array to be read; The length row view data time of integration is alternately read with the weak point row view data time of integration; Next according to back one frame long time of integration T3 size confirm next frame length horizontal reset time of integration original position, and begin a back frame photosensitive pixel array is resetted line by line in next frame length horizontal reset time of integration original position;
D: according to the current frame length T1 time of integration, the present frame short time of integration of T2, next frame length T3 time of integration, short time of integration maximum M confirm in the frame arbitrarily count line in the time current frame length read row, long time of integration reset line, short time of integration reset line, the short time of integration time of integration and read row, next frame length reset line time of integration;
E: circulation execution in step A, B, C, D, with the capable integrated signal output of integration of obtaining.
For solving the problems of the technologies described above, the invention allows for and in imageing sensor, obtain the fixedly device of frame per second high-dynamics image, comprising:
The photosensitive pixel array;
Calculate the time of integration and allocation units, calculate the long and short time of integration according to output image information, and distribute to the photosensitive pixel array; Length integral processing unit, according to present frame long time of integration T1 long time of integration the horizontal reset original position begin present frame photosensitive pixel array is resetted line by line;
Line from the current frame. Integration time sequentially reading out starting position of the current frame has a photosensitive pixel array long integration time line integral image data read out, based on the current frame and the short integration time T2 and the short integration time Maximum M determine the short integration time line resets the starting position, the maximum value of the short integration time M is odd, in a short integration time line resets the starting position of the current frame photosensitive pixel array progressive reduction, based on a short integral time determines the maximum value M short integration time row readout start position, and the short integration time line sequentially reading out starting position of the current frame has a photosensitive pixel array short integration time line integral image data read out; long integration time lines of image data, and short integration time alternating lines of image data read out; next subsequent frame based on the long integration time T3, the size of the frame length to determine the next row reset the starting position the integration time and the integration time of the next row reset frame length starting position for After a reset the photosensitive pixel array row by row;
Maximum M confirms in the frame that the current frame length in the time of count line arbitrarily reads row, long time of integration reset line, short time of integration reset line, the short time of integration time of integration and read row, next frame length reset line time of integration according to the current frame length T1 time of integration, the present frame short time of integration of T2, next frame length T3 time of integration, short time of integration.
The fixedly method and the device of frame per second high-dynamics image of in imageing sensor, obtaining proposed by the invention; Confirm long time of integration of the horizontal reset original position of present frame according to the current frame length T1 time of integration; The length row time of integration is read original position; According to the present frame short time of integration of T2; Short time of integration, maximum M confirmed short time of integration of the horizontal reset original position of present frame; The weak point row time of integration is read original position; Confirm long time of integration of the horizontal reset original position of next frame the time of integration according to next frame length; The size of the current frame length T3 time of integration and next frame length T1 time of integration gap no matter; The current frame length T1 time of integration; The present frame short time of integration of T2; The odd even characteristic of next the frame length T3 time of integration; In the time of can both guaranteeing the photosensitive pixel array with anchor-frame progress row integration operation, present frame and next frame all can reset fully; Reached thus when guaranteeing picture quality, guaranteed that image is complete with fixing frame per second, the effect of correct output.
Description of drawings
Fig. 1 is 10 for the current frame length T1 time of integration that prior art provides, and the weak point T2 time of integration is 2, and the maximum weak point M time of integration is 5, and the back one frame length T3 time of integration is the sequential chart of 100 o'clock the integration that resets;
Fig. 2 is the fixedly method flow diagram of frame per second high-dynamics image that in imageing sensor, obtains provided by the invention;
Fig. 3 is the fixedly device sketch map of frame per second high-dynamics image that in imageing sensor, obtains provided by the invention;
Fig. 4 is 10 for the current frame length T1 time of integration that the embodiment of the invention provides, and the weak point T2 time of integration is 3, and the maximum weak point M time of integration is 5, and the back one frame length T3 time of integration is the sequential chart of 100 o'clock the integration that resets;
Fig. 5 is the partial enlarged drawing of Fig. 4;
Fig. 6 is 10 for the current frame length T1 time of integration that the embodiment of the invention provides, and the weak point T2 time of integration is 2, and the maximum weak point M time of integration is 5, and the back one frame length T3 time of integration is the sequential chart of 1014 o'clock the integration that resets;
Fig. 7 is the partial enlarged drawing of Fig. 6.
Embodiment
Clearer for technical problem, technical scheme and beneficial effect that the present invention is solved, below in conjunction with accompanying drawing and embodiment, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explanation the present invention, and be not used in qualification the present invention.
In imageing sensor, obtain fixedly frame per second high-dynamics image, need the size of the current frame length T1 time of integration, next the frame length T3 time of integration be compared earlier.
Long time of integration of the T1 of present frame is compared with long time of integration of the T3 of back one frame: as if the current frame length T1 time of integration less than the present frame frame length; Back one frame long time of integration T3 greater than long time of integration of the T1 of present frame, and when afterwards the difference of the frame length T3 time of integration and the current frame length T1 time of integration is greater than the frame free time T4 of present frame time.Utilize following algorithm in imageing sensor, to obtain fixedly frame per second high-dynamics image.
In imageing sensor, obtain the fixedly method of frame per second high-dynamics image, as shown in Figure 2, comprise step:
A: the photosensitive pixel array is distributed the long time of integration and the short time of integration;
B: according to present frame long time of integration T1 long time of integration the horizontal reset original position begin present frame photosensitive pixel array is resetted line by line;
C: read original position from the current frame length row time of integration and begin successively the long time of integration of the row view data of integration of present frame photosensitive pixel array to be read; Then according to present frame short time of integration T2 with short time of integration maximum M confirm short time of integration of horizontal reset original position; Said short time of integration, maximum M was an odd number, short time of integration the horizontal reset original position begin present frame photosensitive pixel array is resetted line by line; Read original position according to the definite weak point of the short maximum M time of integration row time of integration, read original position from the weak point row time of integration then and begin successively the short time of integration of the row view data of integration of present frame photosensitive pixel array to be read; The length row view data time of integration is alternately read with the weak point row view data time of integration; Next according to back one frame long time of integration T3 size confirm next frame length horizontal reset time of integration original position, and begin a back frame photosensitive pixel array is resetted line by line in next frame length horizontal reset time of integration original position;
D: maximum M confirms in the frame that the current frame length in the time of count line arbitrarily reads row, long time of integration reset line, short time of integration reset line, the short time of integration time of integration and read row, next frame length reset line time of integration according to the current frame length T1 time of integration, the present frame short time of integration of T2, next frame length T3 time of integration, short time of integration;
E: circulation execution in step A, B, C, D, with the capable integrated signal output of integration of obtaining.
In the said method; The current frame length horizontal reset time of integration, short time of integration, horizontal reset, next frame length horizontal reset time of integration all were per two row gate times delegation that reset; The current frame length row time of integration reads, short time of integration row to read also be that per two row gate times are read delegation, reach long time of integration the row view data with the short purpose that the time of integration, the row view data was alternately read.
Among the step C long time of integration the row picture signal with short time of integration row picture signal alternately read can make short time of integration the row view data can read (the M+1)/2 row long time of integration of row view data earlier before reading; And long time of integration line data read finish after, then need continue to read (the M+1)/2 row short time of integration of row view data.Those are not had the actual long and short row that the time of integration, the row view data was read, its address is pointed to black row or a certainly need do not exported capable address.
In the above-mentioned method of in imageing sensor, obtaining fixing frame per second high-dynamics image, the present frame short time of integration of horizontal reset original position is after current frame length horizontal reset time of integration original position, but early than next frame length horizontal reset time of integration original position.When reading, read long time of integration of the row view data of present frame earlier, begin to read short time of integration of the row view data of present frame behind the row of (M+1)/2.
Describing current frame length horizontal reset time of integration original position in the said method, long time of integration row below in detail reads original position, short time of integration horizontal reset original position, short time of integration row and reads the position relation of original position, next frame length horizontal reset time of integration original position.
Among the said step D capable long when the time of integration, the row view data was read to the N of the integration of said present frame photosensitive pixel array: read present frame photosensitive pixel array (the 2N+1-M)/2 row short time of integration of the row view data of integration at the capable gate time of ensuing unit; If T1 is even number, then at reset (N+T1/2) row long time of integration of row of present frame photosensitive pixel array of this line time; If T1 is odd number, then at reset (N+ (T1+1)/2) row long time of integration of row of present frame photosensitive pixel array of the capable gate time of ensuing unit; If T2 is even number, then at reset (N-(M-T2-1)/2) row short time of integration of row of present frame photosensitive pixel array of the capable gate time of ensuing unit; If T2 is odd number, at reset (N-(M-T2)/2) row short time of integration of row of present frame photosensitive pixel array of this line time; Confirm that according to the back one frame length T3 time of integration at this line time still be the capable length of the S row time of integration of a frame photosensitive pixel array after the capable gate time of ensuing unit resets.
S ＜= ((2N+1-M)/2) ＜ ((N-(M-T2-1)/2) or (N-(M-T2)/2 wherein)) ＜= N ＜ ((N+T1/2) or (N+(T1+1)/2)); Expression is to a certain effective row address in the photosensitive pixel array; The address (N+T1/2) of the current frame length reset line time of integration or (N+(T1+1)/2) reads capable address N the time of integration greater than current frame length; Current frame length is read capable address N more than or equal to the short reset line address time of integration (N-(M-T2-1)/2 of present frame the time of integration) or (N-(M-T2)/2); The short reset line address time of integration (N-(M-T2-1)/2 of present frame) or (N-(M-T2)/2) read row address (2N+1-M)/2 the short time of integration greater than present frame), present frame is read row address (2N+1-M)/2 the short time of integration) more than or equal to the address of next the frame length reset line time of integration.
Further, after said step e, also comprise:, said data image signal is carried out the step that picture signal is handled and exported the step that said integrated signal analog-to-digital conversion is a data image signal.Said picture signal is treated to synthesizes into a frame image data with long and short time of integration of the row view data of same lines address in the same frame.
Further, this algorithm also comprises: in a frame time, long time of integration of the T1 of all the effective capable view data that need read is all identical in the photosensitive pixel array, and short time of integration, T2 was all identical.The length T1 time of integration is more than or equal to the weak point T2 time of integration.In addition,, need read the data that are equivalent to the normal image twice in the frame time for high-dynamics image, in the frame all long times of integration line data and all short times of integration line data all can generate the complete image of a frame respectively; And long and short time of integration horizontal reset pairing address and order all should be identical when reading, the different original positions that just resets and read makes things convenient for long and short time of integration of the line data with the same lines address to synthesize like this.
Further, this algorithm also comprises: in a frame time, to the effective row of photosensitive pixel array accomplish read or reset after, to the horizontal reset of not using of advancing.
The row address of not using is the row address that need not to read in the photosensitive pixel array; Generally be to occur because front end has realized getting window or image zooming function; Exert an influence for avoiding these not read effective row that capable integral charge reads the need that are adjacent; Need reset to it, so that empty its charges accumulated.
Effective row comprises the row of space described in this algorithm.For example, when doing image zoom, exist between any two during the row address of sampling at interval.
Effectively go described in this algorithm and comprise adjacent row.Photosensitive pixel array top and the bottom have the row of much not using when for example, getting window or realization AD HOC.
The fixedly method of frame per second high-dynamics image of in imageing sensor, obtaining proposed by the invention; Confirm long time of integration of the horizontal reset original position of present frame according to the current frame length T1 time of integration; The length row time of integration is read original position; According to the present frame short time of integration of T2; Short time of integration, maximum M confirmed short time of integration of the horizontal reset original position of present frame; The weak point row time of integration is read original position; Confirm long time of integration of the horizontal reset original position of next frame the time of integration according to next frame length; The size of the current frame length T3 time of integration and next frame length T1 time of integration gap no matter; The current frame length T1 time of integration; The present frame short time of integration of T2; The odd even characteristic of next the frame length T3 time of integration; In the time of can both guaranteeing the photosensitive pixel array with anchor-frame progress row integration operation, present frame and next frame all can reset fully; Reached thus when guaranteeing picture quality, guaranteed effect can image complete, correct output with fixing frame per second.
In addition, the present invention also provides and in imageing sensor, has obtained the fixedly device of frame per second high-dynamics image, as shown in Figure 3, comprising: photosensitive pixel array 1, the calculating time of integration and allocation units 2, length integral processing unit 3.
Calculate the time of integration and allocation units 2, calculate the long and short time of integration according to output image information, and distribute to photosensitive pixel array 1; Length integral processing unit 3, according to present frame long time of integration T1 long time of integration the horizontal reset original position begin present frame photosensitive pixel array is resetted line by line;
Line from the current frame. Integration time sequentially reading out starting position of the current frame has a photosensitive pixel array long integration time line integral image data read out, based on the current frame and the short integration time T2 and the short integration time Maximum M determine the short integration time line resets the starting position, the maximum value of the short integration time M is odd, in a short integration time line resets the starting position of the current frame photosensitive pixel array progressive reduction, based on a short integral time determines the maximum value M short integration time row readout start position, and the short integration time line sequentially reading out starting position of the current frame has a photosensitive pixel array short integration time line integral image data read out; long integration time lines of image data, and short integration time alternating lines of image data read out; next subsequent frame based on the long integration time T3, the size of the frame length to determine the next row reset the starting position the integration time and the integration time of the next row reset frame length starting position for After a reset the photosensitive pixel array row by row;
Maximum M confirms in the frame that the current frame length in the time of count line arbitrarily reads row, long time of integration reset line, short time of integration reset line, the short time of integration time of integration and read row, next frame length reset line time of integration according to the current frame length T1 time of integration, the present frame short time of integration of T2, next frame length T3 time of integration, short time of integration.
Further, in imageing sensor, obtaining fixedly, the device of frame per second high-dynamics image also comprises:
AD conversion unit 4: in order to convert said integrated signal into data image signal;
Image signal processing unit 5: picture signal is handled and output in order to said data image signal is carried out, and said picture signal is treated to synthesizes into a frame image data with long and short time of integration of the row view data of same lines address in the same frame.
Further, in a frame time, long time of integration of the T1 of all row of photosensitive pixel array is all identical, and short time of integration, T2 was all identical, and long time of integration, T1 was more than or equal to short time of integration of T2.In addition,, need read the data that are equivalent to the general mode twice in the frame time for high dynamic mode, in the frame all long times of integration line data and all short times of integration line data all can generate the complete image of a frame respectively; And long and short time of integration horizontal reset pairing address and order all should be identical when reading, the different original positions that just resets and read, convenient long and short time of integration of line data with the same lines address synthesizes.
Further, in a frame time, to the effective row of photosensitive pixel array accomplish read or reset after, to the horizontal reset of advancing do not used along the band reset unit.
The row address of not using is the row address that need not to read in the photosensitive pixel array; Generally be to occur because front end has realized getting window or image zooming function; Exert an influence for avoiding these not read effective row that capable integral charge reads the need that are adjacent; Need reset to it, so that empty its charges accumulated.
Further said effective row comprises the row of space.For example, when doing image zoom, the row address of sampling exists when promptly reading row address at interval between any two.
Further, said effective row comprises adjacent row.Photosensitive pixel array top and the bottom have the row of much not using when for example, getting window or realization AD HOC.
The fixedly device of frame per second high-dynamics image that in imageing sensor, obtains proposed by the invention; Confirm long time of integration of the horizontal reset original position of present frame according to the current frame length T1 time of integration; The length row time of integration is read original position; According to the present frame short time of integration of T2; Short time of integration, maximum M confirmed short time of integration of the horizontal reset original position of present frame; The weak point row time of integration is read original position; Confirm long time of integration of the horizontal reset original position of next frame the time of integration according to next frame length; The size of the current frame length T3 time of integration and next frame length T1 time of integration gap no matter; The current frame length T1 time of integration; The present frame short time of integration of T2; The odd even characteristic of next the frame length T3 time of integration; In the time of can both guaranteeing the photosensitive pixel array with anchor-frame progress row integration operation, present frame and next frame all can reset fully; Reached thus when guaranteeing picture quality, guaranteed effect can image complete, correct output with fixing frame per second.
Further; Be convenient to understand in order to make the present invention; Below in conjunction with Fig. 4; Fig. 5; Fig. 6; Fig. 7 is to the current frame length T1 time of integration; The weak point T2 time of integration; Next frame length T3 time of integration; The maximum weak point M time of integration confirms to grow in the algorithm original position that resets the time of integration; The length view data time of integration is read original position; Original position resets the short time of integration; The weak point view data time of integration is read original position; Next frame length original position that resets the time of integration is confirmed the current frame length reset line time of integration to reading a certain long time of integration row view data; The weak point reset line time of integration; Read row the short time of integration; Next frame length reset line time of integration.
Line_counter is the row count signal among Fig. 4, Fig. 5, Fig. 6, Fig. 7; Reset_line_address is the current frame length row address time of integration; Short_int_reset_line_address is the present frame short time of integration of a row address; Double_reset_line_address is next frame length row address time of integration, and Scan_line_address is that the length row time of integration is read the address.
Fig. 4 is the sequential chart of the integral control of the embodiment of the invention; Be worth M the maximum short time of integration is 5, and the current frame length T1 time of integration is 10, and the present frame short time of integration of T2 is 3, and next frame length time of integration is 100.
The long time of integration 10 of present frame and the long time of integration 100 of back one frame are compared; Because current frame length time of integration 10 is less than current frame length 1020; One frame length time of integration 100 of back is greater than current frame length time of integration 10; And (100-10) greater than frame ineffective time 44 of present frame; And 10 and 100 are even number; Therefore under the situation that does not change frame length; The current frame length row time of integration can overlap with resetting of the back one frame length row time of integration, i.e. conflict.Present frame short time of integration is 3 in addition, so between the present frame long and short time of integration of the row and also can overlap with back resetting between the frame length row time of integration present frame short time of integration; For example, the count signal Line_counter that is expert at is 100 o'clock, promptly to the horizontal reset of advancing current frame length time of integration the 465th, again to the horizontal reset of advancing next frame length time of integration the 0th, also to the present frame horizontal reset of advancing the short time of integration the 458th.
10 begin present frame photosensitive pixel array is resetted line by line according to the long integration 10 of the present frame count signal Line_counter that is expert at; From row count signal Line_counter is that 1020 beginnings are read the picture signal of the long time of integration of the row of integration of present frame photosensitive pixel array successively; Being 1018 to begin present frame photosensitive pixel array is resetted line by line according to short time of integration 3 of present frame, the maximum short time of integration 5 from row count signal Line_counter then, is that 1015 beginnings are read the picture signal of the short time of integration of the row of integration of present frame photosensitive pixel array successively according to the maximum 5 of the short time of integration from row count signal Line_counter.Be 100 to begin back one frame photosensitive pixel array is resetted line by line from row count signal Line_counter then according to one frame length time of integration 100 of back.
As shown in Figure 5, the count signal Line_counter that is expert at be 100 o'clock long when the time of integration, row was read to the 460th row of the integration of said present frame photosensitive pixel array, at the 465th row long time of integration of the row of this horizontal reset present frame photosensitive pixel array; The count signal Line_counter that is expert at is the 458th row short time of integration of the row view data of reading the integration of present frame photosensitive pixel array at 99 o'clock, confirms the 459th row short time of integration of the row at this horizontal reset present frame photosensitive pixel array the short time of integration 3 according to present frame simultaneously; Confirm the 0th row long time of integration of the row of a frame photosensitive pixel array behind this horizontal reset one frame length time of integration 100 according to the back.
In addition; Above-mentioned the photosensitive pixel array is resetted in the process with read operation, have one frame length reset line time of integration address, back, 0＜present frame to read the row address 458＜present frame short time of integration of reset line address 459＜current frame length the short time of integration and read row address 460＜current frame length reset line time of integration address 465 time of integration.
Fig. 6 is the sequential chart of another integral control of the embodiment of the invention; Be worth M the maximum short time of integration is 5, and the current frame length T1 time of integration is 10, and the present frame short time of integration of T2 is 3, and next frame length time of integration is 1014.
The long time of integration 10 of present frame and the long time of integration 1014 of back one frame are compared; Because current frame length time of integration 10 is less than current frame length 1020; One frame length time of integration 1014 of back is greater than current frame length time of integration 10; And (1014-10) greater than frame ineffective time 44 of present frame; 10 and 1014 are even number; Therefore under the situation that does not change frame length; The current frame length row time of integration can overlap with resetting of the back one frame length row time of integration, i.e. conflict; Present frame short time of integration is 3 in addition, so between the present frame long and short time of integration of the row and also can overlap with back resetting between the frame length row time of integration present frame short time of integration; For example, the count signal Line_counter that is expert at is 1014 o'clock, promptly the current frame length eighth row time of integration is resetted, again to the horizontal reset of advancing next frame length time of integration the 0th, also to the present frame horizontal reset of advancing the short time of integration the 2nd.
Began present frame photosensitive pixel array is resetted line by line in 10 o'clock according to the long integration 10 of the present frame count signal Line_counter that is expert at; From row count signal Line_counter is that 1020 beginnings are read the picture signal of the long time of integration of the row of integration of present frame photosensitive pixel array successively; Being 1018 to begin present frame photosensitive pixel array is resetted line by line according to short time of integration 3 of present frame, the maximum short time of integration 5 from row count signal Line_counter then, is that 1015 beginnings are read the picture signal of the short time of integration of the row of integration of present frame photosensitive pixel array successively according to the maximum 5 of the short time of integration from row count signal Line_counter.Be 1014 to begin back one frame photosensitive pixel array is resetted line by line from row count signal Line_counter then according to one frame length time of integration 1014 of back.
As shown in Figure 7, the count signal Line_counter that is expert at is the 3rd capable length when the time of integration, row was read of the integration of 1014 pairs of said present frame photosensitive pixel arrays, at the eighth row long time of integration of the row of this horizontal reset present frame photosensitive pixel array; The count signal Line_counter that is expert at is the 1st row short time of integration of the row view data of reading the integration of present frame photosensitive pixel array at 1013 o'clock, is the 2nd row short time of integration of the row of 1014 o'clock present frame photosensitive pixel arrays that reset according to the present frame count signal Line_counter that confirms to be expert at the short time of integration 3 simultaneously; According to the back count signal Line_counter that confirms to be expert at one frame length time of integration 1014 is the 0th row long time of integration of the row of 1014 o'clock back one frame photosensitive pixel arrays that reset.
In addition; Above-mentioned the photosensitive pixel array is resetted in the process with read operation, have one frame length reset line time of integration address, back, 0＜present frame to read the row address 1＜present frame short time of integration of reset line address 2＜current frame length the short time of integration and read row address 3＜current frame length reset line time of integration address 8 time of integration.
The above only is preferred embodiment of the present invention, not in order to restriction the present invention, all any modifications of within spirit of the present invention and principle, being done, is equal to and replaces and improvement etc., all should be included within protection scope of the present invention.
Claims (13)
1. in imageing sensor, obtain the fixedly method of frame per second high-dynamics image, said imageing sensor comprises the photosensitive pixel array that is arranged as row and column, it is characterized in that, this method comprises the steps:
A: the photosensitive pixel array is distributed the long time of integration and the short time of integration;
B: according to present frame long time of integration T1 long time of integration the horizontal reset original position begin present frame photosensitive pixel array is resetted line by line;
C: read original position from the current frame length row time of integration and begin successively the long time of integration of the row view data of integration of present frame photosensitive pixel array to be read; Then according to present frame short time of integration T2 with short time of integration maximum M confirm short time of integration of horizontal reset original position; Said short time of integration, maximum M was an odd number, short time of integration the horizontal reset original position begin present frame photosensitive pixel array is resetted line by line; Read original position according to the definite weak point of the short maximum M time of integration row time of integration, read original position from the weak point row time of integration then and begin successively the short time of integration of the row view data of integration of present frame photosensitive pixel array to be read; The length row view data time of integration is alternately read with the weak point row view data time of integration; Next according to back one frame long time of integration T3 size confirm next frame length horizontal reset time of integration original position, and begin a back frame photosensitive pixel array is resetted line by line in next frame length horizontal reset time of integration original position;
D: according to the current frame length T1 time of integration, the present frame short time of integration of T2, next frame length T3 time of integration, short time of integration maximum M confirm in the frame arbitrarily count line in the time current frame length read row, long time of integration reset line, short time of integration reset line, the short time of integration time of integration and read row, next frame length reset line time of integration;
E: circulation execution in step A, B, C, D, with the capable integrated signal output of integration of obtaining.
2. the fixedly method of frame per second high-dynamics image of in imageing sensor, obtaining as claimed in claim 1 is characterized in that: among the said step D capable long when the time of integration, the row view data was read to the N of the integration of said present frame photosensitive pixel array:
Read present frame photosensitive pixel array (the 2N+1-M)/2 row short time of integration of the row view data of integration at the capable gate time of ensuing unit;
If T1 is even number, then at reset (N+T1/2) row long time of integration of row of present frame photosensitive pixel array of this line time;
If T1 is odd number, then at reset (N+ (T1+1)/2) row long time of integration of row of present frame photosensitive pixel array of the capable gate time of ensuing unit;
If T2 is even number, then at reset (N-(M-T2-1)/2) row short time of integration of row of present frame photosensitive pixel array of the capable gate time of ensuing unit;
If T2 is odd number, at reset (N-(M-T2)/2) row short time of integration of row of present frame photosensitive pixel array of this line time;
Confirm that according to the back one frame length T3 time of integration at this line time still be the capable length of the S row time of integration of a frame photosensitive pixel array after the capable gate time of ensuing unit resets.
3. the fixedly method of frame per second high-dynamics image of in imageing sensor, obtaining as claimed in claim 1 is characterized in that:
After said step e, also comprise:, said data image signal is carried out the step that picture signal is handled and exported the step that said integrated signal analog-to-digital conversion is a data image signal.
4. the fixedly method of frame per second high-dynamics image of in imageing sensor, obtaining as claimed in claim 1 is characterized in that:
In one frame time, long time of integration of the T1 of all row of photosensitive pixel array is identical, and all, T2 was identical capable short time of integration.
5. the fixedly method of frame per second high-dynamics image of in imageing sensor, obtaining according to claim 1 is characterized in that: also be included in the frame time, to the effective row of photosensitive pixel array accomplish read or reset after, to the horizontal reset of not using of advancing.
6. the fixedly method of frame per second high-dynamics image of in imageing sensor, obtaining according to claim 5, it is characterized in that: said effective row comprises the row of space.
7. the fixedly method of frame per second high-dynamics image of in imageing sensor, obtaining according to claim 5, it is characterized in that: said effective row comprises adjacent row.
8. in imageing sensor, obtain the fixedly device of frame per second high-dynamics image, it is characterized in that, comprising:
The photosensitive pixel array;
Calculate the time of integration and allocation units, calculate the long and short time of integration according to output image information, and distribute to the photosensitive pixel array;
Length integral processing unit, according to present frame long time of integration T1 long time of integration the horizontal reset original position begin present frame photosensitive pixel array is resetted line by line;
Line from the current frame. Integration time sequentially reading out starting position of the current frame has a photosensitive pixel array long integration time line integral image data read out, based on the current frame and the short integration time T2 and the short integration time Maximum M determine the short integration time line resets the starting position, the maximum value of the short integration time M is odd, in a short integration time line resets the starting position of the current frame photosensitive pixel array progressive reduction, based on a short integral time determines the maximum value M short integration time row readout start position, and the short integration time line sequentially reading out starting position of the current frame has a photosensitive pixel array short integration time line integral image data read out; long integration time lines of image data, and short integration time alternating lines of image data read out; next subsequent frame based on the long integration time T3, the size of the frame length to determine the next row reset the starting position the integration time and the integration time of the next row reset frame length starting position for After a reset the photosensitive pixel array row by row;
Maximum M confirms in the frame that the current frame length in the time of count line arbitrarily reads row, long time of integration reset line, short time of integration reset line, the short time of integration time of integration and read row, next frame length reset line time of integration according to the current frame length T1 time of integration, the present frame short time of integration of T2, next frame length T3 time of integration, short time of integration.
9. the fixedly device of frame per second high-dynamics image that in imageing sensor, obtains according to claim 8 is characterized in that: also comprise:
AD conversion unit: in order to convert said integrated signal into data image signal;
Image signal processing unit: picture signal is handled and output in order to said data image signal is carried out.
10. according to Claim 8 or the 9 described fixedly devices of frame per second dynamic image that in imageing sensor, obtain, it is characterized in that: in the frame time, long time of integration of the T1 of all row of photosensitive pixel array is identical, and all, T2 was identical capable short time of integration.
11. according to Claim 8 or the 9 described fixedly devices of frame per second high-dynamics image that in imageing sensor, obtain; It is characterized in that: also be included in the frame time; To the effective row of photosensitive pixel array accomplish read or reset after, to the horizontal reset of advancing do not used along the band reset unit.
12. the fixedly device of frame per second high-dynamics image that in imageing sensor, obtains according to claim 11, it is characterized in that: said effective row comprises the row of space.
13. the fixedly device of frame per second high-dynamics image that in imageing sensor, obtains according to claim 11, it is characterized in that: said effective row comprises adjacent row.
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010240370.4A CN102348069B (en) | 2010-07-27 | 2010-07-27 | Method for acquiring high dynamic image with fixed frame rate from image sensor and apparatus thereof |
| PCT/CN2010/079357 WO2011079680A1 (en) | 2009-12-30 | 2010-12-01 | Method for reading out high dynamic range image frame in image sensor and device using the same |
| EP10840469.0A EP2520080B1 (en) | 2009-12-30 | 2010-12-01 | Method for reading out high dynamic range image frame in image sensor and device using the same |
| KR1020127020133A KR101386313B1 (en) | 2009-12-30 | 2010-12-01 | Method for reading out high dynamic range image frame in image sensor and device using the same |
| US12/972,923 US8836807B2 (en) | 2009-12-30 | 2010-12-20 | Method for reading out a high dynamic range image and device using the same |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010240370.4A CN102348069B (en) | 2010-07-27 | 2010-07-27 | Method for acquiring high dynamic image with fixed frame rate from image sensor and apparatus thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102348069A true CN102348069A (en) | 2012-02-08 |
| CN102348069B CN102348069B (en) | 2014-11-05 |
Family
ID=45546313
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010240370.4A Active CN102348069B (en) | 2009-12-30 | 2010-07-27 | Method for acquiring high dynamic image with fixed frame rate from image sensor and apparatus thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102348069B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111638756A (en) * | 2020-05-29 | 2020-09-08 | Oppo广东移动通信有限公司 | Control method, control device, electronic terminal, and computer-readable storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006105707A (en) * | 2004-10-04 | 2006-04-20 | Yokogawa Electric Corp | Pressure detector and diagnostic method of clogging in pressure detector |
| CN101047786A (en) * | 2006-03-27 | 2007-10-03 | 精工爱普生株式会社 | Image sensing apparatus, image sensing system, and image sensing method |
| CN101455074A (en) * | 2006-05-24 | 2009-06-10 | 汤姆森特许公司 | Circuit and method for reading out and resetting pixels of an image sensor |
| US20100007778A1 (en) * | 2008-07-08 | 2010-01-14 | Yong Lim | Dynamic range extending method and apparatus using subsampling |
| CN101957986A (en) * | 2010-10-11 | 2011-01-26 | 华中科技大学 | Method for realizing infrared image enhancement by controlling long and short integrals |
| TW201130303A (en) * | 2009-09-16 | 2011-09-01 | Altasens Inc | Image sensor with wide dynamic range |
-
2010
- 2010-07-27 CN CN201010240370.4A patent/CN102348069B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006105707A (en) * | 2004-10-04 | 2006-04-20 | Yokogawa Electric Corp | Pressure detector and diagnostic method of clogging in pressure detector |
| CN101047786A (en) * | 2006-03-27 | 2007-10-03 | 精工爱普生株式会社 | Image sensing apparatus, image sensing system, and image sensing method |
| CN101455074A (en) * | 2006-05-24 | 2009-06-10 | 汤姆森特许公司 | Circuit and method for reading out and resetting pixels of an image sensor |
| US20100007778A1 (en) * | 2008-07-08 | 2010-01-14 | Yong Lim | Dynamic range extending method and apparatus using subsampling |
| TW201130303A (en) * | 2009-09-16 | 2011-09-01 | Altasens Inc | Image sensor with wide dynamic range |
| CN101957986A (en) * | 2010-10-11 | 2011-01-26 | 华中科技大学 | Method for realizing infrared image enhancement by controlling long and short integrals |
Non-Patent Citations (3)
| Title |
|---|
| 周建康: "积分时间可调的CCD相机驱动时序设计与实现", 《光学学报》 * |
| 王天盛: "高性能大动态范围CMOS图像传感器控制电路的设计", 《天津大学硕士学位论文》 * |
| 陈敏思: "高性能大动态范围CMOS图像传感器时序控制电路的设计", 《天津大学硕士学位论文》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111638756A (en) * | 2020-05-29 | 2020-09-08 | Oppo广东移动通信有限公司 | Control method, control device, electronic terminal, and computer-readable storage medium |
| CN111638756B (en) * | 2020-05-29 | 2022-03-22 | Oppo广东移动通信有限公司 | Control method, control device, electronic terminal, and computer-readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102348069B (en) | 2014-11-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8934037B2 (en) | Imaging device employing rolling shutter system | |
| CN101719995B (en) | Image Acquisition Method That Can Improve CCD Frame Frequency | |
| CN103404126A (en) | Image capture device, image capture method | |
| KR100873880B1 (en) | Image processing apparatus and image processing method | |
| CN102118585B (en) | Method and device for acquiring dynamic image with fixed frame rate in image sensor | |
| CN107786810A (en) | Image processing equipment, image processing method, picture pick-up device and storage medium | |
| CN201623774U (en) | Device for obtaining fixed-frame-rate high dynamic range image in image sensor | |
| CN102348069B (en) | Method for acquiring high dynamic image with fixed frame rate from image sensor and apparatus thereof | |
| KR20150015352A (en) | Solid-state imaging device | |
| KR20050039626A (en) | Pixel arranging apparatus, solid-state image sensing apparatus, and camera | |
| US8836807B2 (en) | Method for reading out a high dynamic range image and device using the same | |
| JP2004165912A (en) | Method and device for driving area imaging element | |
| JP6019295B2 (en) | Solid-state imaging device and camera system | |
| JP7357734B2 (en) | Imaging device and its control method | |
| JP6021556B2 (en) | Image processing device | |
| JP2002027332A (en) | Imaging device | |
| JP6557568B2 (en) | Imaging device | |
| JPH05167932A (en) | Solid state image pickup device | |
| JP2001057654A (en) | High sensitivity imaging device | |
| CN117579945A (en) | Imaging method, device, equipment and storage medium of image sensor | |
| JP3650075B2 (en) | Display device and network system | |
| CN119107227A (en) | Image resolution expansion method, system, medium and device based on FPGA | |
| JP3003760B2 (en) | Imaging device | |
| JP2708822B2 (en) | Imaging device | |
| JP2005011520A (en) | Image data storage device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20191129 Address after: 518119 1 Yanan Road, Kwai Chung street, Dapeng New District, Shenzhen, Guangdong Patentee after: SHENZHEN BYD MICROELECTRONICS Co.,Ltd. Address before: BYD 518118 Shenzhen Road, Guangdong province Pingshan New District No. 3009 Patentee before: BYD Co.,Ltd. |
|
| TR01 | Transfer of patent right | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 518119 No.1 Yan'an Road, Kuiyong street, Dapeng New District, Shenzhen City, Guangdong Province Patentee after: BYD Semiconductor Co.,Ltd. Address before: 518119 No.1 Yan'an Road, Kuiyong street, Dapeng New District, Shenzhen City, Guangdong Province Patentee before: BYD Semiconductor Co.,Ltd. |
|
| CP01 | Change in the name or title of a patent holder | ||
| CP03 | Change of name, title or address |
Address after: 518119 No.1 Yan'an Road, Kuiyong street, Dapeng New District, Shenzhen City, Guangdong Province Patentee after: BYD Semiconductor Co.,Ltd. Address before: 518119 No.1 Yan'an Road, Kwai Chung street, Dapeng New District, Shenzhen City, Guangdong Province Patentee before: SHENZHEN BYD MICROELECTRONICS Co.,Ltd. |
|
| CP03 | Change of name, title or address |